图像生成

Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation

Qin Guo, Tianwei Lin

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments 14 pages, 9 figures

SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models

Yuzhou Huang, Liangbin Xie, Xintao Wang, Ziyang Yuan, Xiaodong Cun, Yixiao Ge, Jiantao Zhou, Chao Dong, Rui Huang, Ruimao Zhang, Ying Shan

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments Project page: https://yuzhou914.github.io/SmartEdit/

BARET : Balanced Attention based Real image Editing driven by Target-text Inversion

Yuming Qiao, Fanyi Wang, Jingwen Su, Yanhao Zhang, Yunjie Yu, Siyu Wu, Guo-Jun Qi

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments Accepted by AAAI2024

Emu Edit: Precise Image Editing via Recognition and Generation Tasks

Shelly Sheynin, Adam Polyak, Uriel Singer, Yuval Kirstain, Amit Zohar, Oron Ashual, Devi Parikh, Yaniv Taigman

专题命中 图像编辑 ：image editing(title,abstract)；inpainting(abstract)；分类 cs.CV

DialogPaint: A Dialog-based Image Editing Model

Jingxuan Wei, Shiyu Wu, Xin Jiang, Yequan Wang

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments 10 pages, 8 figures

FEC: Three Finetuning-free Methods to Enhance Consistency for Real Image Editing

Songyan Chen, Jiancheng Huang

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Complex Scene Image Editing by Scene Graph Comprehension

Zhongping Zhang, Huiwen He, Bryan A. Plummer, Zhenyu Liao, Huayan Wang

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments Accepted to BMVC 2023

DreamEdit: Subject-driven Image Editing

Tianle Li, Max Ku, Cong Wei, Wenhu Chen

专题命中 图像编辑 ：image editing(title,abstract)；image generation(abstract)；分类 cs.CV

DIFF-NST: Diffusion Interleaving For deFormable Neural Style Transfer

Dan Ruta, Gemma Canet Tarrés, Andrew Gilbert, Eli Shechtman, Nicholas Kolkin, John Collomosse

专题命中 图像编辑 ：diffusion(title,abstract)；image generation(abstract)；分类 cs.CV

Improving Tuning-Free Real Image Editing with Proximal Guidance

Ligong Han, Song Wen, Qi Chen, Zhixing Zhang, Kunpeng Song, Mengwei Ren, Ruijiang Gao, Anastasis Stathopoulos, Xiaoxiao He, Yuxiao Chen, Di Liu, Qilong Zhangli, Jindong Jiang, Zhaoyang Xia, Akash Srivastava, Dimitris Metaxas

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments Added inversion guidance, and fixed typos

LEDITS: Real Image Editing with DDPM Inversion and Semantic Guidance

Linoy Tsaban, Apolinário Passos

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Comments 8 pages, 5 figures, 1 table. This report builds up on the works introduced in - arXiv:2304.06140, arXiv:2301.12247

User-friendly Image Editing with Minimal Text Input: Leveraging Captioning and Injection Techniques

Sunwoo Kim, Wooseok Jang, Hyunsu Kim, Junho Kim, Yunjey Choi, Seungryong Kim, Gayeong Lee

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

iEdit: Localised Text-guided Image Editing with Weak Supervision

Rumeysa Bodur, Erhan Gundogdu, Binod Bhattarai, Tae-Kyun Kim, Michael Donoser, Loris Bazzani

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)；分类 cs.CV

Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation

Zeyu Lu, Chengyue Wu, Xinyuan Chen, Yaohui Wang, Lei Bai, Yu Qiao, Xihui Liu

专题命中 图像编辑 ：diffusion(title,abstract)；image synthesis(abstract)；分类 cs.CV

NoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs

Harsh Rangwani, Lavish Bansal, Kartik Sharma, Tejan Karmali, Varun Jampani, R. Venkatesh Babu

专题命中 图像编辑 ：image generation(title,abstract)；image editing(abstract)；分类 cs.CV

Comments CVPR 2023. Project Page: https://rangwani-harsh.github.io/NoisyTwins/

Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Models

Nikita Starodubcev, Dmitry Baranchuk, Valentin Khrulkov, Artem Babenko

专题命中 图像编辑 ：diffusion(title,abstract)；image editing(abstract)；分类 cs.CV

Bridging CLIP and StyleGAN through Latent Alignment for Image Editing

Wanfeng Zheng, Qiang Li, Xiaoyan Guo, Pengfei Wan, Zhongyuan Wang

专题命中 图像编辑 ：image editing(title)；image generation(abstract)；text-to-image(abstract)；分类 cs.CV

Comments 20 pages, 23 figures

GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation

Xingzhe He, Bastian Wandt, Helge Rhodin

专题命中 图像编辑 ：image generation(title,abstract)；image editing(abstract)；分类 cs.CV

Comments CVPR 2022

DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation

Gwanghyun Kim, Taesung Kwon, Jong Chul Ye

专题命中 图像编辑 ：diffusion(title,abstract)；image generation(abstract)；分类 cs.CV

Comments Accepted to CVPR 2022

EdiBERT, a generative model for image editing

Thibaut Issenhuth, Ugo Tanielian, Jérémie Mary, David Picard

专题命中 图像编辑 ：image editing(title,abstract)；inpainting(abstract)；分类 cs.CV

Hierarchical Text-Conditional Image Generation with CLIP Latents

Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, Mark Chen

专题命中 图像编辑 ：image generation(title,abstract)；diffusion(abstract)；分类 cs.CV

Flexible Portrait Image Editing with Fine-Grained Control

Linlin Liu, Qian Fu, Fei Hou, Ying He

专题命中 图像编辑 ：image editing(title,abstract)；image generation(abstract)；分类 cs.CV

Attribute Group Editing for Reliable Few-shot Image Generation

Guanqi Ding, Xinzhe Han, Shuhui Wang, Shuzhe Wu, Xin Jin, Dandan Tu, Qingming Huang

专题命中 图像编辑 ：image generation(title,abstract)；image editing(abstract)；分类 cs.CV

Comments CVPR2022

Modeling Artistic Workflows for Image Generation and Editing

Hung-Yu Tseng, Matthew Fisher, Jingwan Lu, Yijun Li, Vladimir Kim, Ming-Hsuan Yang

专题命中 图像编辑 ：image generation(title,abstract)；image editing(abstract)；分类 cs.CV

Comments ECCV 2020. Code: https://github.com/hytseng0509/ArtEditing

JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation

JoyAI-Image: 激活统一多模态理解和生成中的空间智能

Lin Song, Wenbo Li, Guoqing Ma, Wei Tang, Bo Wang, Yuan Zhang, Yijun Yang, Yicheng Xiao, Jianhui Liu, Yanbing Zhang, Guohui Zhang, Wenhu Zhang, Hang Xu, Nan Jiang, Xin Han, Haoze Sun, Maoquan Zhang, Haoyang Huang, Nan Duan

机构 * Joy Future Academy, JD（京东探索研究院） 纠错

专题命中 图像编辑 ：image generation(abstract)；text-to-image(abstract)；diffusion(abstract)；image editing(abstract)

AI总结 本文提出JoyAI-Image，一种统一的多模态基础模型，用于视觉理解、文本到图像生成和指令引导的图像编辑。该模型结合了空间增强的多模态大语言模型（MLLM）和多模态扩散Transformer（MMDiT），通过共享的多模态接口实现感知与生成的交互。构建可扩展的训练配方，结合统一指令微调、长文本渲染监督、空间 grounded 数据和通用及空间编辑信号，使模型具备广泛的多模态能力，同时增强几何感知推理和可控视觉合成。实验表明，JoyAI-Image在理解、生成、长文本渲染和编辑基准上达到最先进的性能。更重要的是，增强的理解、可控的空间编辑和新视角辅助推理之间的双向循环使模型超越一般视觉能力，向更强的空间智能发展。

Comments Code: https://github.com/jd-opensource/JoyAI-Image

DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing

DARS：用于基于指令的图像编辑的带结构化推理的双层级信用分配强化学习

Haoxiang Cao, Jiajiong Cao, Xuanpu Zhang, Changqian Yu, Chaoqun Wang

机构 * South China Normal University（华南师范大学） ； KlingAI Research（可灵AI研究院） 纠错

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)

AI总结 提出DARS框架，解决基于指令的图像编辑系统仅用最终奖励训练效率低的问题，通过双层级信用分配实现更好性能，在推理密集型编辑上增益显著。

TrojanEdit: Multimodal Backdoor Attack Against Image Editing Model

Ji Guo, Peihong Chen, Wenbo Jiang, Xiaolei Wen, Jiaming He, Jiachen Li, Guoming Lu, Aiguo Chen, Hongwei Li

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)

InstGenIE: Generative Image Editing Made Efficient with Mask-aware Caching and Scheduling

Xiaoxiao Jiang, Suyi Li, Lingyun Yang, Tianyu Feng, Zhipeng Di, Weiyi Lu, Guoxuan Zhu, Xiu Lin, Kan Liu, Yinghao Yu, Tao Lan, Guodong Yang, Lin Qu, Liping Zhang, Wei Wang

机构 * Hong Kong University of Science and Technology（香港科学与技术大学） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)

Routing to the Right Expertise: A Trustworthy Judge for Instruction-based Image Editing

Chenxi Sun, Hongzhi Zhang, Qi Wang, Fuzheng Zhang

专题命中 图像编辑 ：image editing(title,abstract)；diffusion(abstract)

Robust-Wide: Robust Watermarking against Instruction-driven Image Editing

Runyi Hu, Jie Zhang, Ting Xu, Jiwei Li, Tianwei Zhang

专题命中 图像编辑 ：image editing(title,abstract)；inpainting(abstract)

Comments European Conference on Computer Vision (ECCV) 2024