视觉大模型 / VLM

Alleviating Hallucinations in Large Vision-Language Models through Hallucination-Induced Optimization

Xinyu Lyu, Beitao Chen, Lianli Gao, Jingkuan Song, Heng Tao Shen

专题命中 幻觉与鲁棒性 ：vision-language model(title)；visual language model(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2024

Mitigating Cache Noise in Test-Time Adaptation for Large Vision-Language Models

Haotian Zhai, Xinyu Chen, Can Zhang, Tianming Sha, Ruirui Li

专题命中 幻觉与鲁棒性 ：vision-language model(title)；visual language model(abstract)；分类 cs.CV

Comments Accepted by ICME 2025 and ICLR 2025 Workshop on Foundation Models in the Wild

PAINT: Paying Attention to INformed Tokens to Mitigate Hallucination in Large Vision-Language Model

Kazi Hasan Ibn Arif, Sajib Acharjee Dip, Khizar Hussain, Lang Zhang, Chris Thomas

专题命中 幻觉与鲁棒性 ：vision-language model(title)；vision language model(abstract)；分类 cs.CV

Comments 6 pages, 4 tables, 3 figures

Debiasing Multimodal Large Language Models via Noise-Aware Preference Optimization

Zefeng Zhang, Hengzhu Tang, Jiawei Sheng, Zhenyu Zhang, Yiming Ren, Zhenyang Li, Dawei Yin, Duohe Ma, Tingwen Liu

专题命中 幻觉与鲁棒性 ：multimodal large language model(title,abstract)；分类 cs.CV

Comments CVPR 2025

Judge Anything: MLLM as a Judge Across Any Modality

Shu Pu, Yaochen Wang, Dongping Chen, Yuhang Chen, Guohao Wang, Qi Qin, Zhongyi Zhang, Zhiyuan Zhang, Zetong Zhou, Shuang Gong, Yi Gui, Yao Wan, Philip S. Yu

专题命中 幻觉与鲁棒性 ：MLLM(title,abstract)；分类 cs.CV

CeTAD: Towards Certified Toxicity-Aware Distance in Vision Language Models

Xiangyu Yin, Jiaxu Liu, Zhen Chen, Jinwei Hu, Yi Dong, Xiaowei Huang, Wenjie Ruan

专题命中 幻觉与鲁棒性 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Vision-Language Models Generate More Homogeneous Stories for Phenotypically Black Individuals

Messi H. J. Lee, Soyeon Jeon

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Survey of Adversarial Robustness in Multimodal Large Language Models

Chengze Jiang, Zhuangzhuang Wang, Minjing Dong, Jie Gui

专题命中 幻觉与鲁棒性 ：multimodal large language model(title,abstract)；分类 cs.CV

Comments 9 pages

Identifying and Mitigating Position Bias of Multi-image Vision-Language Models

Xinyu Tian, Shu Zou, Zhaoyuan Yang, Jing Zhang

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted to CVPR2025

Evolution-based Region Adversarial Prompt Learning for Robustness Enhancement in Vision-Language Models

Xiaojun Jia, Sensen Gao, Simeng Qin, Ke Ma, Xinfeng Li, Yihao Huang, Wei Dong, Yang Liu, Xiaochun Cao

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

O-TPT: Orthogonality Constraints for Calibrating Test-time Prompt Tuning in Vision-Language Models

Ashshak Sharifdeen, Muhammad Akhtar Munir, Sanoojan Baliah, Salman Khan, Muhammad Haris Khan

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2025

VaLiD: Mitigating the Hallucination of Large Vision Language Models by Visual Layer Fusion Contrastive Decoding

Jiaqi Wang, Yifei Gao, Jitao Sang

专题命中 幻觉与鲁棒性 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments 17 pages

Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts

Qizhou Chen, Chengyu Wang, Dakan Wang, Taolin Zhang, Wangyue Li, Xiaofeng He

专题命中 幻觉与鲁棒性 ：vision language model(title,abstract)；分类 cs.CV

Comments CVPR 2025 Accepted

Modeling Variants of Prompts for Vision-Language Models

Ao Li, Zongfang Liu, Xinhua Li, Jinghui Zhang, Pengwei Wang, Hu Wang

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments 10 pages

Debiased Prompt Tuning in Vision-Language Model without Annotations

Chaoquan Jiang, Yunfan Yang, Rui Hu, Jitao Sang

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

A Framework for Evaluating Vision-Language Model Safety: Building Trust in AI for Public Sector Applications

Maisha Binte Rashid, Pablo Rivas

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments AAAI 2025 Workshop on AI for Social Impact: Bridging Innovations in Finance, Social Media, and Crime Prevention

The Role of Background Information in Reducing Object Hallucination in Vision-Language Models: Insights from Cutoff API Prompting

Masayo Tomita, Katsuhiko Hayashi, Tomoyuki Kaneko

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments Under review

Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generation

Yun-Wei Chu, Kai Zhang, Christopher Malon, Martin Renqiang Min

专题命中 幻觉与鲁棒性 ：multimodal large language model(title,abstract)；分类 cs.AI

Comments GenAI4Health - AAAI '25

A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluations

Mang Ye, Xuankun Rong, Wenke Huang, Bo Du, Nenghai Yu, Dacheng Tao

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments 22 pages, 2 figures

On Fairness of Unified Multimodal Large Language Model for Image Generation

Ming Liu, Hao Chen, Jindong Wang, Liwen Wang, Bhiksha Raj Ramakrishnan, Wensheng Zhang

专题命中 幻觉与鲁棒性 ：multimodal large language model(title,abstract)；分类 cs.AI

LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models

Zhenyue Qin, Yu Yin, Dylan Campbell, Xuansheng Wu, Ke Zou, Yih-Chung Tham, Ninghao Liu, Xiuzhen Zhang, Qingyu Chen

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments 2025 NAACL: Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics Project Page: https://kfzyqin.github.io/lmod/

Mitigating Hallucinations in Large Vision-Language Models with Internal Fact-based Contrastive Decoding

Chao Wang, Xuancheng Zhou, Weiwei Fu, Yang Zhou

专题命中 幻觉与鲁棒性 ：vision-language model(title)；visual language model(abstract)；分类 cs.CV

The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models?

Ching-Chia Kao, Chia-Mu Yu, Chun-Shien Lu, Chu-Song Chen

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.LG

Generalizable Prompt Tuning for Vision-Language Models

Qian Zhang

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments in progress

FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts

Yichen Gong, Delong Ran, Jinyuan Liu, Conglei Wang, Tianshuo Cong, Anyu Wang, Sisi Duan, Xiaoyun Wang

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.AI

Comments AAAI 2025 (Oral)

Realistic Test-Time Adaptation of Vision-Language Models

Maxime Zanella, Clément Fuchs, Christophe De Vleeschouwer, Ismail Ben Ayed

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

VORD: Visual Ordinal Calibration for Mitigating Object Hallucinations in Large Vision-Language Models

Dexter Neo, Tsuhan Chen

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shift

Siyuan Liang, Jiawei Liang, Tianyu Pang, Chao Du, Aishan Liu, Mingli Zhu, Xiaochun Cao, Dacheng Tao

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments 11 pages, 9 figures

Retaining and Enhancing Pre-trained Knowledge in Vision-Language Models with Prompt Ensembling

Donggeun Kim, Yujin Jo, Myungjoo Lee, Taesup Kim

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

Comments IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025

VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation

Ruiyang Zhang, Hu Zhang, Zhedong Zheng

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV