视觉大模型 / VLM - arXivDaily 专题

2411.15720 2024-11-26 cs.CV 79%

Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks

Peng Xie, Yequan Bie, Jianda Mao, Yangqiu Song, Yang Wang, Hao Chen, Kani Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2411.15268 2024-11-26 cs.CV cs.CL 79%

ICT: Image-Object Cross-Level Trusted Intervention for Mitigating Object Hallucination in Large Vision-Language Models

Junzhe Chen, Tianshu Zhang, Shiyu Huang, Yuwei Niu, Linfeng Zhang, Lijie Wen, Xuming Hu

专题命中幻觉与鲁棒性：vision-language model(title)；vision language model(abstract)；分类 cs.CV

2404.03027 2024-11-26 cs.CR cs.AI cs.CL 79%

JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks

Weidi Luo, Siyuan Ma, Xiaogeng Liu, Xiaoyu Guo, Chaowei Xiao

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.AI

2411.13136 2024-11-21 cs.CV 79%

TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models

Xin Wang, Kai Chen, Jiaming Zhang, Jingjing Chen, Xingjun Ma

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2408.05767 2024-11-20 cs.CL cs.AI 79%

Reference-free Hallucination Detection for Large Vision-Language Models

Qing Li, Jiahui Geng, Chenyang Lyu, Derui Zhu, Maxim Panov, Fakhri Karray

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.AI

2410.07571 2024-11-18 cs.CL cs.CV 79%

How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?

Seongyun Lee, Geewook Kim, Jiyeon Kim, Hyunji Lee, Hoyeon Chang, Sue Hyun Park, Minjoon Seo

专题命中幻觉与鲁棒性：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments Work in Progress

2404.19287 2024-11-13 cs.CV 79%

Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspective

Wanqi Zhou, Shuanghao Bai, Danilo P. Mandic, Qibin Zhao, Badong Chen

专题命中幻觉与鲁棒性：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments 17 pages, 13 figures

2406.10839 2024-11-13 cs.CV cs.CL 79%

Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags

Daiqing Qi, Handong Zhao, Zijun Wei, Sheng Li

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.CV

Comments Main Conference at EMNLP 2024

2411.06921 2024-11-12 cs.CV 79%

UMFC: Unsupervised Multi-Domain Feature Calibration for Vision-Language Models

Jiachen Liang, Ruibing Hou, Minyang Hu, Hong Chang, Shiguang Shan, Xilin Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments NeurIPS 2024

2402.15721 2024-11-11 cs.AI cs.CL 79%

Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models

Chaoya Jiang, Hongrui Jia, Wei Ye, Mengfan Dong, Haiyang Xu, Ming Yan, Ji Zhang, Shikun Zhang

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.AI

Comments Accepted by ACM MM 2024

2411.02733 2024-11-06 cs.CV 79%

DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark

Haodong Li, Haicheng Qu, Xiaofeng Zhang

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.CV

2410.22187 2024-10-30 cs.CV 79%

Active Learning for Vision-Language Models

Bardia Safaei, Vishal M. Patel

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted in WACV 2025

2410.15359 2024-10-22 cs.AI 79%

A Survey of Hallucination in Large Visual Language Models

Wei Lan, Wenyi Chen, Qingfeng Chen, Shirui Pan, Huiyu Zhou, Yi Pan

专题命中幻觉与鲁棒性：visual language model(title,abstract)；分类 cs.AI

2407.08374 2024-10-17 cs.CV 79%

Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Self-Regularization

Jinlong Li, Dong Zhao, Zequn Jie, Elisa Ricci, Lin Ma, Nicu Sebe

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2410.08895 2024-10-14 cs.CV 79%

Calibrated Cache Model for Few-Shot Vision-Language Model Adaptation

Kun Ding, Qiang Yu, Haojian Zhang, Gaofeng Meng, Shiming Xiang

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments submitted to IJCV

2404.13874 2024-10-07 cs.CL cs.CV 79%

VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models

Haoyi Qiu, Wenbo Hu, Zi-Yi Dou, Nanyun Peng

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments ACL 2024 Findings

2403.10492 2024-10-07 cs.CV 79%

Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning

Dongmin Park, Zhaofang Qian, Guangxing Han, Ser-Nam Lim

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.CV

2402.09801 2024-09-24 cs.CL cs.CV 79%

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

Shangyu Xing, Fei Zhao, Zhen Wu, Tuo An, Weihao Chen, Chunhui Li, Jianbing Zhang, Xinyu Dai

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.CV

2409.14083 2024-09-24 cs.CV 79%

SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information

Jiashuo Sun, Jihai Zhang, Yucheng Zhou, Zhaochen Su, Xiaoye Qu, Yu Cheng

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments 19 pages, 9 tables, 11 figures

2403.08542 2024-09-04 cs.CV 79%

AIGCs Confuse AI Too: Investigating and Explaining Synthetic Image-induced Hallucinations in Large Vision-Language Models

Yifei Gao, Jiaqi Wang, Zhiyu Lin, Jitao Sang

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2409.00301 2024-09-04 cs.CV 79%

ContextVLM: Zero-Shot and Few-Shot Context Understanding for Autonomous Driving using Vision Language Models

Shounak Sural, Naren, Ragunathan Rajkumar

专题命中幻觉与鲁棒性：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments Accepted at the 27th IEEE International Conference on Intelligent Transportation Systems (ITSC) 2024

2407.07403 2024-07-15 cs.CV 79%

A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends

Daizong Liu, Mingyu Yang, Xiaoye Qu, Pan Zhou, Yu Cheng, Wei Hu

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2407.05342 2024-07-09 cs.CV 79%

Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models

Longxiang Tang, Zhuotao Tian, Kai Li, Chunming He, Hantao Zhou, Hengshuang Zhao, Xiu Li, Jiaya Jia

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments ECCV 2024

2403.14760 2024-07-04 cs.CV 79%

Can 3D Vision-Language Models Truly Understand Natural Language?

Weipeng Deng, Jihan Yang, Runyu Ding, Jiahui Liu, Yijiang Li, Xiaojuan Qi, Edith Ngai

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments https://github.com/VincentDENGP/3D-LR

2406.04031 2024-07-02 cs.CV cs.CR 79%

Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt

Zonghao Ying, Aishan Liu, Tianyuan Zhang, Zhengmin Yu, Siyuan Liang, Xianglong Liu, Dacheng Tao

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.CV

2311.17600 2024-06-21 cs.CV 79%

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

Xin Liu, Yichen Zhu, Jindong Gu, Yunshi Lan, Chao Yang, Yu Qiao

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.CV

2406.07594 2024-06-18 cs.CL cs.AI cs.CR 79%

MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models

Tianle Gu, Zeyang Zhou, Kexin Huang, Dandan Liang, Yixu Wang, Haiquan Zhao, Yuanqi Yao, Xingge Qiao, Keqing Wang, Yujiu Yang, Yan Teng, Yu Qiao, Yingchun Wang

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.AI

2406.09781 2024-06-17 cs.CV 79%

GPT-4o: Visual perception performance of multimodal large language models in piglet activity understanding

Yiqi Wu, Xiaodan Hu, Ziming Fu, Siling Zhou, Jiangong Li

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.CV

2403.03627 2024-04-29 cs.CL cs.AI 79%

Multimodal Large Language Models to Support Real-World Fact-Checking

Jiahui Geng, Yova Kementchedjhieva, Preslav Nakov, Iryna Gurevych

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.AI

2402.07329 2024-04-17 cs.CV 79%

The Bias of Harmful Label Associations in Vision-Language Models

Caner Hazirbas, Alicia Sun, Yonathan Efroni, Mark Ibrahim

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

1. 幻觉与鲁棒性 2246 篇

Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks

ICT: Image-Object Cross-Level Trusted Intervention for Mitigating Object Hallucination in Large Vision-Language Models

JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks

TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models

Reference-free Hallucination Detection for Large Vision-Language Models

How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?

Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspective

Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags

UMFC: Unsupervised Multi-Domain Feature Calibration for Vision-Language Models

Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models

DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark

Active Learning for Vision-Language Models

A Survey of Hallucination in Large Visual Language Models

Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Self-Regularization

Calibrated Cache Model for Few-Shot Vision-Language Model Adaptation

VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models

Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information

AIGCs Confuse AI Too: Investigating and Explaining Synthetic Image-induced Hallucinations in Large Vision-Language Models

ContextVLM: Zero-Shot and Few-Shot Context Understanding for Autonomous Driving using Vision Language Models

A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends

Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models

Can 3D Vision-Language Models Truly Understand Natural Language?

Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models

GPT-4o: Visual perception performance of multimodal large language models in piglet activity understanding

Multimodal Large Language Models to Support Real-World Fact-Checking

The Bias of Harmful Label Associations in Vision-Language Models