视觉大模型 / VLM - arXivDaily 专题

2505.01958 2025-05-06 cs.CV cs.CL 83%

A Comprehensive Analysis for Visual Object Hallucination in Large Vision-Language Models

Liqiang Jing, Guiming Hardy Chen, Ehsan Aghazadeh, Xin Eric Wang, Xinya Du

机构 * University of Texas at Dallas（德克萨斯大学达拉斯分校）； University of Massachusetts at Amherst（马萨诸塞大学阿姆赫斯特分校）； University of California, Santa Cruz（加州大学圣克鲁兹分校）

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2405.20152 2025-05-01 cs.CV 83%

Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals

Phillip Howard, Kathleen C. Fraser, Anahita Bhiwandiwalla, Svetlana Kiritchenko

机构 * Intel Labs（英特尔实验室）； National Research Council Canada（加拿大国家研究理事会）

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments Accepted to NAACL 2025 main track (oral)

2504.16134 2025-04-24 cs.CV cs.CL 83%

Multimodal Large Language Models for Enhanced Traffic Safety: A Comprehensive Review and Future Trends

Mohammad Abu Tami, Mohammed Elhenawy, Huthaifa I. Ashqar

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

2504.09083 2025-04-15 cs.CV 83%

Using Vision Language Models for Safety Hazard Identification in Construction

Muhammad Adil, Gaang Lee, Vicente A. Gonzalez, Qipei Mei

专题命中幻觉与鲁棒性：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV

2504.08205 2025-04-14 cs.CV cs.CR 83%

EO-VLM: VLM-Guided Energy Overload Attacks on Vision Models

Minjae Seo, Myoungsung You, Junhee Lee, Jaehan Kim, Hwanjo Heo, Jintae Oh, Jinwoo Kim

专题命中幻觉与鲁棒性：VLM(title,abstract)；vision language model(abstract)；分类 cs.CV

Comments Presented as a poster at ACSAC 2024

2504.08154 2025-04-14 cs.CV 83%

Investigating Vision-Language Model for Point Cloud-based Vehicle Classification

Yiqiao Li, Jie Wei, Camille Kamga

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments 5 pages,3 figures, 1 table, CVPR DriveX workshop

2410.13146 2025-04-01 cs.CL cs.CV 83%

debiaSAE: Benchmarking and Mitigating Vision-Language Model Bias

Kuleen Sasse, Shan Chen, Jackson Pond, Danielle Bitterman, John Osborne

专题命中幻觉与鲁棒性：vision-language model(title)；vision language model(abstract)；LLaVA(abstract)；分类 cs.CV

Comments Under Review at COLM 2025

2503.16566 2025-03-24 cs.CV 83%

REVAL: A Comprehension Evaluation on Reliability and Values of Large Vision-Language Models

Jie Zhang, Zheng Yuan, Zhongqi Wang, Bei Yan, Sibo Wang, Xiangkui Cao, Zonghui Guo, Shiguang Shan, Xilin Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments 45 pages, 5 figures, 18 tables

2503.15202 2025-03-24 cs.RO cs.AI 83%

A Unified Framework for Real-Time Failure Handling in Robotics Using Vision-Language Models, Reactive Planner and Behavior Trees

Faseeh Ahmad, Hashim Ismail, Jonathan Styrud, Maj Stenmark, Volker Krueger

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；VLM(abstract)；分类 cs.AI

2503.06903 2025-03-24 cs.CV 83%

When Lighting Deceives: Exposing Vision-Language Models' Illumination Vulnerability Through Illumination Transformation Attack

Hanqing Liu, Shouwei Ruan, Yao Huang, Shiji Zhao, Xingxing Wei

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2503.11750 2025-03-18 cs.CV cs.CR 83%

Making Every Step Effective: Jailbreaking Large Vision-Language Models Through Hierarchical KV Equalization

Shuyang Hao, Yiwei Wang, Bryan Hooi, Jun Liu, Muhao Chen, Zi Huang, Yujun Cai

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2412.03002 2025-03-11 cs.CV 83%

AdvDreamer Unveils: Are Vision-Language Models Truly Ready for Real-World 3D Variations?

Shouwei Ruan, Hanqing Liu, Yao Huang, Xiaoqi Wang, Caixin Kang, Hang Su, Yinpeng Dong, Xingxing Wei

专题命中幻觉与鲁棒性：vision-language model(title)；vision language model(abstract)；VLM(abstract)；分类 cs.CV

2410.00982 2025-03-11 cs.CV 83%

ScVLM: Enhancing Vision-Language Model for Safety-Critical Event Understanding

Liang Shi, Boyu Jiang, Tong Zeng, Feng Guo

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments To appear in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025

Journal ref Proceedings of the Winter Conference on Applications of Computer Vision (WACV) Workshops, 2025, pp. 1061-1071

2503.05093 2025-03-10 cs.CV 83%

Visual Cues of Gender and Race are Associated with Stereotyping in Vision-Language Models

Messi H. J. Lee, Soyeon Jeon, Jacob M. Montgomery, Calvin K. Lai

专题命中幻觉与鲁棒性：vision-language model(title)；vision language model(abstract)；VLM(abstract)；分类 cs.CV

2402.10340 2025-03-10 cs.RO cs.AI 83%

On the Vulnerability of LLM/VLM-Controlled Robotics

Xiyang Wu, Souradip Chakraborty, Ruiqi Xian, Jing Liang, Tianrui Guan, Fuxiao Liu, Brian M. Sadler, Dinesh Manocha, Amrit Singh Bedi

专题命中幻觉与鲁棒性：VLM(title,abstract)；vision-language model(abstract)；分类 cs.AI

2502.16911 2025-02-25 cs.CV 83%

SPARC: Score Prompting and Adaptive Fusion for Zero-Shot Multi-Label Recognition in Vision-Language Models

Kevin Miller, Samarth Mishra, Aditya Gangrade, Kate Saenko, Venkatesh Saligrama

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

2501.06132 2025-01-13 cs.RO cs.AI cs.MA 83%

CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systems

Haichao Liu, Ruoyu Yao, Wenru Liu, Zhenmin Huang, Shaojie Shen, Jun Ma

专题命中幻觉与鲁棒性：VLM(title,abstract)；vision-language model(abstract)；分类 cs.AI

2412.02886 2024-12-17 cs.CV 83%

Patchfinder: Leveraging Visual Language Models for Accurate Information Retrieval using Model Uncertainty

Roman Colman, Minh Vu, Manish Bhattarai, Martin Ma, Hari Viswanathan, Daniel O'Malley, Javier E. Santos

专题命中幻觉与鲁棒性：visual language model(title)；vision language model(abstract)；VLM(abstract)；分类 cs.CV

Comments This paper has been accepted to IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025

2412.07518 2024-12-11 cs.CV 83%

Hallucination Elimination and Semantic Enhancement Framework for Vision-Language Models in Traffic Scenarios

Jiaqi Fan, Jianhua Wu, Hongqing Chu, Quanbo Ge, Bingzhao Gao

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；InternVL(abstract)；分类 cs.CV

2411.18000 2024-12-02 cs.CV 83%

Exploring Visual Vulnerabilities via Multi-Loss Adversarial Search for Jailbreaking Vision-Language Models

Shuyang Hao, Bryan Hooi, Jun Liu, Kai-Wei Chang, Zi Huang, Yujun Cai

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2410.22888 2024-10-31 cs.CV cs.CL cs.CR 83%

Effective and Efficient Adversarial Detection for Vision-Language Models via A Single Vector

Youcheng Huang, Fengbin Zhu, Jingkun Tang, Pan Zhou, Wenqiang Lei, Jiancheng Lv, Tat-Seng Chua

专题命中幻觉与鲁棒性：vision-language model(title)；visual language model(abstract)；LLaVA(abstract)；分类 cs.CV

2311.16511 2024-10-29 cs.CV 83%

GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation

Zhanyu Wang, Longyue Wang, Zhen Zhao, Minghao Wu, Chenyang Lyu, Huayang Li, Deng Cai, Luping Zhou, Shuming Shi, Zhaopeng Tu

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

Comments ACM MM 2024, Oral

2410.09962 2024-10-16 cs.CV 83%

LongHalQA: Long-Context Hallucination Evaluation for MultiModal Large Language Models

Han Qiu, Jiaxing Huang, Peng Gao, Qin Qi, Xiaoqin Zhang, Ling Shao, Shijian Lu

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

2406.10900 2024-10-10 cs.CV cs.CL 83%

AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models

Xiyang Wu, Tianrui Guan, Dianqi Li, Shuaiyi Huang, Xiaoyu Liu, Xijun Wang, Ruiqi Xian, Abhinav Shrivastava, Furong Huang, Jordan Lee Boyd-Graber, Tianyi Zhou, Dinesh Manocha

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2408.16769 2024-08-30 cs.CV cs.CR 83%

PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning

Noor Hussein, Fahad Shamshad, Muzammal Naseer, Karthik Nandakumar

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted to MICCAI 2024

2408.01003 2024-08-05 cs.AI 83%

Piculet: Specialized Models-Guided Hallucination Decrease for MultiModal Large Language Models

Kohou Wang, Xiang Liu, Zhaoxiang Liu, Kai Wang, Shiguo Lian

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.AI

Comments 14 pages, 5 figures

2407.13442 2024-07-19 cs.CV cs.CL 83%

BEAF: Observing BEfore-AFter Changes to Evaluate Hallucination in Vision-language Models

Moon Ye-Bin, Nam Hyeon-Woo, Wonseok Choi, Tae-Hyun Oh

专题命中幻觉与鲁棒性：vision-language model(title)；vision language model(abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted at ECCV 2024. [Project Pages] https://beafbench.github.io/

2407.08811 2024-07-15 eess.IV cs.CV 83%

CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting

Naman Sharma

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；grounding(abstract)；分类 cs.CV

Comments Supervised by Professor Ben Glocker

2402.00357 2024-06-21 cs.CV 83%

Safety of Multimodal Large Language Models on Images and Texts

Xin Liu, Yichen Zhu, Yunshi Lan, Chao Yang, Yu Qiao

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted at IJCAI2024

2402.13636 2024-06-18 cs.CV cs.CL cs.CY 83%

A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Models

Ashutosh Sathe, Prachi Jain, Sunayana Sitaram

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

1. 幻觉与鲁棒性 2242 篇

A Comprehensive Analysis for Visual Object Hallucination in Large Vision-Language Models

Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals

Multimodal Large Language Models for Enhanced Traffic Safety: A Comprehensive Review and Future Trends

Using Vision Language Models for Safety Hazard Identification in Construction

EO-VLM: VLM-Guided Energy Overload Attacks on Vision Models

Investigating Vision-Language Model for Point Cloud-based Vehicle Classification

debiaSAE: Benchmarking and Mitigating Vision-Language Model Bias

REVAL: A Comprehension Evaluation on Reliability and Values of Large Vision-Language Models

A Unified Framework for Real-Time Failure Handling in Robotics Using Vision-Language Models, Reactive Planner and Behavior Trees

When Lighting Deceives: Exposing Vision-Language Models' Illumination Vulnerability Through Illumination Transformation Attack

Making Every Step Effective: Jailbreaking Large Vision-Language Models Through Hierarchical KV Equalization

AdvDreamer Unveils: Are Vision-Language Models Truly Ready for Real-World 3D Variations?

ScVLM: Enhancing Vision-Language Model for Safety-Critical Event Understanding

Visual Cues of Gender and Race are Associated with Stereotyping in Vision-Language Models

On the Vulnerability of LLM/VLM-Controlled Robotics

SPARC: Score Prompting and Adaptive Fusion for Zero-Shot Multi-Label Recognition in Vision-Language Models

CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systems

Patchfinder: Leveraging Visual Language Models for Accurate Information Retrieval using Model Uncertainty

Hallucination Elimination and Semantic Enhancement Framework for Vision-Language Models in Traffic Scenarios

Exploring Visual Vulnerabilities via Multi-Loss Adversarial Search for Jailbreaking Vision-Language Models

Effective and Efficient Adversarial Detection for Vision-Language Models via A Single Vector

GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation

LongHalQA: Long-Context Hallucination Evaluation for MultiModal Large Language Models

AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models

PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning

Piculet: Specialized Models-Guided Hallucination Decrease for MultiModal Large Language Models

BEAF: Observing BEfore-AFter Changes to Evaluate Hallucination in Vision-language Models

CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting

Safety of Multimodal Large Language Models on Images and Texts

A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Models