MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMs
MVI-Bench:评估大型视觉语言模型对误导性视觉输入鲁棒性的综合基准
机构 * Department of Computer Science, University of Illinois Chicago, Chicago, USA ; School of Computer Science \& Engineering, Southeast University, Nanjing, China ; Guohao School, Tongji University, Shanghai, China
专题命中 评测与基准 :language model(abstract)
AI总结 针对现有鲁棒性基准忽视误导性视觉输入的问题,提出MVI-Bench基准,基于视觉基元的三级层次(视觉概念、视觉属性、视觉关系)构建6个类别1248个VQA实例,并引入MVI-Sensitivity指标进行细粒度评估,揭示18个LVLM的显著脆弱性。
Comments 18 pages, 9 figures