视觉大模型 / VLM

FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain

Suifeng Zhao, Zhuoran Jin, Sujian Li, Jun Gao

机构 * Key Laboratory of High Confidence Software Technologies, CS, Peking University, China（北京大学高可信软件技术重点实验室） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； State Key Laboratory of Multimedia Information Processing, School of Computer Sciences, Peking University（北京大学多媒体信息处理国家重点实验室） 纠错

专题命中 视觉问答 ：multimodal large language model(abstract)

Context-Adaptive Synthesis and Compression for Enhanced Retrieval-Augmented Generation in Complex Domains

Peiran Zhou, Junnan Zhu, Yichen Shen, Ruoxi Yu

机构 * Kunming Medical University（昆明医科大学） 纠错

专题命中 视觉问答 ：grounding(abstract)

Extracting Information from Scientific Literature via Visual Table Question Answering Models

Dongyoun Kim, Hyung-do Choi, Youngsun Jang, John Kim

专题命中 视觉问答 ：visual question answering(abstract)

Comments Accepted at ACM International Conference on Research in Adaptive and Convergent Systems, November 5-8, 2024, Pompei, Italy

Journal ref Proceedings of the ACM International Conference on Research in Adaptive and Convergent Systems (RACS 24), November 5-8, 2024, Pompei, Italy. ACM

DashboardQA: Benchmarking Multimodal Agents for Question Answering on Interactive Dashboards

Aaryaman Kartha, Ahmed Masry, Mohammed Saidul Islam, Thinh Lang, Shadikur Rahman, Ridwan Mahbub, Mizanur Rahman, Mahir Ahmed, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty

机构 * York University（约克大学） ； RBC ； Qatar Computing Research Institute (QCRI)（卡塔尔计算研究所） ； Nanyang Technological University（南洋理工大学） ； Salesforce Research（Salesforce研究） 纠错

专题命中 视觉问答 ：grounding(abstract)

Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference

Zhuo Chen, Xinyu Wang, Yong Jiang, Zhen Zhang, Xinyu Geng, Pengjun Xie, Fei Huang, Kewei Tu

机构 * School of Information Science and Technology, ShanghaiTech University（信息科学与技术学院，上海科技大学） ； Shanghai Engineering Research Center of Intelligent Vision and Imaging（智能视觉与成像上海工程研究中心） ； Institute for Intelligent Computing, Alibaba Group（智能计算研究院，阿里巴巴集团） 纠错

专题命中 视觉问答 ：visual question answering(abstract)

Comments EMNLP2025 Main Conference

XLQA: A Benchmark for Locale-Aware Multilingual Open-Domain Question Answering

Keon-Woo Roh, Yeong-Joon Ju, Seong-Whan Lee

机构 * Department of Artificial Intelligence, Korea University（人工智能系，韩国大学） 纠错

专题命中 视觉问答 ：grounding(abstract)

Comments Accepted to EMNLP 2025 main conference. 12 pages, 4 figures, 7 tables. Code is available at https://github.com/ro-ko/XLQA

On the Comprehensibility of Multi-structured Financial Documents using LLMs and Pre-processing Tools

Shivani Upadhyay, Messiah Ataey, Syed Shariyar Murtaza, Yifan Nie, Jimmy Lin

专题命中 视觉问答 ：MLLM(abstract)

Comments 15 pages, 5 figures, 9 tables

S2M3: Split-and-Share Multi-Modal Models for Distributed Multi-Task Inference on the Edge

JinYi Yoon, JiHo Lee, Ting He, Nakjung Choi, Bo Ji

专题命中 视觉问答 ：visual question answering(abstract)

Comments Accepted at IEEE International Conference on Distributed Computing Systems (ICDCS 2025)

MuSciClaims: Multimodal Scientific Claim Verification

Yash Kumar Lal, Manikanta Bandham, Mohammad Saqib Hasan, Apoorva Kashi, Mahnaz Koupaee, Niranjan Balasubramanian

机构 * Stony Brook University（石溪大学） 纠错

专题命中 视觉问答 ：vision-language model(abstract)

Solution for Meta KDD Cup'25: A Comprehensive Three-Step Framework for Vision Question Answering

Zijian Zhang, Xiaocheng Zhang, Yang Zhou, Zhimin Lin, Peng Yan

专题命中 视觉问答 ：visual question answering(abstract)

Enhancing Food-Domain Question Answering with a Multimodal Knowledge Graph: Hybrid QA Generation and Diversity Analysis

Srihari K B, Pushpak Bhattacharyya

专题命中 视觉问答 ：LLaVA(abstract)

Chart Question Answering from Real-World Analytical Narratives

Maeve Hutchinson, Radu Jianu, Aidan Slingsby, Jo Wood, Pranava Madhyastha

专题命中 视觉问答 ：multimodal large language model(abstract)

Comments This paper has been accepted to the ACL Student Research Workshop (SRW) 2025

Question Decomposition for Retrieval-Augmented Generation

Paul J. L. Ammann, Jonas Golde, Alan Akbik

机构 * Humboldt-Universität zu Berlin（柏林洪堡大学） 纠错

专题命中 视觉问答 ：grounding(abstract)

Comments Accepted to ACL SRW 2025. 9 Pages, 2 Figures, 4 Tables

Semantic-enhanced Modality-asymmetric Retrieval for Online E-commerce Search

Zhigong Zhou, Ning Ding, Xiaochuan Fan, Yue Shang, Yiming Qiu, Jingwei Zhuo, Zhiwei Ge, Songlin Wang, Lin Liu, Sulong Xu, Han Zhang

专题命中 视觉问答 ：visual question answering(abstract)

Comments published in sigir2023

MM-AttacKG: A Multimodal Approach to Attack Graph Construction with Large Language Models

Yongheng Zhang, Xinyun Zhao, Yunshan Ma, Haokai Ma, Yingxiao Guan, Guozheng Yang, Yuliang Lu, Xiang Wang

专题命中 视觉问答 ：multimodal large language model(abstract)

ChartReasoner: Code-Driven Modality Bridging for Long-Chain Reasoning in Chart Question Answering

Caijun Jia, Nan Xu, Jingxuan Wei, Qingli Wang, Lei Wang, Bihui Yu, Junnan Zhu

机构 * MAIS, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所MAIS研究所） ； Shenyang Institute of Computing Technology, Chinese Academy of Sciences（中国科学院沈阳计算技术研究所） ； Beijing Wenge Technology Co., Ltd.（北京文耕科技有限公司） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 视觉问答 ：visual reasoning(abstract)

ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering

Ruofan Wu, Youngwon Lee, Fan Shu, Danmei Xu, Seung-won Hwang, Zhewei Yao, Yuxiong He, Feng Yan

机构 * University of Houston（德克萨斯大学休斯敦分校） ； Seoul National University（首尔国立大学） ； Snowflake AI Research（Snowflake人工智能研究） 纠错

专题命中 视觉问答 ：grounding(abstract)

Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models

Olga Loginova, Oleksandr Bezrukov, Ravi Shekhar, Alexey Kravets

机构 * University of Trento（特伦托大学） ； Gran Sasso Science Institute（格兰萨索科学研究所） ； University of Essex（埃塞克斯大学） ； University of Bath（巴斯大学） 纠错

专题命中 视觉问答 ：VLM(abstract)

Generative Semantic Communication via Textual Prompts: Latency Performance Tradeoffs

Mengmeng Ren, Li Qiao, Long Yang, Zhen Gao, Jian Chen, Mahdi Boloursaz Mashhadi, Pei Xiao, Rahim Tafazolli, Mehdi Bennis

专题命中 视觉问答 ：vision language model(abstract)

Comments Accepted by IEEE Transactions on Vehicular Technology

Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QA

Xuanzhao Dong, Wenhui Zhu, Hao Wang, Xiwen Chen, Peijie Qiu, Rui Yin, Yi Su, Yalin Wang

机构 * Arizona State University（亚利桑那州立大学） ； Clemson University（克莱姆森大学） ； Washington University in St.Louis（圣路易斯华盛顿大学） ； Banner Alzheimer’s Institute（班纳阿尔茨海默病研究所） 纠错

专题命中 视觉问答 ：VLM(abstract)

ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering

Ahmed Masry, Mohammed Saidul Islam, Mahir Ahmed, Aayush Bajaj, Firoz Kabir, Aaryaman Kartha, Md Tahmid Rahman Laskar, Mizanur Rahman, Shadikur Rahman, Mehrad Shahmohammadi, Megh Thakkar, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty

专题命中 视觉问答 ：vision-language model(abstract)

Graph-Based Multimodal Contrastive Learning for Chart Question Answering

Yue Dai, Soyeon Caren Han, Wei Liu

专题命中 视觉问答 ：multimodal large language model(abstract)

Comments Accepted at SIGIR 2025

Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering

Armin Toroghi, Willis Guo, Mohammad Mahdi Abdollah Pour, Scott Sanner

专题命中 视觉问答 ：grounding(abstract)

Comments 33 pages, EMNLP24

Chameleon: Mixed-Modal Early-Fusion Foundation Models

Chameleon Team

专题命中 视觉问答 ：visual question answering(abstract)

Open-Ended and Knowledge-Intensive Video Question Answering

Md Zarif Ul Alam, Hamed Zamani

专题命中 视觉问答 ：vision language model(abstract)

Expect the Unexpected: FailSafe Long Context QA for Finance

Kiran Kamble, Melisa Russak, Dmytro Mozolevskyi, Muayad Ali, Mateusz Russak, Waseem AlShikh

专题命中 视觉问答 ：grounding(abstract)

Advancing Singlish Understanding: Bridging the Gap with Datasets and Multimodal Models

Bin Wang, Xunlong Zou, Shuo Sun, Wenyu Zhang, Yingxu He, Zhuohan Liu, Chengwei Wei, Nancy F. Chen, AiTi Aw

专题命中 视觉问答 ：multimodal large language model(abstract)

Comments Open-Source: https://github.com/AudioLLMs/Singlish

From Models to Microtheories: Distilling a Model's Topical Knowledge for Grounded Question Answering

Nathaniel Weir, Bhavana Dalvi Mishra, Orion Weller, Oyvind Tafjord, Sam Hornstein, Alexander Sabol, Peter Jansen, Benjamin Van Durme, Peter Clark

专题命中 视觉问答 ：grounding(abstract)

Domain-specific Question Answering with Hybrid Search

Dewang Sultania, Zhaoyu Lu, Twisha Naik, Franck Dernoncourt, David Seunghyun Yoon, Sanat Sharma, Trung Bui, Ashok Gupta, Tushar Vatsa, Suhas Suresha, Ishita Verma, Vibha Belavadi, Cheng Chen, Michael Friedrich

专题命中 视觉问答 ：grounding(abstract)

Comments AAAI-25 Workshop on Document Understanding and Intelligence

Overview of TREC 2024 Biomedical Generative Retrieval (BioGen) Track

Deepak Gupta, Dina Demner-Fushman, William Hersh, Steven Bedrick, Kirk Roberts

专题命中 视觉问答 ：grounding(abstract)