RAG / 检索增强生成

Region-Level Context-Aware Multimodal Understanding

Hongliang Wei, Xianqi Zhang, Xingtao Wang, Xiaopeng Fan, Debin Zhao

机构 * Faculty of Computing, Harbin Institute of Technology（计算机学院，哈尔滨工业大学） ； Department of Computer Science and Technology, Harbin Institute of Technology（计算机科学与技术系，哈尔滨工业大学） ； Harbin Institute of Technology Suzhou Research Institute（哈尔滨工业大学苏州研究院长） ； Peng Cheng Laboratory, Shenzhen, China（鹏城实验室，深圳，中国） 纠错

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 12 pages, 6 figures

MedVQA-TREE: A Multimodal Reasoning and Retrieval Framework for Sarcopenia Prediction

Pardis Moradbeiki, Nasser Ghadiri, Sayed Jalal Zahabi, Uffe Kock Wiil, Kristoffer Kittelmann Brockhattingen, Ali Ebrahimi

机构 * Department of Electrical and Computer Engineering, Isfahan University of Technology（电气与计算机工程系，伊斯法罕技术大学） ； SDU Health Informatics and Technology, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark（南部丹麦大学健康信息学与技术，马士基麦金尼莫勒研究所） ； Geriatric Research Unit, Department of Clinical Research, University of Southern Denmark（老年医学研究单元，临床研究系，南部丹麦大学） 纠错

专题命中 多模态RAG ：knowledge retrieval(abstract)；分类 cs.AI

SentiMM: A Multimodal Multi-Agent Framework for Sentiment Analysis in Social Media

Xilai Xu, Zilin Zhao, Chengye Song, Zining Wang, Jinhe Qiang, Jiongrui Yan, Yuhuai Lin

机构 * College of Information and Electrical Engineering, China Agricultural University（信息与电气工程学院，中国农业大学） ； College of Software, Jilin University（软件学院，吉林大学） ； College of Communication Engineering, Jilin University（通信工程学院，吉林大学） 纠错

专题命中 多模态RAG ：knowledge retrieval(abstract)；分类 cs.CL

M2IO-R1: An Efficient RL-Enhanced Reasoning Framework for Multimodal Retrieval Augmented Multimodal Generation

Zhiyou Xiao, Qinhan Yu, Binghui Li, Geng Chen, Chong Chen, Wentao Zhang

专题命中 多模态RAG ：retrieval-augmented generation(abstract)；分类 cs.IR

TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks

Yuanze Hu, Zhaoxin Fan, Xinyu Wang, Gen Li, Ye Qiu, Zhichao Yang, Wenjun Wu, Kejian Wu, Yifan Sun, Xiaotie Deng, Jin Dong

机构 * Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing（北京未来区块链与隐私计算先进创新中心） ； Beihang University（北京航空航天大学） ； Hangzhou International Innovation Institute（杭州国际创新研究院） ； Xreal ； Renmin University（中国人民大学） ； Peking University（北京大学） ； Beijing Academy of Blockchain and Edge Computing (BABEC)（北京区块链与边缘计算研究院） 纠错

专题命中 多模态RAG ：retrieval-augmented generation(abstract)；分类 cs.AI

Segment as You Wish -- Free-Form Language-Based Segmentation for Medical Images

Longchao Da, Rui Wang, Xiaojian Xu, Parminder Bhatia, Taha Kass-Hout, Hua Wei, Cao Xiao

机构 * Arizona State University（亚利桑那州立大学） 纠错

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 19 pages, 9 as main content. The paper was accepted to KDD2025

Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding

Yuhang Zhang, Haosheng Yu, Jiaping Xiao, Mir Feroskhan

机构 * School of Mechanical and Aerospace Engineering, Nanyang Technological University（机械与航空航天工程学院，南洋理工大学） 纠错

专题命中 多模态RAG ：retriever(abstract)；分类 cs.AI

Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learning

Choi Changin, Lim Sungjun, Rhee Wonjong

机构 * Interdisciplinary Program in Artificial Intelligence（人工智能交叉学科项目） ； Department of Intelligence and Information（智能与信息系） 纠错

专题命中 多模态RAG ：retrieval-augmented generation(abstract)；分类 cs.AI

A Smart Multimodal Healthcare Copilot with Powerful LLM Reasoning

Xuejiao Zhao, Siyan Liu, Su-Yin Yang, Chunyan Miao

机构 * Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), NTU（联合NTU-UBC老龄化积极生活卓越研究中心（LILY），NTU） ； College of Computing and Data Science, Nanyang Technological University (NTU), Singapore（计算与数据科学学院，南洋理工大学（NTU），新加坡） ； Tan Tock Seng Hospital, Singapore（坦 tok sing 医院，新加坡） ； Woodlands Health, Singapore（伍德兰兹健康，新加坡） 纠错

专题命中 多模态RAG ：retrieval-augmented generation(abstract)；分类 cs.AI

RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection

Wenjun Hou, Yi Cheng, Kaishuai Xu, Heng Li, Yan Hu, Wenjie Li, Jiang Liu

机构 * Department of Computing, The Hong Kong Polytechnic University（香港理工大学计算机系） ； Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology（南方科技大学可信自主系统研究院和计算机科学与工程系） ； School of Computer Science, University of Nottingham Ningbo China（宁波大学计算机学院） 纠错

专题命中 多模态RAG ：knowledge retrieval(abstract)；分类 cs.CL

Comments Accepted to ACL 2025 main

Tevatron 2.0: Unified Document Retrieval Toolkit across Scale, Language, and Modality

Xueguang Ma, Luyu Gao, Shengyao Zhuang, Jiaqi Samantha Zhan, Jamie Callan, Jimmy Lin

专题命中 多模态RAG ：retriever(abstract)；分类 cs.IR

Comments Accepted in SIGIR 2025 (Demo)

Detecting and Understanding Hateful Contents in Memes Through Captioning and Visual Question-Answering

Ali Anaissi, Junaid Akram, Kunal Chaturvedi, Ali Braytee

机构 * The University of Sydney, School of Computer Science（悉尼大学计算机科学学院） ； University of Technology Sydney, School of Computer Science（新南威尔士大学技术学院） ； University of Technology Sydney, TD School（新南威尔士大学TD学院） ； Australian Catholic University, Peter Faber Business School（澳大利亚天主教大学彼得·法伯商学院） 纠错

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 13 pages, 2 figures, 2025 International Conference on Computational Science

Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platform

Cheonsu Jeong

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 22 pages, 27 figures

Journal ref 2025 Journal of Intelligence and Information Systems

Rotation Invariance in Floor Plan Digitization using Zernike Moments

Marius Graumann, Jan Marius Stürmer, Tobias Koch

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 17 pages, 5 figures

AI-based association analysis for medical imaging using latent-space geometric confounder correction

Xianjing Liu, Bo Li, Meike W. Vernooij, Eppo B. Wolvius, Gennady V. Roshchupkin, Esther E. Bron

专题命中 多模态RAG ：vector search(abstract)；分类 cs.AI

Comments Accepted by Medical Image Analysis

Diffusion Lens: Interpreting Text Encoders in Text-to-Image Pipelines

Michael Toker, Hadas Orgad, Mor Ventura, Dana Arad, Yonatan Belinkov

专题命中 多模态RAG ：knowledge retrieval(abstract)；分类 cs.CL

Comments Published in: ACL 2024 Project webpage: tokeron.github.io/DiffusionLensWeb

OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answering

Jiahao Nick Li, Zhuohao Jerry Zhang, Jiaju Ma

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments Paper accepted to the 2025 CHI Conference on Human Factors in Computing Systems (CHI 2025)

Multimodal semantic retrieval for product search

Dong Liu, Esther Lopez Ramos

专题命中 多模态RAG ：dense retrieval(abstract)；分类 cs.IR

Comments Accepted at EReL@MIR WWW 2025

Eliza: A Web3 friendly AI Agent Operating System

Shaw Walters, Sam Gao, Shakker Nerd, Feng Da, Warren Williams, Ting-Chien Meng, Amie Chow, Hunter Han, Frank He, Allen Zhang, Ming Wu, Timothy Shen, Maxwell Hu, Jerry Yan

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 20 pages, 5 figures

Improving Multimodal LLMs Ability In Geometry Problem Solving, Reasoning, And Multistep Scoring

Avinash Anand, Raj Jaiswal, Abhishek Dharmadhikari, Atharva Marathe, Harsh Parimal Popat, Harshil Mital, Kritarth Prasad, Rajiv Ratn Shah, Roger Zimmermann

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Comments 15 pages

ViMGuard: A Novel Multi-Modal System for Video Misinformation Guarding

Andrew Kan, Christopher Kan, Zaid Nabulsi

专题命中 多模态RAG ：retrieval augmented generation(abstract)；分类 cs.CL

Comments 7 pages, 2 figures

GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models

Aditya Sharma, Aman Dalmia, Mehran Kazemi, Amal Zouaq, Christopher J. Pal

专题命中 多模态RAG ：RAG(abstract)；分类 cs.CL

WorldGPT: Empowering LLM as Multimodal World Model

Zhiqi Ge, Hongzhe Huang, Mingze Zhou, Juncheng Li, Guoming Wang, Siliang Tang, Yueting Zhuang

专题命中 多模态RAG ：knowledge retrieval(abstract)；分类 cs.AI

Comments update v2

Beyond Relevance: Improving User Engagement by Personalization for Short-Video Search

Wentian Bao, Hu Liu, Kai Zheng, Chao Zhang, Shunyu Zhang, Enyun Yu, Wenwu Ou, Yang Song

专题命中 多模态RAG ：dense retrieval(abstract)；分类 cs.IR

Multimodal Large Language Model Driven Scenario Testing for Autonomous Vehicles

Qiujing Lu, Xuanhan Wang, Yiwei Jiang, Guangming Zhao, Mingyue Ma, Shuo Feng

专题命中 多模态RAG ：retrieval-augmented generation(abstract)；分类 cs.AI

Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wild

Tianqi Wei, Zhi Chen, Xin Yu

专题命中 多模态RAG ：retriever(abstract)；分类 cs.IR

Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos

Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman

专题命中 多模态RAG ：retrieval-augmented generation(abstract)；分类 cs.AI

Comments Project page: https://vision.cs.utexas.edu/projects/action2sound. ECCV 2024 camera-ready version

BSPA: Exploring Black-box Stealthy Prompt Attacks against Image Generators

Yu Tian, Xiao Yang, Yinpeng Dong, Heming Yang, Hang Su, Jun Zhu

专题命中 多模态RAG ：retriever(abstract)；分类 cs.CL

DeepMerge: Deep-Learning-Based Region-Merging for Image Segmentation

Xianwei Lv, Claudio Persello, Wangbin Li, Xiao Huang, Dongping Ming, Alfred Stein

专题命中 多模态RAG ：RAG(abstract)；分类 cs.AI

Video and Audio are Images: A Cross-Modal Mixer for Original Data on Video-Audio Retrieval

Zichen Yuan, Qi Shen, Bingyi Zheng, Yuting Liu, Linying Jiang, Guibing Guo

专题命中 多模态RAG ：retriever(abstract)；分类 cs.IR