MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documents
MultiHaystack:用于40,000张图像、视频和文档的多模态检索和推理的基准测试
Dannong Xu, Zhongyu Yang, Jun Chen, Yingfang Yuan, Ming Hu, Lei Sun, Luc Van Gool, Danda Pani Paudel, Chun-Mei Feng
机构
*
INSAIT
;
Lanzhou University(兰州大学)
;
King Abdullah University of Science and Technology(国王阿卜杜勒-阿齐兹科学与技术大学)
;
Heriot-Watt University(赫瑞-沃德大学)
;
Monash University(莫纳什大学)
;
University College Dublin(都柏林大学学院)
Hidden in the Metadata: Stealth Poisoning Attacks on Multimodal Retrieval-Augmented Generation
元数据中的隐藏攻击:多模态检索增强生成中的隐秘污染攻击
Kennedy Edemacu, Mohammad Mahdi Shokri
机构
*
The City University of New York, CSI, Staten Island, NY 10314, USA(纽约城市大学,CSI,史泰登岛分校)
;
The City University of New York, Graduate Center, New York, NY 10016, USA(纽约城市大学研究生中心)
V-Retrver: Evidence-Driven Agentic Reasoning for Universal Multimodal Retrieval
V-Retrver: 以证据驱动的代理推理用于通用多模态检索
Dongyang Chen, Chaoyang Wang, Dezhao Su, Xi Xiao, Zeyu Zhang, Jing Xiong, Qing Li, Yuzhang Shang, Shichao Kan
机构
*
Tsinghua University(清华大学)
;
University of Central Florida(中央佛罗里达大学)
;
Fudan University(复旦大学)
;
The Australian National University(澳大利亚国立大学)
;
The University of Hong Kong(香港大学)
;
Pengcheng Laboratory(鹏城实验室)
;
Central South University(中南大学)
机构
*
Department of Computer Science and Engineering, BRAC University(计算机科学与工程系,BRAC大学)
;
Department of Computer Science and Engineering, Ahsanullah University of Science and Technology(计算机科学与工程系,Ahsanullah科技大学)
机构
*
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院)
;
School of Computing, National University of Singapore(新加坡国立大学计算机学院)
机构
*
University of Chinese Academy of Sciences(中国科学院大学)
;
Shanghai Advanced Research Institute, Chinese Academy of Sciences(中国科学院上海先进研究院)
;
Department of Radiology, Changhai Hospital(昌海医院放射科)
机构
*
Department of Computer Engineering, Chulalongkorn University(楚莱隆坤大学计算机工程系)
;
School of Information Science and Technology, VISTEC(信息科学与技术学院,VISTEC)
BayesRAG: Probabilistic Mutual Evidence Corroboration for Multimodal Retrieval-Augmented Generation
BayesRAG: 基于概率互证的多模态检索增强生成
Xuan Li, Yining Wang, Haocai Luo, Shengping Liu, Jerry Liang, Ying Fu, Weihuang, Jun Yu, Junnan Zhu
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Unisound AI Technology Co.Ltd(Unisound AI技术有限公司)
;
MAIS, Institute of Automation, Chinese Academy of Sciences(自动化研究所,中国科学院)
SIGMMA: Hierarchical Graph-Based Multi-Scale Multi-modal Contrastive Alignment of Histopathology Image and Spatial Transcriptome
SIGMMA:基于层次图的多尺度多模态对比对齐:组织病理图像与空间转录组
Dabin Jeong, Amirhossein Vahidi, Ciro Ramírez-Suástegui, Marie Moullet, Kevin Ly, Mohammad Vali Sanian, Sebastian Birk, Yinshui Chang, Adam Boxall, Daniyal Jafree, Lloyd Steele, Vijaya Baskar MS, Muzlifah Haniffa, Mohammad Lotfollahi
机构
*
Wellcome Sanger Institute(沃森桑格研究所)
;
Cambridge Centre for AI in Medicine(剑桥人工智能医学中心)
;
Institute of AI for Health(人工智能与健康研究所)
;
Cambridge Stem Cell Institute(剑桥干细胞研究所)
机构
*
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航天信息研究所)
;
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Key Laboratory of Target Cognition and Application Technology(TCAT), Aerospace Information Research Institute, Chinese Academy of Sciences(目标认知与应用技术重点实验室)
;
Department of Electronic Engineering, Tsinghua University(清华大学电子工程系)
;
Peng Cheng Laboratory, Shenzhen(鹏城实验室)
机构
*
University of Liverpool, United Kingdom(利物浦大学)
;
National University of Singapore, Singapore(新加坡国立大学)
;
The Chinese University of Hong Kong, Shenzhen, China(香港中文大学(深圳))
Sensing and Understanding the World over Air: A Large Multimodal Model for Mobile Networks
通过空气感知和理解世界:为移动网络设计的大型多模态模型
Zhuoran Duan, Yuhao Wei, Guoshun Nan, Zijun Wang, Yan Yan, Lihua Xiong, Yuhan Ran, Ji Zhang, Jian Li, Qimei Cui, Xiaofeng Tao, Tony Q. S. Quek
机构
*
National Engineering Research Center for Mobile Network Technologies, Beijing University of Posts and Telecommunications (BUPT), Beijing(中国移动网络技术国家工程研究中心,北京邮电大学)
;
Beiyou Shenzhen Institute(北邮深圳研究所)
;
School of Cyber Security, University of Chinese Academy of Sciences (UCAS)(中国科学院大学网络安全学院)
;
China Telecom Co., Ltd.(中国电信股份有限公司)
;
Singapore University of Technology and Design (SUTD)(新加坡科技设计大学)
Large Language Model Aided Birt-Hogg-Dube Syndrome Diagnosis with Multimodal Retrieval-Augmented Generation
基于多模态检索增强生成的大型语言模型辅助Birt-Hogg-Dube综合征诊断
Haoqing Li, Jun Shi, Xianmeng Chen, Qiwei Jia, Rui Wang, Wei Wei, Hong An, Xiaowen Hu
机构
*
School of Computer Science and Technology(计算机科学与技术学院)
;
Department of Pulmonary and Critical Care Medicine(呼吸与危重症医学科)
;
Center for Diagnosis and Management of Rare Diseases(罕见病诊断与管理中心)
;
the First Affiliated Hospital of USTC(USTC第一附属医院)
;
Division of Life Sciences and Medicine(生命科学与医学系)
;
USTC
;
WanNan Medical College(皖南医学院)