多模态大模型 - arXivDaily 专题

2506.04088 2025-06-05 cs.LG cs.AI cs.CL cs.CV 82%

Multimodal Tabular Reasoning with Privileged Structured Information

Jun-Peng Jiang, Yu Xia, Hai-Long Sun, Shiyin Lu, Qing-Guo Chen, Weihua Luo, Kaifu Zhang, De-Chuan Zhan, Han-Jia Ye

机构 * School of Artificial Intelligence, Nanjing University, China（人工智能学院，南京大学）； National Key Laboratory for Novel Software Technology, Nanjing University, China（新型软件技术国家重点实验室，南京大学）； AI Business, Alibaba Group（阿里集团人工智能业务）

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

2412.20070 2025-06-03 cs.CV cs.AI cs.CL cs.LG 82%

Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging

Zhenyang Cai, Junying Chen, Rongsheng Wang, Weihong Wang, Yonglin Deng, Dingjie Song, Yize Chen, Zixu Zhang, Benyou Wang

机构 * The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

2505.15154 2025-05-22 cs.CL cs.AI cs.MM 82%

Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning

Jinghui Lu, Haiyang Yu, Siliang Xu, Shiwei Ran, Guozhi Tang, Siqi Wang, Bin Shan, Teng Fu, Hao Feng, Jingqun Tang, Han Wang, Can Huang

机构 * ByteDance（字节跳动）； FuDan University（复旦大学）

专题命中其他多模态：MLLM(title)；multimodal(abstract)；分类 cs.CL、cs.AI、cs.MM

2504.04797 2025-04-08 eess.SP 82%

Addressing the Curse of Scenario and Task Generalization in AI-6G: A Multi-Modal Paradigm

Tianyu Jiao, Zhuoran Xiao, Yin Xu, Chenhui Ye, Yihang Huang, Zhiyong Chen, Liyu Cai, Jiang Chang, Dazhi He, Yunfeng Guan, Guangyi Liu, Wenjun Zhang

专题命中其他多模态：multi-modal(title,abstract)；cross-modal(abstract)

2412.15260 2024-12-23 cs.CL cs.CV cs.MM 82%

Analyzing Images of Legal Documents: Toward Multi-Modal LLMs for Access to Justice

Hannes Westermann, Jaromir Savelka

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV、cs.CL、cs.MM

Comments Accepted at AI for Access to Justice Workshop at Jurix 2024, Brno, Czechia. Code and Data available at: https://github.com/hwestermann/AI4A2J_analyzing_images_of_legal_documents

2410.19144 2024-10-28 cs.CV cs.AI cs.CL cs.LG 82%

Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant

Abhirama Subramanyam Penamakuri, Anand Mishra

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted to EMNLP (Main) 2024

2408.09111 2024-10-16 cs.AI cs.CL cs.CV cs.HC 82%

Measuring Agreeableness Bias in Multimodal Models

Jaehyuk Lim, Bruce W. Lee

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

2410.08616 2024-10-14 cs.RO 82%

Dual-AEB: Synergizing Rule-Based and Multimodal Large Language Models for Effective Emergency Braking

Wei Zhang, Pengfei Li, Junli Wang, Bingchuan Sun, Qihao Jin, Guangjun Bao, Shibo Rui, Yang Yu, Wenchao Ding, Peng Li, Yilun Chen

专题命中其他多模态：multimodal(title,abstract)；MLLM(abstract)

2406.17263 2024-10-14 cs.LG cs.NA math.DS math.NA 82%

Efficient, Multimodal, and Derivative-Free Bayesian Inference With Fisher-Rao Gradient Flows

Yifan Chen, Daniel Zhengyu Huang, Jiaoyang Huang, Sebastian Reich, Andrew M. Stuart

专题命中其他多模态：multimodal(title,abstract)；multi-modal(abstract)

Comments 42 pages, 10 figures

2408.13621 2024-08-28 cs.CV cs.AI cs.CL cs.LG 82%

Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models

Sakhinana Sagar Srinivas, Geethan Sannidhi, Sreeja Gangasani, Chidaksh Ravuru, Venkataramana Runkana

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Published at Deployable AI (DAI) Workshop at AAAI-2024

2408.01417 2024-08-05 cs.CL cs.AI cs.CV cs.LG 82%

Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs

Yilun Hua, Yoav Artzi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted to COLM 2024

2406.00667 2024-06-05 eess.IV cs.AI cs.CL cs.CV cs.LG 82%

An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Sulaiman Khan, Md. Rafiul Biswas, Alina Murad, Hazrat Ali, Zubair Shah

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted in Fifth IEEE Workshop on Artificial Intelligence for HealthCare, IEEE 25th International Conference on Information Reuse and Integration for Data Science

2405.13872 2024-05-30 cs.AI cs.CL cs.CV 82%

Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models

Qiji Zhou, Ruochen Zhou, Zike Hu, Panzhong Lu, Siyang Gao, Yue Zhang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Correct the case title

2402.05872 2024-05-30 cs.RO 82%

You've Got to Feel It To Believe It: Multi-Modal Bayesian Inference for Semantic and Property Prediction

Parker Ewen, Hao Chen, Yuzhen Chen, Anran Li, Anup Bagali, Gitesh Gunjal, Ram Vasudevan

专题命中其他多模态：multi-modal(title,abstract)；multimodal(abstract)

2305.08698 2024-05-28 cs.CL cs.AI cs.DB cs.LG cs.MM 82%

Continual Multimodal Knowledge Graph Construction

Xiang Chen, Jintian Zhang, Xiaohan Wang, Ningyu Zhang, Tongtong Wu, Yuxiang Wang, Yongheng Wang, Huajun Chen

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL、cs.AI、cs.MM

Comments IJCAI 2024

2405.05786 2024-05-10 cs.LG 82%

FusionTransNet for Smart Urban Mobility: Spatiotemporal Traffic Forecasting Through Multimodal Network Integration

Binwu Wang, Yan Leng, Guang Wang, Yang Wang

专题命中其他多模态：multimodal(title,abstract)；cross-modal(abstract)

2404.08886 2024-04-16 cs.CV cs.AI cs.CL cs.IR cs.LG 82%

EIVEN: Efficient Implicit Attribute Value Extraction using Multimodal LLM

Henry Peng Zou, Gavin Heqing Yu, Ziwei Fan, Dan Bu, Han Liu, Peng Dai, Dongmei Jia, Cornelia Caragea

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted by NAACL 2024 Industry Track

2303.00720 2024-04-02 cs.LG cs.DB cs.IR 82%

Cross-Modal Entity Matching for Visually Rich Documents

Ritesh Sarkhel, Arnab Nandi

专题命中其他多模态：cross-modal(title,abstract)；multimodal(abstract)

2403.06338 2024-03-12 stat.ML cs.LG q-bio.GN 82%

Disentangling shared and private latent factors in multimodal Variational Autoencoders

Kaspar Märtens, Christopher Yau

专题命中其他多模态：multimodal(title,abstract)；cross-modal(abstract)

Comments Accepted for publication in the Proceedings of Machine Learning in Computational Biology (MLCB 2023)

2402.08577 2024-02-14 cs.CL cs.CR cs.CV cs.LG cs.MM 82%

Test-Time Backdoor Attacks on Multimodal Large Language Models

Dong Lu, Tianyu Pang, Chao Du, Qian Liu, Xianjun Yang, Min Lin

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.MM

2312.11420 2023-12-19 cs.CL cs.AI cs.CV 82%

Tuning LayerNorm in Attention: Towards Efficient Multi-Modal LLM Finetuning

Bingchen Zhao, Haoqin Tu, Chen Wei, Jieru Mei, Cihang Xie

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments The first two authors contributed equally

2312.06093 2023-12-12 cs.CL cs.CV cs.MM 82%

PromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Models

Nirmalendu Prakash, Han Wang, Nguyen Khoi Hoang, Ming Shan Hee, Roy Ka-Wei Lee

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.MM

Comments Accepted at ACM Multimedia'23 Research Track

2302.12247 2023-12-12 cs.LG cs.AI cs.CL cs.CV cs.IT math.IT 82%

Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework

Paul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling, Suzanne Nie, Richard Chen, Zihao Deng, Nicholas Allen, Randy Auerbach, Faisal Mahmood, Ruslan Salakhutdinov, Louis-Philippe Morency

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments NeurIPS 2023. Code available at: https://github.com/pliang279/PID

2306.05240 2023-06-09 cs.CL cs.AI cs.CV 82%

Dealing with Semantic Underspecification in Multimodal NLP

Sandro Pezzelle

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments To appear in the Proceedings of ACL 2023 (main conference). 13 pages, 3 figures

2305.09333 2023-05-17 cs.CV cs.AI cs.CL 82%

Multi-modal Visual Understanding with Prompts for Semantic Information Disentanglement of Image

Yuzhou Peng

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments 8 pages

2305.00581 2023-05-02 cs.CV cs.AI cs.CL 82%

Multimodal Graph Transformer for Multimodal Question Answering

Xuehai He, Xin Eric Wang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

2301.02383 2023-01-09 q-bio.QM cs.LG eess.IV q-bio.GN 82%

Deep Biological Pathway Informed Pathology-Genomic Multimodal Survival Prediction

Lin Qiu, Aminollah Khormali, Kai Liu

专题命中其他多模态：multimodal(title,abstract)；multi-modal(abstract)

2202.05786 2022-12-20 cs.AI cs.CL cs.CV 82%

Multi-Modal Knowledge Graph Construction and Application: A Survey

Xiangru Zhu, Zhixu Li, Xiaodan Wang, Xueyao Jiang, Penglei Sun, Xuwu Wang, Yanghua Xiao, Nicholas Jing Yuan

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments 20 pages, 8 figures, 6 tables. Accepted by TKDE 2022

2209.08569 2022-09-20 cs.CV cs.AI cs.CL 82%

ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding

Wenjin Wang, Zhengjie Huang, Bin Luo, Qianglong Chen, Qiming Peng, Yinxu Pan, Weichong Yin, Shikun Feng, Yu Sun, Dianhai Yu, Yin Zhang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted by ACM Multimedia 2022

2209.01308 2022-09-07 cs.AI cs.CV cs.IR cs.MM 82%

Multimodal and Crossmodal AI for Smart Data Analysis

Minh-Son Dao

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV、cs.AI、cs.MM

1. 其他多模态 4868 篇

Multimodal Tabular Reasoning with Privileged Structured Information

Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging

Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoning

Addressing the Curse of Scenario and Task Generalization in AI-6G: A Multi-Modal Paradigm

Analyzing Images of Legal Documents: Toward Multi-Modal LLMs for Access to Justice

Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant

Measuring Agreeableness Bias in Multimodal Models

Dual-AEB: Synergizing Rule-Based and Multimodal Large Language Models for Effective Emergency Braking

Efficient, Multimodal, and Derivative-Free Bayesian Inference With Fisher-Rao Gradient Flows

Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models

Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs

An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models

You've Got to Feel It To Believe It: Multi-Modal Bayesian Inference for Semantic and Property Prediction

Continual Multimodal Knowledge Graph Construction

FusionTransNet for Smart Urban Mobility: Spatiotemporal Traffic Forecasting Through Multimodal Network Integration

EIVEN: Efficient Implicit Attribute Value Extraction using Multimodal LLM

Cross-Modal Entity Matching for Visually Rich Documents

Disentangling shared and private latent factors in multimodal Variational Autoencoders

Test-Time Backdoor Attacks on Multimodal Large Language Models

Tuning LayerNorm in Attention: Towards Efficient Multi-Modal LLM Finetuning

PromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Models

Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework

Dealing with Semantic Underspecification in Multimodal NLP

Multi-modal Visual Understanding with Prompts for Semantic Information Disentanglement of Image

Multimodal Graph Transformer for Multimodal Question Answering

Deep Biological Pathway Informed Pathology-Genomic Multimodal Survival Prediction

Multi-Modal Knowledge Graph Construction and Application: A Survey

ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding

Multimodal and Crossmodal AI for Smart Data Analysis