多模态大模型

Deciphering Emotions in Children Storybooks: A Comparative Analysis of Multimodal LLMs in Educational Applications

Bushra Asseri, Estabraq Abdelaziz, Maha Al Mogren, Tayef Alhefdhi, Areej Al-Wabil

机构 * College of Engineering & Advanced Computing（工程与高级计算学院） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

AVAM: Universal Training-free Adaptive Visual Anchoring Embedded into Multimodal Large Language Model for Multi-image Question Answering

Kang Zeng, Guojin Zhong, Jintao Cheng, Jin Yuan, Zhiyong Li

机构 * Hunan University（湖南大学） ； South China Normal University（华南师范大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 14 pages, 5 figures

impuTMAE: Multi-modal Transformer with Masked Pre-training for Missing Modalities Imputation in Cancer Survival Prediction

Maria Boyko, Aleksandra Beliaeva, Dmitriy Kornilov, Alexander Bernstein, Maxim Sharaev

机构 * Center for Applied AI, Skolkovo Institute of Science and Technology, Moscow, Russian Federation（应用人工智能中心，斯克尔科夫科学与技术研究所，莫斯科，俄罗斯联邦） ； BIMAI-Lab, Biomedically Informed Artificial Intelligence Laboratory, University of Sharjah, Sharjah, United Arab Emirates（BIMAI实验室，生物医学导向人工智能实验室，肖贾联合大学，肖贾，阿拉伯联合酋长国） ； Ivannikov Institute for System Programming of the Russian Academy of Sciences, Moscow, Russian Federation（伊万诺夫俄罗斯科学院系统编程研究所，莫斯科，俄罗斯联邦） 纠错

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

A Context-aware Attention and Graph Neural Network-based Multimodal Framework for Misogyny Detection

Mohammad Zia Ur Rehman, Sufyaan Zahoor, Areeb Manzoor, Musharaf Maqbool, Nagendra Kumar

机构 * Department of Computer Science and Engineering（计算机科学与工程系） ； Indian Institute of Technology Indore（印度理工学院印德分校） ； Department of Computer Science and Engineering, National Institute of Technology Srinagar（计算机科学与工程系，印度国立技术学院斯里 Nagar分校） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Published in Information Processing & Management

A Multimodal Architecture for Endpoint Position Prediction in Team-based Multiplayer Games

Jonas Peche, Aliaksei Tsishurou, Alexander Zap, Guenter Wallner

机构 * Computer Graphics（计算机图形学） ； Johannes Kepler University Linz（约瑟夫·施特劳斯大学林茨） ； DS Research（DS研究） ； Wargaming（沃拉基姆） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding

Zhaokai Wang, Xizhou Zhu, Xue Yang, Gen Luo, Hao Li, Changyao Tian, Wenhan Dou, Junqi Ge, Lewei Lu, Yu Qiao, Jifeng Dai

机构 * Shanghai Jiao Tong University（上海交通大学） ； Tsinghua University（清华大学） ； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； The Chinese University of Hong Kong（香港中文大学） ； Sensetime 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Journal ref TPAMI 2025

KEN: Knowledge Augmentation and Emotion Guidance Network for Multimodal Fake News Detection

Peican Zhu, Yubo Jing, Le Cheng, Keke Tang, Yangming Guo

机构 * Northwestern Polytechnical University（西北工业大学） ； Guangzhou University（广东大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI、cs.MM

Comments Accepted by ACM MM 2025

CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation

Xinlei Yu, Changmiao Wang, Hui Jin, Ahmed Elazab, Gangyong Jia, Xiang Wan, Changqing Zou, Ruiquan Ge

机构 * Hangzhou Dianzi University（杭州电子科技大学） ； Shenzhen Research Institute of Big Data（深圳大数据研究院） ； Shenzhen University（深圳大学） ； Zhejiang University（浙江大学） 纠错

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted By ACMMM25

Dual-Granularity Cross-Modal Identity Association for Weakly-Supervised Text-to-Person Image Matching

Yafei Zhang, Yongle Shang, Huafeng Li

机构 * Kunming University of Science and Technology（昆明理工大学） 纠错

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV、cs.MM

Multimodal, Multi-Disease Medical Imaging Foundation Model (MerMED-FM)

Yang Zhou, Chrystie Wan Ning Quek, Jun Zhou, Yan Wang, Yang Bai, Yuhe Ke, Jie Yao, Laura Gutierrez, Zhen Ling Teo, Darren Shu Jeng Ting, Brian T. Soetikno, Christopher S. Nielsen, Tobias Elze, Zengxiang Li, Linh Le Dinh, Lionel Tim-Ee Cheng, Tran Nguyen Tuan Anh, Chee Leong Cheng, Tien Yin Wong, Nan Liu, Iain Beehuat Tan, Tony Kiat Hon Lim, Rick Siow Mong Goh, Yong Liu, Daniel Shu Wei Ting

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 42 pages, 3 composite figures, 4 tables

Structured Attention Matters to Multimodal LLMs in Document Understanding

Chang Liu, Hongkai Chen, Yujun Cai, Hang Wu, Qingwen Ye, Ming-Hsuan Yang, Yiwei Wang

机构 * vivo Mobile Communication Co., Ltd（vivo移动通信有限公司） ； The University of Queensland（昆士兰大学） ； University of California, Merced（加州大学默塞德分校） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

AI-based Multimodal Biometrics for Detecting Smartphone Distractions: Application to Online Learning

Alvaro Becerra, Roberto Daza, Ruth Cobos, Aythami Morales, Mutlu Cukurova, Julian Fierrez

机构 * Universidad Autónoma de Madrid（马德里自治大学） ； University College London（伦敦大学学院） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in EC-TEL25: 20th European Conference on Technology Enhanced Learning, Newcastle and Durham, UK, 15-19 September 2025

Mitigating Visual Forgetting via Take-along Visual Conditioning for Multi-modal Long CoT Reasoning

Hai-Long Sun, Zhun Sun, Houwen Peng, Han-Jia Ye

机构 * School of Artificial Intelligence, Nanjing University（南京大学人工智能学院） ； National Key Laboratory for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室） ； Tencent（腾讯） ； Center for Language AI Research, Tohoku University（东北大学语言人工智能研究中心） ； RIKEN Center for Advanced Intelligence Project（日本理化学研究所先进人工智能项目中心） 纠错

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted to ACL 2025. The project page is available at https://sun-hailong.github.io/projects/TVC

VLM-R$^3$: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thought

Chaoya Jiang, Yongrui Heng, Wei Ye, Han Yang, Haiyang Xu, Ming Yan, Ji Zhang, Fei Huang, Shikun Zhang

机构 * National Engineering Research Center for Software Engineering, Peking University（软件工程国家工程研究中心，北京大学） ； Alibaba Group（阿里巴巴集团） ； ZEEKR Intelligent Technology Holding Limited（ZEKR智能科技控股有限公司） 纠错

专题命中 其他多模态 ：multimodal(title)；MLLM(abstract)；分类 cs.CV、cs.AI

MaskAdapt: Unsupervised Geometry-Aware Domain Adaptation Using Multimodal Contextual Learning and RGB-Depth Masking

Numair Nadeem, Muhammad Hamza Asad, Saeed Anwar, Abdul Bais

机构 * University of Regina（里贾纳大学） ； University Canada West（加拿大西部大学） ； The University of Western Australia（西澳大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 11 pages, 5 figures, presented at the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025. Reviewer comments available upon request

The Devil Is in the Details: Tackling Unimodal Spurious Correlations for Generalizable Multimodal Reward Models

Zichao Li, Xueru Wen, Jie Lou, Yuqiu Ji, Yaojie Lu, Xianpei Han, Debing Zhang, Le Sun

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments ICML 2025

Evaluating the Efficacy of Prompt-Engineered Large Multimodal Models Versus Fine-Tuned Vision Transformers in Image-Based Security Applications

Fouad Trad, Ali Chehab

机构 * Electrical and Computer Engineering（电气与计算机工程） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Journal ref Published in ACM Transactions on Intelligent Systems and Technology, 2025

CryoSAMU: Enhancing 3D Cryo-EM Density Maps of Protein Structures at Intermediate Resolution with Structure-Aware Multimodal U-Nets

Chenwei Zhang, Khanh Dao Duc

机构 * Department of Computer Science, UBC（计算机科学系，不列颠哥伦比亚大学） ； Department of Mathematics, UBC（数学系，不列颠哥伦比亚大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 19 pages, 6 main figures, 2 supplementary figures, 3 main tables, 4 supplementary tables

Towards a Multimodal Document-grounded Conversational AI System for Education

Karan Taneja, Anjali Singh, Ashok K. Goel

机构 * Georgia Institute of Technology（佐治亚理工学院） ； University of Texas at Austin（德克萨斯大学奥斯汀分校） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 15 pages, 4 figures, AIED 2025

A Multi-Modal Knowledge-Enhanced Framework for Vessel Trajectory Prediction

Haomin Yu, Tianyi Li, Kristian Torp, Christian S. Jensen

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 5 figures

Knowledge Graph Enhanced Generative Multi-modal Models for Class-Incremental Learning

Xusheng Cao, Haori Lu, Linlan Huang, Fei Yang, Xialei Liu, Ming-Ming Cheng

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

ModeSeq: Taming Sparse Multimodal Motion Prediction with Sequential Mode Modeling

Zikang Zhou, Hengjian Zhou, Haibo Hu, Zihao Wen, Jianping Wang, Yung-Hui Li, Yu-Kai Huang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments CVPR 2025

Leveraging Vision Capabilities of Multimodal LLMs for Automated Data Extraction from Plots

Maciej P. Polak, Dane Morgan

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 3 figures

Multimodal Distillation-Driven Ensemble Learning for Long-Tailed Histopathology Whole Slide Images Analysis

Xitong Ling, Yifeng Ping, Jiawen Li, Jing Peng, Yuxuan Chen, Minxi Ouyang, Yizhi Wang, Yonghong He, Tian Guan, Xiaoping Liu, Lianghui Zhu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification

Linzhuang Sun, Hao Liang, Jingxuan Wei, Bihui Yu, Tianpeng Li, Fan Yang, Zenan Zhou, Wentao Zhang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

InfiR : Crafting Effective Small Language Models and Multimodal Small Language Models in Reasoning

Congkai Xie, Shuo Cai, Wenjun Wang, Pengxiang Li, Zhijie Sang, Kejing Yang, Yiming Zhang, Zhen Li, Guanghao Zhu, Zeyu Liu, Yang Yu, Yuhang Liu, Su Lu, Baoyi He, Qi Zhou, Xiaotian Han, Jianbo Yuan, Shengyu Zhang, Fei Wu, Hongxia Yang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queries

Yuqi Jiang, Xudong Lu, Qian Jin, Qi Sun, Hanming Wu, Cheng Zhuo

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Published in ACM/IEEE International Conference On Computer Aided Design (ICCAD) 2024. Corresponding Author: Qi Sun (qisunchn@zju.edu.cn)

MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field

Zijiang Yang, Zhongwei Qiu, Chang Xu, Dongmei Fu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Published in: IEEE Transactions on Visualization and Computer Graphics

Enhanced Masked Image Modeling to Avoid Model Collapse on Multi-modal MRI Datasets

Linxuan Han, Sa Xiao, Zimeng Li, Haidong Li, Xiuchao Zhao, Yeqing Han, Fumin Guo, Xin Zhou

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments This work has been submitted to the lEEE for possible publication. copyright may be transferred without notice, after which this version may no longer be accessible

Semi-IIN: Semi-supervised Intra-inter modal Interaction Learning Network for Multimodal Sentiment Analysis

Jinhao Lin, Yifei Wang, Yanwu Xu, Qi Liu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI