多模态信息融合

Foundation Model Embeddings Meet Blended Emotions: A Multimodal Fusion Approach for the BLEMORE Challenge

基础模型嵌入与混合情感：一种多模态融合方法用于BLEMORE挑战

Masoumeh Chapariniya, Aref Farhadipour, Sarah Ebling, Volker Dellwo, Teodora Vukovic

机构 * Department of Computational Linguistics, University of Zürich（苏黎世大学计算语言学系） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

AI总结 本文提出了一种多模态融合方法，结合六个编码器家族进行后期概率融合，通过选择冻结的Wav2Vec2的语调编码层和Gemini Embedding 2.0，提升了混合情感识别的性能，最终在测试集上获得0.279的分数。

Unbiased Dynamic Multimodal Fusion

无偏动态多模态融合

Shicai Wei, Kaijie Zhang, Luyi Chen, Tao He, Guiduo Duan

机构 * University of Electronic Science and Technology of China（电子科学与技术大学） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

AI总结 本文提出UDML框架，通过引入噪声感知不确定性估计器和模态dropout量化模态依赖偏置，解决动态多模态融合中模态质量评估不准确和模态贡献分配不合理的问题。

Comments CVPR2026 Findings, 11 pages, 4 figures

Transformer-Driven Multimodal Fusion for Explainable Suspiciousness Estimation in Visual Surveillance

基于Transformer的多模态融合用于视觉监控中的可解释性可疑性估计

Kuldeep Singh Yadav, Lalan Kumar

机构 * Big Data Research and Supercomputing Division, CSIR Fourth Paradigm Institute（CSIR第四范式研究所大数据研究与超级计算部门） ； Department of Electrical Engineering, Bharti School of Telecommunication, Yardi School of Artificial Intelligence, IIT Delhi（电信学院电子工程系、Yardi人工智能学院、德里理工学院） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

AI总结 本文提出基于Transformer的多模态融合框架DeepUSEvision，结合YOLOv12、双深度卷积网络和Transformer判别器，实现高准确率和可解释性的可疑性估计。

Comments 12 pages, 10 figures, IEEE Transaction on Image Processing

Clinical Multi-modal Fusion with Heterogeneous Graph and Disease Correlation Learning for Multi-Disease Prediction

Yueheng Jiang, Peng Zhang

专题命中 融合架构与评测 ：multi-modal fusion(title)；分类 cs.MM

Towards personalized, precise and survey-free environment recognition: AI-enhanced sensor fusion without pre-deployment

Ruichen Wang, Zhikang Ni, Pengzhou Wang, Xiya Cao, Zhi Li, Bao Zhang

专题命中 融合架构与评测 ：sensor fusion(title)；分类 eess.SP

Comments 5 pages, 7 figures, conference

Graph-Based Uncertainty Modeling and Multimodal Fusion for Salient Object Detection

Yuqi Xiong, Wuzhen Shi, Yang Wen, Ruhan Liu

机构 * Guangdong Key Laboratory of Intelligent Information Processing（广东智能信息处理重点实验室） ； College of Electronics and Information Engineering（电子信息工程学院） ； Shenzhen University（深圳大学） ； Furong Laboratory（芙蓉实验室） ； Central South University（中南大学） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments ICONIP 2025

Multimodal Fusion with Semi-Supervised Learning Minimizes Annotation Quantity for Modeling Videoconference Conversation Experience

Andrew Chang, Chenkai Hu, Ji Qi, Zhuojian Wei, Kexin Zhang, Viswadruth Akkaraju, David Poeppel, Dustin Freeman

机构 * New York UniversityUSA（纽约大学） ； Max Planck SocietyGermany（马克斯·普朗克研究所） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.MM

Comments Interspeech 2025

MMFformer: Multimodal Fusion Transformer Network for Depression Detection

Md Rezwanul Haque, Md. Milon Islam, S M Taslim Uddin Raju, Hamdi Altaheri, Lobna Nassar, Fakhri Karray

机构 * Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of Waterloo（模式分析与机器智能中心，电气与计算机工程系，滑铁卢大学） ； School of Engineering and Computing, Department of Computer Science and Engineering, American University of Ras Al Khaimah（工程与计算学院，计算机科学与工程系，阿联酋拉线哈姆斯美国大学） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments Accepted for the 2025 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Vienna, Austria

HeLo: Heterogeneous Multi-Modal Fusion with Label Correlation for Emotion Distribution Learning

Chuhang Zheng, Chunwei Tian, Jie Wen, Daoqiang Zhang, Qi Zhu

机构 * College of Artificial Intelligence（人工智能学院） ； Nanjing University of Aeronautics and Astronautics（南京航空航天大学） ； School of Computer Science and Technology（计算机科学与技术学院） ； Harbin Institute of Technology（哈尔滨工业大学） ； Harbin Institute of Technology, Shenzhen（哈尔滨工业大学深圳分校） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(title)；分类 cs.MM

Dynamical Multimodal Fusion with Mixture-of-Experts for Localizations

Bohao Wang, Zitao Shuai, Fenghao Zhu, Chongwen Huang, Yongliang Shen, Zhaoyang Zhang, Qianqian Yang, Sami Muhaidat, Merouane Debbah

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 eess.SP

SIM-Net: A Multimodal Fusion Network Using Inferred 3D Object Shape Point Clouds from RGB Images for 2D Classification

Youcef Sklab, Hanane Ariouat, Eric Chenin, Edi Prifti, Jean-Daniel Zucker

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments 25 pages, 9 figures, 14 tables

Spatial frequency information fusion network for few-shot learning

Wenqing Zhao, Guojia Xie, Han Pan, Biao Yang, Weichuan Zhang

机构 * School of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology（电子信息与人工智能学院，陕西科技大学） ； Society of Entrepreneurs and Ecology (SEE) Foundation（创业者与生态协会（SEE）基金会） ； Key Laboratory of Southwest China Wildlife Resources Conservation (Ministry of Education)（西南中国野生动物资源保护重点实验室（教育部）） ； China West Normal University（西南大学） 纠错

专题命中 融合架构与评测 ：information fusion(title)；分类 cs.CV

Multimodal Fusion of Glucose Monitoring and Food Imagery for Caloric Content Prediction

Adarsh Kumar

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments The manuscript was submitted without proper consideration of institutional policies. Upon review with professor, it was found that the content is subject to licensing restrictions which prohibit public dissemination in its current form. Therefore, I am withdrawing the paper to comply with these requirements

Multi-Modal Fusion of In-Situ Video Data and Process Parameters for Online Forecasting of Cookie Drying Readiness

Shichen Li, Chenhui Shao

机构 * Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校机械科学与工程系） ； Department of Mechanical Engineering, University of Michigan（密歇根大学机械工程系） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(title)；分类 cs.CV

Comments 17 pages, 12 figures

Enhancing Sentiment Analysis through Multimodal Fusion: A BERT-DINOv2 Approach

Taoxu Zhao, Meisi Li, Kehao Chen, Liye Wang, Xucheng Zhou, Kunal Chaturvedi, Mukesh Prasad, Ali Anaissi, Ali Braytee

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments 12 pages

Training-Free Point Cloud Recognition Based on Geometric and Semantic Information Fusion

Yan Chen, Di Huang, Zhichao Liao, Xi Cheng, Xinghui Li, Long Zeng

专题命中 融合架构与评测 ：information fusion(title)；分类 cs.CV

MDA: An Interpretable and Scalable Multi-Modal Fusion under Missing Modalities and Intrinsic Noise Conditions

Lin Fan, Yafei Ou, Cenyang Zheng, Pengyu Dai, Tamotsu Kamishima, Masayuki Ikebe, Kenji Suzuki, Xun Gong

专题命中 融合架构与评测 ：multi-modal fusion(title)；分类 cs.CV

A Multimodal Fusion Network For Student Emotion Recognition Based on Transformer and Tensor Product

Ao Xiang, Zongqing Qi, Han Wang, Qin Yang, Danqing Ma

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

VMID: A Multimodal Fusion LLM Framework for Detecting and Identifying Misinformation of Short Videos

Weihao Zhong, Yinhao Xiao, Minghui Xu, Xiuzhen Cheng

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2211.10973 by other authors

Bistatic Information Fusion for Positioning and Tracking in Integrated Sensing and Communication

Maximilian Bauhofer, Marcus Henninger, Thorsten Wild, Stephan ten Brink, Silvio Mandelli

专题命中 融合架构与评测 ：information fusion(title)；分类 eess.SP

Comments 6 pages, 6 figures, 3 tables

Parkinson's Disease Classification Using Contrastive Graph Cross-View Learning with Multimodal Fusion of SPECT Images and Clinical Features

Jun-En Ding, Chien-Chin Hsu, Feng Liu

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

GAME-ON: Graph Attention Network based Multimodal Fusion for Fake News Detection

Mudit Dhawan, Shakshi Sharma, Aditya Kadam, Rajesh Sharma, Ponnurangam Kumaraguru

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.MM

Comments Accepted at SNAM 2024

Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space

Zhuyang Xie, Yan Yang, Jie Wang, Xiaorong Liu, Xiaofan Li

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments 14 pages, 9 figures, Accepted by IEEE Transactions on Circuits and Systems for Video Technology

Data-Efficient Multimodal Fusion on a Single GPU

Noël Vouitsis, Zhaoyan Liu, Satya Krishna Gorti, Valentin Villecroze, Jesse C. Cresswell, Guangwei Yu, Gabriel Loaiza-Ganem, Maksims Volkovs

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments CVPR 2024 (Highlight)

An Evolutionary Network Architecture Search Framework with Adaptive Multimodal Fusion for Hand Gesture Recognition

Yizhang Xia, Shihao Song, Zhanglu Hou, Junwen Xu, Juan Zou, Yuan Liu, Shengxiang Yang

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC

Bo Lin, Chuanbin Zhao, Feifei Gao, Geoffrey Ye Li

专题命中 融合架构与评测 ：multi-modal fusion(title)；分类 eess.SP

Multimodal Fusion Method with Spatiotemporal Sequences and Relationship Learning for Valence-Arousal Estimation

Jun Yu, Gongpeng Zhao, Yongqi Wang, Zhihong Wei, Yang Zheng, Zerui Zhang, Zhongpeng Cai, Guochen Xie, Jichao Zhu, Wangyuan Zhu

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments 8 pages,3 figures

Deep Multimodal Fusion for Surgical Feedback Classification

Rafal Kocielnik, Elyssa Y. Wong, Timothy N. Chu, Lydia Lin, De-An Huang, Jiayun Wang, Anima Anandkumar, Andrew J. Hung

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Journal ref Published in Proceedings of Machine Learning for Health 2024

MaxCorrMGNN: A Multi-Graph Neural Network Framework for Generalized Multimodal Fusion of Medical Data for Outcome Prediction

Niharika S. D'Souza, Hongzhi Wang, Andrea Giovannini, Antonio Foncubierta-Rodriguez, Kristen L. Beck, Orest Boyko, Tanveer Syeda-Mahmood

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 eess.SP

Comments To appear in ML4MHD workshop at ICML 2023

SFusion: Self-attention based N-to-One Multimodal Fusion Block

Zecheng Liu, Jia Wei, Rui Li, Jianlong Zhou

专题命中 融合架构与评测 ：multimodal fusion(title)；分类 cs.CV

Comments This paper has been accepted by MICCAI 2023