多模态信息融合

Multi-focus Image Fusion: A Benchmark

Xingchen Zhang

专题命中 融合架构与评测 ：image fusion(title,abstract)；multi-focus(title,abstract)；分类 cs.CV、eess.IV

Comments 12 pages, 4 figures, 6 tables

Feature Entanglement-based Quantum Multimodal Fusion Neural Network

基于特征纠缠的量子多模态融合神经网络

Yu Wu, Qianli Zhou, Jie Geng, Xinyang Deng, Wen Jiang

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；feature-level fusion(abstract)；decision-level fusion(abstract)

AI总结 本文提出基于特征纠缠的量子多模态融合神经网络，通过量子计算框架解决多模态学习中的精度、可解释性和复杂性矛盾，实现高效且可解释的多模态融合。

The Classification Accuracy of Multiple-Metric Learning Algorithm on Multi-Sensor Fusion

Firouz Abdullah Al-Wassai, N. V. Kalyankar

专题命中 融合架构与评测 ：sensor fusion(title)；multi-sensor fusion(title)；分类 cs.CV

Comments This paper has been withdrawn by the author due to a crucial sign error in title the paper

Journal ref International Journal of Soft Computing and Engineering (IJSCE) ISSN: 2231-2307, Volume-3, Issue-4, September 2013,pp.124-131

Deep Multimodal Fusion Detection through Spatial Mask and Channel Fusion

基于空间掩码与通道融合的深度多模态融合检测

Guandi Wang, Ming Li, Yunsen Xing, Junle Liu

机构 * KTH Royal Institute of Technology（KTH皇家理工学院） ； University of Maryland, College Park（马里兰大学帕克分校） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；feature-level fusion(abstract)；分类 cs.CV、cs.MM

AI总结 本文针对现有多模态融合检测的过拟合问题，提出Attention-Driven Complementarity Resampling框架，通过语义掩码交换与可学习通道竞争实现跨模态目标检测的性能提升，在多数据集上取得了有竞争力的结果。

M2HF: Multi-level Multi-modal Hybrid Fusion for Text-Video Retrieval

Shuo Liu, Weize Quan, Ming Zhou, Sihong Chen, Jian Kang, Zhe Zhao, Chen Chen, Dong-Ming Yan

专题命中 融合架构与评测 ：hybrid fusion(title,abstract)；audio-visual fusion(abstract)；分类 cs.CV、cs.MM

Comments 1 1pages, 3 figures, 5 tables

WLC: Weber-Inspired Local Contrast Metric for Low-Altitude Image Fusion

TBC: 低空红外与可见图像融合中的目标-背景对比度度量

Cong Wang, Yufeng Xie

专题命中 融合架构与评测 ：image fusion(title,abstract)；infrared and visible(abstract)；分类 cs.CV

AI总结 本文提出TBC度量，通过关注目标与背景的相对对比度，解决传统度量在低光环境中的失效问题，提升无人机图像融合的鲁棒性和实时性。

Multi-Modal Fusion-Based Multi-Task Semantic Communication System

基于多模态融合的多任务语义通信系统

Zengle Zhu, Rongqing Zhang, Xiang Cheng, Liuqing Yang

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；information fusion(abstract)；分类 eess.SP

AI总结 本文提出基于多模态融合的多任务语义通信系统，利用BERT融合模块提升多模态信息处理效率，实验表明其在性能和通信开销上优于现有模型。

Application of Multimodal Fusion Deep Learning Model in Disease Recognition

Xiaoyi Liu, Hongjie Qiu, Muqing Li, Zhou Yu, Yutian Yang, Yafeng Yan

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；multi-modal fusion(abstract)；分类 cs.CV

Hybrid Multimodal Fusion for Humor Detection

Haojie Xu, Weifeng Liu, Jingwei Liu, Mingzheng Li, Yu Feng, Yasi Peng, Yunwei Shi, Xiao Sun, Meng Wang

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；hybrid fusion(abstract)；分类 cs.MM

Comments 7 pages, 1 figure, to appear in MuSe 2022 (ACM MM2022 co-located workshop)

Document Classification Pattern Recognition via Information Fusion: A Systematic Review of Multimodal and Multiview Representation Approaches

基于信息融合的文档分类模式识别：多模态与多视角表示方法的系统综述

Marcin Michał Mirończuk

机构 * National Information Processing Institute（国家信息处理研究所） 纠错

专题命中 融合架构与评测 ：information fusion(title,abstract)；multimodal fusion(abstract)

AI总结 本文通过系统综述和元分析，提出了统一框架，量化了多模态和多视角融合在文档分类中的性能提升，并揭示了方法学严谨性不足的问题。

Journal ref Information Fusion, 132, 2026, 104247

Characterisation of Density-based FM generation methods in the context of Information Fusion

信息融合背景下基于密度的模糊测度生成方法的表征

Yanhao Huang, Christian Wagner

专题命中 融合架构与评测 ：information fusion(title,abstract)；decision-level fusion(abstract)

AI总结 研究信息融合中基于密度的FM生成方法，指出常用方法不足以唯一确定离散FM，展示如何确定区间值FM及相关置信区间，通过实验表明基于此FM的Choquet FI输出可视为‘理想’融合结果置信区间，为表征FI融合结果提供新途径。

Multimodal Fusion and Interpretability in Human Activity Recognition: A Reproducible Framework for Sensor-Based Modeling

多模态融合与可解释性在人体活动识别中的应用：一种可复现的基于传感器建模框架

Yiyao Yang, Yasemin Gulbahar

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；hybrid fusion(abstract)

AI总结 本文提出了一种可复现的多模态融合框架，通过统一预处理和融合策略提升人体活动识别的准确性和可解释性。

Comments 33 pages, 12 figures, 4 tables

Multidomain Multimodal Fusion For Human Action Recognition Using Inertial Sensors

Zeeshan Ahmad, Naimul Khan

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV、eess.SP

Turing Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrieval

图灵模式用于多媒体：反应-扩散多模态融合用于语言引导的视频时刻检索

Xiang Fang, Wanlong Fang, Wei Ji, Tat-Seng Chua

机构 * Nanyang Technological University（南洋理工大学） ； National University of Singapore（新加坡国立大学） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(title)；multimodal fusion(abstract)；分类 cs.CV、cs.MM

AI总结 提出基于反应-扩散过程的多模态融合框架RDMF，通过模拟生物模式形成机制实现视频与文本的动态对齐，用于视频时刻检索与高亮检测。

Comments Published in ACM MM 2025. Address some typos

MultiFusionNet: Multilayer Multimodal Fusion of Deep Neural Networks for Chest X-Ray Image Classification

MultiFusionNet：多层多模态融合的深度神经网络用于胸部X光图像分类

Saurabh Agarwal, K. V. Arya, Yogesh Kumar Meena

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV

AI总结 MultiFusionNet通过多层多模态融合和FDSFM模块提升胸部X光图像分类的准确率，达到97.21%和99.60%

Comments 19 pages

InSight: AI Mobile Screening Tool for Multiple Eye Disease Detection using Multimodal Fusion

Ananya Raghu, Anisha Raghu, Alice S. Tang, Yannis M. Paulus, Tyson N. Kim, Tomiko T. Oskotsky

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV

Tile Classification Based Viewport Prediction with Multi-modal Fusion Transformer

Zhihao Zhang, Yiwei Chen, Weizhan Zhang, Caixia Yan, Qinghua Zheng, Qi Wang, Wangdu Chen

机构 * Xi'an Jiaotong University（西安交通大学） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV、cs.MM

Comments This paper is accepted by ACM-MM 2023

Dynamic Multimodal Fusion via Meta-Learning Towards Micro-Video Recommendation

Han Liu, Yinwei Wei, Fan Liu, Wenjie Wang, Liqiang Nie, Tat-Seng Chua

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、cs.MM

Comments This paper has been accepted by ACM Transactions on Information Systems

Multimodal Fusion and Coherence Modeling for Video Topic Segmentation

Hai Yu, Chong Deng, Qinglin Zhang, Jiaqing Liu, Qian Chen, Wen Wang

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV

DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency

Wenfang Yao, Kejing Yin, William K. Cheung, Jia Liu, Jing Qin

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV、eess.IV

Comments Accepted by AAAI-24

Design and Development of Laughter Recognition System Based on Multimodal Fusion and Deep Learning

Fuzheng Zhao, Yu Bai

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、cs.MM

Comments 7 pages,2 figures

Pay Less On Clinical Images: Asymmetric Multi-Modal Fusion Method For Efficient Multi-Label Skin Lesion Classification

Peng Tang, Tobias Lasser

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV、eess.IV

DSCENet: Dynamic Screening and Clinical-Enhanced Multimodal Fusion for MPNs Subtype Classification

Yuan Zhang, Yaolei Qi, Xiaoming Qi, Yongyue Wei, Guanyu Yang

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV

Comments Accepted by MICCAI2024

Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolution

Junxiong Lin, Yan Wang, Zeng Tao, Boyang Wang, Qing Zhao, Haorang Wang, Xuan Tong, Xinji Mai, Yuxuan Lin, Wei Song, Jiawen Yu, Shaoqi Yan, Wenqiang Zhang

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV、eess.IV

Deep Multimodal Fusion of Data with Heterogeneous Dimensionality via Projective Networks

José Morano, Guilherme Aresta, Christoph Grechenig, Ursula Schmidt-Erfurth, Hrvoje Bogunović

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV

Comments Accepted for publication in the IEEE Journal of Biomedical and Health Informatics (JBHI)

ELF: An End-to-end Local and Global Multimodal Fusion Framework for Glaucoma Grading

Wenyun Li, Chi-Man Pun

专题命中 融合架构与评测 ：multimodal fusion(title)；multi-modal fusion(abstract)；分类 cs.CV、eess.IV

TTMFN: Two-stream Transformer-based Multimodal Fusion Network for Survival Prediction

Ruiquan Ge, Xiangyang Hu, Rungen Huang, Gangyong Jia, Yaqi Wang, Renshu Gu, Changmiao Wang, Elazab Ahmed, Linyan Wang, Juan Ye, Ye Li

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、eess.IV

Self-MI: Efficient Multimodal Fusion via Self-Supervised Multi-Task Learning with Auxiliary Mutual Information Maximization

Cam-Van Thi Nguyen, Ngoc-Hoa Thi Nguyen, Duc-Trong Le, Quang-Thuy Ha

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted at The 37th Pacific Asia Conference on Language, Information and Computation (PACLIC 37)

Missing-modality Enabled Multi-modal Fusion Architecture for Medical Data

Muyu Wang, Shiyu Fan, Yichen Li, Hui Chen

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV、eess.IV

Deep Equilibrium Multimodal Fusion

Jinhong Ni, Yalong Bai, Wei Zhang, Ting Yao, Tao Mei

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV、cs.MM