多模态信息融合

FusWay: Multimodal hybrid fusion approach. Application to Railway Defect Detection

Alexey Zhukov, Jenny Benois-Pineau, Amira Youssef, Akka Zemmari, Mohamed Mosbah, Virginie Taillandier

机构 * University Bordeaux, CNRS, Bordeaux INP, INRIA, LaBRI（波尔多大学、国家科学研究中心、波尔多国立理工学院、INRIA、LaBRI） ； SNCF, DIR TECHNOLOGIES INNOVATION ET PROJETS GROUPE, IR - DPISF TECH4RAIL - TLI（法国国家铁路公司、技术与项目集团、IR - DPISF TECH4RAIL - TLI） 纠错

专题命中 融合架构与评测 ：hybrid fusion(title)；multimodal fusion(abstract)；分类 cs.CV

MM-Gesture: Towards Precise Micro-Gesture Recognition through Multimodal Fusion

Jihao Gu, Fei Wang, Kun Li, Yanyan Wei, Zhiliang Wu, Dan Guo

机构 * University College London (UCL)（伦敦大学学院） ； School of Computer Science（计算机科学学院） ； Information Engineering, School of Artificial Intelligence, Hefei University of Technology (HFUT)（信息工程学院，人工智能学院，合肥工业大学） ； ReLER, CCAI, Zhejiang University, China（ReLER、CCAI、浙江大学，中国） ； Key Laboratory of Knowledge Engineering with Big Data (HFUT), Ministry of Education（大数据知识工程重点实验室（HFUT），教育部） ； Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, China（人工智能研究所，合肥综合性国家科学中心，中国） ； Xinsight Lab, Research Institute, Hefei Zhongjuyuan Intelligent Technology Co., Ltd., China（Xinsight实验室，研究院，合肥中睿智能科技有限公司，中国） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments 1st Place in Micro-gesture Classification sub-challenge in 3rd MiGA at IJCAI 2025

Multimodal Fusion via Hypergraph Autoencoder and Contrastive Learning for Emotion Recognition in Conversation

Zijian Yi, Ziming Zhao, Zhishu Shen, Tiehua Zhang

专题命中 融合架构与评测 ：multimodal fusion(title)；information fusion(abstract)；分类 cs.MM

Comments Accepted by ACM MULTIMEDIA 2024

A Multimodal Fusion Framework for Bridge Defect Detection with Cross-Verification

Ravi Datta Rachuri, Duoduo Liao, Samhita Sarikonda, Datha Vaishnavi Kondur

机构 * School of Computing George Mason University Fairfax, VA（计算学院乔治·马歇尔大学弗劳伊德堡） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Big Data 2024

Journal ref 2024 IEEE International Conference on Big Data (BigData)

Design and Evaluation of Deep Learning-Based Dual-Spectrum Image Fusion Methods

Beining Xu, Junxian Li

专题命中 融合架构与评测 ：image fusion(title)；visible-infrared(abstract)；分类 cs.CV

Comments 11 pages, 13 figures

A Multi-modal Fusion Network for Terrain Perception Based on Illumination Aware

Rui Wang, Shichun Yang, Yuyi Chen, Zhuoyang Li, Zexiang Tong, Jianyi Xu, Jiayi Lu, Xinjie Feng, Yaoguang Cao

机构 * Department of Transportation Science and Engineering, Beihang University（北京航空航天大学交通运输科学与工程学院） ； Innovation Center of New Energy Vehicle Digital Supervision Technology and Application for State Market Regulation（国家新能源汽车数字监管技术及应用创新中心） ； Hangzhou International Innovation Institute, Beihang University（杭州国际创新研究院） ； State Key Lab of Intelligent Transportation System, Beihang University（智能交通系统国家重点实验室） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.MM

A Transformer-based Multimodal Fusion Model for Efficient Crowd Counting Using Visual and Wireless Signals

Zhe Cui, Yuli Li, Le-Nam Tran

机构 * School of Electrical and Electronic Engineering, University College Dublin（都柏林大学电子与电气工程学院） ； College of Electrical Engineering and Automation, Shandong University of Science and Technology（山东科技大学电气工程与自动化学院） 纠错

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments This paper was accepted at IEEE WCNC 2025

Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perception

Philipp Wolters, Johannes Gilg, Torben Teepe, Fabian Herzog, Anouar Laouichi, Martin Hofmann, Gerhard Rigoll

专题命中 融合架构与评测 ：hybrid fusion(title,abstract)；分类 cs.CV

Comments Accepted to ICRA 2025

Mammo-Clustering: A Multi-views Tri-level Information Fusion Context Clustering Framework for Localization and Classification in Mammography

Shilong Yang, Chulong Zhang, Qi Zang, Juan Yu, Liang Zeng, Xiao Luo, Yexuan Xing, Xin Pan, Qi Li, Xiaokun Liang, Yaoqin Xie

专题命中 融合架构与评测 ：information fusion(title,abstract)；分类 cs.CV

Comments 10 pages, 6 figures

A Multimodal Fusion Model Leveraging MLP Mixer and Handcrafted Features-based Deep Learning Networks for Facial Palsy Detection

Heng Yim Nicole Oo, Min Hun Lee, Jeong Hoon Lim

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments PAKDD 2025. arXiv admin note: text overlap with arXiv:2405.16496

Exploring a Multimodal Fusion-based Deep Learning Network for Detecting Facial Palsy

Heng Yim Nicole Oo, Min Hun Lee, Jeong Hoon Lim

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments IJCAI 2024 4th AI for Ageless Aging Workshop (AIAA)

Multi-modal Fusion and Query Refinement Network for Video Moment Retrieval and Highlight Detection

Yifang Xu, Yunzhuo Sun, Benxiang Zhai, Zien Xie, Youyao Jia, Sidan Du

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV

Comments Accepted by ICME 2024

Hybrid Fusion for 802.11ax Wi-Fi-based Passive Radars Exploiting Beamforming Feedbacks

Martin Willame, Hasan Can Yildirim, Laurent Storrer, Francois Horlin, Jerome Louveaux

专题命中 融合架构与评测 ：hybrid fusion(title,abstract)；分类 eess.SP

Comments 5 pages, 3 figures, Accepted for SPAWC24

DecoratingFusion: A LiDAR-Camera Fusion Network with the Combination of Point-level and Feature-level Fusion

Zixuan Yin, Han Sun, Ningzhong Liu, Huiyu Zhou, Jiaquan Shen

专题命中 融合架构与评测 ：feature-level fusion(title,abstract)；分类 cs.CV

Comments 12 pages, 2 figures. accepted by ICANN2024

Revisiting Multimodal Fusion for 3D Anomaly Detection from an Architectural Perspective

Kaifang Long, Guoyang Xie, Lianbo Ma, Jiaqi Liu, Zhichao Lu

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

VR Based Emotion Recognition Using Deep Multimodal Fusion With Biosignals Across Multiple Anatomical Domains

Pubudu L. Indrasiri, Bipasha Kashyap, Chandima Kolambahewage, Bahareh Nakisa, Kiran Ijaz, Pubudu N. Pathirana

专题命中 融合架构与评测 ：multimodal fusion(title)；multi-modal fusion(abstract)；分类 eess.SP

Comments 14 pages, 6 figures

Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray Generation

Wenfang Yao, Chen Liu, Kejing Yin, William K. Cheung, Jing Qin

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments Accepted by NeurIPS-24

Multi-modal Fusion based Q-distribution Prediction for Controlled Nuclear Fusion

Shiao Wang, Yifeng Wang, Qingchuan Ma, Xiao Wang, Ning Yan, Qingquan Yang, Guosheng Xu, Jin Tang

专题命中 融合架构与评测 ：multi-modal fusion(title)；multimodal fusion(abstract)；分类 cs.CV

SHAP-CAT: A interpretable multi-modal framework enhancing WSI classification via virtual staining and shapley-value-based multimodal fusion

Jun Wang, Yu Mao, Nan Guan, Chun Jason Xue

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

MSMF: Multi-Scale Multi-Modal Fusion for Enhanced Stock Market Prediction

Jiahao Qin

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.MM

Comments 15 pages, 1 figures, 7 tables

Advancing Re-Ranking with Multimodal Fusion and Target-Oriented Auxiliary Tasks in E-Commerce Search

Enqiang Xu, Xinhui Li, Zhigong Zhou, Jiahao Ji, Jinyuan Zhao, Dadong Miao, Songlin Wang, Lin Liu, Sulong Xu

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

ERIT Lightweight Multimodal Dataset for Elderly Emotion Recognition and Multimodal Fusion Evaluation

Rita Frieske, Bertram E. Shi

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Benchmark Evaluation of Image Fusion algorithms for Smartphone Camera Capture

Lucas N. Kirsten

专题命中 融合架构与评测 ：image fusion(title,abstract)；分类 cs.CV

Comments Presented at the ICMLAI 2024, in Mendonza, Argentina

Journal ref International Journal on Recent and Innovation Trends in Computing and Communication; Vol. 11 No. 9 (2023)

Multimodal Fusion of Echocardiography and Electronic Health Records for the Detection of Cardiac Amyloidosis

Zishun Feng, Joseph A. Sivak, Ashok K. Krishnamurthy

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 eess.IV

Multimodal Fusion with Pre-Trained Model Features in Affective Behaviour Analysis In-the-wild

Zhuofan Wen, Fengyu Zhang, Siyuan Zhang, Haiyang Sun, Mingyu Xu, Licai Sun, Zheng Lian, Bin Liu, Jianhua Tao

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perception

Yiheng Li, Hongyang Li, Zehao Huang, Hong Chang, Naiyan Wang

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV

A Computer Vision Based Approach for Stalking Detection Using a CNN-LSTM-MLP Hybrid Fusion Model

Murad Hasan, Shahriar Iqbal, Md. Billal Hossain Faisal, Md. Musnad Hossin Neloy, Md. Tonmoy Kabir, Md. Tanzim Reza, Md. Golam Rabiul Alam, Md Zia Uddin

专题命中 融合架构与评测 ：hybrid fusion(title,abstract)；分类 cs.CV

Comments Under review for publication in the PLOS ONE journal, 17 pages, 9 figures

Video Quality Assessment with Texture Information Fusion for Streaming Applications

Vignesh V Menon, Prajit T Rajendran, Reza Farahani, Klaus Schoeffmann, Christian Timmerer

专题命中 融合架构与评测 ：information fusion(title,abstract)；分类 cs.MM

Comments 2024 Mile High Video (MHV)

Multi-view Distillation based on Multi-modal Fusion for Few-shot Action Recognition(CLIP-$\mathrm{M^2}$DF)

Fei Guo, YiKang Wang, Han Qi, WenPing Jin, Li Zhu

专题命中 融合架构与评测 ：multi-modal fusion(title,abstract)；分类 cs.CV

A Bi-Pyramid Multimodal Fusion Method for the Diagnosis of Bipolar Disorders

Guoxin Wang, Sheng Shi, Shan An, Fengmei Fan, Wenshu Ge, Qi Wang, Feng Yu, Zhiren Wang

专题命中 融合架构与评测 ：multimodal fusion(title,abstract)；分类 cs.CV

Comments Accepted by IEEE ICASSP 2024