多模态信息融合

Multimodal Medical Image Classification via Synergistic Learning Pre-training

Qinghua Lin, Guang-Hai Liu, Zuoyong Li, Yang Li, Yuting Jiang, Xiang Wu

机构 * College of Biomedical Engineering, Fudan University（复旦大学生物医学工程学院） ； College of Computer Science and Engineering, Guangxi Normal University（广西师范大学计算机科学与工程学院） ； Fujian Provincial Key Laboratory of Information Processing and Intelligent Control, School of Computer and Big Data, Minjiang University（福建省信息处理与智能控制重点实验室，闽江学院计算机与大数据学院） ； Department of Automation Science and Electrical Engineering, Beihang University（北京航空航天大学自动化科学与电气工程学院） ； Department of Digestive Endoscopy, Fuzhou University Affiliated Provincial Hospital, Provincial Clinical Medical College of Fujian Medical University（福州市大学附属省医院消化内镜科，福建医科大学省临床医学学院） ； Department of Urology, Fuzhou University Affiliated Provincial Hospital, Provincial Clinical Medical College of Fujian Medical University（福州市大学附属省医院泌尿科，福建医科大学省临床医学学院） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Multimodal Hate Detection Using Dual-Stream Graph Neural Networks

Jiangbei Yue, Shuonan Yang, Tailin Chen, Jianbo Jiao, Zeyu Fu

机构 * Multimodal Intelligence Lab, Department of Computer Science University of Exeter Exeter, UK（埃克塞特大学计算机科学系多模态智能实验室） ； School of Computer Science University of Birmingham Birmingham, UK（伯明翰大学计算机科学学院） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

MMMS: Multi-Modal Multi-Surface Interactive Segmentation

Robin Schön, Julian Lorenz, Katja Ludwig, Daniel Kienzle, Rainer Lienhart

机构 * Fakultät für Angewandte Informatik University of Augsburg（应用信息学院乌尔姆大学） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Comments 19 pages, 11 figures, 10 pages

Parse Graph-Based Visual-Language Interaction for Human Pose Estimation

Shibang Liu, Xuemei Xie, Guangming Shi

机构 * Shibang Liu ； Xuemei Xie ； Guangming Shi 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Surformer v2: A Multimodal Classifier for Surface Understanding from Touch and Vision

Manish Kansana, Sindhuja Penchala, Shahram Rahimi, Noorbakhsh Amiri Golilarz

机构 * Department of Computer Science（计算机科学系） ； Engineering Mississippi State University Mississippi State, USA（工程学硕士州大学密西西比州） ； Department of Computer Science The University of Alabama Tuscaloosa, USA（计算机科学系阿拉巴马大学塔斯卡洛osa） 纠错

专题命中 融合架构与评测 ：decision-level fusion(abstract)；分类 cs.RO

Comments 6 pages

DVS-PedX: Synthetic-and-Real Event-Based Pedestrian Dataset

Mustafa Sakhai, Kaung Sithu, Min Khant Soe Oke, Maciej Wielgosz

机构 * Faculty of Computer Science, Electronics and Telecommunications（计算机科学与电子技术学院） ； AGH University of Science and Technology（AGH科技大学） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments 12 pages, 8 figures, 3 tables; dataset descriptor paper introducing DVS-PedX (synthetic-and-real event-based pedestrian dataset with baselines) External URL: https://doi.org/10.5281/zenodo.17030898

Scalable and Loosely-Coupled Multimodal Deep Learning for Breast Cancer Subtyping

Mohammed Amer, Mohamed A. Suliman, Tu Bui, Nuria Garcia, Serban Georgescu

机构 * Fujitsu Research of Europe Ltd（富士通欧洲研究有限公司） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Uninformed-to-Informed Estimation: A Ping-Pong Positioning Method for Multi-user Wideband mmWave Systems

Lin Guo, Tiejun Lv, Yashuai Cao, Mugen Peng

专题命中 融合架构与评测 ：information fusion(abstract)；分类 eess.SP

Comments 16 pages, 13 figures, Accepted by IEEE Transactions on Communications

ARTPS: Depth-Enhanced Hybrid Anomaly Detection and Learnable Curiosity Score for Autonomous Rover Target Prioritization

Poyraz Baydemir

专题命中 融合架构与评测 ：hybrid fusion(abstract)；分类 cs.CV

Comments 18 pages, 12 figures, 4 table, autonomous exploration, Mars rover, computer vision, anomaly detection, depth estimation, curiosity-driven exploration

DiffS-NOCS: 3D Point Cloud Reconstruction through Coloring Sketches to NOCS Maps Using Diffusion Models

Di Kong, Qianhui Wan

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； Tsinghua University（清华大学） ； Zhongguancun Academy（中关村学院） ； Beijing Normal University（北京师范大学） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Training-free Dimensionality Reduction via Feature Truncation: Enhancing Efficiency in Privacy-preserving Multi-Biometric Systems

Florian Bayer, Maximilian Russo, Christian Rathgeb

机构 * Hochschule Darmstadt（达姆斯塔特应用技术大学） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences

Jieyu Li, Xin Zhang, Joey Tianyi Zhou

机构 * National University of Singapore（新加坡国立大学） ； Agency for Science, Technology and Research（科技研究局） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments Proceedings of the 33rd ACM International Conference on Multimedia

CellSymphony: Deciphering the molecular and phenotypic orchestration of cells with single-cell pathomics

Paul H. Acosta, Pingjun Chen, Simon P. Castillo, Maria Esther Salvatierra, Yinyin Yuan, Xiaoxi Pan

机构 * Translational Molecular Pathology Department, Division of Pathology and Laboratory Medicine, The University of Texas MD Anderson Cancer Center（德克萨斯大学MD安德森癌症中心转化分子病理学部门） ； Institute for Data Science in Oncology, The University of Texas MD Anderson Cancer Center（德克萨斯大学MD安德森癌症中心肿瘤数据科学研究所） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Alignment-free Raw Video Demoireing

Shuning Xu, Xina Liu, Binbin Song, Xiangyu Chen, Qiubo Chen, Jiantao Zhou

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

MoDA: Multi-modal Diffusion Architecture for Talking Head Generation

Xinyang Li, Gen Li, Zhihui Lin, Yichen Qian, GongXin Yao, Weinan Jia, Aowen Wang, Weihua Chen, Fan Wang

机构 * Xunguang Team, DAMO Academy, Alibaba Group（达摩院、阿里集团） ； Zhejiang University（浙江大学） ； Hupan Lab（虎盘实验室） 纠错

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments 12 pages, 7 figures

Automatic Fused Multimodal Deep Learning for Plant Identification

Alfreds Lapkovskis, Natalia Nefedova, Ali Beikmohammadi

机构 * Department of Computer and Systems Sciences（计算机与系统科学系） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Journal ref Front. Plant Sci., 05 August 2025

Beyond Images: Adaptive Fusion of Visual and Textual Data for Food Classification

Prateek Mittal, Puneet Goyal, Joohi Chauhan

机构 * Motilal Nehru National Institute of Technology Allahabad, India（Motilal Nehru国立技术学院Allahabad分校） ； Indian Institute of Technology Ropar, India（印度理工学院Ropar分校） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Multiple Time Series Fusion Based on LSTM An Application to CAP A Phase Classification Using EEG

Fábio Mendonça, Sheikh Shanawaz Mostafa, Diogo Freitas, Fernando Morgado-Dias, Antonio G. Ravelo-García

专题命中 融合架构与评测 ：information fusion(abstract)；分类 eess.SP

Comments 47 pages, 7 figures, 4 tables, for journal publication

Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator

Ronglai Zuo, Rolandos Alexandros Potamias, Evangelos Ververas, Jiankang Deng, Stefanos Zafeiriou

机构 * Imperial College London（伦敦帝国学院） 纠错

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments Accepted by ICCV 2025

ATR-UMMIM: A Benchmark Dataset for UAV-Based Multimodal Image Registration under Complex Imaging Conditions

Kangcheng Bin, Chen Chen, Ting Hu, Jiahao Qi, Ping Zhong

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Benchmarking Graph Neural Networks for Document Layout Analysis in Public Affairs

Miguel Lopez-Duran, Julian Fierrez, Aythami Morales, Ruben Tolosana, Oscar Delgado-Mohatar, Alvaro Ortigosa

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments 15 pages, 2 figures, accepted paper at The Fifth ICDAR International Workshop on Machine Learning

InceptionMamba: An Efficient Hybrid Network with Large Band Convolution and Bottleneck Mamba

Yuhang Wang, Jun Li, Zhijian Wu, Jifeng Shen, Jianhua Xu, Wankou Yang

机构 * School of Computer and Electronic Information, Nanjing Normal University, Nanjing, China（计算机与电子信息学院，南京师范大学，南京，中国） ； Medical Artificial Intelligence Lab, Westlake University, Zhejiang, China（医学人工智能实验室，西湖大学，浙江，中国） ； School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, China（电气与信息工程学院，江苏大学，镇江，中国） ； School of Automation, Southeast University, Nanjing, China（自动化学院，东南大学，南京，中国） 纠错

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

MultiRetNet: A Multimodal Vision Model and Deferral System for Staging Diabetic Retinopathy

Jeannie She, Katie Spivakovsky

机构 * MIT（麻省理工学院） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

GRAM-MAMBA: Holistic Feature Alignment for Wireless Perception with Adaptive Low-Rank Compensation

Weiqi Yang, Xu Zhou, Jingfu Guan, Hao Du, Tianyu Bai

机构 * Hefei University of Technology（合肥工业大学） ； Sun Yat-sen University（中山大学） ； Jilin University（吉林大学） ； Durham University（杜伦大学） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

SP$^2$T: Sparse Proxy Attention for Dual-stream Point Transformer

Jiaxu Wan, Hong Zhang, Ziqi He, Yangyan Deng, Qishu Wang, Ding Yuan, Yifan Yang

机构 * School of Aerospace, BUAA（航空学院） ； School of Artificial Intelligence, BUAA（人工智能学院） ； School of Electronics and Information Engineering, BUAA（电子与信息工程学院） 纠错

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments Accept by ICCV2025

FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Images

Guang Yang

机构 * University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV

Differential Attention for Multimodal Crisis Event Analysis

Nusrat Munia, Junfeng Zhu, Olfa Nasraoui, Abdullah-Al-Zubaer Imran

机构 * University of Kentucky（肯塔基大学） ； Kentucky Geological Survey（肯塔基地质调查局） ； University of Louisville（路易斯维尔大学） 纠错

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV

Comments Presented at CVPRw 2025, MMFM3

MRC-DETR: An Adaptive Multi-Residual Coupled Transformer for Bare Board PCB Defect Detection

Jiangzhong Cao, Huanqi Wu, Xu Zhang, Lianghong Tan, Huan Zhang

机构 * School of Information Engineering, Guangdong University of Technology（广东科技大學信息工程學院） ； School of Computer Science, Wuhan University（武漢大學計算機科學學院） 纠错

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Cooperative Sensing in Cell-free Massive MIMO ISAC Systems: Performance Optimization and Signal Processing

Haotian Liu, Zhiqing Wei, Luyang Sun, Ruizhong Xu, Yixin Zhang, Zhiyong Feng

专题命中 融合架构与评测 ：information fusion(abstract)；分类 eess.SP

Comments 13 pages, 10 figures

Event Data Association via Robust Model Fitting for Event-based Object Tracking

Haosheng Chen, Yue Wu, Yidong Peng

机构 * Chongqing University of Posts and Telecommunications（重庆邮电大学） 纠错

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV

Comments 32 pages, 7 figures