多模态信息融合

UNIV: Unified Foundation Model for Infrared and Visible Modalities

UNIV：用于红外和可见模态的统一基础模型

Fangyuan Mao, Shuo Wang, Jilin Mei, Shun Lu, Chen Min, Fuyang Liu, Xiaokun Feng, Meiqi Wu, Yu Hu

机构 * Research Center for Intelligent Computing Systems, CAS ICT（智能计算系统研究所以及中国科学院信息科技研究院） ； University of Chinese Academy of Sciences（中国科学院大学） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） 纠错

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；visible-infrared(abstract)；分类 cs.CV

AI总结 UNIV通过跨模态对比学习提升红外与可见光感知的鲁棒性，解决模态偏差问题，实验显示在红外任务中表现优异。

CAWM-Mamba: A unified model for infrared-visible image fusion and compound adverse weather restoration

CAWM-Mamba：一种用于红外可见图像融合和复合恶劣天气恢复的统一模型

Huichun Liu, Xiaosong Li, Zhuangfan Huang, Tao Ye, Yang Liu, Haishu Tan

机构 * School of Physics（物理学院） ； Optoelectronic Engineering, Foshan University, Foshan 528225, China（光学电子工程学院，佛山大学，佛山528225，中国） ； Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, Foshan 528225, China（粤港澳联合智能微纳光电子技术实验室，佛山528225，中国） ； School of Mechanical Electronic（机械电子学院） ； Information Engineering, China University of Mining and Technology, Beijing 100083, China（信息工程学院，中国矿业大学，北京100083，中国） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；multimodal image fusion(abstract)；分类 cs.CV

AI总结 CAWM-Mamba提出了一种统一模型，用于红外可见图像融合和复合恶劣天气恢复，通过三个关键模块提升多退化场景下的性能。

X-ReID: Multi-granularity Information Interaction for Video-Based Visible-Infrared Person Re-Identification

X-ReID：基于视频的可见-红外人重识别中的多粒度信息交互

Chenyang Yu, Xuehu Liu, Pingping Zhang, Huchuan Lu

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；information fusion(abstract)；分类 cs.CV

AI总结 X-ReID通过多粒度信息交互和跨模态特征学习，提升视频中可见-红外人重识别的性能。

Comments Accepted by AAAI2026. More modifications may be performed

DDFusion:Degradation-Decoupled Fusion Framework for Robust Infrared and Visible Images Fusion

Tianpei Zhang, Jufeng Zhao, Yiming Zhu, Guangmang Cui, Yuxin Jing

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；image fusion(abstract)；分类 cs.CV

MAFS: Masked Autoencoder for Infrared-Visible Image Fusion and Semantic Segmentation

Liying Wang, Xiaoli Zhang, Chuanmin Jia, Siwei Ma

机构 * Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University（教育部符号计算与知识工程重点实验室，吉林大学） ； Wangxuan Institute of Computer Technology, Peking University（北京大学王轩计算机技术研究所） ； National Engineering Research Center of Visual Technology, School of Computer Science, Peking University（视觉技术国家工程研究中心，北京大学计算机科学学院） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；feature-level fusion(abstract)；分类 cs.CV

Comments Accepted by TIP 2025

Faster and Better: Reinforced Collaborative Distillation and Self-Learning for Infrared-Visible Image Fusion

Yuhao Wang, Lingjuan Miao, Zhiqiang Zhou, Yajun Qiao, Lei Zhang

机构 * Yuhao Wang, Lingjuan Miao, Zhiqiang Zhou, Yajun Qiao, Lei Zhang（作者） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；infrared and visible(abstract)；分类 cs.CV

S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion

Haolong Ma, Hui Li, Chunyang Cheng, Gaoang Wang, Xiaoning Song, Xiaojun Wu

机构 * Sino-UK Joint Laboratory on Artificial Intelligence of Ministry of Science and Technology（科技部中英联合人工智能实验室） ； International Joint Laboratory on Artificial Intelligence of Ministry of Education（教育部国际人工智能联合实验室） ； School of Artificial Intelligence and Computer Science（人工智能与计算机科学学院） ； College of Computer Science and Technology（计算机科学与技术学院） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；infrared and visible(abstract)；分类 cs.CV

Video-Level Language-Driven Video-Based Visible-Infrared Person Re-Identification

Shuang Li, Jiaxu Leng, Changjiang Kuang, Mingpi Tan, Xinbo Gao

机构 * School of Computer Science and Technology, Chongqing University of Posts and Telecommunications（重庆邮电大学计算机科学与技术学院） ； Chongqing Institute for Brain and Intelligence（重庆脑科学与智能技术研究院） ； Guangyang Bay Laboratory（广阳湾实验室） 纠错

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；infrared and visible(abstract)；分类 cs.CV

Comments Accepted by IEEE TIFS

A Semantic-Aware and Multi-Guided Network for Infrared-Visible Image Fusion

Xiaoli Zhang, Liying Wang, Libo Zhao, Xiongfei Li, Siwei Ma

机构 * Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University（教育部符号计算与知识工程重点实验室，吉林大学） ； Institute of Digital Media, School of Electronic Engineering and Computer Science, Peking University（数字媒体研究所，电子工程与计算机科学学院，北京大学） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；medical image fusion(abstract)；分类 cs.CV

Comments TMM 2026

Quaternion Infrared Visible Image Fusion

Weihua Yang, Yicong Zhou

机构 * University of Macau（澳门大学） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；infrared and visible(abstract)；分类 cs.CV

CoMoFusion: Fast and High-quality Fusion of Infrared and Visible Image with Consistency Model

Zhiming Meng, Hui Li, Zeyang Zhang, Zhongwei Shen, Yunlong Yu, Xiaoning Song, Xiaojun Wu

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；image fusion(abstract)；分类 cs.CV

Fusion of Infrared and Visible Images based on Spatial-Channel Attentional Mechanism

Qian Xu

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；image fusion(abstract)；分类 cs.CV

PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation

Zhu Liu, Jinyuan Liu, Benzhuang Zhang, Long Ma, Xin Fan, Risheng Liu

专题命中 红外-可见光融合 ：image fusion(title,abstract)；infrared and visible(abstract)；分类 cs.CV

Comments Accepted by ACM MM'2023;The source codes are available at https://github.com/LiuZhu-CV/PAIF

DePF: A Novel Fusion Approach based on Decomposition Pooling for Infrared and Visible Images

Hui Li, Yongbiao Xiao, Chunyang Cheng, Zhongwei Shen, Xiaoning Song

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；image fusion(abstract)；分类 cs.CV

Siamese Infrared and Visible Light Fusion Network for RGB-T Tracking

Peng Jingchao, Zhao Haitao, Hu Zhengwei, Zhuang Yi, Wang Bofan

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；feature-level fusion(abstract)；分类 cs.CV

LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images

Hui Li, Tianyang Xu, Xiao-Jun Wu, Jiwen Lu, Josef Kittler

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；image fusion(abstract)；分类 cs.CV

Comments 14 pages, 15 figures, 8 tables

Bayesian Fusion for Infrared and Visible Images

Zixiang Zhao, Shuang Xu, Chunxia Zhang, Junmin Liu, Jiangshe Zhang

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；image fusion(abstract)；分类 cs.CV

Combined Dictionary Unfolding Network with Gradient-Adaptive Fidelity for Transferable Multi-Source Fusion

结合字典展开网络与梯度自适应保真度的可迁移多源融合

Ge Luo, Jun-Jie Huang, Qi Yu, Tianrui Liu, Ke Liang, Yuming Xiang, Wentao Zhao, Xinwang Liu, Meng Wang

机构 * College of Computer Science and Technology, National University of Defense Technology（国防科技大学计算机科学与技术学院） ； College of Surveying and Geoinformatics, Tongji University（同济大学测绘与地理信息学院） ； School of Computer and Information, Hefei University of Technology（合肥工业大学计算机与信息学院） 纠错

专题命中 红外-可见光融合 ：image fusion(abstract)；infrared and visible(abstract)；multi-exposure(abstract)；medical image fusion(abstract)

AI总结 本文提出CDNet，通过结合字典学习的共同-特定表示先验，设计轻量级结构约束联合展开架构，提升多源图像融合效率与性能。

Robust Duality Learning for Unsupervised Visible-Infrared Person Re-Identification

Yongxiang Li, Yuan Sun, Yang Qin, Dezhong Peng, Xi Peng, Peng Hu

机构 * College of Computer Science, Sichuan University（四川大学计算机学院） 纠错

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；分类 cs.CV、cs.MM

Extended Cross-Modality United Learning for Unsupervised Visible-Infrared Person Re-identification

Ruixing Wu, Yiming Yang, Jiakai He, Haifeng Hu

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；分类 cs.CV、eess.IV

A Lightweight GAN-Based Image Fusion Algorithm for Visible and Infrared Images

Zhizhong Wu, Jiajing Chen, LiangHao Tan, Hao Gong, Zhou Yuru, Ge Shi

专题命中 红外-可见光融合 ：image fusion(title,abstract)；分类 cs.CV、eess.IV

Enhancing Visible-Infrared Person Re-identification with Modality- and Instance-aware Visual Prompt Learning

Ruiqi Wu, Bingliang Jiao, Wenxuan Wang, Meng Liu, Peng Wang

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；分类 cs.CV、cs.MM

Comments Accepyed by ACM International Conference on Multimedia Retrieval (ICMR'24)

Journal ref ICMR'24: Proceedings of the 2024 International Conference on Multimedia Retrieval (2024) 579 - 588

Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification

Hu Lu, Xuezhang Zou, Pingping Zhang

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；分类 cs.CV、cs.MM

Comments This work will appear in AAAI2023, including 8 figures and 6 tables. More improvements may be added

Near-infrared and visible-light periocular recognition with Gabor features using frequency-adaptive automatic eye detection

Fernando Alonso-Fernandez, Josef Bigun

专题命中 红外-可见光融合 ：infrared and visible(title,abstract)；分类 cs.CV、eess.IV

Comments Published at IET Biometrics

Deep Decomposition Network for Image Processing: A Case Study for Visible and Infrared Image Fusion

Yu Fu, Xiao-Jun Wu, Josef Kittler

专题命中 红外-可见光融合 ：image fusion(title,abstract)；分类 cs.CV、eess.IV

VIFB: A Visible and Infrared Image Fusion Benchmark

Xingchen Zhang, Ping Ye, Gang Xiao

专题命中 红外-可见光融合 ：image fusion(title,abstract)；分类 cs.CV、cs.MM

Comments 11 pages, 5 figures, 5 tables. Accepted to CVPRW2020. Compared to the CVPRW2020 version, this version corrects minor mistakes in Table 4 and the first paragraph of Section 4.2

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

P2Fusion：基于提示的双先验蒸馏红外-可见光图像渐进融合

Yi Shi, Huichao Xie, Yuqing Wang, Mingyu Wang, Kaihui Yang, Yu Liu, Ruitao Lu, Lizhe Li, Junwei Han, Dingwen Zhang

机构 * Northwestern Polytechnical University（西北工业大学） ； Hefei University of Technology（合肥工业大学） ； Rocket Force University of Engineering（火箭军工程大学） ； Chongqing University of Posts and Telecommunications（重庆邮电大学） 纠错

专题命中 红外-可见光融合 ：image fusion(title,abstract)；分类 cs.CV

AI总结 针对红外-可见光图像融合的信息差异挑战，提出基于双固有提示的P2Fusion框架，结合Teach-to-Fuse机制与GDER模块，在多数据集上实现SOTA性能并提升下游感知鲁棒性。

Comments Accepted by ECCV 2026. Website: https://p2fusion.github.io

Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration

缓解严重跨模态错位：通过显式特征域仿射配准实现端到端可见光-红外目标检测

Qi Ming, Yuyang Wang, Mingjing Zhao, Yifan Xiao, Zhixin Guo, Zhiqiang Zhou, Peng Sun, Juan Fang, Fuqiang Yang, Xudong Zhao

机构 * Beijing University of Technology（北京工业大学） ； Central South University（中南大学） ； Beijing Electronics Science & Technology Institute（北京电子科学技术研究所） ； China Aerospace Science & Industry Corporation（中国航天科技集团） ； Beijing Institute of Technology（北京理工大学） ； Information Support Force Engineering University（信息支援部队工程大学） ； Trunk Technology (Beijing) Co., Ltd.（trunk技术（北京）有限公司） 纠错

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；分类 cs.CV

AI总结 针对可见光-红外目标检测的严重跨模态错位问题，提出JFRDet网络，含CMAA、IGCF、AQCG模块，构建DVMA基准，在该基准上达到69.7% mAP₅₀的SOTA性能。

Ranking Image Fusion the Way Humans Do: A Learned Pairwise Preference Measure for Infrared-Visible Fusion Assessment

以人类方式进行图像融合排序：用于红外-可见光融合评估的学习型成对偏好度量

Haoran Liu, Mingzhe Liu, Peng Li, Guibin Zan

专题命中 红外-可见光融合 ：image fusion(title,abstract)；分类 cs.CV

AI总结 针对红外-可见光图像融合缺乏理想参考、成对比较成本高的问题，提出LPIFM模型，利用新偏好语料库训练，可准确复现人类成对判断，性能优于传统度量，还公开了相关数据集与代码。

Comments 23 pages, 8 figures

MEC-Patch: Visible-Infrared Cross-Modal Adversarial Attack Driven by Intrinsic Material Emissivity Laws

MEC-Patch：基于本征材料发射率定律的可见-红外跨模态对抗攻击

Zhixiang Huang, Xinbo Nie, Wenxuan Wang, Lu Yang, Xin Li, Xuelin Qian, Peng Wang

专题命中 红外-可见光融合 ：visible-infrared(title,abstract)；分类 cs.MM

AI总结 本文提出基于斯特藩-玻尔兹曼定律的MEC-Patch跨模态对抗攻击框架，结合NSGA-II与DAR策略，可欺骗多模态检测器并提升环境鲁棒性，为多模态感知系统安全评估提供新思路。

Comments Accepted by the 34th ACM International Conference on Multimedia (MM '26). Includes supplementary material