多模态信息融合 - arXivDaily 专题

2506.13733 2025-09-17 eess.IV eess.SP 62%

Robust Recursive Fusion of Multiresolution Multispectral Images with Location-Aware Neural Networks

Haoqing Li, Ricardo Borsoi, Tales Imbiriba, Pau Closas

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 eess.IV、eess.SP

2505.24605 2025-06-02 eess.IV cs.CV 62%

Model-Guided Network with Cluster-Based Operators for Spatio-Spectral Super-Resolution

Ivan Pereira-Sánchez, Julia Navarro, Ana Belén Petro, Joan Duran

机构 * Institute of Applied Computing and Community Code (IAC3)（应用计算与社区代码研究所）； Dept. of Mathematics and Computer Science, Universitat de les Illes Balears（数学与计算机科学系，巴利阿里大学）

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 cs.CV、eess.IV

2501.07953 2025-01-15 cs.CV eess.IV 62%

Robust Hyperspectral Image Panshapring via Sparse Spatial-Spectral Representation

Chia-Ming Lee, Yu-Fan Lin, Li-Wei Kang, Chih-Chung Hsu

专题命中遥感融合与全色锐化：pansharpening(abstract)；分类 cs.CV、eess.IV

Comments Submitted to IGARSS 2025

2412.03893 2024-12-06 eess.IV cs.AI cs.CV 62%

Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification

Zhu Han, Jin Yang, Lianru Gao, Zhiqiang Zeng, Bing Zhang, Jocelyn Chanussot

专题命中遥感融合与全色锐化：information fusion(abstract)；分类 cs.CV、eess.IV

2403.09327 2024-11-21 cs.CV eess.IV 62%

Perspective-Equivariance for Unsupervised Imaging with Camera Geometry

Andrew Wang, Mike Davies

专题命中遥感融合与全色锐化：pansharpening(abstract)；分类 cs.CV、eess.IV

Comments ECCV camera-ready

2409.09670 2024-09-20 cs.CV eess.IV 62%

Unsupervised Hyperspectral and Multispectral Image Blind Fusion Based on Deep Tucker Decomposition Network with Spatial-Spectral Manifold Learning

He Wang, Yang Xu, Zebin Wu, Zhihui Wei

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted by TNNLS 2024 Some errors has been corrected

2109.00400 2024-05-15 eess.IV cs.CV 62%

An Integrated Framework for the Heterogeneous Spatio-Spectral-Temporal Fusion of Remote Sensing Images

Menghui Jiang, Huanfeng Shen, Jie Li, Liangpei Zhang

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 cs.CV、eess.IV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-15, 2022

2108.06073 2024-05-15 eess.IV cs.CV 62%

Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusion

Huanfeng Shen, Menghui Jiang, Jie Li, Chenxia Zhou, Qiangqiang Yuan, Liangpei Zhang

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 cs.CV、eess.IV

Journal ref IEEE Geoscience and Remote Sensing Magazine, vol. 10, no. 2, pp. 231-249, June 2022

2301.11154 2023-11-06 cs.CV eess.IV 62%

Multitemporal and multispectral data fusion for super-resolution of Sentinel-2 images

Tomasz Tarasiewicz, Jakub Nalepa, Reuben A. Farrugia, Gianluca Valentino, Mang Chen, Johann A. Briffa, Michal Kawulok

专题命中遥感融合与全色锐化：information fusion(abstract)；分类 cs.CV、eess.IV

Comments Submitted to IEEE Transactions On Geoscience And Remote Sensing

2309.00005 2023-09-04 cs.CV cs.LG eess.IV 62%

High Spectral Spatial Resolution Synthetic HyperSpectral Dataset form multi-source fusion

Yajie Sun, Ali Zia, Jun Zhou

专题命中遥感融合与全色锐化：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments IJCNN workshop on Multimodal Synthetic Data for Deep Neural Networks (MSynD), 2023

2307.03413 2023-07-10 cs.CV eess.IV 62%

Unsupervised Hyperspectral and Multispectral Images Fusion Based on the Cycle Consistency

Shuaikai Shi, Lijun Zhang, Yoann Altmann, Jie Chen

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 cs.CV、eess.IV

2107.09092 2022-11-30 cs.CV eess.IV 62%

Learning a Joint Embedding of Multiple Satellite Sensors: A Case Study for Lake Ice Monitoring

Manu Tom, Yuchang Jiang, Emmanuel Baltsavias, Konrad Schindler

专题命中遥感融合与全色锐化：sensor fusion(abstract)；分类 cs.CV、eess.IV

Journal ref IEEE Transactions on Geoscience and Remote Sensing 2022

2102.11228 2022-04-05 eess.IV cs.CV 62%

Subspace-Based Feature Fusion From Hyperspectral And Multispectral Image For Land Cover Classification

Juan Ramírez, Héctor Vargas, José Ignacio Martínez, Henry Arguello

专题命中遥感融合与全色锐化：image fusion(abstract)；分类 cs.CV、eess.IV

Comments 4 pages, 2 figures, 1 table, and 2 algorithms. Submitted to the International Geoscience and Remote Sensing Symposium (2021)

2203.04960 2022-03-11 eess.IV cs.CV 62%

Memory-augmented Deep Unfolding Network for Guided Image Super-resolution

Man Zhou, Keyu Yan, Jinshan Pan, Wenqi Ren, Qi Xie, Xiangyong Cao

专题命中遥感融合与全色锐化：pan-sharpening(abstract)；分类 cs.CV、eess.IV

Comments 24 pages, 16 figures

2112.02237 2021-12-07 cs.CV eess.IV 62%

A Triple-Double Convolutional Neural Network for Panchromatic Sharpening

Tian-Jing Zhang, Liang-Jian Deng, Ting-Zhu Huang, Jocelyn Chanussot, Gemine Vivone

专题命中遥感融合与全色锐化：pansharpening(abstract)；分类 cs.CV、eess.IV

2105.02400 2021-05-07 cs.CV eess.IV 62%

SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery

Jaehyup Lee, Soomin Seo, Munchurl Kim

专题命中遥感融合与全色锐化：pan-sharpening(abstract)；分类 cs.CV、eess.IV

Comments Accepted to CVPR 2021

2104.07791 2021-04-19 cs.CV cs.LG eess.IV 62%

Learning User's confidence for active learning

Devis Tuia, Jordi Munoz-Mari

专题命中遥感融合与全色锐化：pansharpening(abstract)；分类 cs.CV、eess.IV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, 51(2): 872 - 880, 2013

2103.12547 2021-03-24 eess.IV cs.CV cs.LG 62%

A new public Alsat-2B dataset for single-image super-resolution

Achraf Djerida, Khelifa Djerriri, Moussa Sofiane Karoui, Mohammed El Amin larabi

专题命中遥感融合与全色锐化：pan-sharpening(abstract)；分类 cs.CV、eess.IV

Comments This paper has been Accepted for publication in the International Geoscience and Remote Sensing Symposium (IGARSS 2021)

2102.06260 2021-02-15 cs.CV cs.LG eess.IV 62%

Towards DeepSentinel: An extensible corpus of labelled Sentinel-1 and -2 imagery and a general-purpose sensor-fusion semantic embedding model

Lucas Kruitwagen

专题命中遥感融合与全色锐化：sensor fusion(abstract)；分类 cs.CV、eess.IV

Comments Proposal presented at NeurIPS 2020 Climate Change AI Workshop and ESA Phi-Week. Copernicus Masters finalist. 14 pages; 4 figures

2002.00580 2020-08-11 eess.IV cs.CV 62%

Super-resolution of multispectral satellite images using convolutional neural networks

M. U. Müller, N. Ekhtiari, R. M. Almeida, C. Rieke

专题命中遥感融合与全色锐化：pan-sharpening(abstract)；分类 cs.CV、eess.IV

Comments To be published in the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences: https://www.isprs.org/publications/annals.aspx, proceedings of the XXIV ISPRS Congress, 14-20 June 2020, Nice, France

Journal ref ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., V-1-2020, 33-40

2007.05996 2020-07-14 cs.CV eess.IV physics.ao-ph 62%

Differentiable Programming for Hyperspectral Unmixing using a Physics-based Dispersion Model

John Janiczek, Parth Thaker, Gautam Dasarathy, Christopher S. Edwards, Philip Christensen, Suren Jayasuriya

专题命中遥感融合与全色锐化：infrared and visible(abstract)；分类 cs.CV、eess.IV

Comments 36 pages, 11 figures. Accepted to European Conference on Computer Vision (ECCV) 2020

2606.26416 2026-06-26 cs.CV 新提交 57%

Methane-Plume Segmentation From Hyperspectral Satellite Imagery Via Multimodal Deep Learning

基于多模态深度学习的高光谱卫星图像甲烷羽流分割

Brayan Quintero, Jeferson Acevedo, Samuel Traslaviña, Hoover Rueda-Chacón

机构 * Department of Computer Science, Universidad Industrial de Santander（计算机科学系，圣安德烈斯工业大学）

专题命中遥感融合与全色锐化：multimodal fusion(abstract)；分类 cs.CV

AI总结提出一种多模态深度学习模型，集成特征引导的甲烷增强机制，在MPDataset上取得优于现有方法的性能，实现高精度与高效率的甲烷羽流分割。

Comments Accepted at IEEE International Geoscience and Remote Sensing Symposium (IGARSS) 2026

2606.09347 2026-06-11 cs.CV 版本更新 57%

IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal

IB-HFN: 信息瓶颈驱动的SAR-光学融合网络用于高保真云去除

Haojun Guo, Fan Feng, Ziquan Wang, Yongsheng Zhang, Ying Yu

机构 * Institute of Geospatial Information, Information Engineering University（测绘信息研究院，信息工程大学）

专题命中遥感融合与全色锐化：multimodal fusion(abstract)；分类 cs.CV

AI总结提出IB-HFN网络，通过双流骨干、空间信息瓶颈融合模块和联合优化策略，抑制SAR散斑噪声并保留光学细节，实现高保真云去除。

2605.24532 2026-05-26 cs.CV 57%

Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation

图像条件实例提示网络用于遥感图像指代分割

Biaoyu Ren, Qingsheng Wang, Cun Xu, Dingkang Yang, Wenxuan Wang

机构 * School of Computer Science, Northwestern Polytechnical University, Xi'an, China（西北工业大学计算机科学学院，西安，中国）； College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, China（复旦大学智能机器人与先进制造学院，上海，中国）； Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen, China（西北工业大学深圳研究院，深圳，中国）

专题命中遥感融合与全色锐化：information fusion(abstract)；分类 cs.CV

AI总结提出图像条件实例提示网络（ICIPNet），通过自适应视觉语义表示和双边信息融合模块，缓解跨模态特征融合瓶颈，提升遥感图像指代分割性能。

Comments 6 pages, 3 figures. Equal contribution: Biaoyu Ren and Qingsheng Wang. Corresponding authors: Dingkang Yang and Wenxuan Wang

2605.24014 2026-05-26 cs.CV 57%

SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild

SkySeg: 野外异构无人机协同机载语义分割

Anqi Lu, Yun Cheng, Youbing Hu, Zhiqiang Cao, Jie Liu, Zhijun Li

机构 * Harbin Institute of Technology（哈尔滨工业大学）； ETH Zurich（苏黎世联邦理工学院）； Huawei Cloud Algorithm Innovation Lab（华为云算法创新实验室）

专题命中遥感融合与全色锐化：information fusion(abstract)；分类 cs.CV

AI总结针对资源受限无人机在动态环境中实时语义分割的挑战，提出SkySeg异构多无人机空-空协作框架，结合高效信息融合推理与跨设备测试时自适应策略，实现低成本传感器下的机载分割，加速约3.6倍并提升精度5.91%。

2605.21075 2026-05-21 cs.CV cs.LG 57%

SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining

SpectralEarth-FM: 将高光谱图像引入多模态地球观测预训练

Nassim Ait Ali Braham, Aaron Banze, Conrad M. Albrecht, Julien Mairal, Jocelyn Chanussot, Xiao Xiang Zhu

机构 * Chair of Data Science in Earth Observation（地球观测数据科学主任）； Technical University of Munich（慕尼黑技术大学）； Remote Sensing Technology Institute（遥感技术研究所）； German Aerospace Center (DLR)（德国航空航天中心）； Department of Aerospace Engineering（航空航天工程系）； University of the Bundeswehr Munich（联邦国防军慕尼黑大学）； LEAP ； Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）； Univ. Grenoble Alpes（格勒诺布尔阿尔卑斯大学）； Inria（法国国家信息与自动化技术研究院）； CNRS（法国国家科学研究中心）； Grenoble INP（格勒诺布尔INP）； LJK

专题命中遥感融合与全色锐化：sensor fusion(abstract)；分类 cs.CV

AI总结本文提出SpectralEarth-FM，一种用于多传感器地球观测输入的分层变压器，旨在联合处理高光谱图像与低通道观测。通过构建SpectralEarth-MM数据集，采用JEPA风格的目标进行预训练，实现了在高光谱下游任务和标准EO基准上的最佳性能。

2605.13621 2026-05-14 cs.CV 57%

WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning

WD-FQDet：通过小波分解和频率感知查询学习的多光谱检测变换器

Chunjin Yang, Xiwei Zhang, Yiming Xiao, Fanman Meng

机构 * University of Electronic Science and Technology of China（电子科学与技术大学）

专题命中遥感融合与全色锐化：infrared and visible(abstract)；分类 cs.CV

AI总结本文提出WD-FQDet框架，通过小波分解和频率感知查询学习分离红外与可见光的共性与专用特征，提升多光谱目标检测性能。

2605.10769 2026-05-12 cs.CV cs.AI 57%

MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation

MPerS: 动态多模态大语言模型混合专家感知引导的遥感场景分割

Ziyi Wang, Xianping Ma, Ziyao Wang, Hongyang Zhang, Man On Pun

机构 * The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））； Southwest Jiaotong University（西南交通大学）

专题命中遥感融合与全色锐化：multimodal fusion(abstract)；分类 cs.CV

AI总结本文提出MPerS方法，通过设计多提示生成高质量遥感描述，结合DINOv3提取视觉特征，利用动态混合专家模块和语言查询引导注意力实现精准分割。

Comments Accepted to CVPR 2026 Findings. 11 pages, 6 figures

2605.00156 2026-05-04 cs.MM cs.CR 57%

RoboKA: KAN Informed Multimodal Learning for RoboCall Surveillance System

RoboKA：基于KAN的多模态学习用于RoboCall监控系统

Nitin Choudhury, Nikhil Kumar, Aditya Kumar Sinha, Abhijeet Anand, Hossein Salemi, Orchid Chetia Phukan, Hemant Purohit, Arun Balaji Buduru

专题命中遥感融合与全色锐化：multimodal fusion(abstract)；分类 cs.MM

AI总结本文提出RoboKA，一种基于KAN的多模态融合框架，用于建模音频和语言线索之间的非线性交互，以提高RoboCall监控的召回率和F1分数。

Comments Accepted to the International Conference on Multimedia & Expo (ICME) 2026, 7th International Workshop on Surveillance Data Processing

2604.03094 2026-04-06 cs.CV cs.AI 57%

A Data-Centric Vision Transformer Baseline for SAR Sea Ice Classification

一种面向数据的视觉Transformer基线用于SAR海冰分类

David Mike-Ewewie, Panhapiseth Lim, Priyanka Kumar

机构 * The University of Texas Permian Basin（德克萨斯大学二叠纪盆地分校）

专题命中遥感融合与全色锐化：multimodal fusion(abstract)；分类 cs.CV

AI总结本文提出一种基于SAR的视觉Transformer基线，用于解决极地海冰分类中的类别不平衡问题，通过对比不同损失函数的性能，验证了聚焦损失在稀有冰类中的有效性。

1. 遥感融合与全色锐化 319 篇

Robust Recursive Fusion of Multiresolution Multispectral Images with Location-Aware Neural Networks

Model-Guided Network with Cluster-Based Operators for Spatio-Spectral Super-Resolution

Robust Hyperspectral Image Panshapring via Sparse Spatial-Spectral Representation

Dual-Branch Subpixel-Guided Network for Hyperspectral Image Classification

Perspective-Equivariance for Unsupervised Imaging with Camera Geometry

Unsupervised Hyperspectral and Multispectral Image Blind Fusion Based on Deep Tucker Decomposition Network with Spatial-Spectral Manifold Learning

An Integrated Framework for the Heterogeneous Spatio-Spectral-Temporal Fusion of Remote Sensing Images

Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusion

Multitemporal and multispectral data fusion for super-resolution of Sentinel-2 images

High Spectral Spatial Resolution Synthetic HyperSpectral Dataset form multi-source fusion

Unsupervised Hyperspectral and Multispectral Images Fusion Based on the Cycle Consistency

Learning a Joint Embedding of Multiple Satellite Sensors: A Case Study for Lake Ice Monitoring

Subspace-Based Feature Fusion From Hyperspectral And Multispectral Image For Land Cover Classification

Memory-augmented Deep Unfolding Network for Guided Image Super-resolution

A Triple-Double Convolutional Neural Network for Panchromatic Sharpening

SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery

Learning User's confidence for active learning

A new public Alsat-2B dataset for single-image super-resolution

Towards DeepSentinel: An extensible corpus of labelled Sentinel-1 and -2 imagery and a general-purpose sensor-fusion semantic embedding model

Super-resolution of multispectral satellite images using convolutional neural networks

Differentiable Programming for Hyperspectral Unmixing using a Physics-based Dispersion Model

Methane-Plume Segmentation From Hyperspectral Satellite Imagery Via Multimodal Deep Learning

IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal

Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation

SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild

SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining

WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning

MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation

RoboKA: KAN Informed Multimodal Learning for RoboCall Surveillance System

A Data-Centric Vision Transformer Baseline for SAR Sea Ice Classification