多模态信息融合

Towards Multimodal Prediction of Spontaneous Humour: A Novel Dataset and First Results

Lukas Christ, Shahin Amiriparian, Alexander Kathan, Niklas Müller, Andreas König, Björn W. Schuller

专题命中 融合架构与评测 ：decision-level fusion(abstract)；分类 cs.CV、cs.MM

Comments This work has been submitted to the IEEE for possible publication (Major Revision)

A Survey of Multimodal Composite Editing and Retrieval

Suyan Li, Fuxiang Huang, Lei Zhang

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.MM

Comments 20 pages, 3 figures, and 11 tables

SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion Recognition

Zebang Cheng, Shuyuan Tu, Dawei Huang, Minghan Li, Xiaojiang Peng, Zhi-Qi Cheng, Alexander G. Hauptmann

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.MM

Comments Ranked 1st in MER24@IJCAI and MRAC24@ACM MM (MER-NOISE & MER-OV (self-evaluated))

End-to-end Semantic-centric Video-based Multimodal Affective Computing

Ronghao Lin, Ying Zeng, Sijie Mai, Haifeng Hu

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.MM

Comments Under Review

MU-MAE: Multimodal Masked Autoencoders-Based One-Shot Learning

Rex Liu, Xin Liu

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.MM

Comments IEEE MIPR 2024

ASI-Seg: Audio-Driven Surgical Instrument Segmentation with Surgeon Intention Understanding

Zhen Chen, Zongming Zhang, Wenwu Guo, Xingjian Luo, Long Bai, Jinlin Wu, Hongliang Ren, Hongbin Liu

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.RO

Comments This work is accepted by IROS 2024 (Oral)

Multi-task Prompt Words Learning for Social Media Content Generation

Haochen Xue, Chong Zhang, Chengzhi Liu, Fangyu Wu, Xiaobo Jin

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、cs.MM

Comments 8 pages, 5 figures

Journal ref International Joint Conference on Neural Networks 2024

ODIN: A Single Model for 2D and 3D Segmentation

Ayush Jain, Pushkal Katara, Nikolaos Gkanatsios, Adam W. Harley, Gabriel Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、cs.RO

Comments Camera Ready (CVPR 2024, Highlight)

Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

Haoyu Zhang, Yu Wang, Guanghao Yin, Kejun Liu, Yuanyuan Liu, Tianshu Yu

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.MM

Comments Published in EMNLP 2023

Journal ref Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Source-Free Domain Adaptation for RGB-D Semantic Segmentation with Vision Transformers

Giulia Rizzoli, Donald Shenaj, Pietro Zanuttigh

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、cs.MM

Comments WACV 2024, 2nd Workshop on Pretraining (WACVW)

Cross-Attention is Not Enough: Incongruity-Aware Dynamic Hierarchical Fusion for Multimodal Affect Recognition

Yaoting Wang, Yuanchao Li, Paul Pu Liang, Louis-Philippe Morency, Peter Bell, Catherine Lai

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 eess.IV、cs.MM

Comments *First two authors contributed equally

MuS2: A Real-World Benchmark for Sentinel-2 Multi-Image Super-Resolution

Pawel Kowaleczko, Tomasz Tarasiewicz, Maciej Ziaja, Daniel Kostrzewa, Jakub Nalepa, Przemyslaw Rokita, Michal Kawulok

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、eess.IV

Camera-LiDAR Fusion with Latent Contact for Place Recognition in Challenging Cross-Scenes

Yan Pan, Jiapeng Xie, Jiajie Wu, Bo Zhou

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV、cs.RO

Transformer-based interpretable multi-modal data fusion for skin lesion classification

Theodor Cheslerean-Boghiu, Melia-Evelina Fleischmann, Theresa Willem, Tobias Lasser

专题命中 融合架构与评测 ：decision-level fusion(abstract)；分类 cs.CV、eess.IV

Comments Submitted to IEEE JBHI in July 2023

Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI

Qiankun Zuo, Yanfei Zhu, Libin Lu, Zhi Yang, Yuhui Li, Ning Zhang

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments 4 figures

H-DenseFormer: An Efficient Hybrid Densely Connected Transformer for Multimodal Tumor Segmentation

Jun Shi, Hongyu Kan, Shulan Ruan, Ziqi Zhu, Minfan Zhao, Liang Qiao, Zhaohui Wang, Hong An, Xudong Xue

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments 11 pages, 2 figures. This paper has been accepted by Medical Image Computing and Computer-Assisted Intervention(MICCAI) 2023

Survey on LiDAR Perception in Adverse Weather Conditions

Mariella Dreissig, Dominik Scheuble, Florian Piewak, Joschka Boedecker

专题命中 融合架构与评测 ：sensor fusion(abstract)；分类 cs.CV、cs.RO

Comments published at IEEE IV 2023

Adaptive-Mask Fusion Network for Segmentation of Drivable Road and Negative Obstacle With Untrustworthy Features

Zhen Feng, Yuchao Feng, Yanning Guo, Yuxiang Sun

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV、cs.RO

Comments This paper has been accepted by 2023 IEEE Intelligent Vehicles Symposium (IV) (IEEE IV 2023)

Informative Data Selection with Uncertainty for Multi-modal Object Detection

Xinyu Zhang, Zhiwei Li, Zhenhong Zou, Xin Gao, Yijin Xiong, Dafeng Jin, Jun Li, Huaping Liu

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Towards Local Visual Modeling for Image Captioning

Yiwei Ma, Jiayi Ji, Xiaoshuai Sun, Yiyi Zhou, Rongrong Ji

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、cs.MM

Comments Preprint

Recurrent Video Restoration Transformer with Guided Deformable Attention

Jingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan, Eddy Ilg, Simon Green, Jiezhang Cao, Kai Zhang, Radu Timofte, Luc Van Gool

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted by NeurIPS 2022. Code: https://github.com/JingyunLiang/RVRT

Fusing Modalities by Multiplexed Graph Neural Networks for Outcome Prediction in Tuberculosis

Niharika S. D'Souza, Hongzhi Wang, Andrea Giovannini, Antonio Foncubierta-Rodriguez, Kristen L. Beck, Orest Boyko, Tanveer Syeda-Mahmood

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted into MICCAI 2022

TLDW: Extreme Multimodal Summarisation of News Videos

Peggy Tang, Kun Hu, Lei Zhang, Jiebo Luo, Zhiyong Wang

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.MM

Multi-modal Depression Estimation based on Sub-attentional Fusion

Ping-Cheng Wei, Kunyu Peng, Alina Roitberg, Kailun Yang, Jiaming Zhang, Rainer Stiefelhagen

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV、cs.RO

Comments Accepted to ECCV 2022 ACVR Workshop. Code is publicly available at https://github.com/PingCheng-Wei/DepressionEstimation

USegScene: Unsupervised Learning of Depth, Optical Flow and Ego-Motion with Semantic Guidance and Coupled Networks

Johan Vertens, Wolfram Burgard

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、cs.RO

OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication

Runsheng Xu, Hao Xiang, Xin Xia, Xu Han, Jinlong Li, Jiaqi Ma

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、cs.RO

Comments Accepted by ICRA2022

A Look at Improving Robustness in Visual-inertial SLAM by Moment Matching

Arno Solin, Rui Li, Andrea Pilzer

专题命中 融合架构与评测 ：information fusion(abstract)；分类 cs.CV、cs.RO

Comments 8 pages, to appear in Proceedings of FUSION 2022

DetMatch: Two Teachers are Better Than One for Joint 2D and 3D Semi-Supervised Object Detection

Jinhyung Park, Chenfeng Xu, Yiyang Zhou, Masayoshi Tomizuka, Wei Zhan

专题命中 融合架构与评测 ：multi-modal fusion(abstract)；分类 cs.CV、cs.RO

Comments https://github.com/Divadi/DetMatch

Attention-based Dual Supervised Decoder for RGBD Semantic Segmentation

Yang Zhang, Yang Yang, Chenyun Xiong, Guodong Sun, Yanwen Guo

专题命中 融合架构与评测 ：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments 12 pages, 6 figures

COROLLA: An Efficient Multi-Modality Fusion Framework with Supervised Contrastive Learning for Glaucoma Grading

Zhiyuan Cai, Li Lin, Huaqing He, Xiaoying Tang

专题命中 融合架构与评测 ：feature-level fusion(abstract)；分类 cs.CV、eess.IV

Comments 5 pages, To be published in ISBI 2022