多模态信息融合 - arXivDaily 专题

2208.00339 2023-12-05 cs.MM 79%

GraphMFT: A Graph Network based Multimodal Fusion Technique for Emotion Recognition in Conversation

Jiang Li, Xiaoping Wang, Guoqing Lv, Zhigang Zeng

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.MM

Comments Accepted by Neurocomputing

2310.18046 2023-10-30 cs.CL cs.CV 79%

ViCLEVR: A Visual Reasoning Dataset and Hybrid Multimodal Fusion Model for Visual Question Answering in Vietnamese

Khiem Vinh Tran, Hao Phu Phan, Kiet Van Nguyen, Ngan Luu Thuy Nguyen

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments A pre-print version and submitted to journal

2303.00601 2023-09-08 cs.CV 79%

Multimodal Industrial Anomaly Detection via Hybrid Fusion

Yue Wang, Jinlong Peng, Jiangning Zhang, Ran Yi, Yabiao Wang, Chengjie Wang

专题命中融合架构与评测：hybrid fusion(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2023

2309.02190 2023-09-06 cs.CV cs.AI 79%

Exchanging-based Multimodal Fusion with Transformer

Renyu Zhu, Chengcheng Han, Yong Qian, Qiushi Sun, Xiang Li, Ming Gao, Xuezhi Cao, Yunsen Xian

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

2304.06306 2023-05-16 cs.CV 79%

Efficient Multimodal Fusion via Interactive Prompting

Yaowei Li, Ruijie Quan, Linchao Zhu, Yi Yang

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments Camera-ready version for CVPR2023

2304.06485 2023-04-14 eess.SP cs.AI cs.LG 79%

CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities

Konstantinos Kontras, Christos Chatzichristos, Huy Phan, Johan Suykens, Maarten De Vos

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 eess.SP

Comments 10 pages, 4 figures, 2 tables, journal

2103.17084 2023-03-23 cs.CV 79%

DA-DETR: Domain Adaptive Detection Transformer with Information Fusion

Jingyi Zhang, Jiaxing Huang, Zhipeng Luo, Gongjie Zhang, Xiaoqin Zhang, Shijian Lu

专题命中融合架构与评测：information fusion(title,abstract)；分类 cs.CV

Comments Accepted to CVPR2023

2303.04636 2023-03-09 cs.LG eess.SP 79%

Robust Multimodal Fusion for Human Activity Recognition

Sanju Xaviar, Xin Yang, Omid Ardakanian

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 eess.SP

Comments 13 pages

2302.08744 2023-02-20 eess.SP cs.AR 79%

Tensorized Optical Multimodal Fusion Network

Yequan Zhao, Xian Xiao, Geza Kurczveil, Raymond G. Beausoleil, Zheng Zhang

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 eess.SP

Comments CLEO 2023 Novel Applications in Integrated Photonics

2302.05289 2023-02-13 cs.CV cs.AI cs.CL cs.SI 79%

Rumor Classification through a Multimodal Fusion Framework and Ensemble Learning

Abderrazek Azri, Cécile Favre, Nouria Harbi, Jérôme Darmont, Camille Noûs

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments Information Systems Frontiers, 2022

2203.15588 2023-01-30 cs.LG cs.AI cs.CV 79%

Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Review

Can Cui, Haichun Yang, Yaohong Wang, Shilin Zhao, Zuhayr Asad, Lori A. Coburn, Keith T. Wilson, Bennett A. Landman, Yuankai Huo

专题命中融合架构与评测：multi-modal fusion(title,abstract)；分类 cs.CV

2211.00933 2023-01-02 cs.CV 79%

Deep Multimodal Fusion for Generalizable Person Re-identification

Suncheng Xiang, Hao Chen, Wei Ran, Zefang Yu, Ting Liu, Dahong Qian, Yuzhuo Fu

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

2212.13323 2022-12-29 eess.SP 79%

Dynamics of Social Networks: Multi-agent Information Fusion, Anticipatory Decision Making and Polling

Vikram Krishnamurthy

专题命中融合架构与评测：information fusion(title,abstract)；分类 eess.SP

2211.00207 2022-11-02 cs.CV 79%

GMF: General Multimodal Fusion Framework for Correspondence Outlier Rejection

Xiaoshui Huang, Wentao Qu, Yifan Zuo, Yuming Fang, Xiaowei Zhao

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments Accepted by IEEE RAL

2210.15132 2022-10-28 cs.AI eess.SP 79%

Hybrid Indoor Localization via Reinforcement Learning-based Information Fusion

Mohammad Salimibeni, Arash Mohammadi

专题命中融合架构与评测：information fusion(title,abstract)；分类 eess.SP

2206.12714 2022-06-28 cs.CV cs.CR cs.LG 79%

Defending Multimodal Fusion Models against Single-Source Adversaries

Karren Yang, Wan-Yi Lin, Manash Barman, Filipe Condessa, Zico Kolter

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments CVPR 2021

2206.02187 2022-06-07 cs.CV cs.SD eess.AS 79%

M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversation

Vishal Chudasama, Purbayan Kar, Ashish Gudmalwar, Nirmesh Shah, Pankaj Wasnik, Naoyuki Onoe

专题命中融合架构与评测：multi-modal fusion(title,abstract)；分类 cs.CV

Comments Accepted for publication in the 5th Multimodal Learning and Applications (MULA) Workshop at CVPR 2022

2201.10353 2022-02-28 cs.LG cs.AI cs.CV 79%

A Multi-modal Fusion Framework Based on Multi-task Correlation Learning for Cancer Prognosis Prediction

Kaiwen Tan, Weixian Huang, Xiaofeng Liu, Jinlong Hu, Shoubin Dong

专题命中融合架构与评测：multi-modal fusion(title,abstract)；分类 cs.CV

2104.01530 2021-12-13 cs.CV 79%

High-resolution Depth Maps Imaging via Attention-based Hierarchical Multi-modal Fusion

Zhiwei Zhong, Xianming Liu, Junjun Jiang, Debin Zhao, Zhiwen Chen, Xiangyang Ji

专题命中融合架构与评测：multi-modal fusion(title,abstract)；分类 cs.CV

2106.07985 2021-12-09 eess.IV physics.med-ph 79%

Impedance-optical Dual-modal Cell Culture Imaging with Learning-based Information Fusion

Zhe Liu, Pierre Bagnaninchi, Yunjie Yang

专题命中融合架构与评测：information fusion(title,abstract)；分类 eess.IV

Journal ref IEEE Transactions on Medical Imaging, 19 November 2021

2111.09624 2021-11-19 cs.CV 79%

IMFNet: Interpretable Multimodal Fusion for Point Cloud Registration

Xiaoshui Huang, Wentao Qu, Yifan Zuo, Yuming Fang, Xiaowei Zhao

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments Technical report

2111.02327 2021-11-04 cs.HC cs.CV 79%

ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle

Amr Gomaa, Guillermo Reyes, Michael Feld

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Journal ref In Proceedings of the 2021 International Conference on Multimodal Interaction, pp. 318-327. 2021

2106.03821 2021-09-16 cs.SD cs.CL cs.CV eess.AS 79%

Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-based Multimodal Fusion

Baptiste Pouthier, Laurent Pilati, Leela K. Gudupudi, Charles Bouveyron, Frederic Precioso

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments In INTERSPEECH 2021

Journal ref Proc. Interspeech 2021, 2381-2385

2104.03435 2021-04-09 cs.CV cs.AI 79%

Multimodal Fusion Refiner Networks

Sethuraman Sankaran, David Yang, Ser-Nam Lim

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments 11 pages, 6 figures

2103.11114 2021-03-23 cs.CV 79%

A novel multimodal fusion network based on a joint coding model for lane line segmentation

Zhenhong Zou, Xinyu Zhang, Huaping Liu, Zhiwei Li, Amir Hussain, Jun Li

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

2103.00359 2021-03-02 cs.CV cs.LG 79%

The Labeled Multiple Canonical Correlation Analysis for Information Fusion

Lei Gao, Rui Zhang, Lin Qi, Enqing Chen, Ling Guan

专题命中融合架构与评测：information fusion(title,abstract)；分类 cs.CV

Journal ref IEEE Transactions on Multimedia, 2019

2011.05005 2020-12-08 cs.CV cs.LG 79%

Deep Multimodal Fusion by Channel Exchanging

Yikai Wang, Wenbing Huang, Fuchun Sun, Tingyang Xu, Yu Rong, Junzhou Huang

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments NeurIPS 2020. Code and models: https://github.com/yikaiw/CEN

2011.10776 2020-11-24 cs.CV 79%

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

Lei Li, Suping Wu

专题命中融合架构与评测：information fusion(title,abstract)；分类 cs.CV

Comments ICPR 2020 (Oral)

2010.14095 2020-10-28 cs.CV 79%

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 cs.CV

Comments Accepted at Findings of EMNLP 2020

2004.13918 2020-04-30 eess.SP cs.LG stat.ML 79%

EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition

Jun-Ho Choi, Jong-Seok Lee

专题命中融合架构与评测：multimodal fusion(title,abstract)；分类 eess.SP

Comments Accepted in HASCA at ACM UbiComp/ISWC 2019, won the 2nd place in the SHL Recognition Challenge 2019

1. 融合架构与评测 1405 篇

GraphMFT: A Graph Network based Multimodal Fusion Technique for Emotion Recognition in Conversation

ViCLEVR: A Visual Reasoning Dataset and Hybrid Multimodal Fusion Model for Visual Question Answering in Vietnamese

Multimodal Industrial Anomaly Detection via Hybrid Fusion

Exchanging-based Multimodal Fusion with Transformer

Efficient Multimodal Fusion via Interactive Prompting

CoRe-Sleep: A Multimodal Fusion Framework for Time Series Robust to Imperfect Modalities

DA-DETR: Domain Adaptive Detection Transformer with Information Fusion

Robust Multimodal Fusion for Human Activity Recognition

Tensorized Optical Multimodal Fusion Network

Rumor Classification through a Multimodal Fusion Framework and Ensemble Learning

Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Review

Deep Multimodal Fusion for Generalizable Person Re-identification

Dynamics of Social Networks: Multi-agent Information Fusion, Anticipatory Decision Making and Polling

GMF: General Multimodal Fusion Framework for Correspondence Outlier Rejection

Hybrid Indoor Localization via Reinforcement Learning-based Information Fusion

Defending Multimodal Fusion Models against Single-Source Adversaries

M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversation

A Multi-modal Fusion Framework Based on Multi-task Correlation Learning for Cancer Prognosis Prediction

High-resolution Depth Maps Imaging via Attention-based Hierarchical Multi-modal Fusion

Impedance-optical Dual-modal Cell Culture Imaging with Learning-based Information Fusion

IMFNet: Interpretable Multimodal Fusion for Point Cloud Registration

ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle

Active Speaker Detection as a Multi-Objective Optimization with Uncertainty-based Multimodal Fusion

Multimodal Fusion Refiner Networks

A novel multimodal fusion network based on a joint coding model for lane line segmentation

The Labeled Multiple Canonical Correlation Analysis for Information Fusion

Deep Multimodal Fusion by Channel Exchanging

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition