多模态大模型 - arXivDaily 专题

2009.12148 2021-08-05 cs.MM 79%

Adaptive Multi-modal Fusion Hashing via Hadamard Matrix

Jun Yu, Donglin Zhang, Zhenqiu Shu, Feng Chen

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.MM

Comments 10pages, 8figures, 3tables. The paper is under consideration at Applied Intelligence

2107.12167 2021-07-27 cs.HC cs.CV cs.LG 79%

Multimodal Fusion Using Deep Learning Applied to Driver's Referencing of Outside-Vehicle Objects

Abdul Rafey Aftab, Michael von der Beeck, Steven Rohrhirsch, Benoit Diotte, Michael Feld

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2107.11585 2021-07-27 cs.CV cs.LG eess.IV 79%

Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions

Rupak Bose, Shivam Pande, Biplab Banerjee

专题命中多模态训练与对齐：multimodal(title)；cross-modal(abstract)；分类 cs.CV

Comments Accepted in IEEE International conference on Image Processing (ICIP), 2021

2107.09928 2021-07-22 cs.CV 79%

Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction

Qiankun Zuo, Baiying Lei, Yanyan Shen, Yong Liu, Zhiguang Feng, Shuqiang Wang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 3 figures

2107.04548 2021-07-13 cs.CV 79%

Cross-modal Attention for MRI and Ultrasound Volume Registration

Xinrui Song, Hengtao Guo, Xuanang Xu, Hanqing Chao, Sheng Xu, Baris Turkbey, Bradford J. Wood, Ge Wang, Pingkun Yan

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments This paper has been accepted by MICCAI 2021

2107.02339 2021-07-07 cs.LG cs.AI cs.RO 79%

Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning

Kaiqi Chen, Yong Lee, Harold Soh

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments 10 pages, Published in ICRA 2021

2010.14924 2021-06-30 cs.CV 79%

Multimodal End-to-End Learning for Autonomous Steering in Adverse Road and Weather Conditions

Jyri Maanpää, Josef Taher, Petri Manninen, Leo Pakola, Iaroslav Melekhov, Juha Hyyppä

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 8 figures, included in the conference proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), 2021

Journal ref 2020 25th International Conference on Pattern Recognition (ICPR), 2021, pp. 699-706

2106.14174 2021-06-29 cs.LG cs.DB cs.IR cs.MM 79%

Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspects

Sana Rahmani, Saeid Hosseini, Raziyeh Zall, Mohammad Reza Kangavari, Sara Kamran, Wen Hua

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.MM

Comments Under Review on IEEE Transactions on Pattern Analysis and Machine Intelligence

2012.07175 2021-06-29 cs.CV cs.LG 79%

MSAF: Multimodal Split Attention Fusion

Lang Su, Chuqing Hu, Guofa Li, Dongpu Cao

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1810.12941 2021-06-17 cs.CV 79%

Joint detection and matching of feature points in multimodal images

Elad Ben Baruch, Yosi Keller

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1912.07812 2021-06-15 cs.LG cs.CV eess.SP stat.ML 79%

Capsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation

Guangyi Zhang, Ali Etemad

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Neural Systems and Rehabilitation Engineering

2102.11456 2021-06-14 cs.CV 79%

Representation Disentanglement for Multi-modal brain MR Analysis

Jiahong Ouyang, Ehsan Adeli, Kilian M. Pohl, Qingyu Zhao, Greg Zaharchuk

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by Information Processing in Medical Imaging (IPMI) 2021

2008.10833 2021-06-09 cs.CV 79%

Adaptive Context-Aware Multi-Modal Network for Depth Completion

Shanshan Zhao, Mingming Gong, Huan Fu, Dacheng Tao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2106.03619 2021-06-08 cs.AI 79%

Multi-modal Entity Alignment in Hyperbolic Space

Hao Guo, Jiuyang Tang, Weixin Zeng, Xiang Zhao, Li Liu

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments 24 pages,5 figures;

2005.02933 2021-05-10 eess.IV cs.CV 79%

Groupwise Multimodal Image Registration using Joint Total Variation

Mikael Brudfors, Yaël Balbastre, John Ashburner

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2105.02489 2021-05-07 cs.LG cs.CV 79%

Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond

Tianyuan Huang, Zhecheng Wang, Hao Sheng, Andrew Y. Ng, Ram Rajagopal

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2105.00310 2021-05-04 cs.CV 79%

MARL: Multimodal Attentional Representation Learning for Disease Prediction

Ali Hamdi, Amr Aboeleneen, Khaled Shaban

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, submitted to IEEE-FUZZ'2021

2105.00136 2021-05-04 cs.MM 79%

Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answering

Haifan Gong, Guanqi Chen, Sishuo Liu, Yizhou Yu, Guanbin Li

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.MM

Comments ICMR '21: ACM International Conference on Multimedia Retrieval, Taipei, Taiwan, August 21-24, 2021

2104.11476 2021-04-28 cs.CL 79%

Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection

Nguyen Manh Duc Tuan, Pham Quang Nhat Minh

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments RIVF 2021

2104.11693 2021-04-26 cs.CV 79%

Deep Lucas-Kanade Homography for Multimodal Image Alignment

Yiming Zhao, Xinming Huang, Ziming Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2021, codelink: https://github.com/placeforyiming/CVPR21-Deep-Lucas-Kanade-Homography

2011.13572 2021-04-26 cs.AI 79%

Analyzing Unaligned Multimodal Sequence via Graph Convolution and Graph Pooling Fusion

Sijie Mai, Songlong Xing, Jiaxuan He, Ying Zeng, Haifeng Hu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments preprint, work in progress

2104.08403 2021-04-20 cs.CV 79%

Accurate 3D Facial Geometry Prediction by Multi-Task, Multi-Modal, and Multi-Representation Landmark Refinement Network

Cho-Ying Wu, Qiangeng Xu, Ulrich Neumann

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Project page: https://choyingw.github.io/works/M3-LRN/index.html

2104.04000 2021-04-12 cs.AI cs.LG cs.RO 79%

Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems

Cong Hao, Deming Chen

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments Invited paper at IEEE AICAS 2021, 5 pages

1808.06194 2021-04-01 cs.CV 79%

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Yuanxin Ye, Lorenzo Bruzzone, Jie Shan, Francesca Bovolo, Qing Zhu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2005.08706 2021-04-01 cs.CV 79%

Towards Better Graph Representation: Two-Branch Collaborative Graph Neural Networks for Multimodal Marketing Intention Detection

Lu Zhang, Jian Zhang, Zhibin Li, Jingsong Xu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by ICME2020

2103.11832 2021-03-23 cs.CV 79%

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

Peng Sun, Wenhu Zhang, Huanyu Wang, Songyuan Li, Xi Li

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2021, Oral

2103.11114 2021-03-23 cs.CV 79%

A novel multimodal fusion network based on a joint coding model for lane line segmentation

Zhenhong Zou, Xinyu Zhang, Huaping Liu, Zhiwei Li, Amir Hussain, Jun Li

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2103.05940 2021-03-11 cs.CV 79%

TransMed: Transformers Advance Multi-modal Medical Image Classification

Yin Dai, Yifan Gao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 4 figures

1709.08680 2021-03-11 cs.CV 79%

Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries

Pingfan Song, Xin Deng, João F. C. Mota, Nikos Deligiannis, Pier Luigi Dragotti, Miguel R. D. Rodrigues

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 8 figures, 9 tables

2103.05107 2021-03-10 cs.CV cs.LG 79%

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Wenshan Wang, Su Yang, Weishan Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

1. 多模态训练与对齐 6887 篇

Adaptive Multi-modal Fusion Hashing via Hadamard Matrix

Multimodal Fusion Using Deep Learning Applied to Driver's Referencing of Outside-Vehicle Objects

Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions

Multimodal Representations Learning and Adversarial Hypergraph Fusion for Early Alzheimer's Disease Prediction

Cross-modal Attention for MRI and Ultrasound Volume Registration

Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning

Multimodal End-to-End Learning for Autonomous Steering in Adverse Road and Weather Conditions

Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspects

MSAF: Multimodal Split Attention Fusion

Joint detection and matching of feature points in multimodal images

Capsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation

Representation Disentanglement for Multi-modal brain MR Analysis

Adaptive Context-Aware Multi-Modal Network for Depth Completion

Multi-modal Entity Alignment in Hyperbolic Space

Groupwise Multimodal Image Registration using Joint Total Variation

Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond

MARL: Multimodal Attentional Representation Learning for Disease Prediction

Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answering

Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection

Deep Lucas-Kanade Homography for Multimodal Image Alignment

Analyzing Unaligned Multimodal Sequence via Graph Convolution and Graph Pooling Fusion

Accurate 3D Facial Geometry Prediction by Multi-Task, Multi-Modal, and Multi-Representation Landmark Refinement Network

Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Towards Better Graph Representation: Two-Branch Collaborative Graph Neural Networks for Multimodal Marketing Intention Detection

Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion

A novel multimodal fusion network based on a joint coding model for lane line segmentation

TransMed: Transformers Advance Multi-modal Medical Image Classification

Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data