多模态大模型 - arXivDaily 专题

2103.11114 2021-03-23 cs.CV 79%

A novel multimodal fusion network based on a joint coding model for lane line segmentation

Zhenhong Zou, Xinyu Zhang, Huaping Liu, Zhiwei Li, Amir Hussain, Jun Li

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2103.05940 2021-03-11 cs.CV 79%

TransMed: Transformers Advance Multi-modal Medical Image Classification

Yin Dai, Yifan Gao

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 4 figures

1709.08680 2021-03-11 cs.CV 79%

Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries

Pingfan Song, Xin Deng, João F. C. Mota, Nikos Deligiannis, Pier Luigi Dragotti, Miguel R. D. Rodrigues

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 8 figures, 9 tables

2103.05107 2021-03-10 cs.CV cs.LG 79%

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Wenshan Wang, Su Yang, Weishan Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2103.04412 2021-03-09 cs.RO cs.AI 79%

Multimodal VAE Active Inference Controller

Cristian Meo, Pablo Lanillos

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments Submitted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

2102.08641 2021-02-18 cs.CV cs.LG eess.IV 79%

Coupled Feature Learning for Multimodal Medical Image Fusion

Farshad G. Veshki, Nora Ouzir, Sergiy A. Vorobyov, Esa Ollila

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2102.03111 2021-02-08 eess.IV cs.CV cs.LG 79%

3D Medical Multi-modal Segmentation Network Guided by Multi-source Correlation Constraint

Tongxue Zhou, Stéphane Canu, Pierre Vera, Su Ruan

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 8 pages, 8 figures

2012.13024 2020-12-25 cs.CV cs.LG 79%

Private-Shared Disentangled Multimodal VAE for Learning of Hybrid Latent Representations

Mihee Lee, Vladimir Pavlovic

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CV

2012.10160 2020-12-23 eess.IV cs.CV 79%

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

José Morano, Álvaro S. Hervella, Noelia Barreira, Jorge Novo, José Rouco

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Journal ref Proceedings of the 24th European Conference on Artificial Intelligence (ECAI 2020)

2012.08637 2020-12-17 cs.RO cs.AI cs.LG 79%

Multi-Modal Anomaly Detection for Unstructured and Uncertain Environments

Tianchen Ji, Sri Theja Vuppala, Girish Chowdhary, Katherine Driggs-Campbell

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments Conference on Robot Learning (CoRL) 2020

2012.04446 2020-12-09 cs.MM 79%

LAMP: Label Augmented Multimodal Pretraining

Jia Guo, Chen Zhu, Yilun Zhao, Heda Wang, Yao Hu, Xiaofei He, Deng Cai

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.MM

2012.03417 2020-12-08 cs.CV 79%

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Fan Wang, Jiangxin Yang, Yanlong Cao, Yanpeng Cao, Michael Ying Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 7 figures

2011.05005 2020-12-08 cs.CV cs.LG 79%

Deep Multimodal Fusion by Channel Exchanging

Yikai Wang, Wenbing Huang, Fuchun Sun, Tingyang Xu, Yu Rong, Junzhou Huang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments NeurIPS 2020. Code and models: https://github.com/yikaiw/CEN

1908.05787 2020-11-24 cs.LG cs.CL stat.ML 79%

Integrating Multimodal Information in Large Pretrained Transformers

Wasifur Rahman, Md. Kamrul Hasan, Sangwu Lee, Amir Zadeh, Chengfeng Mao, Louis-Philippe Morency, Ehsan Hoque

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

2011.07191 2020-11-17 cs.LG cs.AI 79%

On the Benefits of Early Fusion in Multimodal Representation Learning

George Barnum, Sabera Talukder, Yisong Yue

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

2011.06216 2020-11-13 cs.CV eess.IV 79%

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

Zhe Xu, Jiangpeng Yan, Jie Luo, Xiu Li, Jayender Jagadeesan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 5 pages, under review

2011.00168 2020-11-03 cs.CV cs.LG cs.RO 79%

Multimodal and self-supervised representation learning for automatic gesture recognition in surgical robotics

Aniruddha Tamhane, Jie Ying Wu, Mathias Unberath

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments 15 pages, 7 figures

2010.14095 2020-10-28 cs.CV 79%

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at Findings of EMNLP 2020

2007.08076 2020-10-26 cs.LG cs.CV stat.ML 79%

Memory based fusion for multi-modal deep learning

Darshana Priyasad, Tharindu Fernando, Simon Denman, Sridha Sridharan, Clinton Fookes

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Pre-print submitted to Information Fusion

2010.08218 2020-10-19 cs.AI 79%

Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment Analysis

Sunny Verma, Jiwei Wang, Zhefeng Ge, Rujia Shen, Fan Jin, Yang Wang, Fang Chen, Wei Liu

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments Accepted at ICDM 2020

2009.09629 2020-10-08 cs.CL 79%

Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition

Wenliang Dai, Zihan Liu, Tiezheng Yu, Pascale Fung

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CL

Comments 12 pages, 5 figures

2009.02902 2020-09-29 cs.CL 79%

TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis

Zilong Wang, Zhaohong Wan, Xiaojun Wan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments Proceedings of The Web Conference 2020

2009.10945 2020-09-24 cs.CV 79%

MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion

Zehan Zhang, Ming Zhang, Zhidong Liang, Xian Zhao, Ming Yang, Wenming Tan, ShiLiang Pu

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 6 figures

2009.04549 2020-09-23 cs.LG cs.AI cs.CR cs.SE stat.ML 79%

Multimodal Deep Learning for Flaw Detection in Software Programs

Scott Heidbrink, Kathryn N. Rodhouse, Daniel M. Dunlavy

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

Comments 13 pages, 2 figures, 5 tables

2009.05147 2020-09-14 cs.CV cs.LG cs.RO stat.ML 79%

Practical Cross-modal Manifold Alignment for Grounded Language

Andre T. Nguyen, Luke E. Richards, Gaoussou Youssouf Kebe, Edward Raff, Kasra Darvish, Frank Ferraro, Cynthia Matuszek

专题命中多模态训练与对齐：cross-modal(title)；multi-modal(abstract)；分类 cs.CV

2009.03118 2020-09-08 cs.CV 79%

Interpretable Deep Multimodal Image Super-Resolution

Iman Marivani, Evaggelia Tsiligianni, Bruno Cornelis, Nikos Deligiannis

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments in Proceedings of iTWIST'20, Paper-ID: 41, Nantes, France, December, 2-4, 2020

2009.02569 2020-09-08 eess.IV cs.AI 79%

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Haochuan Jiang, Chengjia Wang, Agisilaos Chartsias, Sotirios A. Tsaftaris

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

Comments 13 pages, 7 figures, conference paper

Journal ref MICCAI-2020 MyoPS Challenge Paper

2008.09672 2020-08-25 cs.CV cs.RO 79%

Towards Autonomous Driving: a Multi-Modal 360$^{\circ}$ Perception Proposal

Jorge Beltrán, Carlos Guindel, Irene Cortés, Alejandro Barrera, Armando Astudillo, Jesús Urdiales, Mario Álvarez, Farid Bekka, Vicente Milanés, Fernando García

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication in IEEE ITSC 2020

2008.06179 2020-08-17 cs.CV cs.IR 79%

A Multimodal Late Fusion Model for E-Commerce Product Classification

Ye Bi, Shuo Wang, Zhongrui Fan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 4 pages, SIGIR 2020 E-commerce Workshop Data Challenge Technical Report

2008.05457 2020-08-13 cs.CV eess.IV 79%

More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification

Danfeng Hong, Lianru Gao, Naoto Yokoya, Jing Yao, Jocelyn Chanussot, Qian Du, Bing Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, 2020

1. 多模态训练与对齐 6897 篇

A novel multimodal fusion network based on a joint coding model for lane line segmentation

TransMed: Transformers Advance Multi-modal Medical Image Classification

Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Multimodal VAE Active Inference Controller

Coupled Feature Learning for Multimodal Medical Image Fusion

3D Medical Multi-modal Segmentation Network Guided by Multi-source Correlation Constraint

Private-Shared Disentangled Multimodal VAE for Learning of Hybrid Latent Representations

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

Multi-Modal Anomaly Detection for Unstructured and Uncertain Environments

LAMP: Label Augmented Multimodal Pretraining

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Deep Multimodal Fusion by Channel Exchanging

Integrating Multimodal Information in Large Pretrained Transformers

On the Benefits of Early Fusion in Multimodal Representation Learning

Unsupervised Multimodal Image Registration with Adaptative Gradient Guidance

Multimodal and self-supervised representation learning for automatic gesture recognition in surgical robotics

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

Memory based fusion for multi-modal deep learning

Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment Analysis

Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition

TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis

MAFF-Net: Filter False Positive for 3D Vehicle Detection with Multi-modal Adaptive Feature Fusion

Multimodal Deep Learning for Flaw Detection in Software Programs

Practical Cross-modal Manifold Alignment for Grounded Language

Interpretable Deep Multimodal Image Super-Resolution

Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention and Dynamic Resampling

Towards Autonomous Driving: a Multi-Modal 360$^{\circ}$ Perception Proposal

A Multimodal Late Fusion Model for E-Commerce Product Classification

More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification