多模态大模型 - arXivDaily 专题

2012.13619 2022-05-24 cs.LG 78%

On self-supervised multi-modal representation learning: An application to Alzheimer's disease

Alex Fedorov, Lei Wu, Tristan Sylvain, Margaux Luck, Thomas P. DeRamus, Dmitry Bleklov, Sergey M. Plis, Vince D. Calhoun

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)

2205.06907 2022-05-17 cs.LG 78%

Multimodal Conversational AI: A Survey of Datasets and Approaches

Anirudh Sundar, Larry Heck

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 17 pages, 1 figure, to be published in the 4th Workshop on NLP for Conversational AI

2205.04300 2022-05-17 cs.RO 78%

Multi-modal Semantic SLAM for Complex Dynamic Environments

Han Wang, Jing Ying Ko, Lihua Xie

专题命中多模态训练与对齐：multi-modal(title,abstract)

2203.12221 2022-03-24 cs.LG 78%

Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)

Yu Huang, Junyang Lin, Chang Zhou, Hongxia Yang, Longbo Huang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 41 pages, 2 figures

2104.07407 2022-03-24 cs.IR 78%

MM-Rec: Multimodal News Recommendation

Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang

专题命中多模态训练与对齐：multimodal(title,abstract)

2104.09684 2022-03-16 cs.LG 78%

Suppressing simulation bias using multi-modal data

Bogdan Kustowski, Jim A. Gaffney, Brian K. Spears, Gemma J. Anderson, Rushil Anirudh, Peer-Timo Bremer, Jayaraman J. Thiagarajan, Michael K. G. Kruse, Ryan C. Nora

专题命中多模态训练与对齐：multi-modal(title,abstract)

2202.08401 2022-02-18 cs.RO 78%

Multi-Modal Fusion in Contact-Rich Precise Tasks via Hierarchical Policy Learning

Piaopiao Jin, Yinjie Lin, Yanchao Tan, Tiefeng Li, Wei Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)

2201.07683 2022-01-20 stat.ML cs.LG stat.ME 78%

Coupled Support Tensor Machine Classification for Multimodal Neuroimaging Data

Li Peide, Seyyid Emre Sofuoglu, Tapabrata Maiti, Selin Aviyente

专题命中多模态训练与对齐：multimodal(title,abstract)

2201.04712 2022-01-14 cs.LG eess.SP 78%

Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network

Batool Salehi, Guillem Reus-Muns, Debashri Roy, Zifeng Wang, Tong Jian, Jennifer Dy, Stratis Ioannidis, Kaushik Chowdhury

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 16 pages

2107.00992 2022-01-14 cs.SE cs.LG 78%

Multimodal Representation for Neural Code Search

Jian Gu, Zimin Chen, Martin Monperrus

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 12 pages, 9 figures, 7 tables, accepted by ICSME 2021, the camera-ready version

Journal ref Proceedings of International Conference on Software Maintenance and Evolution, 2021

2112.04814 2021-12-10 q-bio.BM cs.LG 78%

Multimodal Pre-Training Model for Sequence-based Prediction of Protein-Protein Interaction

Yang Xue, Zijing Liu, Xiaomin Fang, Fan Wang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments MLCB 2021 Spotlight

2105.06018 2021-11-24 cs.LG stat.ML 78%

Robust Dynamic Multi-Modal Data Fusion: A Model Uncertainty Perspective

Bin Liu

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments This paper has been accepted by IEEE Signal Processing Letters for publication

2111.04898 2021-11-10 cs.LG 78%

Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

Ziyi Liu, Jiaqi Zhang, Yongshuai Hou, Xinran Zhang, Ge Li, Yang Xiang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 37 pages, 3 tables, 2 figures, to be submitted to JAMIA

2111.04497 2021-11-09 cs.LG cs.CY 78%

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing

Xinyi Ding, Tao Han, Yili Fang, Eric Larson

专题命中多模态训练与对齐：multimodal(title,abstract)

2005.14117 2021-10-26 eess.IV cs.LG stat.ML 78%

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Danilo Avola, Luigi Cinque, Alessio Fagioli, Sebastiano Filetti, Giorgio Grani, Emanuele Rodolà

专题命中多模态训练与对齐：multimodal(title,abstract)

2108.12445 2021-10-04 cs.LG stat.ML 78%

Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

Yasin Yilmaz, Mehmet Aktukmak, Alfred O. Hero

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments IEEE Transactions on Signal Processing (2021)

2109.12547 2021-09-28 cs.SI 78%

Multi-modal Fusion using Fine-tuned Self-attention and Transfer Learning for Veracity Analysis of Web Information

Priyanka Meel, Dinesh Kumar Vishwakarma

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 31 pages, 12 figures

2109.03029 2021-09-08 cs.LG 78%

Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Network

Tathagata Banerjee, Matthew Kollada, Pablo Gersberg, Oscar Rodriguez, Jane Tiller, Andrew E Jaffe, John Reynders

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 8 pages, 3 figures, Published in the Computational Approaches to Mental Health Workshop of the International Conference on Machine Learning 2021, accepted-papers" target="_blank" rel="noopener">https://sites.google.com/view/ca2mh/accepted-papers

2108.08301 2021-08-24 cs.LG eess.IV 78%

Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion

Chuanbo Hu, Minglei Yin, Bin Liu, Xin Li, Yanfang Ye

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by ACM Transactions on Intelligent Systems and Technology (TIST)

2011.05817 2021-08-02 cs.RO 78%

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

Arda Inceoglu, Eren Erdal Aksoy, Abdullah Cihan Ak, Sanem Sariel

专题命中多模态训练与对齐：multimodal(title,abstract)

2107.09869 2021-07-22 cs.LG cs.NE eess.SP 78%

ECG Heartbeat Classification Using Multimodal Fusion

Zeeshan Ahmad, Anika Tabassum, Ling Guan, Naimul Khan

专题命中多模态训练与对齐：multimodal(title,abstract)

2106.11473 2021-06-23 cs.LG 78%

Sequential Late Fusion Technique for Multi-modal Sentiment Analysis

Debapriya Banerjee, Fotios Lygerakis, Fillia Makedon

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 2 pages, 1 figure, 1 table

2106.06180 2021-06-14 eess.SP 78%

Gas Detection and Identification Using Multimodal Artificial Intelligence Based Sensor Fusion

Parag Narkhede, Rahee Walambe, Shruti Mandaokar, Pulkit Chandel, Ketan Kotecha, George Ghinea

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 14 Pages, 9 Figures

Journal ref Applied System Innovation. 2021; 4(1):3

2005.14372 2021-06-09 stat.ME stat.CO 78%

Multimodal Bayesian Registration of Noisy Functions using Hamiltonian Monte Carlo

J. Derek Tucker, Lyndsay Shand, Kenny Chowdhary

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

1901.10610 2021-04-23 cs.LG stat.ML 78%

Robust Deep Multi-Modal Sensor Fusion using Fusion Weight Regularization and Target Learning

Myung Seok Shim, Chenye Zhao, Yang Li, Xuchong Zhang, Wenrui Zhang, Peng Li

专题命中多模态训练与对齐：multi-modal(title,abstract)

2104.09580 2021-04-21 cs.CL cs.AI cs.CV 78%

Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Information

Jialu Li, Hao Tan, Mohit Bansal

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CV、cs.CL、cs.AI

Comments NAACL 2021 (10 pages)

2012.00431 2021-04-13 physics.app-ph 78%

Exploring the Potentials of the Multi-modal Equivalent Circuit Approach for Stacks of 2-D Aperture Arrays

Antonio Alex-Amor, Francisco Mesa, Ángel Palomares-Caballero, Carlos Molero, Pablo Padilla

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 15 pages, 12 figures, IEEE Transactions on Antennas and Propagation

2103.05432 2021-03-10 cs.LG eess.SP q-bio.GN stat.AP 78%

Multimodal fusion using sparse CCA for breast cancer survival prediction

Vaishnavi Subramanian, Tanveer Syeda-Mahmood, Minh N. Do

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted for poster presentation at International Symposium on Biomedical Imaging (ISBI) 2021. 4 pages, 1 figure, 4 tables

2101.08616 2021-01-22 cs.RO 78%

Learning rich touch representations through cross-modal self-supervision

Martina Zambelli, Yusuf Aytar, Francesco Visin, Yuxiang Zhou, Raia Hadsell

专题命中多模态训练与对齐：cross-modal(title,abstract)

2010.13021 2020-12-24 cs.RO 78%

Multimodal Sensor Fusion with Differentiable Filters

Michelle A. Lee, Brent Yi, Roberto Martín-Martín, Silvio Savarese, Jeannette Bohg

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Published in IROS 2020. Updated sponsors, fixed Kalman gain typo

1. 多模态训练与对齐 6897 篇

On self-supervised multi-modal representation learning: An application to Alzheimer's disease

Multimodal Conversational AI: A Survey of Datasets and Approaches

Multi-modal Semantic SLAM for Complex Dynamic Environments

Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)

MM-Rec: Multimodal News Recommendation

Suppressing simulation bias using multi-modal data

Multi-Modal Fusion in Contact-Rich Precise Tasks via Hierarchical Policy Learning

Coupled Support Tensor Machine Classification for Multimodal Neuroimaging Data

Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network

Multimodal Representation for Neural Code Search

Multimodal Pre-Training Model for Sequence-based Prediction of Protein-Protein Interaction

Robust Dynamic Multi-Modal Data Fusion: A Model Uncertainty Perspective

Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Multimodal Data Fusion in High-Dimensional Heterogeneous Datasets via Generative Models

Multi-modal Fusion using Fine-tuned Self-attention and Transfer Learning for Veracity Analysis of Web Information

Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Network

Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion

FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection

ECG Heartbeat Classification Using Multimodal Fusion

Sequential Late Fusion Technique for Multi-modal Sentiment Analysis

Gas Detection and Identification Using Multimodal Artificial Intelligence Based Sensor Fusion

Multimodal Bayesian Registration of Noisy Functions using Hamiltonian Monte Carlo

Robust Deep Multi-Modal Sensor Fusion using Fusion Weight Regularization and Target Learning

Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Information

Exploring the Potentials of the Multi-modal Equivalent Circuit Approach for Stacks of 2-D Aperture Arrays

Multimodal fusion using sparse CCA for breast cancer survival prediction

Learning rich touch representations through cross-modal self-supervision

Multimodal Sensor Fusion with Differentiable Filters