多模态大模型 - arXivDaily 专题

2007.09366 2020-12-01 eess.SP cs.IT math.IT 78%

Deep Multimodal Learning: Merging Sensory Data for Massive MIMO Channel Prediction

Yuwen Yang, Feifei Gao, Chengwen Xing, Jianping An, Ahmed Alkhateeb

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments accepted by IEEE Journal on Selected Areas in Communications

2008.11450 2020-10-27 cs.LG stat.ML 78%

Training Multimodal Systems for Classification with Multiple Objectives

Jason Armitage, Shramana Thakur, Rishi Tripathi, Jens Lehmann, Maria Maleshkova

专题命中多模态训练与对齐：multimodal(title,abstract)

Journal ref Proceedings of the 1st International Workshop on Cross-lingual Event-centric Open Analytics co-located with the 17th Extended Semantic Web Conference (ESWC 2020)

1911.10241 2020-10-05 q-bio.QM cs.LG stat.ML 78%

Cross-modal representation alignment of molecular structure and perturbation-induced transcriptional profiles

Samuel G. Finlayson, Matthew B. A. McDermott, Alex V. Pickering, Scott L. Lipnick, Isaac S. Kohane

专题命中多模态训练与对齐：cross-modal(title,abstract)

Comments Accepted for oral presentation at the Pacific Symposium of Biocomputing, 2021

2001.09485 2020-09-22 cs.LG stat.ML 78%

Multimodal Data Fusion based on the Global Workspace Theory

Cong Bao, Zafeirios Fountas, Temitayo Olugbade, Nadia Bianchi-Berthouze

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 12 pages, 5 figures

2008.02171 2020-08-06 cs.LG stat.ML 78%

A Causal-based Framework for Multimodal Multivariate Time Series Validation Enhanced by Unsupervised Deep Learning as an Enabler for Industry 4.0

Cedric Schockaert

专题命中多模态训练与对齐：multimodal(title,abstract)

2005.09202 2020-08-04 cs.RO cs.SY eess.SY 78%

Multi-modal Sensor Fusion-Based Deep Neural Network for End-to-end Autonomous Driving with Scene Understanding

Zhiyu Huang, Chen Lv, Yang Xing, Jingda Wu

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)

2007.15945 2020-08-03 cs.RO 78%

Autonomous Navigation in Complex Environments with Deep Multimodal Fusion Network

Anh Nguyen, Ngoc Nguyen, Kim Tran, Erman Tjiputra, Quang D. Tran

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted to IROS 2020

1902.07830 2020-07-20 cs.RO 78%

Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

Di Feng, Christian Haase-Schütz, Lars Rosenbaum, Heinz Hertlein, Claudius Glaeser, Fabian Timm, Werner Wiesbeck, Klaus Dietmayer

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments Update copyright; Interactive platform online: https://boschresearch.github.io/multimodalperception/

2006.08209 2020-06-16 physics.ao-ph physics.data-an 78%

Multimodal fusion for sea level anomaly forecasting

Guosong Wang, Xidong Wang, Xinrong Wu, Kexiu Liu, Yiquan Qi, Chunjian Sun, Hongli Fu

专题命中多模态训练与对齐：multimodal(title,abstract)

2006.02991 2020-06-05 cs.LG stat.ML 78%

MHVAE: a Human-Inspired Deep Hierarchical Generative Model for Multimodal Representation Learning

Miguel Vasco, Francisco S. Melo, Ana Paiva

专题命中多模态训练与对齐：multimodal(title,abstract)

2004.13918 2020-04-30 eess.SP cs.LG stat.ML 78%

EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition

Jun-Ho Choi, Jong-Seok Lee

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted in HASCA at ACM UbiComp/ISWC 2019, won the 2nd place in the SHL Recognition Challenge 2019

2003.07162 2020-03-17 cs.IR cs.LG stat.ML 78%

Adversarial Multimodal Representation Learning for Click-Through Rate Prediction

Xiang Li, Chao Wang, Jiwei Tan, Xiaoyi Zeng, Dan Ou, Bo Zheng

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted to WWW 2020, 10 pages

1911.06364 2020-03-06 eess.SP cs.LG stat.ML 78%

MmWave Radar Point Cloud Segmentation using GMM in Multimodal Traffic Monitoring

Feng Jin, Arindam Sengupta, Siyang Cao, Yao-Jan Wu

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments This paper has been accepted by the IEEE International Radar Conference 2020

2002.01982 2020-02-07 eess.IV cs.LG eess.SP q-bio.GN 78%

Multimodal fusion of imaging and genomics for lung cancer recurrence prediction

Vaishnavi Subramanian, Minh N. Do, Tanveer Syeda-Mahmood

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted for presentation at International Symposium on Biomedical Imaging (ISBI) 2020 (Iowa City). 5 pages, last page references

1912.05075 2019-12-12 cs.LG stat.ML 78%

Multimodal Generative Models for Compositional Representation Learning

Mike Wu, Noah Goodman

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 24 pages content; 7 pages appendix

1911.04048 2019-11-12 stat.ML cs.LG eess.IV eess.SP stat.AP 78%

Multidataset Independent Subspace Analysis with Application to Multimodal Fusion

Rogers F. Silva, Sergey M. Plis, Tulay Adali, Marios S. Pattichis, Vince D. Calhoun

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments For associated code, see https://github.com/rsilva8/MISA For associated data, see https://github.com/rsilva8/MISA-data Submitted to IEEE Transactions on Image Processing on Nov/7/2019: 13 pages, 8 figures Supplement: 16 pages, 5 figures

1906.11768 2019-11-05 stat.ML cs.LG 78%

Hierarchical Optimal Transport for Multimodal Distribution Alignment

John Lee, Max Dabagia, Eva L. Dyer, Christopher J. Rozell

专题命中多模态训练与对齐：multimodal(title,abstract)

1910.03854 2019-10-10 cs.RO 78%

Multimodal representation models for prediction and control from partial information

Martina Zambelli, Antoine Cully, Yiannis Demiris

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted for publication on Robotics and Autonomous Systems

1903.06478 2019-09-20 q-fin.CP cs.LG 78%

Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets

Sang Il Lee, Seong Joon Yoo

专题命中多模态训练与对齐：multimodal(title,abstract)

1907.13098 2019-07-31 cs.RO cs.LG 78%

Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks

Michelle A. Lee, Yuke Zhu, Peter Zachares, Matthew Tan, Krishnan Srinivasan, Silvio Savarese, Li Fei-Fei, Animesh Garg, Jeannette Bohg

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments arXiv admin note: substantial text overlap with arXiv:1810.10191

1906.07354 2019-06-19 q-bio.QM q-bio.NC 78%

Bayesian fusion and multimodal DCM for EEG and fMRI

Huilin Wei, Amirhossein Jafarian, Peter Zeidman, Vladimir Litvak, Adeel Razi, Dewen Hu, Karl J. Friston

专题命中多模态训练与对齐：multimodal(title,abstract)

1906.03772 2019-06-11 stat.ME eess.SP 78%

Multimodal Data Fusion of Non-Gaussian Spatial Fields in Sensor Networks

Pengfei Zhang, Gareth W. Peters, Ido Nevat, Keng Boon Teo, Yixin Wang

专题命中多模态训练与对齐：multimodal(title,abstract)

1905.03053 2019-05-09 cs.LG stat.ML 78%

Multi-modal Graph Fusion for Inductive Disease Classification in Incomplete Datasets

Gerome Vivar, Hendrik Burwinkel, Anees Kazi, Andreas Zwergal, Nassir Navab, Seyed-Ahmad Ahmadi

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 9 pages, 3 figures

1904.13349 2019-05-01 cs.LG stat.ML 78%

Multimodal Classification of Urban Micro-Events

Maarten Sukel, Stevan Rudinac, Marcel Worring

专题命中多模态训练与对齐：multimodal(title,abstract)

1901.00877 2019-01-07 cs.LG q-bio.QM stat.ML 78%

A Network-based Multimodal Data Fusion Approach for Characterizing Dynamic Multimodal Physiological Patterns

Miaolin Fan, Chun-An Chou, Sheng-Che Yen, Yingzi Lin

专题命中多模态训练与对齐：multimodal(title,abstract)

1701.03619 2018-11-21 stat.ML cs.LG physics.data-an 78%

Diffusion-based nonlinear filtering for multimodal data fusion with application to sleep stage assessment

Ori Katz, Ronen Talmon, Yu-Lun Lo, Hau-Tieng Wu

专题命中多模态训练与对齐：multimodal(title,abstract)

1807.07611 2018-08-21 physics.flu-dyn 78%

Multimodal Functions as Flow Signatures in Complex Porous Media

Branko Bijeljic, Ali Q. Raeini, Qingyang Lin, Martin J. Blunt

专题命中多模态训练与对齐：multimodal(title,abstract)

1807.01298 2018-07-04 cs.LG stat.ML 78%

Generalized Bilinear Deep Convolutional Neural Networks for Multimodal Biometric Identification

Sobhan Soleymani, Amirsina Torfi, Jeremy Dawson, Nasser M. Nasrabadi

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted in 2018 IEEE International Conference on Image Processing

1701.01352 2018-02-14 stat.AP cs.IT math.IT 78%

Compressive Sensing-Based Detection with Multimodal Dependent Data

Thakshila Wimalajeewa, Pramod K. Varshney

专题命中多模态训练与对齐：multimodal(title,abstract)

1702.04815 2017-11-10 cs.IR 78%

Multimodal Content Representation and Similarity Ranking of Movies

Konstantinos Bougiatiotis, Theodore Giannakopoulos

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

Comments Preliminary work

1. 多模态训练与对齐 6897 篇

Deep Multimodal Learning: Merging Sensory Data for Massive MIMO Channel Prediction

Training Multimodal Systems for Classification with Multiple Objectives

Cross-modal representation alignment of molecular structure and perturbation-induced transcriptional profiles

Multimodal Data Fusion based on the Global Workspace Theory

A Causal-based Framework for Multimodal Multivariate Time Series Validation Enhanced by Unsupervised Deep Learning as an Enabler for Industry 4.0

Multi-modal Sensor Fusion-Based Deep Neural Network for End-to-end Autonomous Driving with Scene Understanding

Autonomous Navigation in Complex Environments with Deep Multimodal Fusion Network

Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

Multimodal fusion for sea level anomaly forecasting

MHVAE: a Human-Inspired Deep Hierarchical Generative Model for Multimodal Representation Learning

EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition

Adversarial Multimodal Representation Learning for Click-Through Rate Prediction

MmWave Radar Point Cloud Segmentation using GMM in Multimodal Traffic Monitoring

Multimodal fusion of imaging and genomics for lung cancer recurrence prediction

Multimodal Generative Models for Compositional Representation Learning

Multidataset Independent Subspace Analysis with Application to Multimodal Fusion

Hierarchical Optimal Transport for Multimodal Distribution Alignment

Multimodal representation models for prediction and control from partial information

Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets

Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks

Bayesian fusion and multimodal DCM for EEG and fMRI

Multimodal Data Fusion of Non-Gaussian Spatial Fields in Sensor Networks

Multi-modal Graph Fusion for Inductive Disease Classification in Incomplete Datasets

Multimodal Classification of Urban Micro-Events

A Network-based Multimodal Data Fusion Approach for Characterizing Dynamic Multimodal Physiological Patterns

Diffusion-based nonlinear filtering for multimodal data fusion with application to sleep stage assessment

Multimodal Functions as Flow Signatures in Complex Porous Media

Generalized Bilinear Deep Convolutional Neural Networks for Multimodal Biometric Identification

Compressive Sensing-Based Detection with Multimodal Dependent Data

Multimodal Content Representation and Similarity Ranking of Movies