多模态大模型 - arXivDaily 专题

2310.08114 2023-10-13 cs.RO 78%

Multi-Modal Sensor Fusion and Object Tracking for Autonomous Racing

Phillip Karle, Felix Fent, Sebastian Huch, Florian Sauerbeck, Markus Lienkamp

专题命中多模态训练与对齐：multi-modal(title,abstract)

Journal ref IEEE Transactions on Intelligent Vehicles, vol. 8, no. 7, pp. 3871-3883, July 2023

2310.07648 2023-10-12 cs.HC cs.LG eess.SP 78%

Hypercomplex Multimodal Emotion Recognition from EEG and Peripheral Physiological Signals

Eleonora Lopez, Eleonora Chiarantano, Eleonora Grassucci, Danilo Comminiello

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Published at IEEE ICASSP workshops 2023

2310.02275 2023-10-05 cs.LG q-bio.GN 78%

MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data

Tianyu Liu, Yuge Wang, Rex Ying, Hongyu Zhao

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by NeurIPS 2023

2309.16816 2023-10-02 cs.LG 78%

PROSE: Predicting Operators and Symbolic Expressions using Multimodal Transformers

Yuxuan Liu, Zecheng Zhang, Hayden Schaeffer

专题命中多模态训练与对齐：multimodal(title,abstract)

2308.09442 2023-08-22 cs.CE 78%

BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine

Yizhen Luo, Jiahuan Zhang, Siqi Fan, Kai Yang, Yushuai Wu, Mu Qiao, Zaiqing Nie

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 12 pages, 4 figures

2208.11061 2023-08-17 cs.LG 78%

Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping

Bodong Zhou, Jiahui Liu, Songyi Cui, Yaping Zhao

专题命中多模态训练与对齐：multimodal(title,abstract)

Journal ref 2022 IEEE International Conference on Data Science and Advanced Analytics

2308.04067 2023-08-15 cs.IR 78%

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

Wei Ji, Xiangyan Liu, An Zhang, Yinwei Wei, Yongxin Ni, Xiang Wang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 11 pages, 7 figures, accepted in ACM MM 2023

2308.01966 2023-08-07 cs.MM cs.CL cs.LG cs.SD eess.AS 78%

DCTM: Dilated Convolutional Transformer Model for Multimodal Engagement Estimation in Conversation

Vu Ngoc Tu, Van Thong Huynh, Hyung-Jeong Yang, M. Zaigham Zaheer, Shah Nawaz, Karthik Nandakumar, Soo-Hyung Kim

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL、cs.MM、eess.AS

Comments Accepted in ACMM Grand Challenge

2307.10519 2023-07-21 cs.RO 78%

Probabilistic Multimodal Depth Estimation Based on Camera-LiDAR Sensor Fusion

Johan S. Obando-Ceron, Victor Romero-Cano, Sildomar Monteiro

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

Comments 15 pages. arXiv admin note: text overlap with arXiv:1411.6387, arXiv:1702.02706 by other authors

Journal ref Machine Vision and Applications journal, 2023

2307.07093 2023-07-17 cs.LG eess.SP 78%

MaxCorrMGNN: A Multi-Graph Neural Network Framework for Generalized Multimodal Fusion of Medical Data for Outcome Prediction

Niharika S. D'Souza, Hongzhi Wang, Andrea Giovannini, Antonio Foncubierta-Rodriguez, Kristen L. Beck, Orest Boyko, Tanveer Syeda-Mahmood

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments To appear in ML4MHD workshop at ICML 2023

2306.17374 2023-07-03 cs.RO cs.HC 78%

Group Dynamics: Survey of Existing Multimodal Models and Considerations for Social Mediation

Hifza Javed, Nawid Jamali

专题命中多模态训练与对齐：multimodal(title,abstract)

2306.14919 2023-06-28 physics.chem-ph cs.LG q-bio.QM 78%

Beyond Chemical Language: A Multimodal Approach to Enhance Molecular Property Prediction

Eduardo Soares, Emilio Vital Brazil, Karen Fiorela Aquino Gutierrez, Renato Cerqueira, Dan Sanders, Kristin Schmidt, Dmitry Zubarev

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 14 pages, 6 Figures, 5 tables. Submited to NEURIPS 2023, Under review

1911.12918 2023-06-02 eess.SP cs.HC cs.LG 78%

Multimodal Affective States Recognition Based on Multiscale CNNs and Biologically Inspired Decision Fusion Model

Yuxuan Zhao, Xinyan Cao, Jinlong Lin, Dunshan Yu, Xixin Cao

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 21 pages, 11 figures, 8 tables

Journal ref IEEE Transactions on Affective Computing 14 (2023) 1391-1403

2304.12568 2023-04-28 cs.DC cs.LG cs.PF 78%

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Akash Dutta, Jordi Alcaraz, Ali TehraniJamsaz, Eduardo Cesar, Anna Sikora, Ali Jannesari

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 14 pages, 9 figures, 3 tables

1811.12624 2023-04-18 cs.LG stat.ML 78%

Modality-based Factorization for Multimodal Fusion

Elham J. Barezi, Peyman Momeni, Pascale Fung

专题命中多模态训练与对齐：multimodal(title,abstract)

2210.16598 2023-04-14 cs.LG 78%

Self-Supervised Predictive Coding with Multimodal Fusion for Patient Deterioration Prediction in Fine-grained Time Resolution

Kwanhyung Lee, John Won, Heejung Hyun, Sangchul Hahn, Edward Choi, Joohyung Lee

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

Comments Accepted as oral contribution at Trustworthy Machine Learning for Healthcare Workshop, ICLR 2023

2302.05894 2023-04-06 cs.LG 78%

Neural Architecture Search with Multimodal Fusion Methods for Diagnosing Dementia

Michail Chatzianastasis, Loukas Ilias, Dimitris Askounis, Michalis Vazirgiannis

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted at ICASSP 2023

2302.05738 2023-03-21 cs.LG 78%

Cross-Modal Fine-Tuning: Align then Refine

Junhong Shen, Liam Li, Lucio M. Dery, Corey Staten, Mikhail Khodak, Graham Neubig, Ameet Talwalkar

专题命中多模态训练与对齐：cross-modal(title,abstract)

2303.04636 2023-03-09 cs.LG eess.SP 78%

Robust Multimodal Fusion for Human Activity Recognition

Sanju Xaviar, Xin Yang, Omid Ardakanian

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 13 pages

2302.08744 2023-02-20 eess.SP cs.AR 78%

Tensorized Optical Multimodal Fusion Network

Yequan Zhao, Xian Xiao, Geza Kurczveil, Raymond G. Beausoleil, Zheng Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments CLEO 2023 Novel Applications in Integrated Photonics

2202.07732 2022-12-27 cs.HC 78%

Multi-Modal Data Fusion in Enhancing Human-Machine Interaction for Robotic Applications: A Survey

Tauheed Khan Mohd, Nicole Nguyen, Ahmad Y Javaid

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments Planning to add more changes

2211.04767 2022-11-10 eess.IV 78%

Multimodal Remote Sensing Image Registration Based on Adaptive Multi-scale PIIFD

Ning Li, Yuxuan Li, Jichao jiao

专题命中多模态训练与对齐：multimodal(title,abstract)

2211.04260 2022-11-09 astro-ph.GA astro-ph.IM 78%

PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars

Shuxin Hong, Zhiqiang Zou, A-Li Luo, Xiao Kong, Wenyu Yang, Yanli Chen

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 10 pages, 8 figures, accepted for publication in MNRAS

2201.06718 2022-10-24 cs.NE 78%

A Simple Evolutionary Algorithm for Multi-modal Multi-objective Optimization

Tapabrata Ray, Mohammad Mohiuddin Mamun, Hemant Kumar Singh

专题命中多模态训练与对齐：multi-modal(title,abstract)

Journal ref 2022 IEEE Congress on Evolutionary Computation (CEC)

2210.03927 2022-10-11 cs.LG 78%

APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

Elan Rosenfeld, Preetum Nakkiran, Hadi Pouransari, Oncel Tuzel, Fartash Faghri

专题命中多模态训练与对齐：multimodal(title,abstract)

2210.02590 2022-10-07 cs.LG cs.NA math.NA 78%

Star-Graph Multimodal Matching Component Analysis for Data Fusion and Transfer Learning

Nick Lorenzo

专题命中多模态训练与对齐：multimodal(title,abstract)

2110.08465 2022-09-30 cs.LG cs.NE q-bio.NC 78%

Heterogeneous Graph-Based Multimodal Brain Network Learning

Gen Shi, Yifan Zhu, Wenjin Liu, Quanming Yao, Xuesong Li

专题命中多模态训练与对齐：multimodal(title,abstract)

2209.08978 2022-09-20 cs.SE 78%

MMF3: Neural Code Summarization Based on Multi-Modal Fine-Grained Feature Fusion

Zheng Ma, Yuexiu Gao, Lei Lyu, Chen Lyu

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 12 pages, 5 figures

2207.04292 2022-07-12 cond-mat.mtrl-sci 78%

Multimodal Image Registration of Raman Spectral Maps in Two Dimensional Materials by Strain and Doping Analysis

Kirby Schmidt, Anthony Trofe, Tetyana Ignatova

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 11 pages 2 figures

2206.10846 2022-06-23 eess.SY cs.SY 78%

A Multimodal Perceived Stress Classification Framework using Wearable Physiological Sensors

Muhammad Majid, Aamir Arsalan, Syed Muhammad Anwar

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Submitted in IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS

1. 多模态训练与对齐 6897 篇

Multi-Modal Sensor Fusion and Object Tracking for Autonomous Racing

Hypercomplex Multimodal Emotion Recognition from EEG and Peripheral Physiological Signals

MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data

PROSE: Predicting Operators and Symbolic Expressions using Multimodal Transformers

BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine

Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

DCTM: Dilated Convolutional Transformer Model for Multimodal Engagement Estimation in Conversation

Probabilistic Multimodal Depth Estimation Based on Camera-LiDAR Sensor Fusion

MaxCorrMGNN: A Multi-Graph Neural Network Framework for Generalized Multimodal Fusion of Medical Data for Outcome Prediction

Group Dynamics: Survey of Existing Multimodal Models and Considerations for Social Mediation

Beyond Chemical Language: A Multimodal Approach to Enhance Molecular Property Prediction

Multimodal Affective States Recognition Based on Multiscale CNNs and Biologically Inspired Decision Fusion Model

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Modality-based Factorization for Multimodal Fusion

Self-Supervised Predictive Coding with Multimodal Fusion for Patient Deterioration Prediction in Fine-grained Time Resolution

Neural Architecture Search with Multimodal Fusion Methods for Diagnosing Dementia

Cross-Modal Fine-Tuning: Align then Refine

Robust Multimodal Fusion for Human Activity Recognition

Tensorized Optical Multimodal Fusion Network

Multi-Modal Data Fusion in Enhancing Human-Machine Interaction for Robotic Applications: A Survey

Multimodal Remote Sensing Image Registration Based on Adaptive Multi-scale PIIFD

PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars

A Simple Evolutionary Algorithm for Multi-modal Multi-objective Optimization

APE: Aligning Pretrained Encoders to Quickly Learn Aligned Multimodal Representations

Star-Graph Multimodal Matching Component Analysis for Data Fusion and Transfer Learning

Heterogeneous Graph-Based Multimodal Brain Network Learning

MMF3: Neural Code Summarization Based on Multi-Modal Fine-Grained Feature Fusion

Multimodal Image Registration of Raman Spectral Maps in Two Dimensional Materials by Strain and Doping Analysis

A Multimodal Perceived Stress Classification Framework using Wearable Physiological Sensors