多模态大模型 - arXivDaily 专题

2312.17495 2024-09-16 cs.LG physics.bio-ph q-bio.BM 78%

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Xiaohua Lu, Liangxu Xie, Lei Xu, Rongzhi Mao, Shan Chang, Xiaojun Xu

专题命中多模态训练与对齐：multimodal(title,abstract)

2408.14609 2024-08-28 cs.CR 78%

Securing Biometric Data: Fully Homomorphic Encryption in Multimodal Iris and Face Recognition

Surendra Singh, Lambert Igene, Stephanie Schuckers

专题命中多模态训练与对齐：multimodal(title,abstract)

2310.07048 2024-08-21 cs.LG cs.DC cs.NI 78%

FedMFS: Federated Multimodal Fusion Learning with Selective Modality Communication

Liangqi Yuan, Dong-Jun Han, Vishnu Pandi Chellapandi, Stanislaw H. Żak, Christopher G. Brinton

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments ICC 2024

2408.03096 2024-08-07 cs.SI 78%

Enhancing Twitter Bot Detection via Multimodal Invariant Representations

Jibing Gong, Jiquan Peng, Jin Qu, ShuYing Du, Kaiyu Wang

专题命中多模态训练与对齐：multimodal(title,abstract)

2403.12384 2024-08-02 cs.IR cs.LG 78%

AlignRec: Aligning and Training in Multimodal Recommendations

Yifan Liu, Kangning Zhang, Xiangyuan Ren, Yanhua Huang, Jiarui Jin, Yingjie Qin, Ruilong Su, Ruiwen Xu, Yong Yu, Weinan Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 9 page paper, 2 page appendix. Accepted by CIKM24

2303.06471 2024-07-29 cs.LG 78%

Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review

Asim Waqas, Aakash Tripathi, Ravi P. Ramachandran, Paul Stewart, Ghulam Rasool

专题命中多模态训练与对齐：multimodal(title,abstract)

2311.13817 2024-07-29 cs.LG physics.chem-ph q-bio.QM 78%

Enhancing Peak Assignment in 13C NMR Spectroscopy: A Novel Approach Using Multimodal Alignment

Hao Xu, Zhengyang Zhou, Pengyu Hong

专题命中多模态训练与对齐：multimodal(title,abstract)

2406.18829 2024-06-28 stat.ME stat.ML 78%

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Ruiyang Li, F. DuBois Bowman, Seonjoo Lee

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 17 pages, 6 figures

2401.09181 2024-06-28 cs.LG 78%

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

Junhao Zheng, Qianli Ma, Zhen Liu, Binquan Wu, Huawen Feng

专题命中多模态训练与对齐：multimodal(title,abstract)

2304.12259 2024-06-19 physics.comp-ph cond-mat.mtrl-sci physics.data-an 78%

Imaging 3D Chemistry at 1 nm Resolution with Fused Multi-Modal Electron Tomography

Jonathan Schwartz, Zichao Wendy Di, Yi Jiang, Jason Manassa, Jacob Pietryga, Yiwen Qian, Min Gee Cho, Jonathan L. Rowell, Huihuo Zheng, Richard D. Robinson, Junsi Gu, Alexey Kirilin, Steve Rozeveld, Peter Ercius, Jeffrey A. Fessler, Ting Xu, Mary Scott, Robert Hovden

专题命中多模态训练与对齐：multi-modal(title,abstract)

Journal ref Nat Commun 15, 3555 (2024)

2404.11058 2024-06-10 eess.IV 78%

Multimodal Fusion of Echocardiography and Electronic Health Records for the Detection of Cardiac Amyloidosis

Zishun Feng, Joseph A. Sivak, Ashok K. Krishnamurthy

专题命中多模态训练与对齐：multimodal(title,abstract)

2308.00264 2024-06-04 cs.CL cs.AI cs.LG cs.MM 78%

Multimodal Multi-loss Fusion Network for Sentiment Analysis

Zehui Wu, Ziwei Gong, Jaywon Koo, Julia Hirschberg

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL、cs.AI、cs.MM

Comments First two authors contributed equally to the paper

2405.19031 2024-05-30 cs.IR 78%

SynerGraph: An Integrated Graph Convolution Network for Multimodal Recommendation

Mert Burabak, Tevfik Aytekin

专题命中多模态训练与对齐：multimodal(title,abstract)

2405.16083 2024-05-28 cs.LG 78%

From Orthogonality to Dependency: Learning Disentangled Representation for Multi-Modal Time-Series Sensing Signals

Ruichu Cai, Zhifang Jiang, Zijian Li, Weilin Chen, Xuexin Chen, Zhifeng Hao, Yifan Shen, Guangyi Chen, Kun Zhang

专题命中多模态训练与对齐：multi-modal(title,abstract)

2405.07435 2024-05-14 cs.CE 78%

An Efficient Multimodal Learning Framework to Comprehend Consumer Preferences Using BERT and Cross-Attention

Junichiro Niimi

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments This manuscript is under peer review

2404.16005 2024-04-26 cs.LG eess.SP 78%

Unimodal and Multimodal Sensor Fusion for Wearable Activity Recognition

Hymalai Bello

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted in IEEE 22nd International Conference on Pervasive Computing and Communications (PerCom 2024)

2310.02561 2024-03-27 eess.SP 78%

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)

Haotian Zhang, Shijian Gao, Xiang Cheng, Liuqing Yang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 14 pages, 12 figures, 5 tables

2401.17859 2024-03-20 cs.IR 78%

Towards Semantic Consistency: Dirichlet Energy Driven Robust Multi-Modal Entity Alignment

Yuanyi Wang, Haifeng Sun, Jiabo Wang, Jingyu Wang, Wei Tang, Qi Qi, Shaoling Sun, Jianxin Liao

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments arXiv admin note: text overlap with arXiv:2307.16210 by other authors

2403.12371 2024-03-20 cs.LG 78%

Advancing Time Series Classification with Multimodal Language Modeling

Mingyue Cheng, Yiheng Chen, Qi Liu, Zhiding Liu, Yucong Luo

专题命中多模态训练与对齐：multimodal(title,abstract)

2311.00136 2024-03-19 q-bio.NC cs.LG cs.NE 78%

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data

Antonis Antoniades, Yiyi Yu, Joseph Canzano, William Wang, Spencer LaVere Smith

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 9 pages for main paper. 22 pages in total. 13 figures, 1 table

2403.01483 2024-03-05 cs.RO 78%

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

Jianbo Zhao, Hao Chen, Qingyao Tian, Jian Chen, Bingyu Yang, Hongbin Liu

专题命中多模态训练与对齐：multimodal(title,abstract)

2403.00717 2024-03-04 cs.HC cs.GR 78%

MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

JooYoung Seo, Yilin Xia, Bongshin Lee, Sean McCurry, Yu Jun Yam

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted to CHI 2024. Source code is available at https://github.com/xability/maidr

2402.19071 2024-03-01 cs.CY cs.HC 78%

FATE in MMLA: A Student-Centred Exploration of Fairness, Accountability, Transparency, and Ethics in Multimodal Learning Analytics

Yueqiao Jin, Vanessa Echeverria, Lixiang Yan, Linxuan Zhao, Riordan Alfredo, Yi-Shan Tsai, Dragan Gašević, Roberto Martinez-Maldonado

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 16 pages, 1 figure

2402.12743 2024-02-21 cs.CR cs.LG 78%

APT-MMF: An advanced persistent threat actor attribution method based on multimodal and multilevel feature fusion

Nan Xiao, Bo Lang, Ting Wang, Yikai Chen

专题命中多模态训练与对齐：multimodal(title,abstract)

2401.09904 2024-01-22 eess.SP 78%

Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence

Jie Guo, Hao Chen, Bin Song, Yuhao Chi, Chau Yuen, Fei Richard Yu, Geoffrey Ye Li, Dusit Niyato

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 7 pages, 5 figures, 1 table, accepted by IEEE Communications Magazine

2401.03369 2024-01-10 q-bio.MN cs.LG q-bio.BM 78%

Multi-Modal Representation Learning for Molecular Property Prediction: Sequence, Graph, Geometry

Zeyu Wang, Tianyi Jiang, Jinhuan Wang, Qi Xuan

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 8 pages, 3 figures

2312.15725 2023-12-29 cs.IT eess.SP math.IT 78%

Notes on Information Propagation in Noisy Multichannel Data Models: Insights into Sensor Selection and Fusion in Multimodal Biomedical Applications

Reza Sameni

专题命中多模态训练与对齐：multimodal(title,abstract)

2312.08900 2023-12-15 cs.LG 78%

Context-PEFT: Efficient Multi-Modal, Multi-Task Fine-Tuning

Avelina Asada Hadji-Kyriacou, Ognjen Arandjelovic

专题命中多模态训练与对齐：multi-modal(title,abstract)

2311.02842 2023-11-07 eess.IV eess.SP 78%

An invariant feature extraction for multi-modal images matching

Chenzhong Gao, Wei Li

专题命中多模态训练与对齐：multi-modal(title,abstract)

2311.02282 2023-11-07 cs.LG cs.SY eess.SY 78%

Contrastive Multi-Modal Representation Learning for Spark Plug Fault Diagnosis

Ardavan Modarres, Vahid Mohammad-Zadeh Eivaghi, Mahdi Aliyari Shoorehdeli, Ashkan Moosavian

专题命中多模态训练与对齐：multi-modal(title,abstract)

1. 多模态训练与对齐 6897 篇

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Securing Biometric Data: Fully Homomorphic Encryption in Multimodal Iris and Face Recognition

FedMFS: Federated Multimodal Fusion Learning with Selective Modality Communication

Enhancing Twitter Bot Detection via Multimodal Invariant Representations

AlignRec: Aligning and Training in Multimodal Recommendations

Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review

Enhancing Peak Assignment in 13C NMR Spectroscopy: A Novel Approach Using Multimodal Alignment

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

Imaging 3D Chemistry at 1 nm Resolution with Fused Multi-Modal Electron Tomography

Multimodal Fusion of Echocardiography and Electronic Health Records for the Detection of Cardiac Amyloidosis

Multimodal Multi-loss Fusion Network for Sentiment Analysis

SynerGraph: An Integrated Graph Convolution Network for Multimodal Recommendation

From Orthogonality to Dependency: Learning Disentangled Representation for Multi-Modal Time-Series Sensing Signals

An Efficient Multimodal Learning Framework to Comprehend Consumer Preferences Using BERT and Cross-Attention

Unimodal and Multimodal Sensor Fusion for Wearable Activity Recognition

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)

Towards Semantic Consistency: Dirichlet Energy Driven Robust Multi-Modal Entity Alignment

Advancing Time Series Classification with Multimodal Language Modeling

Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Data

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

FATE in MMLA: A Student-Centred Exploration of Fairness, Accountability, Transparency, and Ethics in Multimodal Learning Analytics

APT-MMF: An advanced persistent threat actor attribution method based on multimodal and multilevel feature fusion

Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence

Multi-Modal Representation Learning for Molecular Property Prediction: Sequence, Graph, Geometry

Notes on Information Propagation in Noisy Multichannel Data Models: Insights into Sensor Selection and Fusion in Multimodal Biomedical Applications

Context-PEFT: Efficient Multi-Modal, Multi-Task Fine-Tuning

An invariant feature extraction for multi-modal images matching

Contrastive Multi-Modal Representation Learning for Spark Plug Fault Diagnosis