多模态大模型

Multimodal Quantum Vision Transformer for Enzyme Commission Classification from Biochemical Representations

Murat Isik, Mandeep Kaur Saggi, Humaira Gowher, Sabre Kais

机构 * Purdue University（普渡大学） ； NC State University（北卡罗来纳州立大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted at IEEE International Conference on Quantum Artificial Intelligence (QAI) 2025

MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representations

Daniel Bogdoll, Yitian Yang, Tim Joseph, Melih Yazgan, J. Marius Zöllner

机构 * FZI Research Center for Information Technology, Germany（德国弗赖堡信息科技研究中心） ； Karlsruhe Institute of Technology, Germany（德国卡尔斯鲁厄理工学院） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Daniel Bogdoll and Yitian Yang contributed equally. Accepted for publication at IV 2025

Hypercomplex Prompt-aware Multimodal Recommendation

Zheyu Chen, Jinfeng Xu, Hewei Wang, Shuo Yang, Zitong Wan, Haibo Hu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted by CIKM 2025

Chem3DLLM: 3D Multimodal Large Language Models for Chemistry

Lei Jiang, Shuzhou Sun, Biqing Qi, Yuchen Fu, Xiaohua Xu, Yuqiang Li, Dongzhan Zhou, Tianfan Fu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 15 pages, 9 figures

Multimodal Fusion And Sparse Attention-based Alignment Model for Long Sequential Recommendation

Yongrui Fu, Jian Liu, Tao Li, Zonggang Wu, Shouke Qin, Hanmeng Liu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 10 pages

Multi-modal Policies with Physics-informed Representations in Complex Fluid Environments

Haodong Feng, Peiyan Hu, Yue Wang, Dixia Fan

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Where is the Boundary: Multimodal Sensor Fusion Test Bench for Tissue Boundary Delineation

Zacharias Chen, Alexa Cristelle Cahilig, Sarah Dias, Prithu Kolar, Ravi Prakash, Patrick J. Codd

机构 * Duke University（杜克大学） ； Research Triangle High School（研究三角高中） ； North Carolina School of Science and Mathematics（北卡罗来纳科学与数学高中） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 4 pages, 5 figures

Physics-Informed Multimodal Bearing Fault Classification under Variable Operating Conditions using Transfer Learning

Tasfiq E. Alam, Md Manjurul Ahsan, Shivakumar Raman

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysis

Maciej Pawłowski, Anna Wróblewska, Sylwia Sysko-Romańczuk

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

AUV-Fusion: Cross-Modal Adversarial Fusion of User Interactions and Visual Perturbations Against VARS

Hai Ling, Tianchi Wang, Xiaohao Liu, Zhulin Tao, Lifang Yang, Xianglin Huang

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)

Comments 14 pages,6 figures

Multimodal Late Fusion Model for Problem-Solving Strategy Classification in a Machine Learning Game

Clemens Witt, Thiemo Leonhardt, Nadine Bergner, Mareen Grillenberger

机构 * TUD Dresden University of Technology（德累斯顿技术大学） ； RWTH Aachen University（亚琛工业大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments This is the author's version of a paper accepted for publication at the 2025 European Conference on Technology Enhanced Learning (EC-TEL 2025). The final authenticated version will be published in the Lecture Notes in Computer Science (LNCS) series by Springer and will be available via SpringerLink

G$^{2}$SF-MIAD: Geometry-Guided Score Fusion for Multimodal Industrial Anomaly Detection

Chengyu Tao, Xuanming Cao, Juan Du

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Applying multimodal learning to Classify transient Detections Early (AppleCiDEr) I: Data set, methods, and infrastructure

Alexandra Junell, Argyro Sasli, Felipe Fontinele Nunes, Maojie Xu, Benny Border, Nabeel Rehemtulla, Mariia Rizhko, Yu-Jing Qin, Theophile Jegou Du Laz, Antoine Le Calloch, Sushant Sharma Chaudhary, Shaowei Wu, Jesper Sollerman, Niharika Sravan, Steven L. Groom, David Hale, Mansi M. Kasliwal, Josiah Purdum, Avery Wold, Matthew J. Graham, Michael W. Coughlin

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 17 pages, 8 figures

Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networks

Ahmad M. Nazar, Abdulkadir Celik, Mohamed Y. Selim, Asmaa Abdallah, Daji Qiao, Ahmed M. Eltawil

机构 * Department of Electrical and Computer Engineering, Iowa State University of Science and Technology（电气与计算机工程系，爱荷华州立大学） ； Computer, Electrical, and Mathematical Sciences & Engineering (CEMSE) Division at King Abdullah University of Science and Technology (KAUST)（国王 Abdullah 科学与技术大学（KAUST）计算机、电气和数学科学与工程（CEMSE）系） 纠错

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Comments Accepted in IEEE Asilomar Conference on Signals, Systems, and Computers 2025

RaMen: Multi-Strategy Multi-Modal Learning for Bundle Construction

Huy-Son Nguyen, Quang-Huy Nguyen, Duc-Hoang Pham, Duc-Trong Le, Hoang-Quynh Le, Padipat Sitkrongwong, Atsuhiro Takasu, Masoud Mansoury

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

MNO : A Multi-modal Neural Operator for Parametric Nonlinear BVPs

Vamshi C. Madala, Nithin Govindarajan, Shivkumar Chandrasekaran

专题命中 多模态训练与对齐 ：multi-modal(title)；multimodal(abstract)

SLIF-MR: Self-loop Iterative Fusion of Heterogeneous Auxiliary Information for Multimodal Recommendation

Jie Guo, Jiahao Jiang, Ziyuan Guo, Bin Song, Yue Sun

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 10 pages,7 figures

Platform for Representation and Integration of multimodal Molecular Embeddings

Erika Yilin Zheng, Yu Yan, Baradwaj Simha Sankar, Ethan Ji, Steven Swee, Irsyad Adam, Ding Wang, Alexander Russell Pelletier, Alex Bui, Wei Wang, Peipei Ping

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Model

Xinghao Wang, Feng Liu, Rui Su, Zhihui Wang, Lihua Fang, Lianqing Zhou, Lei Bai, Wanli Ouyang

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； International School of Information Science and Engineering（国际信息科学与工程学院） ； School of Electronic Information and Electrical Engineering（电子信息与电气工程学院） ； Shanghai Jiao Tong University（上海交通大学） ； Dalian University of Technology（大连理工大学） ； Institute of Earthquake Forecasting（地震预测研究所） ； China Earthquake Administration（中国地震局） 纠错

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)

Comments Code is available at https://github.com/StarMoonWang/SeisMoLLM. v2 fixed errors in the location figures

Dynamical Multimodal Fusion with Mixture-of-Experts for Localizations

Bohao Wang, Zitao Shuai, Fenghao Zhu, Chongwen Huang, Yongliang Shen, Zhaoyang Zhang, Qianqian Yang, Sami Muhaidat, Merouane Debbah

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Robotic Multimodal Data Acquisition for In-Field Deep Learning Estimation of Cover Crop Biomass

Joe Johnson, Phanender Chalasani, Arnav Shah, Ram L. Ray, Muthukumar Bagavathiannan

机构 * Department of Soil and Crop Sciences, Texas A&M University（土壤与作物科学系，德克萨斯A&M大学） ； Department of Computer Science and Engineering, Texas A&M University（计算机科学与工程系，德克萨斯A&M大学） ； Department of Mechanical Engineering, Texas A&M University（机械工程系，德克萨斯A&M大学） ； College of Agriculture, Food and Natural Resources, Prairie View A&M University（农业、食品与自然资源学院，普里奥里视A&M大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments Accepted in the Extended Abstract, The 22nd International Conference on Ubiquitous Robots (UR 2025), Texas, USA

Multimodal Anomaly Detection with a Mixture-of-Experts

Christoph Willibald, Daniel Sliwowski, Dongheui Lee

机构 * Institute of Robotics and Mechatronics (DLR), German Aerospace Center（机器人与机电研究所（DLR），德国航空航天中心） ； Autonomous Systems Lab, Institute of Computer Technology, TU Wien（自主系统实验室，计算机技术研究所，维也纳技术大学） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments 8 pages, 5 figures, 1 table, the paper has been accepted for publication in the Proceedings of the 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)

Cross-Modal Epileptic Signal Harmonization: Frequency Domain Mapping Quantization for Pre-training a Unified Neurophysiological Transformer

Runkai Zhang, Hua Yu, John Q. Gan, Haixian Wang

专题命中 多模态训练与对齐 ：cross-modal(title)；multi-modal(abstract)

MM-AttacKG: A Multimodal Approach to Attack Graph Construction with Large Language Models

Yongheng Zhang, Xinyun Zhao, Yunshan Ma, Haokai Ma, Yingxiao Guan, Guozheng Yang, Yuliang Lu, Xiang Wang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Causality-Inspired Fair Representation Learning for Multimodal Recommendation

Weixin Chen, Li Chen, Yongxin Ni, Yuhan Zhao

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Comments In ACM Transactions on Information Systems (TOIS), 2025 (just accepted)

FuXi-Air: Urban Air Quality Forecasting Based on Emission-Meteorology-Pollutant multimodal Machine Learning

Zhixin Geng, Xu Fan, Xiqiao Lu, Yan Zhang, Guangyuan Yu, Cheng Huang, Qian Wang, Yuewu Li, Weichun Ma, Qi Yu, Libo Wu, Hao Li

机构 * Shanghai Key Laboratory of Atmospheric Particle Pollution and Prevention（上海大气颗粒污染与防治重点实验室） ； National Observations and Research Station for Wetland Ecosystems of the Yangtze Estuary（长江入海口湿地生态系统观测与研究站） ； Department of Environmental Science and Engineering（环境科学与工程学院） ； Shanghai Academy of AI for Science (SAIS)（上海人工智能科学研究院） ； MOE Laboratory for National Development and Intelligent Governance（教育部国家发展与智能治理实验室） ； Shanghai Institute for Energy and Carbon Neutrality Strategy（上海能源与碳中和战略研究院） ； IRDR ICoE on Risk Interconnectivity and Governance on Weather/Climate Extremes Impact and Public Health（国际减灾与发展研究院风险互联与治理国际联合实验室） ； Shanghai Institute of Eco-Chongming (SIEC)（上海生态崇明研究院） ； Shanghai Environmental Monitoring Center (SEMC)（上海市环境监测中心） 纠错

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

A Unified Anti-Jamming Design in Complex Environments Based on Cross-Modal Fusion and Intelligent Decision-Making

Huake Wang, Xudong Han, Bairui Cai, Guisheng Liao, Yinghui Quan

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)

Aligning Multimodal Representations through an Information Bottleneck

Antonio Almudévar, José Miguel Hernández-Lobato, Sameer Khurana, Ricard Marxer, Alfonso Ortega

专题命中 多模态训练与对齐 ：multimodal(title,abstract)

Topological Eigenvalue Theorems for Tensor Analysis in Multi-Modal Data Fusion

Ronald Katende

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)

Comments Error in Results. Need to re-run them

Multimodal Fusion with Relational Learning for Molecular Property Prediction

Zhengyang Zhou, Yunrui Li, Pengyu Hong, Hao Xu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)