多模态大模型

QARM V2: Quantitative Alignment Multi-Modal Recommendation for Reasoning User Sequence Modeling

QARM V2：量化对齐多模态推荐用于推理用户序列建模

Tian Xia, Jiaqi Zhang, Yueyang Liu, Hongjian Dou, Tingya Yin, Jiangxia Cao, Xulei Liang, Tianlu Xie, Lihao Liu, Xiang Chen, Shen Wang, Changxin Lao, Haixiang Gan, Jinkai Yu, Keting Cen, Lu Hao, Xu Zhang, Qiqiang Zhong, Zhongbo Sun, Yiyu Wang, Shuang Yang, Mingxin Wen, Xiangyu Wu, Shaoguo Liu, Tingting Gao, Zhaojie Liu, Han Li, Kun Gai

专题命中 多模态训练与对齐 ：multi-modal(title)

AI总结 QARM V2通过量化对齐多模态推荐方法，解决推荐系统中用户序列建模的语义理解与业务需求不匹配问题。

Comments Work in progress

Accurate Pedestrian Tracking in Urban Canyons: A Multi-Modal Fusion Approach

城市峡谷中精确的人行道跟踪：一种多模态融合方法

Shahar Dubiner, Peng Ren, Roberto Manduchi

专题命中 多模态训练与对齐 ：multi-modal(title)

AI总结 本文提出一种多模态融合方法，通过融合GNSS和惯性数据提升城市峡谷中行人定位精度，优于单独使用GNSS或惯性导航。

Enhancing Alzheimer's Detection through Late Fusion of Multi-Modal EEG Features

通过多模态EEG特征晚融合增强阿尔茨海默病检测

Nguyen Thanh Vinh, Manoj Vishwanath, Thinh Nguyen-Quang, Nguyen Viet Ha, Bui Thanh Tung, Huy-Dung Han, Nguyen Quang Linh, Nguyen Hai Linh, Hung Cao

专题命中 多模态训练与对齐 ：multi-modal(title)

AI总结 本研究提出一种基于多模态EEG特征晚融合的深度学习框架，用于提高阿尔茨海默病的早期检测准确率。

Semantic-Enhanced Feature Matching with Learnable Geometric Verification for Cross-Modal Neuron Registration

语义增强的特征匹配与可学习几何验证用于跨模态神经元配准

Wenwei Li, Lingyi Cai, Hui Gong, Qingming Luo, Anan Li

专题命中 多模态训练与对齐 ：cross-modal(title)

AI总结 本文提出一种结合语义增强和可学习几何验证的深度学习框架，用于解决跨模态神经元配准中的模态差距、数据稀缺和组织形变问题，提升生物医学影像配准精度。

Trust-Aware Multimodal Data Fusion for Yield Estimation: A Case Study of the 2020 Beirut Explosion

具有信任意识的多模态数据融合用于产量估计：贝鲁特2020爆炸的案例研究

Lekha Patel, Craig Ulmer, Stephen J. Verzi, Daniel J. Krofcheck, Indu Manickam, Asmeret Naugle, Jaideep Ray

专题命中 多模态训练与对齐 ：multimodal(title)

AI总结 本文提出一种基于贝叶斯分数后验框架的多模态数据融合方法，用于估计爆炸产量，通过信任权重校准不同观测数据，提升不确定性量化和抗偏差能力。

Comments 19 pages, 4 figures, supplementary material, journal

BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model

Adibvafa Fallahpour, Andrew Magnuson, Purav Gupta, Shihao Ma, Jack Naimer, Arnav Shah, Haonan Duan, Omar Ibrahim, Hani Goodarzi, Chris J. Maddison, Bo Wang

专题命中 多模态训练与对齐 ：multimodal(title)

Comments 28 pages, 4 figures, 4 tables

Multi-Modal Decentralized Reinforcement Learning for Modular Reconfigurable Lunar Robots

Ashutosh Mishra, Shreya Santra, Elian Neppel, Edoardo M. Rossi Lombardi, Shamistan Karimov, Kentaro Uno, Kazuya Yoshida

机构 * Space Robotics Lab. (SRL) in Department of Aerospace Engineering, Graduate School of Engineering, Tohoku University（太空机器人实验室（SRL）位于东东北大学航空航天工程系研究生院） ； Politecnico di Milano（米兰理工大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(title)

Comments Accepted in IEEE iSpaRo 2025. Awaiting Publication

Nephrobase Cell+: Multimodal Single-Cell Foundation Model for Decoding Kidney Biology

Chenyu Li, Elias Ziyadeh, Yash Sharma, Bernhard Dumoulin, Jonathan Levinsohn, Eunji Ha, Siyu Pan, Vishwanatha Rao, Madhav Subramaniyam, Mario Szegedy, Nancy Zhang, Katalin Susztak

专题命中 多模态训练与对齐 ：multimodal(title)

CaR1: A Multi-Modal Baseline for BEV Vehicle Segmentation via Camera-Radar Fusion

Santiago Montiel-Marín, Angel Llamazares, Miguel Antunes-García, Fabio Sánchez-García, Luis M. Bergasa

机构 * Department of Electronics. University of Alcalá, Community of Madrid, Spain（电子系。阿尔卡拉大学，马德里社区） 纠错

专题命中 多模态训练与对齐 ：multi-modal(title)

Comments 4 pages, 2 figures

Information Fusion in Multimodal IoT Systems for physical activity level monitoring

Mohsen Shirali, Zahra Ahmadi, Jose-Luis Bayo-Monton, Zoe Valero-Ramon, Carlos Fernandez-Llatas

专题命中 多模态训练与对齐 ：multimodal(title)

Self-Aligning EPM Connector: A Versatile Solution for Adaptive and Multi-Modal Interfaces

Bingchao Wang, Adam A. Stokes

机构 * Soft Systems Group, The School of Engineering, The University of Edinburgh（软系统组、工程学院、爱丁堡大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(title)

GenEDA: Towards Generative Netlist Functional Reasoning via Cross-Modal Circuit Encoder-Decoder Alignment

Wenji Fang, Jing Wang, Yao Lu, Shang Liu, Zhiyao Xie

机构 * Hong Kong University of Science and Technology（香港理工大学） 纠错

专题命中 多模态训练与对齐 ：cross-modal(title)

Comments Accepted by ICCAD'25

CROSS-GAiT: Cross-Attention-Based Multimodal Representation Fusion for Parametric Gait Adaptation in Complex Terrains

Gershom Seneviratne, Kasun Weerakoon, Mohamed Elnoor, Vignesh Rajgopal, Harshavarthan Varatharajan, Mohamed Khalid M Jaffar, Jason Pusey, Dinesh Manocha

专题命中 多模态训练与对齐 ：multimodal(title)

CoC: Chain-of-Cancer based on Cross-Modal Autoregressive Traction for Survival Prediction

Haipeng Zhou, Sicheng Yang, Sihan Yang, Jing Qin, Lei Chen, Lei Zhu

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； Xi'an Jiaotong University（西安交通大学） ； The Hong Kong Polytechnic University（香港理工大学） ； The Hong Kong University of Science and Technology（香港科技大学） 纠错

专题命中 多模态训练与对齐 ：cross-modal(title)

MDF: Multi-Modal Data Fusion with CNN-Based Object Detection for Enhanced Indoor Localization Using LiDAR-SLAM

Saqi Hussain Kalan, Boon Giin Lee, Wan-Young Chung

机构 * Department of Artificial Intelligence Convergence, Pukyong National University（人工智能融合系，浦项国立大学） ； School of Computer Science, University of Nottingham Ningbo China（计算机科学学院，诺丁汉国际大学） 纠错

专题命中 多模态训练与对齐 ：multi-modal(title)

Conversation-Based Multimodal Abuse Detection Through Text and Graph Embeddings

Noé Cecillon, Vincent Labatut, Richard Dufour

专题命中 多模态训练与对齐 ：multimodal(title)

Journal ref Computing, 2025, 107, pp.124

St4DeM: A software suite for multi-modal 4D-STEM acquisition techniques

Toni Uusimaeki, Cheuk-Wai Tai, Tom Willhammar, Thomas Thersleff, Hasan Ali, Seda Ulusoy, Meltem Sezen, Bora Derin

专题命中 多模态训练与对齐 ：multi-modal(title)

Multi-modal single-cell foundation models via dynamic token adaptation

Wenmin Zhao, Ana Solaguren-Beascoa, Grant Neilson, Louwai Muhammed, Liisi Laaniste, Sera Aylin Cakiroglu

专题命中 多模态训练与对齐 ：multi-modal(title)

Federated Multimodal Learning with Dual Adapters and Selective Pruning for Communication and Computational Efficiency

Duy Phuong Nguyen, J. Pablo Munoz, Tanya Roosta, Ali Jannesari

专题命中 多模态训练与对齐 ：multimodal(title)

Comments Accepted at CCGrid 2025

Cross-domain Recommender Systems via Multimodal Domain Adaptation

Adamya Shyam, Ramya Kamani, Venkateswara Rao Kagita, Vikas Kumar

专题命中 多模态训练与对齐 ：multimodal(title)

Comments 20 pages

Personalized Coupled Tensor Decomposition for Multimodal Data Fusion: Uniqueness and Algorithms

Ricardo Augusto Borsoi, Konstantin Usevich, David Brie, Tülay Adali

专题命中 多模态训练与对齐 ：multimodal(title)

Scalable Representation Learning for Multimodal Tabular Transactions

Natraj Raman, Sumitra Ganesh, Manuela Veloso

专题命中 多模态训练与对齐 ：multimodal(title)

Looking through the mind's eye via multimodal encoder-decoder networks

Arman Afrasiyabi, Erica Busch, Rahul Singh, Dhananjay Bhaskar, Laurent Caplette, Nicholas Turk-Browne, Smita Krishnaswamy

专题命中 多模态训练与对齐 ：multimodal(title)

MuTT: A Multimodal Trajectory Transformer for Robot Skills

Claudius Kienle, Benjamin Alt, Onur Celik, Philipp Becker, Darko Katic, Rainer Jäkel, Gerhard Neumann

专题命中 多模态训练与对齐 ：multimodal(title)

Teaching Visual Accessibility in Introductory Data Science Classes with Multi-Modal Data Representations

JooYoung Seo, Mine Dogucu

专题命中 多模态训练与对齐 ：multi-modal(title)

Comments 17 pages, 6 figures

Journal ref Journal of Data Science Volume 21, Issue 2 (2023)

Multimodal Security of Iris and Fingerprint with Bloom Filters

R. Sridevi, P. Shobana

专题命中 多模态训练与对齐 ：multimodal(title)

Comments Volume 8, Issue 10, 2020, Aegaeum Journal

Journal ref Aegaeum Journal Volume 8 Issue 10 (2020) 402-410

A Unified Multi-Task Semantic Communication System for Multimodal Data

Guangyi Zhang, Qiyu Hu, Zhijin Qin, Yunlong Cai, Guanding Yu, Xiaoming Tao

专题命中 多模态训练与对齐 ：multimodal(title)

Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC

Bo Lin, Chuanbin Zhao, Feifei Gao, Geoffrey Ye Li

专题命中 多模态训练与对齐 ：multi-modal(title)

Simplified Shielded MEG-MRI Multimodal System with Scalar-mode Optically Pumped Magnetometers as MEG Sensors

Yosuke Ito, Hiroyuki Ueda, Takenori Oida, Takahiro Moriya, Akinori Saito, Motohiro Suyama

专题命中 多模态训练与对齐 ：multimodal(title)

Comments 11 pages, 11 figures

Multimodal and multicontrast image fusion via deep generative models

Giovanna Maria Dimitri, Simeon Spasov, Andrea Duggento, Luca Passamonti, Pietro Li`o, Nicola Toschi

专题命中 多模态训练与对齐 ：multimodal(title)