arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4874 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4874 篇

2509.01996 2025-09-03 cs.RO cs.HC 78%

MIRAGE: Multimodal Intention Recognition and Admittance-Guided Enhancement in VR-based Multi-object Teleoperation

Chi Sun, Xian Wang, Abhishek Kumar, Chengbin Cui, Lik-Hang Lee

机构 * The Hong Kong Polytechnic University(香港理工大学) University of Jyväskylä(于韦斯屈莱大学)

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by ISMAR 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.01164 2025-09-03 cs.LG eess.IV 78%

A Multimodal Deep Learning Framework for Early Diagnosis of Liver Cancer via Optimized BiLSTM-AM-VMD Architecture

Cheng Cheng, Zeping Chen, Xavier Wang

机构 * Department of Encephalopathy, Chengdu Pidu District Hospital of Traditional Chinese Medicine, Chengdu 611730, China(成都Pidu区中医医院神经病科) Department of Tuina, Chengdu Pidu District Hospital of Traditional Chinese Medicine, Chengdu 611730, China(成都Pidu区中医医院推拿科) Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA(卡内基梅隆大学电气与计算机工程系)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.01123 2025-09-03 eess.SY cs.SI cs.SY 78%

Using Gaussian Mixtures to Model Evolving Multi-Modal Beliefs Across Social Media

Yijun Chen, Farhad Farokhi, Yutong Bu, Nicholas Kah Yean Low, Jarra Horstman, Julian Greentree, Robin Evans, Andrew Melatos

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 8 pages, 5 figures, IEEE Conference on Decision and Control

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.00775 2025-09-03 physics.optics 78%

Multimodal near-infrared spectroscopy for biosensing applications

Krisztian Neutsch, Jana Nikolic, Asra Mafakheri, Jan Stegemann, Sebastian Kruss

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.07417 2025-08-26 physics.optics physics.app-ph 78%

Multimodal Guided Surface Lattice Resonances in Index-Discontinuous Environments

Suichu Huang, Kan Yao, Hao Wang, Xumin Ding, Feiran Li, Cong Huang, Wentao Huang, Xuezheng Zhao, Yuebing Zheng, Yunlu Pan

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.14523 2025-08-21 cs.LG 78%

Great GATsBi: Hybrid, Multimodal, Trajectory Forecasting for Bicycles using Anticipation Mechanism

Kevin Riehl, Shaimaa K. El-Baklish, Anastasios Kouvelas, Michail A. Makridis

机构 * Traffic Engineering Group, Institute for Transport Planning and Systems, ETH Zürich(交通规划与系统研究所,瑞士苏黎世联邦理工学院)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.14363 2025-08-21 physics.med-ph 78%

Multimodal concentric surface coils for enhanced sensitivity in MR imaging

Yunkun Zhao, Aditya A Bhosale, Xiaoliang Zhang

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.09271 2025-08-14 eess.IV cs.LG 78%

A Generative Imputation Method for Multimodal Alzheimer's Disease Diagnosis

Reihaneh Hassanzadeh, Anees Abrol, Hamid Reza Hassanzadeh, Vince D. Calhoun

机构 * School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA(电气与计算机工程学院,佐治亚理工学院,亚特兰大,GA,USA) Courtesy Faculty Appointment, College of Pharmacy, University of Florida, Gainesville, FL, USA(佛罗里达大学药学院荣誉教职)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.08554 2025-08-13 cs.HC 78%

Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations

Sanchita S. Kamath, Aziz N. Zeidieh, JooYoung Seo

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.07287 2025-08-12 cs.RO 78%

Multimodal Spiking Neural Network for Space Robotic Manipulation

Liwen Zhang, Dong Zhou, Shibo Shao, Zihao Su, Guanghui Sun

机构 * School of Astronautics, Harbin Institute of Technology(航天学院,哈尔滨工业大学)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.07057 2025-08-12 cs.HC cs.CY cs.ET 78%

Rethinking Privacy Indicators in Extended Reality: Multimodal Design for Situationally Impaired Bystanders

Syed Ibrahim Mustafa Shah Bukhari, Maha Sajid, Bo Ji, Brendan David-John

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.05077 2025-08-08 cs.LG cs.RO 78%

Analyzing the Impact of Multimodal Perception on Sample Complexity and Optimization Landscapes in Imitation Learning

Luai Abuelsamen, Temitope Lukman Adebanjo

机构 * University of California, Berkeley(加州大学伯克利分校)

专题命中 其他多模态 :multimodal(title,abstract)

Comments 9 pages, 1 figure, 1 table, theoretical analysis with empirical validation on PerAct implementation in MuJoCo simulation environment

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.03517 2025-08-06 cs.CR 78%

Intrusion Detection in Heterogeneous Networks with Domain-Adaptive Multi-Modal Learning

Mabin Umman Varghese, Zahra Taghiyarrenani

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.22605 2025-07-31 physics.optics cond-mat.mes-hall physics.app-ph 78%

Optically Actuated Transitions in Multimodal, Bistable Micromechanical Oscillators

Lior Michaeli, Ramon Gao, Michael D. Kelzenberg, Claudio U. Hail, John E. Sader, Harry A. Atwater

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.06871 2025-07-30 stat.CO stat.ML 78%

Sampling from high-dimensional, multimodal distributions using automatically tuned, tempered Hamiltonian Monte Carlo

Joonha Park

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.07928 2025-07-29 physics.optics 78%

Hydrodynamic Insight Drives Multimodal Light_Field Dynamics via Streamline Engineering

Wenxiang Yan, Zheng Yuan, Yuan Gao, Zhaozhong Chen, Zhi-Cheng Ren, Xi-Lin Wang, Jianping Ding, Hui-Tian Wang

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.19479 2025-07-28 cs.HC 78%

IoT and Older Adults: Towards Multimodal EMG and AI-Based Interaction with Smart Home

Wiesław Kopeć, Jarosław Kowalski, Aleksander Majda, Anna Duszyk-Bogorodzka, Anna Jaskulska, Cezary Biele

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.18489 2025-07-25 cs.IR 78%

The Best is Yet to Come: Graph Convolution in the Testing Phase for Multimodal Recommendation

Jinfeng Xu, Zheyu Chen, Shuo Yang, Jinze Li, Edith C. H. Ngai

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by MM 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.17298 2025-07-24 astro-ph.SR astro-ph.IM 78%

Multi-modal encoder-decoder neural network for forecasting solar wind speed at L1

Dattaraj B. Dhuri, Shravan M. Hanasoge, Harsh Joon, Gopika SM, Dipankar Das, Bharat Kaul

专题命中 其他多模态 :multi-modal(title);multimodal(abstract)

Comments 18 Pages, 8 figures, Accepted for Publication in ApJS

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.12950 2025-07-21 cs.LG 78%

Insights into a radiology-specialised multimodal large language model with sparse autoencoders

Kenza Bouzid, Shruthi Bannur, Felix Meissen, Daniel Coelho de Castro, Anton Schwaighofer, Javier Alvarez-Valle, Stephanie L. Hyland

机构 * Microsoft Research, Health Futures, Cambridge, United Kingdom(微软研究院,健康未来,剑桥,英国)

专题命中 其他多模态 :multimodal(title,abstract)

Comments Actionable Interpretability Workshop at ICML 2025. 24 pages, 7 figures, 5 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.13217 2025-07-18 cond-mat.mtrl-sci physics.app-ph 78%

From the up-converting multimodal luminescent thermometer to ratiometric visual power density meter based on Er3+,Yb3+ emission

Anam Javaid, Maja Szymczak, Lukasz Marciniak

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.13916 2025-07-18 cs.LG stat.CO stat.ML 78%

Branching Stein Variational Gradient Descent for sampling multimodal distributions

Isaías Bañales, Arturo Jaramillo, Joshué Helí Ricalde-Guerrero

机构 * ) Kyoto University, Disaster Prevention Research Institute, Japan ) Centro de Investigaci\'on en Matem\'aticas A.C., Department of Probability ) ETH Zurich, Department of Mathematics, Switzerland

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.07645 2025-07-11 eess.SY cs.SY 78%

PhysioEdge: Multimodal Compressive Sensing Platform for Wearable Health Monitoring

Rens Baeyens, Dennis Laurijssen, Jan Steckel, Walter Daems

专题命中 其他多模态 :multimodal(title);multi-modal(abstract)

Comments to be published in the proceedings of the 28th Euromicro Conference on Digital System Design (DSD)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.07592 2025-07-11 stat.ME eess.IV 78%

Semantic-guided Masked Mutual Learning for Multi-modal Brain Tumor Segmentation with Arbitrary Missing Modalities

Guoyan Liang, Qin Zhou, Jingyuan Chen, Bingcang Huang, Kai Chen, Lin Gu, Zhe Wang, Sai Wu, Chang Yao

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 9 pages, 3 figures,conference

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.04620 2025-07-08 cs.RO 78%

IDAGC: Adaptive Generalized Human-Robot Collaboration via Human Intent Estimation and Multimodal Policy Learning

Haotian Liu, Yuchuang Tong, Guanchen Liu, Zhaojie Ju, Zhengtao Zhang

机构 * Chinese Academy of Sciences(中国科学院) Institute of Automation(自动化研究所) University of Chinese Academy of Sciences(中国科学院大学) Zhejiang University(浙江大学) Beijing Zhongke Huiling Robot Technology Co., LTD(北京中科创联机器人科技有限公司)

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by IROS 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.18218 2025-07-08 eess.SP 78%

Multimodal Visual Image Based User Association and Beamforming Using Graph Neural Networks

Yinghan Li, Yiming Liu, Wei Yu

专题命中 其他多模态 :multimodal(title,abstract)

Comments 16 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.10566 2025-06-30 cs.LG stat.ML 78%

ROME: Robust Multi-Modal Density Estimator

Anna Mészáros, Julian F. Schumann, Javier Alonso-Mora, Arkady Zgonnikov, Jens Kober

机构 * Cognitive Robotics, TU Delft, Netherlands(认知机器人学,代尔夫特理工大学,荷兰)

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.19201 2025-06-25 cs.RO 78%

The MOTIF Hand: A Robotic Hand for Multimodal Observations with Thermal, Inertial, and Force Sensors

Hanyang Zhou, Haozhe Lou, Wenhao Liu, Enyu Zhao, Yue Wang, Daniel Seita

机构 * Department of Computer Science, Viterbi School of Engineering University of Southern California(计算机科学系,维特比工程学院,南加州大学)

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.02796 2025-06-25 math.NT math.CO 78%

Multimodal sequences and their generating functions

Philip Cuthbertson, Robert Schneider

专题命中 其他多模态 :multimodal(title,abstract)

Comments 13 pages, submitted for publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.20691 2025-06-24 cs.NI cs.LG eess.SP 78%

Wireless-Friendly Window Position Optimization for RIS-Aided Outdoor-to-Indoor Networks based on Multi-Modal Large Language Model

Jinbo Hou, Kehai Qiu, Zitian Zhang, Yong Yu, Kezhi Wang, Stefano Capolongo, Jiliang Zhang, Zeyang Li, Jie Zhang

机构 * Department of Electronic and Electrical Engineering, the University of Sheffield(电子与电气工程系,谢菲尔德大学) Department of Computer Science and Technology, University of Cambridge(计算机科学与技术系,剑桥大学) Brunel University London(伦敦布鲁内尔大学) School of Information and Electronic Engineering, Zhejiang Gongshang University(信息与电子工程学院,浙江工商大学) Design & Health Lab, Department of Architecture, Built Environment and Construction Engineering, Politecnico di Milano(设计与健康实验室,建筑、环境与土木工程系,米兰理工学院) Department of Computer Science, Brunel University London(计算机科学系,伦敦布鲁内尔大学) The State Key Laboratory of Synthetical Automation for Process Industries and The College of Information Science and Engineering, Northeastern University(过程工业综合自动化国家重点实验室和信息科学与工程学院,东北大学) Centre for Wireless Innovation, Queen’s University of Belfast(无线创新中心,贝尔法斯特女王大学)

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏