arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4874 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4874 篇

2405.13023 2024-05-24 cs.HC 78%

A Machine Learning Approach for Predicting Upper Limb Motion Intentions with Multimodal Data in Virtual Reality

Pavan Uttej Ravva, Pinar Kullu, Mohammad Fahim Abrar, Roghayeh Leila Barmaki

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.12431 2024-05-22 cs.DC 78%

Data Sharing at the Edge of the Network: A Disturbance Resilient Multi-modal ITS

Igor Mikolasek, Saeedeh Ghanadbashi, Nima Afraz, Fatemeh Golpayegani

专题命中 其他多模态 :multi-modal(title);multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.11788 2024-05-21 cs.LG 78%

TinyLLaVA Factory: A Modularized Codebase for Small-scale Large Multimodal Models

Junlong Jia, Ying Hu, Xi Weng, Yiming Shi, Miao Li, Xingjian Zhang, Baichuan Zhou, Ziyu Liu, Jie Luo, Lei Huang, Ji Wu

专题命中 其他多模态 :multimodal(title,abstract)

Comments Our codebase is made public at https://github.com/TinyLLaVA/TinyLLaVA_Factory with documentation available at https://tinyllava-factory.readthedocs.io/en/latest/

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03920 2024-05-08 cs.CL cs.AI cs.MM 78%

A Roadmap for Multilingual, Multimodal Domain Independent Deception Detection

Dainis Boumber, Rakesh M. Verma, Fatima Zahra Qachfar

专题命中 其他多模态 :multimodal(title);分类 cs.CL、cs.AI、cs.MM

Comments 6 pages, 1 figure, shorter version in SIAM International Conference on Data Mining (SDM) 2024

Journal ref Proc. SDM 2024, 396-399

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03829 2024-05-08 q-bio.NC 78%

Unsupervised Machine Learning Identifies Latent Ultradian States in Multi-Modal Wearable Sensor Signals

Christopher Thornton, Billy C. Smith, Guillermo M. Besne, Bethany Little, Yujiang Wang

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.01243 2024-05-03 physics.comp-ph physics.data-an 78%

Multimodal reconstruction of TbCo thin film structure with Basyeian analysis of polarised neutron reflectivity

P. S. Savchenkov, K. V. Nikolaev, V. I. Bodnarchuk, A. N. Pirogov, A. V. Belushkin, S. N. Yakunin

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.18631 2024-04-30 cs.LG 78%

Feature importance to explain multimodal prediction models. A clinical use case

Jorn-Jan van de Beld, Shreyasi Pathak, Jeroen Geerdink, Johannes H. Hegeman, Christin Seifert

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted at World Conference on Explainable Artificial Intelligence; 19 pages, 2 figures, 7 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.09744 2024-04-25 cs.LG cond-mat.mtrl-sci 78%

Bridging the Semantic-Numerical Gap: A Numerical Reasoning Method of Cross-modal Knowledge Graph for Material Property Prediction

Guangxuan Song, Dongmei Fu, Zhongwei Qiu, Zijiang Yang, Jiaxin Dai, Lingwei Ma, Dawei Zhang

专题命中 其他多模态 :cross-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.03165 2024-04-24 math.OC 78%

The Impact of Congestion and Dedicated Lanes on On-Demand Multimodal Transit Systems

Jason Lu, Anthony Trasatti, Hongzhao Guan, Kevin Dalmeijer, Pascal Van Hentenryck

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.01163 2024-04-16 cs.SI cs.IR 78%

A Multi-Modal Latent-Features based Service Recommendation System for the Social Internet of Things

Amar Khelloufi, Huansheng Ning, Abdenacer Naouri, Abdelkarim Ben Sada, Attia Qammar, Abdelkader Khalil, Sahraoui Dhelim, Lingfeng Mao

专题命中 其他多模态 :multi-modal(title,abstract)

Comments Published in IEEE Transactions on Computational Social Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.15301 2024-04-15 cs.LG 78%

ADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer's Disease

Xiaomin Ouyang, Xian Shuai, Yang Li, Li Pan, Xifan Zhang, Heming Fu, Sitong Cheng, Xinyan Wang, Shihua Cao, Jiang Xin, Hazel Mok, Zhenyu Yan, Doris Sau Fung Yu, Timothy Kwok, Guoliang Xing

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.05885 2024-04-10 cs.SI math.OC 78%

Design of Transit-Centric Multimodal Urban Mobility System with Autonomous Mobility-on-Demand

Xiaotong Guo, Jinhua Zhao

专题命中 其他多模态 :multimodal(title,abstract)

Comments 31 Pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.12011 2024-04-04 nucl-th 78%

Multimodal fission from self-consistent calculations

Daniel Lay, Eric Flynn, Sylvester Agbemava, Kyle Godbey, Witold Nazarewicz, Samuel A. Giuliani, Jhilam Sadhukhan

专题命中 其他多模态 :multimodal(title,abstract)

Journal ref Phys. Rev. C 109, 044306 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.13066 2024-03-21 eess.SP 78%

Multimodal wearable EEG, EMG and accelerometry measurements improve the accuracy of tonic-clonic seizure detection in-hospital

Jingwei Zhang, Lauren Swinnen, Christos Chatzichristos, Victoria Broux, Renee Proost, Katrien Jansen, Benno Mahler, Nicolas Zabler, Nino Epitashvilli, Matthias Dümpelmann, Andreas Schulze-Bonhage, Elisabeth Schriewer, Ummahan Ermis, Stefan Wolking, Florian Linke, Yvonne Weber, Mkael Symmonds, Arjune Sen, Andrea Biondi, Mark P. Richardson, Abuhaiba Sulaiman, Ana Isabel Silva, Francisco Sales, Gergely Vértes, Wim Van Paesschen, Maarten De Vos

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.12719 2024-03-20 cs.LG 78%

Bilevel Hypergraph Networks for Multi-Modal Alzheimer's Diagnosis

Angelica I. Aviles-Rivero, Chun-Wun Cheng, Zhongying Deng, Zoe Kourtzi, Carola-Bibiane Schönlieb

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.03414 2024-03-19 math.OC 78%

Multimodal Transportation Pricing Alliance Design: Large-Scale Optimization for Rapid Gains

Kayla Cummings, Vikrant Vaze, Özlem Ergun, Cynthia Barnhart

专题命中 其他多模态 :multimodal(title,abstract)

Comments v1 Submitted to Transportation Science 8 Jan 2023. v2 Submitted to Transportation Science 17 March 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.05002 2024-03-12 cs.RO 78%

LHMap-loc: Cross-Modal Monocular Localization Using LiDAR Point Cloud Heat Map

Xinrui Wu, Jianbo Xu, Puyuan Hu, Guangming Wang, Hesheng Wang

专题命中 其他多模态 :cross-modal(title,abstract)

Comments Accepted by 2024 IEEE International Conference on Robotics and Automation (ICRA 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.04974 2024-03-12 cs.RO 78%

Embracing Large Language and Multimodal Models for Prosthetic Technologies

Sharmita Dey, Arndt F. Schilling

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.06027 2024-03-12 cs.LG eess.SP 78%

Multimodal deep learning approach to predicting neurological recovery from coma after cardiac arrest

Felix H. Krones, Ben Walker, Guy Parsons, Terry Lyons, Adam Mahdi

专题命中 其他多模态 :multimodal(title,abstract)

Comments 5 figures, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17188 2024-03-12 cs.IR 78%

PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-Tuning

Wei Wei, Jiabin Tang, Yangqin Jiang, Lianghao Xia, Chao Huang

专题命中 其他多模态 :multi-modal(title,abstract)

Comments WWW 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.14718 2024-03-12 cs.RO 78%

Design and Control of a Small Humanoid Equipped with Flight Unit and Wheels for Multimodal Locomotion

Kazuki Sugihara, Moju Zhao, Takuzumi Nishio, Tasuku Makabe, Kei Okada, Masayuki Inaba

专题命中 其他多模态 :multimodal(title,abstract)

Comments 8 pages, 17 figures. Accepted by IEEE Robotics and Automation Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17269 2024-03-11 cs.LG 78%

Curriculum Learning Meets Directed Acyclic Graph for Multimodal Emotion Recognition

Cam-Van Thi Nguyen, Cao-Bach Nguyen, Quang-Thuy Ha, Duc-Trong Le

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by LREC-COLING 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.03775 2024-03-07 physics.optics cs.ET 78%

Photonic-electronic spiking neuron with multi-modal and multi-wavelength excitatory and inhibitory operation for high-speed neuromorphic sensing and computing

Weikang Zhang, Matěj Hejda, Qusay Raghib Ali Al-Taai, Dafydd Owen-Newns, Bruno Romeira, José M. L. Figueiredo, Joshua Robertson, Edward Wasige, Antonio Hurtado

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 12 pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.01524 2024-03-05 physics.app-ph physics.ins-det 78%

Aerosol Jet Printing of High-Temperature Multimodal Sensors for Strain and Temperature Sensing

Md. Omarsany Bappy, Qiang Jiang, Stephanie Atampugre, Yanliang Zhang

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17806 2024-02-29 cs.LG cond-mat.mtrl-sci stat.ML 78%

Material Microstructure Design Using VAE-Regression with Multimodal Prior

Avadhut Sardeshmukh, Sreedhar Reddy, BP Gautham, Pushpak Bhattacharyya

专题命中 其他多模态 :multimodal(title);multi-modal(abstract)

Comments 12 pages main paper, 9 pages appendix. 10 tables and 11 figures. Accepted for publication in PAKDD 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.08405 2024-02-27 q-fin.RM cs.LG stat.ML 78%

Multimodal Generative Models for Bankruptcy Prediction Using Textual Data

Rogelio A. Mancisidor, Kjersti Aas

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.14266 2024-02-23 cs.IT math.IT 78%

Efficient Solvers for Wyner Common Information with Application to Multi-Modal Clustering

Teng-Hui Huang, Hesham El Gamal

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.11262 2024-02-20 cs.IR cs.LG 78%

Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minima

Shanshan Zhong, Zhongzhan Huang, Daifeng Li, Wushao Wen, Jinghui Qin, Liang Lin

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by WWW'24

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.08817 2024-02-15 eess.SY cs.SY 78%

An Adaptive System Architecture for Multimodal Intelligent Transportation Systems

Muhammad Farooq, Nima Afraz, Fatemeh Golpayegani

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.02572 2024-02-14 math.CT cs.LO 78%

Semantics of multimodal adjoint type theory

Michael Shulman

专题命中 其他多模态 :multimodal(title,abstract)

Comments 19 pages. v2: Improved notation; extended pre-proceedings version for MFPS 2023. v3: correct some mis-wordings, final. v4: condensed version for conference postproceedings

Journal ref Electronic Notes in Theoretical Informatics and Computer Science, Volume 3 - Proceedings of MFPS XXXIX (November 23, 2023) entics:12300

详情

展开后加载摘要…

URL PDF HTML 收藏