arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4874 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4874 篇

2407.15426 2024-10-22 cs.LG 78%

Resource-Efficient Federated Multimodal Learning via Layer-wise and Progressive Training

Ye Lin Tun, Chu Myaet Thwal, Minh N. H. Nguyen, Choong Seon Hong

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.10546 2024-10-03 physics.soc-ph 78%

Universal properties of multimodal human mobility: a statistical physics point of view

Chiara Mizzi, Alessandro Fabbri, Giulio Colombini, Flavio Bertini, Armando Bazzani

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.19171 2024-10-01 q-bio.QM cs.LG eess.IV 78%

Reducing Overtreatment of Indeterminate Thyroid Nodules Using a Multimodal Deep Learning Model

Shreeram Athreya, Andrew Melehy, Sujit Silas Armstrong Suthahar, Vedrana Ivezić, Ashwath Radhachandran, Vivek Sant, Chace Moleta, Henry Zheng, Maitraya Patel, Rinat Masamed, Corey W. Arnold, William Speier

专题命中 其他多模态 :multimodal(title);multi-modal(abstract)

Comments 9 pages, 3 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.00380 2024-09-25 stat.ML cs.LG 78%

Learning multi-modal generative models with permutation-invariant encoders and tighter variational objectives

Marcel Hirt, Domenico Campolo, Victoria Leong, Juan-Pablo Ortega

专题命中 其他多模态 :multi-modal(title,abstract)

Journal ref Transactions on Machine Learning Research (TMLR), 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.04962 2024-09-17 physics.geo-ph cs.LG 78%

A foundation model enpowered by a multi-modal prompt engine for universal seismic geobody interpretation across surveys

Hang Gao, Xinming Wu, Luming Liang, Hanlin Sheng, Xu Si, Gao Hui, Yaxing Li

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.18834 2024-09-17 hep-ph 78%

Exploring Exotic Decays of the Higgs Boson to Multi-Photons at the LHC via Multimodal Learning Approaches

A. Hammad, P. Ko, Chih-Ting Lu, Myeonghun Park

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted version for JHEP publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.14416 2024-09-13 stat.AP 78%

Algorithm-agnostic significance testing in supervised learning with multimodal data

Lucas Kook, Anton Rask Lundborg

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.04595 2024-09-10 cs.RO 78%

A Multi-Modal Approach Based on Large Vision Model for Close-Range Underwater Target Localization

Mingyang Yang, Zeyu Sha, Feitian Zhang

专题命中 其他多模态 :multi-modal(title,abstract)

Journal ref IEEE/ASME Transactions on Mechatronics, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.03853 2024-09-09 cs.HC 78%

Users' Perspectives on Multimodal Menstrual Tracking Using Consumer Health Devices

Georgianna Lin, Brenna Li, Helen Li, Chloe Zhao, Khai N Truong, Alex Mariakakis

专题命中 其他多模态 :multimodal(title,abstract)

Comments 25 pages, 4 figures, 2 tables. The paper was accepted by IMWUT/Ubicomp 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.12764 2024-08-26 gr-qc astro-ph.IM 78%

A rapid multi-modal parameter estimation technique for LISA

Charlie Hoy, Connor Weaving, Laura K. Nuttall, Ian Harry

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 28 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.11767 2024-08-22 cs.IR 78%

Do We Really Need to Drop Items with Missing Modalities in Multimodal Recommendation?

Daniele Malitesta, Emanuele Rossi, Claudio Pomo, Tommaso Di Noia, Fragkiskos D. Malliaros

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted at CIKM 2024 in the short paper track

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.10861 2024-08-21 cs.RO cs.HC 78%

DVRP-MHSI: Dynamic Visualization Research Platform for Multimodal Human-Swarm Interaction

Pengming Zhu, Zhiwen Zeng, Weijia Yao, Wei Dai, Huimin Lu, Zongtan Zhou

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.06549 2024-08-14 cs.LG cs.DC 78%

Prioritizing Modalities: Flexible Importance Scheduling in Federated Multimodal Learning

Jieming Bian, Lei Wang, Jie Xu

专题命中 其他多模态 :multimodal(title,abstract)

Comments Submitted to IEEE TMC, under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.01986 2024-08-12 cs.RO 78%

A Vision-Based Tactile Sensing System for Multimodal Contact Information Perception via Neural Network

Weiliang Xu, Guoyuan Zhou, Yuanzhi Zhou, Zhibin Zou, Jiali Wang, Wenfeng Wu, Xinming Li

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.20768 2024-07-31 cs.LG 78%

HyperMM : Robust Multimodal Learning with Varying-sized Inputs

Hava Chaptoukaev, Vincenzo Marcianó, Francesco Galati, Maria A. Zuluaga

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.19467 2024-07-30 cs.IR cs.LG 78%

Enhancing Taobao Display Advertising with Multimodal Representations: Challenges, Approaches and Insights

Xiang-Rong Sheng, Feifan Yang, Litong Gong, Biao Wang, Zhangming Chan, Yujing Zhang, Yueyao Cheng, Yong-Nan Zhu, Tiezheng Ge, Han Zhu, Yuning Jiang, Jian Xu, Bo Zheng

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted at CIKM 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.06313 2024-07-10 eess.SY cs.SY 78%

Data-Driven Multi-Modal Learning Model Predictive Control

Fionna B. Kopp, Francesco Borrelli

专题命中 其他多模态 :multi-modal(title,abstract)

Comments Submitted to 2024 IEEE Conference on Decision and Control

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.01562 2024-07-03 cs.RO 78%

Small but Fair! Fairness for Multimodal Human-Human and Robot-Human Mental Wellbeing Coaching

Jiaee Cheong, Micol Spitale, Hatice Gunes

专题命中 其他多模态 :multimodal(title,abstract)

Comments First two authors have equal contribution, alphabetic order

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.18162 2024-06-27 cs.RO cs.HC 78%

Multimodal Reaching-Position Prediction for ADL Support Using Neural Networks

Yutaka Takase, Kimitoshi Yamazaki

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.14150 2024-06-21 cs.LG 78%

Multi-modal Transfer Learning between Biological Foundation Models

Juan Jose Garau-Luis, Patrick Bordes, Liam Gonzalez, Masa Roller, Bernardo P. de Almeida, Lorenz Hexemer, Christopher Blum, Stefan Laurent, Jan Grzegorzewski, Maren Lang, Thomas Pierrot, Guillaume Richard

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.09051 2024-06-21 stat.ML cs.LG stat.AP 78%

Bayesian Structural Model Updating with Multimodal Variational Autoencoder

Tatsuya Itoi, Kazuho Amishiki, Sangwon Lee, Taro Yaoyama

专题命中 其他多模态 :multimodal(title,abstract)

Comments 44 pages, 21 figures

Journal ref Computer Methods in Applied Mechanics and Engineering,Volume 429, 1 September 2024, 117148

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.02224 2024-06-21 cs.LG stat.ML 78%

TAP: The Attention Patch for Cross-Modal Knowledge Transfer from Unlabeled Modality

Yinsong Wang, Shahin Shahrampour

专题命中 其他多模态 :cross-modal(title,abstract)

Comments Accepted to TMLR

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.09147 2024-06-14 cs.LG 78%

Weakly-supervised anomaly detection for multimodal data distributions

Xu Tan, Junqi Chen, Sylwan Rahardja, Jiawei Yang, Susanto Rahardja

专题命中 其他多模态 :multimodal(title,abstract)

Comments 5 pages, 3 figures. Accepted by 2024 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.07915 2024-06-13 cs.IT eess.SP math.IT 78%

Aggregation Design for Personalized Federated Multi-Modal Learning over Wireless Networks

Benshun Yin, Zhiyong Chen, Meixia Tao

专题命中 其他多模态 :multi-modal(title,abstract)

Comments accepted by IEEE Communications Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.18584 2024-06-12 astro-ph.IM astro-ph.GA 78%

Identification of multi-component LOFAR sources with multi-modal deep learning

Lara Alegre, Philip Best, Jose Sabater, Huub Rottgering, Martin Hardcastle, Wendy Williams

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 20 pages, 14 figures, accepted for publication in MNRAS

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.06448 2024-06-11 cs.HC 78%

How is the Pilot Doing: VTOL Pilot Workload Estimation by Multimodal Machine Learning on Psycho-physiological Signals

Jong Hoon Park, Lawrence Chen, Ian Higgins, Zhaobo Zheng, Shashank Mehrotra, Kevin Salubre, Mohammadreza Mousaei, Steven Willits, Blain Levedahl, Timothy Buker, Eliot Xing, Teruhisa Misu, Sebastian Scherer, Jean Oh

专题命中 其他多模态 :multimodal(title,abstract)

Comments 8 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.02658 2024-06-06 cs.NE 78%

Maintaining Diversity Provably Helps in Evolutionary Multimodal Optimization

Shengjie Ren, Zhijia Qiu, Chao Bian, Miqing Li, Chao Qian

专题命中 其他多模态 :multimodal(title,abstract)

Comments arXiv admin note: text overlap with arXiv:2406.02118

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.02312 2024-06-05 eess.SY cs.SY physics.app-ph 78%

Multimodal Resonance in Strongly Coupled Inductor Arrays

Robert R. Hughes, James Treisman, Alexis Hernandez Arroyo, Anthony J. Mulholland

专题命中 其他多模态 :multimodal(title);multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.18497 2024-05-30 cs.IT math.IT 78%

Capacity Results for Non-Ergodic Multi-Modal Broadcast Channels with Controllable Statistics

Alireza Vahid, Shih-Chun Lin

专题命中 其他多模态 :multi-modal(title,abstract)

Comments under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.17906 2024-05-29 physics.optics 78%

Laser-scanning optical-frequency-comb microscopy for multimodal imaging

Shimpei Kajiwara, Eiji Hase, Shota Nakano, Keishiro Ootani, Tomoya Okabe, Hidenori Koresawa, Akifumi Asahara, Kazumichi Yoshii, Hirotsugu Yamamoto, Kaoru Minoshima, Takeshi Yasui, Takeo Minamikawa

专题命中 其他多模态 :multimodal(title,abstract)

Comments 11 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏