arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4868 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4868 篇

2409.17273 2025-03-19 eess.IV cs.CV cs.LG 79%

Targeted Neural Architectures in Multi-Objective Frameworks for Complete Glioma Characterization from Multimodal MRI

Shravan Venkatraman, Pandiyaraju V, Abeshek A, Aravintakshan S A, Pavan Kumar S, Kannan A, Madhan S

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments 29 pages, 25 figures, 6 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.07751 2025-03-14 eess.IV cs.CV 79%

DeepThalamus: A novel deep learning method for automatic segmentation of brain thalamic nuclei from multimodal ultra-high resolution MRI

Marina Ruiz-Perez, Sergio Morell-Ortega, Marien Gadea, Roberto Vivo-Hernando, Gregorio Rubio, Fernando Aparici, Mariam de la Iglesia-Vaya, Thomas Tourdias, Pierrick Coupé, José V. Manjón

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.05971 2025-03-13 cs.LG cs.AI 79%

A Real-time Multimodal Transformer Neural Network-powered Wildfire Forecasting System

Qijun Chen, Shaofan Li

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.06827 2025-03-11 eess.IV cs.CV 79%

Two-stage Deep Denoising with Self-guided Noise Attention for Multimodal Medical Images

S M A Sharif, Rizwan Ali Naqvi, Woong-Kee Loh

专题命中 其他多模态 :multimodal(title);multi-modal(abstract);分类 cs.CV

Comments IEEE Transactions on Radiation and Plasma Medical Sciences (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.06797 2025-03-11 eess.IV cs.AI q-bio.QM 79%

Multimodal AI-driven Biomarker for Early Detection of Cancer Cachexia

Sabeen Ahmed, Nathan Parker, Margaret Park, Evan W. Davis, Jennifer B. Permuth, Matthew B. Schabath, Yasin Yilmaz, Ghulam Rasool

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

Comments 17 pages, 6 figures, 3 Tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.05190 2025-03-10 cs.CV 79%

Partially Supervised Unpaired Multi-Modal Learning for Label-Efficient Medical Image Segmentation

Lei Zhu, Yanyu Xu, Huazhu Fu, Xinxing Xu, Rick Siow Mong Goh, Yong Liu

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted to MLMI 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.05186 2025-03-10 q-fin.ST cs.AI cs.LG 79%

Multimodal Stock Price Prediction

Furkan Karadaş, Bahaeddin Eravcı, Ahmet Murat Özbayoğlu

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

Comments 9 pages, 6 table

Journal ref In Proceedings of the 17th International Conference on Agents and Artificial Intelligence 3 (2025) 687-694

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.04506 2025-03-07 cs.SE cs.AI 79%

Multi-modal Summarization in Model-Based Engineering: Automotive Software Development Case Study

Nenad Petrovic, Yurui Zhang, Moaad Maaroufi, Kuo-Yi Chao, Lukasz Mazur, Fengjunjie Pan, Vahid Zolfaghari, Alois Knoll

专题命中 其他多模态 :multi-modal(title);multimodal(abstract);分类 cs.AI

Comments Conference paper accepted for IntelliSys2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.03792 2025-03-07 cs.LG cs.AI 79%

Rebalanced Multimodal Learning with Data-aware Unimodal Sampling

Qingyuan Jiang, Zhouyang Chi, Xiao Ma, Qirong Mao, Yang Yang, Jinhui Tang

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.02616 2025-03-05 cs.LG cs.CV 79%

Smoothing the Shift: Towards Stable Test-Time Adaptation under Complex Multimodal Noises

Zirun Guo, Tao Jin

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments Accepted at ICLR 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.00221 2025-02-10 eess.IV cs.CV 79%

multiGradICON: A Foundation Model for Multimodal Medical Image Registration

Basar Demir, Lin Tian, Thomas Hastings Greer, Roland Kwitt, Francois-Xavier Vialard, Raul San Jose Estepar, Sylvain Bouix, Richard Jarrett Rushmore, Ebrahim Ebrahim, Marc Niethammer

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.02761 2025-02-06 cs.LG cs.CV cs.DC 79%

Federated Low-Rank Tensor Estimation for Multimodal Image Reconstruction

Anh Van Nguyen, Diego Klabjan, Minseok Ryu, Kibaek Kim, Zichao Di

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.00960 2025-02-04 cs.CV 79%

SAM-guided Pseudo Label Enhancement for Multi-modal 3D Semantic Segmentation

Mingyu Yang, Jitong Lu, Hun-Seok Kim

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments ICRA 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.03333 2025-02-03 cs.CV 79%

Real-time Multi-modal Object Detection and Tracking on Edge for Regulatory Compliance Monitoring

Jia Syuen Lim, Ziwei Wang, Jiajun Liu, Abdelwahed Khamis, Reza Arablouei, Robert Barlow, Ryan McAllister

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Journal ref IJCAI (2024) 8725-8728

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.06512 2025-01-29 cs.LG cs.CL 79%

Multimodal Clinical Trial Outcome Prediction with Large Language Models

Wenhao Zheng, Liaoyaqi Wang, Dongshen Peng, Hongxia Xu, Yun Li, Hongtu Zhu, Tianfan Fu, Huaxiu Yao

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.01248 2025-01-28 cs.RO cs.AI cs.LG 79%

Multimodal and Force-Matched Imitation Learning with a See-Through Visuotactile Sensor

Trevor Ablett, Oliver Limoyo, Adam Sigal, Affan Jilani, Jonathan Kelly, Kaleem Siddiqi, Francois Hogan, Gregory Dudek

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

Comments 14 pages, 22 figures

Journal ref IEEE Transactions on Robotics (T-RO), Vol. 41, pp. 946-959, Jan. 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.04322 2025-01-24 cs.CV 79%

Eve: Efficient Multimodal Vision Language Models with Elastic Visual Experts

Miao Rang, Zhenni Bi, Chuanjian Liu, Yehui Tang, Kai Han, Yunhe Wang

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.13307 2025-01-24 cs.CV 79%

From Cross-Modal to Mixed-Modal Visible-Infrared Re-Identification

Mahdi Alehdaghi, Rajarshi Bhattacharya, Pourya Shamsolmoali, Rafael M. O. Cruz, Eric Granger

专题命中 其他多模态 :cross-modal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.10848 2025-01-22 cs.LG cs.AI 79%

Fake Advertisements Detection Using Automated Multimodal Learning: A Case Study for Vietnamese Real Estate Data

Duy Nguyen, Trung T. Nguyen, Cuong V. Nguyen

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.19876 2025-01-13 cs.CR cs.AI 79%

LUMIA: Linear probing for Unimodal and MultiModal Membership Inference Attacks leveraging internal LLM states

Luis Ibanez-Lissen, Lorena Gonzalez-Manzano, Jose Maria de Fuentes, Nicolas Anciaux, Joaquin Garcia-Alfaro

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.21534 2025-01-08 cs.CV 79%

ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models

Mingrui Wu, Xinyue Cai, Jiayi Ji, Jiale Li, Oucheng Huang, Gen Luo, Hao Fei, Guannan Jiang, Xiaoshuai Sun, Rongrong Ji

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments Accepted to NeurIPS 2024; Code:https://github.com/mrwu-mac/ControlMLLM

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.17678 2025-01-08 cs.CV 79%

Hierarchical Light Transformer Ensembles for Multimodal Trajectory Forecasting

Adrien Lafage, Mathieu Barbier, Gianni Franchi, David Filliat

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments WACV 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.17677 2024-12-24 cs.CV 79%

EPE-P: Evidence-based Parameter-efficient Prompting for Multimodal Learning with Missing Modalities

Zhe Chen, Xun Lin, Yawen Cui, Zitong Yu

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments Accepted by ICASSP 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.15614 2024-12-23 cs.CR cs.CV 79%

Technical Report for ICML 2024 TiFA Workshop MLLM Attack Challenge: Suffix Injection and Projected Gradient Descent Can Easily Fool An MLLM

Yangyang Guo, Ziwei Xu, Xilie Xu, YongKang Wong, Liqiang Nie, Mohan Kankanhalli

专题命中 其他多模态 :MLLM(title,abstract);分类 cs.CV

Comments ICML TiFA Challenge Technical Report

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.16208 2024-12-20 q-bio.BM cs.AI cs.LG 79%

InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery

He Cao, Zijing Liu, Xingyu Lu, Yuan Yao, Yu Li

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.10659 2024-12-17 cs.CV cs.LG q-bio.QM 79%

MEATRD: Multimodal Anomalous Tissue Region Detection Enhanced with Spatial Transcriptomics

Kaichen Xu, Qilong Wu, Yan Lu, Yinan Zheng, Wenlin Li, Xingjie Tang, Jun Wang, Xiaobo Sun

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments AAAI 2025. Code: https://github.com/wqlzuel/MEATRD

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.15708 2024-12-11 cs.LG cs.CV 79%

Score-Based Multimodal Autoencoder

Daniel Wesego, Pedram Rooshenas

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.19822 2024-12-02 cs.CL 79%

SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for Incomplete Multimodal Learning in Conversational Emotion Recognition

Fangze Fu, Wei Ai, Fan Yang, Yuntao Shou, Tao Meng, Keqin Li

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

Comments 17 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.18377 2024-11-28 cs.CV cs.LG 79%

XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration

Denys Rozumnyi, Nadine Bertsch, Othman Sbai, Filippo Arcadu, Yuhua Chen, Artsiom Sanakoyeu, Manoj Kumar, Catherine Herold, Robin Kips

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted to WACV 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.15208 2024-11-26 cs.LG cs.AI q-bio.BM 79%

M2oE: Multimodal Collaborative Expert Peptide Model

Zengzhu Guo, Zhiqi Ma

专题命中 其他多模态 :multimodal(title);multi-modal(abstract);分类 cs.AI

Comments accepted by bibm 2024

详情

展开后加载摘要…

URL PDF HTML 收藏