arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2766 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2766 篇

2502.02550 2025-02-05 eess.SY cs.SY 78%

Reachability-Based Contingency Planning against Multi-Modal Predictions with Branch MPC

Mohamed-Khalil Bouzidi, Bojan Derajic, Daniel Goehring, Joerg Reichardt

专题命中 多模态Agent :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.00276 2025-01-31 math.OC 78%

Assessing How Ride-hailing Rebalancing Strategies Improve the Resilience of Multi-modal Transportation Systems

Euntak Lee, Rim Slama, Ludovic Leclercq

专题命中 多模态Agent :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.07806 2025-01-30 cs.RO 78%

From Decision to Action in Surgical Autonomy: Multi-Modal Large Language Models for Robot-Assisted Blood Suction

Sadra Zargarzadeh, Maryam Mirzaei, Yafei Ou, Mahdi Tavakoli

专题命中 多模态Agent :multi-modal(title,abstract)

Comments Accepted for Publication in IEEE Robotics and Automation Letters, 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.10738 2025-01-24 cs.CR 78%

PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection

Tri Cao, Chengyu Huang, Yuexin Li, Huilin Wang, Amy He, Nay Oo, Bryan Hooi

专题命中 多模态Agent :multimodal(title,abstract)

Comments Accepted at AAAI 2025 (Oral)

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.12799 2025-01-23 cs.RO 78%

Int2Planner: An Intention-based Multi-modal Motion Planner for Integrated Prediction and Planning

Xiaolei Chen, Junchi Yan, Wenlong Liao, Tao He, Pai Peng

专题命中 多模态Agent :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.02328 2025-01-22 cs.RO 78%

Multi-Modal MPPI and Active Inference for Reactive Task and Motion Planning

Yuezhe Zhang, Corrado Pezzato, Elia Trevisan, Chadi Salmi, Carlos Hernández Corbato, Javier Alonso-Mora

专题命中 多模态Agent :multi-modal(title,abstract)

Comments Accepted for IEEE RA-L, June 2024. Project's website: https://autonomousrobots.nl/paper_websites/m3p2i-aip

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.17293 2024-12-24 q-fin.PM 78%

Multimodal Deep Reinforcement Learning for Portfolio Optimization

Sumit Nawathe, Ravi Panguluri, James Zhang, Sashwat Venkatesh

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.14210 2024-12-20 cs.HC cs.CY cs.SI 78%

Mobilizing Waldo: Evaluating Multimodal AI for Public Mobilization

Manuel Cebrian, Petter Holme, Niccolo Pescetelli

专题命中 多模态Agent :multimodal(title,abstract)

Comments 11 pages, 2 figures, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.11683 2024-12-17 cs.LG 78%

Multimodal LLM for Intelligent Transportation Systems

Dexter Le, Aybars Yunusoglu, Karn Tiwari, Murat Isik, I. Can Dikmen

专题命中 多模态Agent :multimodal(title,abstract)

Comments Accepted at IEEE Symposium Series on Computational Intelligence (SSCI) 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.09001 2024-12-13 cs.HC 78%

MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI

Yunnong Chen, Shuhong Xiao, Yaxuan Song, Zejian Li, Lingyun Sun, Liuqing Chen

专题命中 多模态Agent :multimodal(title,abstract)

Comments 18 pages,7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.14438 2024-11-25 cs.MA 78%

Agent-Based Modeling for Multimodal Transportation of $CO_2$ for Carbon Capture, Utilization, and Storage: CCUS-Agent

Majbah Uddin, Robin Clark, Michael Hilliard, Joshua Thompson, Matthew Langholtz, Erin Webb

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.00522 2024-11-04 cs.LG cs.IT math.IT 78%

Analyzing Multimodal Integration in the Variational Autoencoder from an Information-Theoretic Perspective

Carlotta Langer, Yasmin Kim Georgie, Ilja Porohovoj, Verena Vanessa Hafner, Nihat Ay

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.09054 2024-10-15 cs.AR 78%

Circuits and Systems for Embodied AI: Exploring uJ Multi-Modal Perception for Nano-UAVs on the Kraken Shield

Viviane Potocnik, Alfio Di Mauro, Lorenzo Lamberti, Victor Kartsch, Moritz Scherer, Francesco Conti, Luca Benini

专题命中 多模态Agent :multi-modal(title,abstract)

Comments 5 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.04223 2024-10-08 cs.LG physics.chem-ph q-bio.BM 78%

Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planning

Gang Liu, Michael Sun, Wojciech Matusik, Meng Jiang, Jie Chen

专题命中 多模态Agent :multimodal(title,abstract)

Comments 27 pages, 11 figures, 4 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03806 2024-10-03 cs.HC 78%

In Situ AI Prototyping: Infusing Multimodal Prompts into Mobile Settings with MobileMaker

Savvas Petridis, Michael Xieyang Liu, Alexander J. Fiannaca, Vivian Tsai, Michael Terry, Carrie J. Cai

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.13993 2024-09-24 cs.RO cs.GT 78%

Integrated Decision Making and Trajectory Planning for Autonomous Driving Under Multimodal Uncertainties: A Bayesian Game Approach

Zhenmin Huang, Tong Li, Shaojie Shen, Jun Ma

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.11981 2024-09-19 cs.RO 78%

LMMCoDrive: Cooperative Driving with Large Multimodal Model

Haichao Liu, Ruoyu Yao, Zhenmin Huang, Shaojie Shen, Jun Ma

专题命中 多模态Agent :multimodal(title,abstract)

Comments 7 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.00636 2024-09-04 cs.IR cs.MA 78%

A Learnable Agent Collaboration Network Framework for Personalized Multimodal AI Search Engine

Yunxiao Shi, Min Xu, Haimin Zhang, Xing Zi, Qiang Wu

专题命中 多模态Agent :multimodal(title,abstract)

Comments ACMMM 2024 MMGR WORKSHOP

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.16850 2024-09-02 eess.SP 78%

MPADA: Open source framework for multimodal time series antenna array measurements

Yuyi Chang, Yingzhe Zhang, Asimina Kiourti, Emre Ertin

专题命中 多模态Agent :multimodal(title);cross-modal(abstract)

Comments AMTA 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.07265 2024-08-26 cs.RO 78%

Multimodal Reinforcement Learning for Robots Collaborating with Humans

Afagh Mehri Shervedani, Siyu Li, Natawut Monaikul, Bahareh Abbasi, Barbara Di Eugenio, Milos Zefran

专题命中 多模态Agent :multimodal(title);multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.07311 2024-08-15 cs.HC 78%

MultiSurf-GPT: Facilitating Context-Aware Reasoning with Large-Scale Language Models for Multimodal Surface Sensing

Yongquan Hu, Black Sun, Pengcheng An, Zhuying Li, Wen Hu, Aaron J. Quigley

专题命中 多模态Agent :multimodal(title,abstract)

Comments 6 pages. MOBILEHCI Adjunct '24, 26th International Conference on Mobile Human-Computer Interaction, September 30-October 3, 2024, Melbourne, VIC, Australia

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.04929 2024-07-31 cs.RO 78%

RoboMP$^2$: A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models

Qi Lv, Hao Li, Xiang Deng, Rui Shao, Michael Yu Wang, Liqiang Nie

专题命中 多模态Agent :multimodal(title,abstract)

Comments Accepted by ICML 2024; Project page: https://aopolin-lv.github.io/RoboMP2.github.io/

Journal ref Proceedings of the 41st International Conference on Machine Learning, PMLR 235:33558-33574, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.11898 2024-07-03 cs.RO 78%

Multimodal Safe Control for Human-Robot Interaction

Ravi Pandya, Tianhao Wei, Changliu Liu

专题命中 多模态Agent :multimodal(title,abstract)

Comments American Control Conference (ACC) 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.16118 2024-06-25 cs.SE cs.ET 78%

Beyond words and actions: Exploring Multimodal Analytics and Collaboration in the Digital Age

Diego Miranda, Rene Noel, Jaime Godoy, Carlos Escobedo, Cristian Cechinel, Roberto Munoz

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17387 2024-06-21 cs.RO 78%

RACP: Risk-Aware Contingency Planning with Multi-Modal Predictions

Khaled A. Mustafa, Daniel Jarne Ornia, Jens Kober, Javier Alonso-Mora

专题命中 多模态Agent :multi-modal(title,abstract)

Comments Accepted at IEEE Transactions on Intelligent Vehicles (T-IV)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.12565 2024-05-22 q-fin.RM 78%

Resilience Analysis of Multi-modal Logistics Service Network Through Robust Optimization with Budget-of-Uncertainty

Yaxin Pang, Shenle Pan, Eric Ballot

专题命中 多模态Agent :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.06570 2024-05-14 cs.RO 78%

MORPHeus: a Multimodal One-armed Robot-assisted Peeling System with Human Users In-the-loop

Ruolin Ye, Yifei Hu, Yuhan, Bian, Luke Kulm, Tapomayukh Bhattacharjee

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03470 2024-05-07 cs.RO cs.SY eess.SY 78%

Motion Planning under Uncertainty: Integrating Learning-Based Multi-Modal Predictors into Branch Model Predictive Control

Mohamed-Khalil Bouzidi, Bojan Derajic, Daniel Goehring, Joerg Reichardt

专题命中 多模态Agent :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.08354 2024-04-16 cs.RO 78%

Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal

Max Asselmeier, Jane Ivanova, Ziyi Zhou, Patricio A. Vela, Ye Zhao

专题命中 多模态Agent :multi-modal(title,abstract)

Comments Accepted to 2024 International Conference on Robotics and Automation (ICRA)

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.12677 2024-04-02 math.OC cs.SY eess.SY 78%

Towards a Multimodal Charging Network: Joint Planning of Charging Stations and Battery Swapping Stations for Electrified Ride-Hailing Fleets

Zhijie Lai, Sen Li

专题命中 多模态Agent :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏