arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2777 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2777 篇

2506.17378 2025-06-24 cs.RO cs.CV 57%

A workflow for generating synthetic LiDAR datasets in simulation environments

Abhishek Phadke, Shakib Mahmud Dipto, Pratip Rana

机构 * School of Engineering \& Computing Christopher Newport University Department of Computer Science Old Dominion University

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.15425 2025-06-19 cs.CL 57%

Understanding GUI Agent Localization Biases through Logit Sharpness

Xingjian Tao, Yiwei Wang, Yujun Cai, Zhicheng Yang, Jing Tang

机构 * The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)) The Hong Kong University of Science and Technology(香港科学与技术大学) University of California, Merced(加州大学梅德福分校) The University of Queensland(昆士兰大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.12594 2025-06-17 cs.AI cs.MA 57%

A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications

Renjun Xu, Jingwen Peng

机构 * Zhejiang University(浙江大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 95 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.10953 2025-06-13 cs.LG cs.CL 57%

Build the web for agents, not agents for the web

Xing Han Lù, Gaurav Kamath, Marius Mosbach, Siva Reddy

机构 * McGill University(麦吉尔大学) Mila – Quebec AI Institute(蒙特利尔人工智能研究所)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.07803 2025-06-10 cs.CV 57%

Image Reconstruction as a Tool for Feature Analysis

Eduard Allakhverdov, Dmitrii Tarasov, Elizaveta Goncharova, Andrey Kuznetsov

机构 * AIRI Moscow, Russia(莫斯科AIRI机构) MIPT Dolgoprudny, Russia(多尔戈普鲁德尼 MIPT)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 23 pages, 14 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00398 2025-06-03 cs.AI cs.RO 57%

Position: Olfaction Standardization is Essential for the Advancement of Embodied Artificial Intelligence

Kordel K. France, Rohith Peddi, Nik Dennler, Ovidiu Daescu

机构 * Dept. of Computer Science University of Texas at Dallas(计算机科学系德克萨斯大学达拉斯分校) Dept. of Computer Science ETH Zurich(计算机科学系瑞士联邦理工学院苏黎世分校)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00235 2025-06-03 cs.CL 57%

MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility

Yexiao He, Ang Li, Boyi Liu, Zhewei Yao, Yuxiong He

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00071 2025-06-03 q-bio.NC cs.AI cs.RO 57%

Human sensory-musculoskeletal modeling and control of whole-body movements

Chenhui Zuo, Guohao Lin, Chen Zhang, Shanning Zhuang, Yanan Sui

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.24354 2025-06-02 cs.CL 57%

Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research

Qianqian Zhang, Jiajia Liao, Heting Ying, Yibo Ma, Haozhan Shen, Jingcheng Li, Peng Liu, Lu Zhang, Chunxin Fang, Kyusong Lee, Ruochen Xu, Tiancheng Zhao

机构 * Om AI Research(Om AI研究机构) Binjiang Institute of Zhejiang University(浙江大学滨江学院) College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments Accepted by ACL 2025 Demo

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.02673 2025-05-30 cs.LG cs.AI cs.MA 57%

MedRAX: Medical Reasoning Agent for Chest X-ray

Adibvafa Fallahpour, Jun Ma, Alif Munim, Hongwei Lyu, Bo Wang

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 16 pages, 4 figures, 5 Tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.21389 2025-05-28 cs.CL 57%

AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs

Xuanwen Ding, Chengjun Pan, Zejun Li, Jiwen Zhang, Siyuan Wang, Zhongyu Wei

机构 * Fudan University(复旦大学) University of Southern California(南加州大学) Shanghai Innovation Institute(上海创新研究院)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.20814 2025-05-28 cs.RO cs.CV 57%

Spatial RoboGrasp: Generalized Robotic Grasping Control Policy

Yiqi Huang, Travis Davies, Jiahuan Yan, Jiankai Sun, Xiang Chen, Luhui Hu

机构 * Stanford University(斯坦福大学) Peking University(北京大学) ZhiCheng AI(智城AI)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.18010 2025-05-28 cs.RO cs.AI cs.HC 57%

Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation

Zilin Huang, Zihao Sheng, Zhengyang Wan, Yansong Qu, Yuhao Luo, Boyue Wang, Pei Li, Yen-Jung Chen, Jiancong Chen, Keke Long, Jiayi Meng, Yue Leng, Sikai Chen

机构 * Department of Civil and Environmental Engineering, University of Wisconsin-Madison(土木与环境工程系,威斯康星大学麦迪逊分校) Lyles School of Civil and Construction Engineering, Purdue University(莱尔斯土木与建设工程学院,普渡大学) Elmore Family School of Electrical and Computer Engineering, Purdue University(埃尔摩家族电气与计算机工程学院,普渡大学) Department of Computer Science and Engineering, The University of Texas at Arlington(计算机科学与工程系,德克萨斯大学阿灵顿分校) Google(谷歌)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments 14 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.20273 2025-05-27 cs.AI 57%

Ten Principles of AI Agent Economics

Ke Yang, ChengXiang Zhai

机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.18845 2025-05-27 cs.CL 57%

Multi-Party Conversational Agents: A Survey

Sagar Sapkota, Mohammad Saqib Hasan, Mubarak Shah, Santu Karmaker

机构 * University of Central Florida(中央佛罗里达大学) Stony Brook University(石溪大学)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.15259 2025-05-27 cs.LG cs.CL 57%

ReGUIDE: Data Efficient GUI Grounding via Spatial Reasoning and Search

Hyunseok Lee, Jeonghoon Kim, Beomjun Kim, Jihoon Tack, Chansong Jo, Jaehong Lee, Cheonbok Park, Sookyo In, Jinwoo Shin, Kang Min Yoo

机构 * KAIST(韩国科学技术院) NAVER Cloud(NAVER云)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.02279 2025-05-26 cs.AI 57%

A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)

Abul Ehtesham, Aditi Singh, Gaurav Kumar Gupta, Saket Kumar

机构 * Kent State University(肯特州立大学) Cleveland State University(克利夫兰州立大学) Youngstown State University(青年州立大学) Northeastern University(东北大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16640 2025-05-23 cs.CR cs.AI 57%

BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization

Xueyang Zhou, Guiyao Tie, Guowen Zhang, Hechang Wang, Pan Zhou, Lichao Sun

机构 * Huazhong University of Science and Technology(华中科技大学) Lehigh University(莱斯大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 19 pages, 12 figures, 6 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16282 2025-05-23 cs.CV 57%

ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay

Fanbin Lu, Zhisheng Zhong, Shu Liu, Chi-Wing Fu, Jiaya Jia

机构 * The Chinese University of Hong Kong(香港中文大学) SmartMore Hong Kong University of Science and Technology(香港理工大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.11871 2025-05-22 cs.HC cs.AI 57%

TinyClick: Single-Turn Agent for Empowering GUI Automation

Pawel Pawlowski, Krystian Zawistowski, Wojciech Lapacz, Adam Wiacek, Marcin Skorupa, Sebastien Postansque, Jakub Hoscilowicz

机构 * Warsaw University of Technology(华沙技术大学)

专题命中 多模态Agent :MLLM(abstract);分类 cs.AI

Comments Accepted to Interspeech 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.17140 2025-05-20 cs.AI 57%

AXIS: Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents

Junting Lu, Zhiyang Zhang, Fangkai Yang, Jue Zhang, Lu Wang, Chao Du, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

机构 * Peking University(北京大学) Nanjing University(南京大学) Microsoft(微软)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.12501 2025-05-20 cs.AI 57%

ALAS: A Stateful Multi-LLM Agent Framework for Disruption-Aware Planning

Edward Y. Chang, Longling Geng

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 36 pages, 10 figures, 19 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.13461 2025-05-20 cs.RO cs.CV cs.MA 57%

Knowledge-Informed Multi-Agent Trajectory Prediction at Signalized Intersections for Infrastructure-to-Everything

Huilin Yin, Yangwenhui Xu, Jiaxiang Li, Hao Zhang, Gerhard Rigoll

机构 * College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院) Shanghai Institute of Intelligent Science and Technology, Tongji University(同济大学上海智能科学与技术研究院) Department of Electrical and Computer Engineering, Technical University of Munich(慕尼黑技术大学电子与计算机工程系)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.07064 2025-05-13 cs.HC cs.AI 57%

ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Use

Shusen Liu, Haichao Miao, Peer-Timo Bremer

机构 * CASC, Computing, Lawrence Livermore National Laboratory(计算部、劳伦斯利弗莫尔国家实验室)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.06897 2025-05-13 cs.AI 57%

Embodied Intelligence: The Key to Unblocking Generalized Artificial Intelligence

Jinhao Jiang, Changlin Chen, Shile Feng, Wanru Geng, Zesheng Zhou, Ni Wang, Shuai Li, Feng-Qi Cui, Erbao Dong

机构 * Hefei University of Technology(合肥工业大学) University of Science and Technology of China(中国科学技术大学) Amazon Development Center Germany GmbH(亚马逊德国开发中心)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 19pages,7 figures,3 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.05762 2025-05-12 cs.RO cs.AI 57%

Multi-Agent Systems for Robotic Autonomy with LLMs

Junhong Chen, Ziqi Yang, Haoyuan G Xu, Dandan Zhang, George Mylonas

机构 * Imperial College London(伦敦帝国学院)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 11 pages, 2 figures, 5 tables, submitted for publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.04454 2025-05-06 cs.CL 57%

Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

Yiheng Xu, Zekun Wang, Junli Wang, Dunjie Lu, Tianbao Xie, Amrita Saha, Doyen Sahoo, Tao Yu, Caiming Xiong

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments ICML 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.00989 2025-05-05 cs.CL 57%

VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Language

Sijin Sun, Liangbin Zhao, Ming Deng, Xiuju Fu

机构 * Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR IHPC)(高性能计算研究所,科技研究局(A*STAR IHPC)) National University of Singapore(国立新加坡大学) Shanghai University(上海大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments 8 pages, 5 figures, 7 tablels, submitted to ITSC2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.05348 2025-05-05 cs.AI 57%

LLM-PySC2: Starcraft II learning environment for Large Language Models

Zongyuan Li, Yanan Ni, Runnan Qi, Lumin Jiang, Chang Lu, Xiaojie Xu, Xiangbei Liu, Pengfei Li, Yunzheng Guo, Zhe Ma, Huanyu Li, Hui Wu, Xian Guo, Kuihua Huang, Xuebo Zhang

机构 * NKAI-Decision-Team(NKAI决策团队)

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.00368 2025-05-02 cs.AI cs.ET cs.MA cs.RO 57%

Urban Air Mobility as a System of Systems: An LLM-Enhanced Holonic Approach

Ahmed R. Sadik, Muhammad Ashfaq, Niko Mäkitalo, Tommi Mikkonen

机构 * Honda Research Institute Europe(本田欧洲研究院) Faculty of IT University of Jyväskylä(信息技术学院约赫斯基尔亚大学)

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏