多模态大模型

OSUniverse: Benchmark for Multimodal GUI-navigation AI Agents

Mariya Davydova, Daniel Jeffries, Patrick Barker, Arturo Márquez Flores, Sinéad Ryan

机构 * Kentauros AI Inc.（Kentauros AI公司） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Optimizing SIA Development: A Case Study in User-Centered Design for Estuary, a Multimodal Socially Interactive Agent Framework

Spencer Lin, Miru Jun, Basem Rizk, Karen Shieh, Scott Fisher, Sharon Mozgai

机构 * University of Southern California（南加州大学） ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platform

Cheonsu Jeong

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 22 pages, 27 figures

Journal ref 2025 Journal of Intelligence and Information Systems

Multi-modal Knowledge Distillation-based Human Trajectory Forecasting

Jaewoo Jeong, Seohee Lee, Daehee Park, Giwon Lee, Kuk-Jin Yoon

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

MMAC-Copilot: Multi-modal Agent Collaboration Operating Copilot

Zirui Song, Yaohang Li, Meng Fang, Yanda Li, Zhenhao Chen, Zecheng Shi, Yuan Huang, Xiuying Chen, Ling Chen

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Comments Technical Reports

Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models

Chengkai Huang, Junda Wu, Yu Xia, Zixu Yu, Ruhan Wang, Tong Yu, Ruiyi Zhang, Ryan A. Rossi, Branislav Kveton, Dongruo Zhou, Julian McAuley, Lina Yao

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

LEMMo-Plan: LLM-Enhanced Learning from Multi-Modal Demonstration for Planning Sequential Contact-Rich Manipulation Tasks

Kejia Chen, Zheng Shen, Yue Zhang, Lingyun Chen, Fan Wu, Zhenshan Bing, Sami Haddadin, Alois Knoll

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecasting

Bohan Tang, Yiqi Zhong, Chenxin Xu, Wei-Tao Wu, Ulrich Neumann, Yanfeng Wang, Ya Zhang, Siheng Chen

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2110.13947

Evidential Uncertainty Estimation for Multi-Modal Trajectory Prediction

Sajad Marvi, Christoph Rist, Julian Schmidt, Julian Jordan, Abhinav Valada

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Urban Safety Perception Through the Lens of Large Multimodal Models: A Persona-based Approach

Ciro Beneduce, Bruno Lepri, Massimiliano Luca

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Solar Multimodal Transformer: Intraday Solar Irradiance Predictor using Public Cameras and Time Series

Yanan Niu, Roy Sarkis, Demetri Psaltis, Mario Paolone, Christophe Moser, Luisa Lambertini

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments WACV2025

ChatMotion: A Multimodal Multi-Agent for Human Motion Analysis

Lei Li, Sen Jia, Jianhao Wang, Zhaochong An, Jiaang Li, Jenq-Neng Hwang, Serge Belongie

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agents

Sabit Hassan, Hye-Young Chung, Xiang Zhi Tan, Malihe Alikhani

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments To appear at AAMAS, 2025

Exploring Embodied Multimodal Large Models: Development, Datasets, and Future Directions

Shoubin Chen, Zehao Wu, Kai Zhang, Chunyu Li, Baiyang Zhang, Fei Ma, Fei Richard Yu, Qingquan Li

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 81 pages, submitted to a journal for review

Explainable Multimodal Machine Learning for Revealing Structure-Property Relationships in Carbon Nanotube Fibers

Daisuke Kimura, Naoko Tajima, Toshiya Okazaki, Shun Muroga

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 33 pages, 9 figures

DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers

Yuntao Chen, Yuqi Wang, Zhaoxiang Zhang

专题命中 多模态Agent ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Precision ICU Resource Planning: A Multimodal Model for Brain Surgery Outcomes

Maximilian Fischer, Florian M. Hauptmann, Robin Peretzke, Paul Naser, Peter Neher, Jan-Oliver Neumann, Klaus Maier-Hein

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

PsyDraw: A Multi-Agent Multimodal System for Mental Health Screening in Left-Behind Children

Yiqun Zhang, Xiaocui Yang, Xiaobai Li, Siyuan Yu, Yi Luan, Shi Feng, Daling Wang, Yifei Zhang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments preprint

LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulation

Yijun Liu, Wu Liu, Xiaoyan Gu, Yong Rui, Xiaodong He, Yongdong Zhang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Self-supervised cost of transport estimation for multimodal path planning

Vincent Gherold, Ioannis Mandralis, Eric Sihite, Adarsh Salagame, Alireza Ramezani, Morteza Gharib

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

MobileFlow: A Multimodal LLM For Mobile GUI Agent

Songqin Nong, Jiali Zhu, Rui Wu, Jiongchao Jin, Shuo Shan, Xiutian Huang, Wenhao Xu

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Large Language Model-empowered multimodal strain sensory system for shape recognition, monitoring, and human interaction of tensegrity

Zebing Mao, Ryota Kobayashi, Hiroyuki Nabae, Koichi Suzumori

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Multimodal Perception System for Real Open Environment

Yuyang Sha

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction

Yonggang Jin, Ge Zhang, Hao Zhao, Tianyu Zheng, Jarvi Guo, Liuyu Xiang, Shawn Yue, Stephen W. Huang, Zhaofeng He, Jie Fu

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Digitizing Touch with an Artificial Multimodal Fingertip

Mike Lambeta, Tingfan Wu, Ali Sengul, Victoria Rose Most, Nolan Black, Kevin Sawyer, Romeo Mercado, Haozhi Qi, Alexander Sohn, Byron Taylor, Norb Tydingco, Gregg Kammerer, Dave Stroud, Jake Khatha, Kurt Jenkins, Kyle Most, Neal Stein, Ricardo Chavira, Thomas Craven-Bartle, Eric Sanchez, Yitian Ding, Jitendra Malik, Roberto Calandra

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments 28 pages

DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution

Yang Yue, Yulin Wang, Bingyi Kang, Yizeng Han, Shenzhi Wang, Shiji Song, Jiashi Feng, Gao Huang

专题命中 多模态Agent ：multimodal(title)；MLLM(abstract)；分类 cs.AI

Comments 25 pages, 6 figures, NeurIPS 2024

Personalized Recommendation Systems using Multimodal, Autonomous, Multi Agent Systems

Param Thakkar, Anushka Yadav

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Real-time Vehicle-to-Vehicle Communication Based Network Cooperative Control System through Distributed Database and Multimodal Perception: Demonstrated in Crossroads

Xinwen Zhu, Zihao Li, Yuxuan Jiang, Jiazhen Xu, Jie Wang, Xuyang Bai

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments ICICT 2024, 18 pages

Cross-Domain Separable Translation Network for Multimodal Image Change Detection

Tao Zhan, Yuanyuan Zhu, Jie Lan, Qianlong Dang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication

Multimodal Auto Validation For Self-Refinement in Web Agents

Ruhana Azam, Tamer Abuelsaad, Aditya Vempaty, Ashish Jagmohan

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.AI