多模态大模型

An LLM-Powered Agent for Physiological Data Analysis: A Case Study on PPG-based Heart Rate Estimation

Mohammad Feli, Iman Azimi, Pasi Liljeberg, Amir M. Rahmani

机构 * Department of Computing, University of Turku（图波卡大学计算机系） ； Department of Computer Science, University of California, Irvine（加州大学伊文斯顿分校计算机科学系） ； School of Nursing, University of California, Irvine（加州大学伊文斯顿分校护理学院） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Sparks: Multi-Agent Artificial Intelligence Model Discovers Protein Design Principles

Alireza Ghafarollahi, Markus J. Buehler

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

On the workflow, opportunities and challenges of developing foundation model in geophysics

Hanlin Sheng, Xinming Wu, Hang Gao, Haibin Di, Sergey Fomel, Jintao Li, Xu Si

机构 * Computational Interpretation Group, Laboratory of Seismology and Physics of the Earth’s Interior, School of Earth and Space Sciences, University of Science and Technology of China（中国科学技术大学地球和空间科学学院地球物理学与地球内部物理实验室） ； SLB ； Bureau of Economic Geology, Jackson School of Geosciences, The University of Texas at Austin（德克萨斯大学奥斯汀分校地质学院经济地质局） ； Georgia Institute of Technology（佐治亚理工学院） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

UFO2: The Desktop AgentOS

Chaoyun Zhang, He Huang, Chiming Ni, Jian Mu, Si Qin, Shilin He, Lu Wang, Fangkai Yang, Pu Zhao, Chao Du, Liqun Li, Yu Kang, Zhao Jiang, Suzhen Zheng, Rujia Wang, Jiaxu Qian, Minghua Ma, Jian-Guang Lou, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

机构 * Microsoft（微软公司） ； ZJU-UIUC Institute（浙大-伊利诺伊大学联合研究所） ； Nanjing University（南京大学） ； Peking University（北京大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments The source code of UFO2 is publicly available at https://github.com/microsoft/UFO/, with comprehensive documentation provided at https://microsoft.github.io/UFO/

Latent Diffusion Planning for Imitation Learning

Amber Xie, Oleh Rybkin, Dorsa Sadigh, Chelsea Finn

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

First-place Solution for Streetscape Shop Sign Recognition Competition

Bin Wang, Li Jing

机构 * Zhejiang Gongshang University（浙江工商大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments technical report

Ascribe New Dimensions to Scientific Data Visualization with VR

Daniela Ushizima, Guilherme Melo dos Santos, Zineb Sordo, Ronald Pandolfi, Jeffrey Donatelli

机构 * Applied Math and Computational Research Division Lawrence Berkeley National Laboratory（应用数学与计算研究部伯克利国家实验室） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

AgentPolyp: Accurate Polyp Segmentation via Image Enhancement Agent

Pu Wang, Zhihua Zhang, Dianjie Lu, Guijuan Zhang, Youshan Zhang, Zhuoran Zheng

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Unlocking the Wisdom of Large Language Models: An Introduction to The Path to Artificial General Intelligence

Edward Y. Chang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 153 pages, 5 figures

UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility

Yonglin Tian, Fei Lin, Yiduo Li, Tengchao Zhang, Qiyao Zhang, Xuan Fu, Jun Huang, Xingyuan Dai, Yutong Wang, Chunwei Tian, Bai Li, Yisheng Lv, Levente Kovács, Fei-Yue Wang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Journal ref Information Fusion, Volume 122, 2025, 103158

Human-like compositional learning of visually-grounded concepts using synthetic environments

Zijun Lin, M Ganesh Kumar, Cheston Tan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Automated radiotherapy treatment planning guided by GPT-4Vision

Sheng Liu, Oscar Pastor-Serrano, Yizheng Chen, Matthew Gopaulchan, Weixing Liang, Mark Buyyounouski, Erqi Pollom, Quynh-Thu Le, Michael Gensheimer, Peng Dong, Yong Yang, James Zou, Lei Xing

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 12 pages, 4 figures

A Human Digital Twin Architecture for Knowledge-based Interactions and Context-Aware Conversations

Abdul Mannan Mohammed, Azhar Ali Mohammad, Jason A. Ortiz, Carsten Neumann, Grace Bochenek, Dirk Reiners, Carolina Cruz-Neira

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Presented at: 2024 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Paper No. 24366, 10 pages, 5 figures

LeForecast: Enterprise Hybrid Forecast by Time Series Intelligence

Zheng Tan, Yiwen Nie, Wenfa Wu, Guanyu Zhang, Yanze Liu, Xinyuan Tian, Kailin Gao, Mengya Liu, Qijiang Cheng, Haipeng Jiang, Yingzheng Ma, Wei Zheng, Yuci Zhu, Yuanyuan Sun, Xiangyu Lei, Xiyu Guan, Wanqing Huang, Shouming Liu, Xiangquan Meng, Pengzhan Qu, Chao Yang, Jiaxuan Fan, Yuan He, Hongsheng Qi, Yangzhou Du

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

ScreenLLM: Stateful Screen Schema for Efficient Action Understanding and Prediction

Yiqiao Jin, Stefano Petrangeli, Yu Shen, Gang Wu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments Accepted to MM4SG Workshop at The Web Conference 2025

SimBEV: A Synthetic Multi-Task Multi-Sensor Driving Data Generation Tool and Dataset

Goodarz Mehr, Azim Eskandarian

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving

Dongkun Zhang, Jiaming Liang, Ke Guo, Sha Lu, Qi Wang, Rong Xiong, Zhenwei Miao, Yue Wang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments CVPR 2025

EmpathyAgent: Can Embodied Agents Conduct Empathetic Actions?

Xinyan Chen, Jiaxin Ge, Hongming Dai, Qiang Zhou, Qiuxuan Feng, Jingtong Hu, Yizhou Wang, Jiaming Liu, Shanghang Zhang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

AlignBot: Aligning VLM-powered Customized Task Planning with User Reminders Through Fine-Tuning for Household Robots

Zhaxizhuoma Zhaxizhuoma, Pengan Chen, Ziniu Wu, Jiawei Sun, Dong Wang, Peng Zhou, Nieqing Cao, Yan Ding, Bin Zhao, Xuelong Li

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Construction

Ganlong Zhao, Guanbin Li, Jia Pan, Yizhou Yu

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Comments Under Submission

TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools

Shanghua Gao, Richard Zhu, Zhenglun Kong, Ayush Noori, Xiaorui Su, Curtis Ginder, Theodoros Tsiligkaridis, Marinka Zitnik

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Project page: https://zitniklab.hms.harvard.edu/TxAgent TxAgent code: https://github.com/mims-harvard/TxAgent ToolUniverse code: https://github.com/mims-harvard/ToolUniverse

Uncertainty in Action: Confidence Elicitation in Embodied Agents

Tianjiao Yu, Vedant Shah, Muntasir Wahed, Kiet A. Nguyen, Adheesh Juvekar, Tal August, Ismini Lourentzou

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Project page: https://plan-lab.github.io/ece/

Automatic Operator-level Parallelism Planning for Distributed Deep Learning -- A Mixed-Integer Programming Approach

Ruifeng She, Bowen Pang, Kai Li, Zehua Liu, Tao Zhong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Closed Loop Interactive Embodied Reasoning for Robot Manipulation

Michal Nazarczuk, Jan Kristof Behrens, Karla Stepanova, Matej Hoffmann, Krystian Mikolajczyk

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to ICRA 2025. Project page: https://michaal94.github.io/CLIER

ACAI for SBOs: AI Co-creation for Advertising and Inspiration for Small Business Owners

Nimisha Karnatak, Adrien Baranes, Rob Marchant, Triona Butler, Kristen Olson

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

CLEA: Closed-Loop Embodied Agent for Enhancing Task Execution in Dynamic Environments

Mingcong Lei, Ge Wang, Yiming Zhao, Zhixin Mai, Qing Zhao, Yao Guo, Zhen Li, Shuguang Cui, Yatong Han, Jinke Ren

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

From Screens to Scenes: A Survey of Embodied AI in Healthcare

Yihao Liu, Xu Cao, Tingting Chen, Yankai Jiang, Junjie You, Minghua Wu, Xiaosong Wang, Mengling Feng, Yaochu Jin, Jintai Chen

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 56 pages, 11 figures, manuscript accepted by Information Fusion

AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials

Yiheng Xu, Dunjie Lu, Zhennan Shen, Junli Wang, Zekun Wang, Yuchen Mao, Caiming Xiong, Tao Yu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments ICLR2025 Spotlight https://agenttrek.github.io

Opus: A Workflow Intention Framework for Complex Workflow Generation

Phillip Kingston, Théo Fagnoni, Mahsun Altin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 1 Figure, 27 Pages

TRIFFID: Autonomous Robotic Aid For Increasing First Responders Efficiency

Jorgen Cani, Panagiotis Koletsis, Konstantinos Foteinos, Ioannis Kefaloukos, Lampros Argyriou, Manolis Falelakis, Iván Del Pino, Angel Santamaria-Navarro, Martin Čech, Ondřej Severa, Alessandro Umbrico, Francesca Fracasso, AndreA Orlandini, Dimitrios Drakoulis, Evangelos Markakis, Iraklis Varlamis, Georgios Th. Papadopoulos

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI