多模态大模型

A Survey on Integration of Large Language Models with Intelligent Robots

Yeseung Kim, Dohyun Kim, Jieun Choi, Jisang Park, Nayoung Oh, Daehyung Park

专题命中 多模态Agent ：multimodal(abstract)

Comments 24 pages, 5 figures, Published in Intelligent Service Robotics (ISR)

Modeling Transit in a Fully Integrated Agent-Based Framework: Methodology and Large-Scale Application

Omer Verbas, Taner Cokyasar, Pedro Veiga de Camargo, Krishna Murthy Gurumurthy, Natalia Zuniga-Garcia, Joshua Auld

专题命中 多模态Agent ：multimodal(abstract)

From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systems

Leixian Shen, Haotian Li, Yun Wang, Huamin Qu

专题命中 多模态Agent ：multi-modal(abstract)

Comments 6 pages, 2 figures, IEEE VIS 2024 Gen4DS Workshop

CompdVision: Combining Near-Field 3D Visual and Tactile Sensing Using a Compact Compound-Eye Imaging System

Lifan Luo, Boyang Zhang, Zhijie Peng, Yik Kin Cheung, Guanlan Zhang, Zhigang Li, Michael Yu Wang, Hongyu Yu

专题命中 多模态Agent ：multi-modal(abstract)

Comments Accepted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2024

Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMD

Nuwan Janaka, Runze Cai, Shengdong Zhao, David Hsu

专题命中 多模态Agent ：multi-modal(abstract)

Comments 10 pages, 5 figures, 1 table

Journal ref UbiComp Companion (2024)

Dynamic On-Palm Manipulation via Controlled Sliding

William Yang, Michael Posa

专题命中 多模态Agent ：multi-modal(abstract)

Comments Project website: https://dynamic-controlled-sliding.github.io/

VIPS-Odom: Visual-Inertial Odometry Tightly-coupled with Parking Slots for Autonomous Parking

Xuefeng Jiang, Fangyuan Wang, Rongzhang Zheng, Han Liu, Yixiong Huo, Jinzhang Peng, Lu Tian, Emad Barsoum

专题命中 多模态Agent ：multi-modal(abstract)

Comments A SLAM Method for Autonomous Parking

Stimulated emission tomography for efficient characterization of spatial entanglement

Yang Xu, Saumya Choudhary, Robert W. Boyd

专题命中 多模态Agent ：multi-modal(abstract)

Beyond Efficiency: Scaling AI Sustainably

Carole-Jean Wu, Bilge Acun, Ramya Raghavendra, Kim Hazelwood

专题命中 多模态Agent ：multi-modal(abstract)

Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving

Zhiyu Huang, Chen Tang, Chen Lv, Masayoshi Tomizuka, Wei Zhan

专题命中 多模态Agent ：multi-modal(abstract)

Comments IEEE Robotics and Automation Letters

ZAPP! Zonotope Agreement of Prediction and Planning for Continuous-Time Collision Avoidance with Discrete-Time Dynamics

Luca Paparusso, Shreyas Kousik, Edward Schmerling, Francesco Braghin, Marco Pavone

专题命中 多模态Agent ：multimodal(abstract)

Comments 8 pages, 3 figures, 1 table, submitted to 2024 IEEE International Conference on Robotics and Automation (ICRA)

Understanding On-the-Fly End-User Robot Programming

Laura Stegner, Yuna Hwang, David Porfirio, Bilge Mutlu

专题命中 多模态Agent ：multimodal(abstract)

Comments To appear at DIS'24. Stegner and Hwang contributed equally to this research

Flexible Agent-based Modeling Framework to Evaluate Integrated Microtransit and Fixed-route Transit Designs: Mode Choice, Supernetworks, and Fleet Simulation

Siwei Hu, Michael F. Hyland, Ritun Saha, Jacob J. Berkel, Geoffrey Vander Veen

专题命中 多模态Agent ：multi-modal(abstract)

Comments 49 pages, 25 figures, 8 tables; Submitted To: Transportation Research Part C: Emerging Technologies on May 1st, 2024

Hacking Predictors Means Hacking Cars: Using Sensitivity Analysis to Identify Trajectory Prediction Vulnerabilities for Autonomous Driving Security

Marsalis Gibson, David Babazadeh, Claire Tomlin, Shankar Sastry

专题命中 多模态Agent ：multi-modal(abstract)

Comments 10 pages, 5 figures, 1 tables

Large Language Model Enhanced Machine Learning Estimators for Classification

Yuhang Wu, Yingfei Wang, Chu Wang, Zeyu Zheng

专题命中 多模态Agent ：multimodal(abstract)

Generative Planning with Fast Collision Checks for High Speed Navigation

Craig Knuth, Cora Dimmig, Brian Bittner

专题命中 多模态Agent ：multi-modal(abstract)

Comments Presented at Agile Robotics ICRA 2024 workshop

Retrieval-Augmented Embodied Agents

Yichen Zhu, Zhicai Ou, Xiaofeng Mou, Jian Tang

专题命中 多模态Agent ：multi-modal(abstract)

Comments CVPR2024

AV4EV: Open-Source Modular Autonomous Electric Vehicle Platform for Making Mobility Research Accessible

Zhijie Qiao, Mingyan Zhou, Zhijun Zhuang, Tejas Agarwal, Felix Jahncke, Po-Jen Wang, Jason Friedman, Hongyi Lai, Divyanshu Sahu, Tomáš Nagy, Martin Endler, Jason Schlessman, Rahul Mangharam

专题命中 多模态Agent ：multi-modal(abstract)

Comments 6 pages, 5 figures

Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedback

James F. Mullen, Josh Mosier, Sounak Chakrabarti, Anqi Chen, Tyler White, Dylan P. Losey

专题命中 多模态Agent ：multimodal(abstract)

Comments 8 pages, 5 figures

Journal ref IEEE Robotics and Automation Letters 6.4 (2021) 8522-8529

Spatial Assisted Human-Drone Collaborative Navigation and Interaction through Immersive Mixed Reality

Luca Morando, Giuseppe Loianno

专题命中 多模态Agent ：multi-modal(abstract)

Comments Currently Accepted at International Conference on Robotics and Automation (ICRA) 2024, Nominated as Finalist for IEEE ICRA 2024 Best Paper Award on Unmanned Aerial Vehicles

AllHands: Ask Me Anything on Large-scale Verbatim Feedback via Large Language Models

Chaoyun Zhang, Zicheng Ma, Yuhao Wu, Shilin He, Si Qin, Minghua Ma, Xiaoting Qin, Yu Kang, Yuyi Liang, Xiaoyu Gou, Yajie Xue, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

专题命中 多模态Agent ：multi-modal(abstract)

Enhancing Empathy in Virtual Reality: An Embodied Approach to Mindset Modulation

Seoyeon Bae, Yoon Kyung Lee, Jungcheol Lee, Jaeheon Kim, Haeseong Jeon, Seung-Hwan Lim, Byung-Cheol Kim, Sowon Hahn

专题命中 多模态Agent ：multimodal(abstract)

Comments 9 pages, 2 figures, 1 table

Bridging deep learning force fields and electronic structures with a physics-informed approach

Yubo Qi, Weiyi Gong, Qimin Yan

专题命中 多模态Agent ：multimodal(abstract)

Towards AI-Based Precision Oncology: A Machine Learning Framework for Personalized Counterfactual Treatment Suggestions based on Multi-Omics Data

Manuel Schürch, Laura Boos, Viola Heinzelmann-Schwarz, Gabriele Gut, Michael Krauthammer, Andreas Wicki, Tumor Profiler Consortium

专题命中 多模态Agent ：multimodal(abstract)

Comments arXiv admin comment: This version has been removed by arXiv administrators as the submitter did not have the rights to agree to the license at the time of submission

Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving

Adam Villaflor, Brian Yang, Huangyuan Su, Katerina Fragkiadaki, John Dolan, Jeff Schneider

专题命中 多模态Agent ：multimodal(abstract)

Stein Variational Belief Propagation for Multi-Robot Coordination

Jana Pavlasek, Joshua Jing Zhi Mah, Ruihan Xu, Odest Chadwicke Jenkins, Fabio Ramos

专题命中 多模态Agent ：multi-modal(abstract)

Comments 8 pages, accepted for publication in Robotics and Automation Letters (RA-L); experiment updated, background methodology added

Modular 3D Interface Design for Accessible VR Applications

Corrie Green, Dr Yang Jiang, Dr John Isaacs

专题命中 多模态Agent ：multimodal(abstract)

Comments This preprint has not undergone peer review or any post-submission corrections. The Version of Record of this contribution will be published in Springer Nature Computer Science book series in Volume HCI International 2023

Journal ref Virtual, Augmented and Mixed Reality. HCII 2023

Enhancing Task Performance of Learned Simplified Models via Reinforcement Learning

Hien Bui, Michael Posa

专题命中 多模态Agent ：multi-modal(abstract)

Comments The work will be presented in ICRA2024

Conversational Language Models for Human-in-the-Loop Multi-Robot Coordination

William Hunt, Toby Godfrey, Mohammad D. Soorati

专题命中 多模态Agent ：multimodal(abstract)

Computational and Systems Biology Advances to Enable Bioagent-Agnostic Signatures

Andy Lin, Cameron Torres, Errett C. Hobbs, Jaydeep Bardhan, Stephen B. Aley, Charles T. Spencer, Karen L. Taylor, Tony Chiang

专题命中 多模态Agent ：multi-modal(abstract)