多模态大模型 - arXivDaily 专题

2507.19701 2025-07-29 cs.RO stat.ML 71%

PhysVarMix: Physics-Informed Variational Mixture Model for Multi-Modal Trajectory Prediction

Haichuan Li, Tomi Westerlund

机构 * Turku Intelligent Embedded and Robotics Systems lab, Faculty of Technology University of Turku（图尔库智能嵌入式与机器人系统实验室，技术学院图尔库大学）

专题命中多模态Agent ：multi-modal(title)

2506.22034 2025-06-30 cs.RO 71%

Multi-Robot Assembly of Deformable Linear Objects Using Multi-Modal Perception

Kejia Chen, Celina Dettmering, Florian Pachler, Zhuo Liu, Yue Zhang, Tailai Cheng, Jonas Dirr, Zhenshan Bing, Alois Knoll, Rüdiger Daub

机构 * Chair of Robotics, Artificial Intelligence and Real-time Systems, School of Computation, Information and Technology（机器人学、人工智能与实时系统教授会，计算、信息与技术学院）； Institute for Machine Tools and Industrial Management, School of Engineering and Design（机械加工与工业管理研究所，工程与设计学院）

专题命中多模态Agent ：multi-modal(title)

2407.15010 2025-05-20 cs.CY cs.HC cs.LG 71%

ChatISA: A Prompt-Engineered, In-House Multi-Modal Generative AI Chatbot for Information Systems Education

Fadel M. Megahed, Ying-Ju Chen, Joshua A. Ferris, Cameron Resatar, Kaitlyn Ross, Younghwa Lee, L. Allison Jones-Farmer

专题命中多模态Agent ：multi-modal(title)

Comments 22 pages

2504.16446 2025-04-24 cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.soft 71%

Mumott -- a Python package for the analysis of multi-modal tensor tomography data

Leonard C. Nielsen, Mads Carlsen, Sici Wang, Arthur Baroni, Torne Tänzer, Marianne Liebi, Paul Erhart

专题命中多模态Agent ：multi-modal(title)

Comments 13 pages, 6 figures

2502.14163 2025-02-21 cs.HC 71%

"It Brought the Model to Life": Exploring the Embodiment of Multimodal I3Ms for People who are Blind or have Low Vision

Samuel Reinders, Matthew Butler, Kim Marriott

专题命中多模态Agent ：multimodal(title)

Comments Conditionally Accepted to appear at ACM CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 - May 1, 2025, Yokohama, Japan

2501.13081 2025-01-23 cs.CR 71%

Real-Time Multi-Modal Subcomponent-Level Measurements for Trustworthy System Monitoring and Malware Detection

Farshad Khorrami, Ramesh Karri, Prashanth Krishnamurthy

专题命中多模态Agent ：multi-modal(title)

Comments 12 pages, 29 figures

2412.17282 2024-12-24 cs.RO 71%

LMD-PGN: Cross-Modal Knowledge Distillation from First-Person-View Images to Third-Person-View BEV Maps for Universal Point Goal Navigation

Riku Uemura, Kanji Tanaka, Kenta Tsukahara, Daiki Iwata

专题命中多模态Agent ：cross-modal(title)

Comments Draft version of a conference paper: 5 pages with 2 figures

2409.17751 2024-09-27 stat.ME stat.AP stat.CO 71%

Granger Causality for Mixed Time Series Generalized Linear Models: A Case Study on Multimodal Brain Connectivity

Luiza S. C. Piancastelli, Wagner Barreto-Souza, Norbert J. Fortin, Keiland W. Cooper, Hernando Ombao

专题命中多模态Agent ：multimodal(title)

Comments Paper submitted for publication

2408.06222 2024-08-13 cs.HC 71%

ARCADE: An Augmented Reality Display Environment for Multimodal Interaction with Conversational Agents

Carolin Schindler, Daiki Mayumi, Yuki Matsuda, Niklas Rach, Keiichi Yasumoto, Wolfgang Minker

专题命中多模态Agent ：multimodal(title)

2407.19053 2024-07-30 cs.SE 71%

A Study of Using Multimodal LLMs for Non-Crash Functional Bug Detection in Android Apps

Bangyan Ju, Jin Yang, Tingting Yu, Tamerlan Abdullayev, Yuanyuan Wu, Dingbang Wang, Yu Zhao

专题命中多模态Agent ：multimodal(title)

2404.18374 2024-04-30 cs.RO 71%

Trajectory Optimization for Adaptive Informative Path Planning with Multimodal Sensing

Joshua Ott, Edward Balaban, Mykel Kochenderfer

专题命中多模态Agent ：multimodal(title)

Comments IEEE International Conference on Control, Decision and Information Technologies

2401.03088 2024-01-09 cs.RO cs.HC 71%

The RoSiD Tool: Empowering Users to Design Multimodal Signals for Human-Robot Collaboration

Nathaniel Dennler, David Delgado, Daniel Zeng, Stefanos Nikolaidis, Maja Matarić

专题命中多模态Agent ：multimodal(title)

Comments Accepted to ISER 2023. 8 pages, 4 figures

2207.00097 2023-10-03 math.OC 71%

A multimodal tourist trip planner integrating road and pedestrian networks

Tommaso Adamo, Lucio Colizzi, Giovanni Dimauro, Gianpaolo Ghiani, Emanuela Guerriero

专题命中多模态Agent ：multimodal(title)

Journal ref Expert Systems with applications 2024

2306.08907 2023-06-16 q-bio.BM cs.LG 71%

MCPI: Integrating Multimodal Data for Enhanced Prediction of Compound Protein Interactions

Li Zhang, Wenhao Li, Haotian Guan, Zhiquan He, Mingjun Cheng, Han Wang

专题命中多模态Agent ：multimodal(title)

Comments 12 pages, 9 figures

2306.03870 2023-06-07 physics.med-ph physics.optics q-bio.TO 71%

Multimodal imaging of the mouse eye using visible light photoacoustic ophthalmoscopy and near-infrared-II optical coherence tomography

Richard Haindl, Valentina Bellemo, Praveenbalaji Rajendran, Bingyao Tan, Mengyang Liu, Qifa Zhou, Rainer A. Leitgeb, Wolfgang Drexler, Leopold Schmetterer, Manojit Pramanik

专题命中多模态Agent ：multimodal(title)

Comments 14 pages, 4 figures

2210.10814 2023-05-24 cs.GT cs.RO math.OC 71%

MPOGames: Efficient Multimodal Partially Observable Dynamic Games

Oswin So, Paul Drews, Thomas Balch, Velin Dimitrov, Guy Rosman, Evangelos A. Theodorou

专题命中多模态Agent ：multimodal(title)

Comments Accepted to ICRA 2023

2211.11602 2022-11-22 cs.LG cs.HC cs.MA 71%

Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedback

Josh Abramson, Arun Ahuja, Federico Carnevale, Petko Georgiev, Alex Goldin, Alden Hung, Jessica Landon, Jirka Lhotka, Timothy Lillicrap, Alistair Muldal, George Powell, Adam Santoro, Guy Scully, Sanjana Srivastava, Tamara von Glehn, Greg Wayne, Nathaniel Wong, Chen Yan, Rui Zhu

专题命中多模态Agent ：multimodal(title)

2201.07928 2022-03-04 cs.RO 71%

Complex In-Hand Manipulation via Compliance-Enabled Finger Gaiting and Multi-Modal Planning

Andrew S. Morgan, Kaiyu Hang, Bowen Wen, Kostas Bekris, Aaron M. Dollar

专题命中多模态Agent ：multi-modal(title)

Comments IEEE Robotics and Automation Letters, 2022

2001.11155 2021-07-07 physics.med-ph eess.IV 71%

An automatic deep learning-based workflow for glioblastoma survival prediction using pre-operative multimodal MR images

Jie Fu, Kamal Singhrao, Xinran Zhong, Yu Gao, Sharon Qi, Yingli Yang, Dan Ruan, John H Lewis

专题命中多模态Agent ：multimodal(title)

Journal ref Advances in Radiation Oncology, 2021

2106.15253 2021-06-30 math.NA cs.NA 71%

Mathematical osmosis imaging for multi-modal and multi-spectral applications in Cultural Heritage conservation

Simone Parisotto, Luca Calatroni, Claudia Daffara

专题命中多模态Agent ：multi-modal(title)

Comments 3 pages, 6 figures

Journal ref Proceedings of the 6th International workshop on Image Processing for Art Investigation (IP4AI) 2018

2103.09236 2021-03-18 physics.bio-ph 71%

Nanoparticles for Multimodal Antivascular Therapeutics: Dual Drug Release, Photothermal and Photodynamic Therapy

Juan L. Paris, Gonzalo Villaverde, Sergio Gomez-Grana, Maria Vallet-Regi

专题命中多模态Agent ：multimodal(title)

Comments 33 pages, 8 figures

Journal ref Acta Biomaterialia 101, 459-468 (2019)

2103.02201 2021-03-04 cs.RO 71%

Semantic constraints to represent common sense required in household actions for multi-modal Learning-from-observation robot

Katsushi Ikeuchi, Naoki Wake, Riku Arakawa, Kazuhiro Sasabuchi, Jun Takamatsu

专题命中多模态Agent ：multi-modal(title)

Comments 18 pages, 31 figures

2003.07054 2020-09-24 cs.RO 71%

Multimodal Trajectory Optimization for Motion Planning

Takayuki Osa

专题命中多模态Agent ：multimodal(title)

Comments 17 pages, International Journal of Robotics Research

2009.01960 2020-09-15 cs.CY cs.SY eess.SY 71%

Multimodal Autonomous Last Mile Delivery System Design and Application

Farah Samouh, Veronica Gluza, Shadi Djavadian, Seyed Mehdi Meshkani, Bilal Farooq

专题命中多模态Agent ：multimodal(title)

Comments Accepted in the proceedings of 6th IEEE International Smart Cities Conference, Sep 28 - Oct 1, 2020

2003.08293 2020-03-19 cs.RO cs.MA cs.SY eess.SY 71%

The Shapeshifter: a Morphing, Multi-Agent,Multi-Modal Robotic Platform for the Exploration of Titan (preprint version)

Ali-akbar Agha-mohammadi, Andrea Tagliabue, Stephanie Schneider, Benjamin Morrell, Marco Pavone, Jason Hofgartner, Issa A. D. Nesnas, Rashied B. Amini, Arash Kalantari, Alessandra Babuscia, Jonathan Lunine

专题命中多模态Agent ：multi-modal(title)

Comments Ali-akbar Agha-mohammadi is the Principal Investigator. arXiv admin note: substantial text overlap with arXiv:2002.00515

2002.00515 2020-02-04 cs.RO cs.SY eess.SY 71%

Shapeshifter: A Multi-Agent, Multi-Modal Robotic Platform for Exploration of Titan

Andrea Tagliabue, Stephanie Schneider, Marco Pavone, Ali-akbar Agha-mohammadi

专题命中多模态Agent ：multi-modal(title)

1707.02983 2018-06-22 cond-mat.mes-hall 71%

Local field enhancement and thermoplasmonics in multimodal Aluminum structures

Peter R. Wiecha, Marie-Maxime Mennemanteuil, Dmitry Khlopin, Jérôme Martin, Arnaud Arbouet, Davy Gérard, Alexandre Bouhelier, Jérôme Plain, Aurélien Cuche

专题命中多模态Agent ：multimodal(title)

Comments 8 pages 6 figures main article; 7 pages 9 figures supporting informations

Journal ref Physical Review B 96, 035440 (2018)

1801.10225 2018-02-01 cs.RO 71%

A Single-Planner Approach to Multi-Modal Humanoid Mobility

Andrew Dornbush, Karthik Vijayakumar, Sameer Bardapurkar, Fahad Islam, Maxim Likhachev

专题命中多模态Agent ：multi-modal(title)

1712.09716 2017-12-29 cs.RO 71%

Multi-Modal Active Perception for Information Gathering in Science Missions

Akash Arora, P. Michael Furlong, Robert Fitch, Salah Sukkarieh, Terrence Fong

专题命中多模态Agent ：multi-modal(title)

1109.6122 2011-09-29 physics.bio-ph 71%

Multimodal CARS and SHG microscopy for label-free detection of collagen produced by hDFs in fibrin gel

Leonardo Mortati, Carla Divieto, Maria Paola Sassi

专题命中多模态Agent ：multimodal(title)

Comments 9 pages, 7 figures

1. 多模态Agent 2773 篇

PhysVarMix: Physics-Informed Variational Mixture Model for Multi-Modal Trajectory Prediction

Multi-Robot Assembly of Deformable Linear Objects Using Multi-Modal Perception

ChatISA: A Prompt-Engineered, In-House Multi-Modal Generative AI Chatbot for Information Systems Education

Mumott -- a Python package for the analysis of multi-modal tensor tomography data

"It Brought the Model to Life": Exploring the Embodiment of Multimodal I3Ms for People who are Blind or have Low Vision

Real-Time Multi-Modal Subcomponent-Level Measurements for Trustworthy System Monitoring and Malware Detection

LMD-PGN: Cross-Modal Knowledge Distillation from First-Person-View Images to Third-Person-View BEV Maps for Universal Point Goal Navigation

Granger Causality for Mixed Time Series Generalized Linear Models: A Case Study on Multimodal Brain Connectivity

ARCADE: An Augmented Reality Display Environment for Multimodal Interaction with Conversational Agents

A Study of Using Multimodal LLMs for Non-Crash Functional Bug Detection in Android Apps

Trajectory Optimization for Adaptive Informative Path Planning with Multimodal Sensing

The RoSiD Tool: Empowering Users to Design Multimodal Signals for Human-Robot Collaboration

A multimodal tourist trip planner integrating road and pedestrian networks

MCPI: Integrating Multimodal Data for Enhanced Prediction of Compound Protein Interactions

Multimodal imaging of the mouse eye using visible light photoacoustic ophthalmoscopy and near-infrared-II optical coherence tomography

MPOGames: Efficient Multimodal Partially Observable Dynamic Games

Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedback

Complex In-Hand Manipulation via Compliance-Enabled Finger Gaiting and Multi-Modal Planning

An automatic deep learning-based workflow for glioblastoma survival prediction using pre-operative multimodal MR images

Mathematical osmosis imaging for multi-modal and multi-spectral applications in Cultural Heritage conservation

Nanoparticles for Multimodal Antivascular Therapeutics: Dual Drug Release, Photothermal and Photodynamic Therapy

Semantic constraints to represent common sense required in household actions for multi-modal Learning-from-observation robot

Multimodal Trajectory Optimization for Motion Planning

Multimodal Autonomous Last Mile Delivery System Design and Application

The Shapeshifter: a Morphing, Multi-Agent,Multi-Modal Robotic Platform for the Exploration of Titan (preprint version)

Shapeshifter: A Multi-Agent, Multi-Modal Robotic Platform for Exploration of Titan

Local field enhancement and thermoplasmonics in multimodal Aluminum structures

A Single-Planner Approach to Multi-Modal Humanoid Mobility

Multi-Modal Active Perception for Information Gathering in Science Missions

Multimodal CARS and SHG microscopy for label-free detection of collagen produced by hDFs in fibrin gel