多模态大模型 - arXivDaily 专题

2210.13889 2023-09-20 eess.IV cs.CV 79%

Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data

Huy Hoang Nguyen, Matthew B. Blaschko, Simo Saarakkala, Aleksei Tiulpin

专题命中多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments Accepted in IEEE Transactions on Medical Imaging 2023

2308.07598 2023-08-16 cs.LG cs.AI 79%

Generating Personas for Games with Multimodal Adversarial Imitation Learning

William Ahlberg, Alessandro Sestini, Konrad Tollmar, Linus Gisslén

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Published in CoG 2023

2306.09470 2023-06-19 cs.RO cs.AI 79%

Improving Path Planning Performance through Multimodal Generative Models with Local Critics

Jorge Ocampo Jimenez, Wael Suleiman

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Under review

2206.08019 2023-05-26 eess.IV cs.CV 79%

Multi-View Imputation and Cross-Attention Network Based on Incomplete Longitudinal and Multimodal Data for Conversion Prediction of Mild Cognitive Impairment

Tao Wang, Xiumei Chen, Xiaoling Zhang, Shuoling Zhou, Qianjin Feng, Meiyan Huang

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CV

2305.04750 2023-05-09 cs.RO cs.AI cs.LG 79%

Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing

Elena Shrestha, Chetan Reddy, Hanxi Wan, Yulun Zhuang, Ram Vasudevan

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

2305.01795 2023-05-04 cs.CL 79%

Multimodal Procedural Planning via Dual Text-Image Prompting

Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Eric Wang, William Yang Wang

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CL

2301.11845 2023-02-06 cs.CL 79%

Learning the Effects of Physical Actions in a Multi-modal Environment

Gautier Dagan, Frank Keller, Alex Lascarides

专题命中多模态Agent ：multi-modal(title,abstract)；分类 cs.CL

2210.12418 2023-01-24 cs.RO cs.AI cs.HC cs.LG 79%

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

Vignesh Prasad, Dorothea Koert, Ruth Stock-Homburg, Jan Peters, Georgia Chalvatzaki

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted at the IEEE-RAS International Conference on Humanoid Robots (Humanoids) 2022

2201.09862 2022-10-26 cs.RO cs.AI 79%

Learning to Act with Affordance-Aware Multimodal Neural SLAM

Zhiwei Jia, Kaixiang Lin, Yizhou Zhao, Qiaozi Gao, Govind Thattai, Gaurav Sukhatme

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted by IROS 2022

2010.10344 2022-09-29 cs.AI math.OC 79%

The bi-objective multimodal car-sharing problem

Miriam Enzi, Sophie N. Parragh, Jakob Puchinger

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

2209.07660 2022-09-19 cs.AI cs.RO 79%

Sequential Bayesian Optimization for Adaptive Informative Path Planning with Multimodal Sensing

Joshua Ott, Edward Balaban, Mykel J. Kochenderfer

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

2207.07894 2022-07-19 cs.CV 79%

Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis

Muhammad Abdullah Jamal, Omid Mohareri

专题命中多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI'22)

2206.00636 2022-06-02 cs.AI cs.HC cs.RO 79%

A modular architecture for creating multimodal agents

Thomas Baier, Selene Baez Santamaria, Piek Vossen

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

2205.11836 2022-05-25 cs.CL 79%

Charon: a FrameNet Annotation Tool for Multimodal Corpora

Frederico Belcavello, Marcelo Viridiano, Ely Edison Matos, Tiago Timponi Torrent

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted submission for the The Sixteenth Linguistic Annotation Workshop (LAW-XVI 2022)

2203.04132 2022-03-28 cs.CV cs.HC cs.LG cs.RO 79%

Motron: Multimodal Probabilistic Human Motion Forecasting

Tim Salzmann, Marco Pavone, Markus Ryll

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments CVPR 2022

2111.13350 2021-11-29 cs.LG cs.CV cs.RO 79%

Jointly Learning Agent and Lane Information for Multimodal Trajectory Prediction

Jie Wang, Caili Guo, Minan Guo, Jiujiu Chen

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CV

2108.00887 2021-08-10 cs.LG cs.AI 79%

A Machine learning approach for rapid disaster response based on multi-modal data. The case of housing & shelter needs

Karla Saldana Ochoa, Tina Comes

专题命中多模态Agent ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

2012.10489 2021-02-25 cs.AI 79%

XAI4Wind: A Multimodal Knowledge Graph Database for Explainable Decision Support in Operations & Maintenance of Wind Turbines

Joyjit Chatterjee, Nina Dethlefs

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Updated version of knowledge graph resource paper - updates include additions to the Appendix on more properties in the knowledge graph, corrected typos/grammatical errors etc

2102.11387 2021-02-24 cs.CL 79%

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

Julia Ive, Andy Mingren Li, Yishu Miao, Ozan Caglayan, Pranava Madhyastha, Lucia Specia

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments Long paper accepted to EACL 2021, Camera-ready version

2003.03212 2020-09-01 cs.CV 79%

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

Seong Hyeon Park, Gyubok Lee, Manoj Bhat, Jimin Seo, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments ECCV 2020

2008.03573 2020-08-11 cs.AI cs.LO cs.MA cs.RO 79%

Explanation Generation for Multi-Modal Multi-Agent Path Finding with Optimal Resource Utilization using Answer Set Programming

Aysu Bogatarkan, Esra Erdem

专题命中多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Comments Paper presented at the 36th International Conference on Logic Programming (ICLP 2020), University Of Calabria, Rende (CS), Italy, September 2020, 16 pages, 6 figures

2006.10135 2020-07-16 eess.IV cs.CV cs.LG 79%

M2Net: Multi-modal Multi-channel Network for Overall Survival Time Prediction of Brain Tumor Patients

Tao Zhou, Huazhu Fu, Yu Zhang, Changqing Zhang, Xiankai Lu, Jianbing Shen, Ling Shao

专题命中多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI'20

2004.07173 2020-04-16 cs.CV 79%

Bias in Multimodal AI: Testbed for Fair Automatic Recruitment

Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Journal ref IEEE CVPR Workshop on Fair, Data Efficient and Trusted Computer Vision, Washington, Seattle, USA, 2020

2004.07093 2020-04-16 cs.LG cs.CL stat.ML 79%

lamBERT: Language and Action Learning Using Multimodal BERT

Kazuki Miyazawa, Tatsuya Aoki, Takato Horii, Takayuki Nagai

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments 8 pages, 9 figures

2003.09746 2020-03-24 cs.AI 79%

Adaptive Informative Path Planning with Multimodal Sensing

Shushman Choudhury, Nate Gruver, Mykel J. Kochenderfer

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments First two authors contributed equally; International Conference on Automated Planning and Scheduling (ICAPS) 2020

1911.00584 2019-11-05 cs.RO cs.AI cs.LG cs.MA 79%

A Perceived Environment Design using a Multi-Modal Variational Autoencoder for learning Active-Sensing

Timo Korthals, Malte Schilling, Jürgen Leitner

专题命中多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Comments Extended Abstract for the IROS 2019 Workshop on Deep Probabilistic Generative Models for Cognitive Architecture in Robotics

1909.08161 2019-09-19 cs.HC cs.AI cs.RO 79%

Multimodal Continuation-style Architectures for Human-Robot Interaction

Nikhil Krishnaswamy, James Pustejovsky

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Advances in Cognitive Systems Cognitive Vision Workshop (2019), 8 pages, 5 figures

1909.01140 2019-09-04 eess.IV cs.CV 79%

A Tool for Super-Resolving Multimodal Clinical MRI

Mikael Brudfors, Yael Balbastre, Parashkev Nachev, John Ashburner

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.CV

1906.09094 2019-06-24 cs.AI 79%

Hybrid Planning for Dynamic Multimodal Stochastic Shortest Paths

Shushman Choudhury, Mykel J. Kochenderfer

专题命中多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments 20 pages, 5 figures, 5 tables; Under Review

1905.09949 2019-05-30 cs.RO cs.CV 79%

Scene Induced Multi-Modal Trajectory Forecasting via Planning

Nachiket Deo, Mohan M. Trivedi

专题命中多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments ICRA Workshop on Long Term Human Motion Prediction (extended abstract)

1. 多模态Agent 2766 篇

Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data

Generating Personas for Games with Multimodal Adversarial Imitation Learning

Improving Path Planning Performance through Multimodal Generative Models with Local Critics

Multi-View Imputation and Cross-Attention Network Based on Incomplete Longitudinal and Multimodal Data for Conversion Prediction of Mild Cognitive Impairment

Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing

Multimodal Procedural Planning via Dual Text-Image Prompting

Learning the Effects of Physical Actions in a Multi-modal Environment

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

Learning to Act with Affordance-Aware Multimodal Neural SLAM

The bi-objective multimodal car-sharing problem

Sequential Bayesian Optimization for Adaptive Informative Path Planning with Multimodal Sensing

Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis

A modular architecture for creating multimodal agents

Charon: a FrameNet Annotation Tool for Multimodal Corpora

Motron: Multimodal Probabilistic Human Motion Forecasting

Jointly Learning Agent and Lane Information for Multimodal Trajectory Prediction

A Machine learning approach for rapid disaster response based on multi-modal data. The case of housing & shelter needs

XAI4Wind: A Multimodal Knowledge Graph Database for Explainable Decision Support in Operations & Maintenance of Wind Turbines

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

Explanation Generation for Multi-Modal Multi-Agent Path Finding with Optimal Resource Utilization using Answer Set Programming

M2Net: Multi-modal Multi-channel Network for Overall Survival Time Prediction of Brain Tumor Patients

Bias in Multimodal AI: Testbed for Fair Automatic Recruitment

lamBERT: Language and Action Learning Using Multimodal BERT

Adaptive Informative Path Planning with Multimodal Sensing

A Perceived Environment Design using a Multi-Modal Variational Autoencoder for learning Active-Sensing

Multimodal Continuation-style Architectures for Human-Robot Interaction

A Tool for Super-Resolving Multimodal Clinical MRI

Hybrid Planning for Dynamic Multimodal Stochastic Shortest Paths

Scene Induced Multi-Modal Trajectory Forecasting via Planning