arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2777 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2777 篇

2203.16792 2022-04-01 cs.RO cs.AI 57%

TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Driving

Qichao Zhang, Yinfeng Gao, Yikang Zhang, Youtian Guo, Dawei Ding, Yunpeng Wang, Peng Sun, Dongbin Zhao

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.07342 2022-03-18 cs.CL cs.LG 57%

FILM: Following Instructions in Language with Modular Methods

So Yeon Min, Devendra Singh Chaplot, Pradeep Ravikumar, Yonatan Bisk, Ruslan Salakhutdinov

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments Published as a conference paper at International Conference on Learning Representations (ICLR) 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.11742 2022-02-25 cs.CV 57%

Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation

Shizhe Chen, Pierre-Louis Guhur, Makarand Tapaswi, Cordelia Schmid, Ivan Laptev

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.10544 2022-01-25 cs.AI cs.LG cs.RO 57%

Learning Space Partitions for Path Planning

Kevin Yang, Tianjun Zhang, Chris Cummins, Brandon Cui, Benoit Steiner, Linnan Wang, Joseph E. Gonzalez, Dan Klein, Yuandong Tian

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Journal ref NeurIPS 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.06607 2022-01-24 cs.CV cs.RO 57%

THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling

Thomas Gilles, Stefano Sabatini, Dzmitry Tsishkou, Bogdan Stanciulescu, Fabien Moutarde

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.07096 2022-01-19 cs.SE cs.AI 57%

Lifelong Dynamic Optimization for Self-Adaptive Systems: Fact or Fiction?

Tao Chen

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments The paper has been accepted as a full technical paper at the 29th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.07263 2021-12-15 cs.LG cs.AI 57%

Quantifying Multimodality in World Models

Andreas Sedlmeier, Michael Kölle, Robert Müller, Leo Baudrexel, Claudia Linnhoff-Popien

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.03642 2021-12-08 cs.LG cs.CV 57%

CLIMAT: Clinically-Inspired Multi-Agent Transformers for Knee Osteoarthritis Trajectory Forecasting

Huy Hoang Nguyen, Simo Saarakkala, Matthew B. Blaschko, Aleksei Tiulpin

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 10 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.05059 2021-11-10 cs.CV cs.LG eess.IV 57%

MMD-ReID: A Simple but Effective Solution for Visible-Thermal Person ReID

Chaitra Jambigi, Ruchit Rawal, Anirban Chakraborty

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

Comments Accepted in BMVC 2021 (Oral)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.11043 2021-11-10 cs.CV 57%

Integrating Deep Learning and Augmented Reality to Enhance Situational Awareness in Firefighting Environments

Manish Bhattarai

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments PhD Dissertation

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.04027 2021-10-22 cs.CV cs.RO 57%

Learning to Predict Vehicle Trajectories with Model-based Planning

Haoran Song, Di Luan, Wenchao Ding, Michael Yu Wang, Qifeng Chen

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments Accepted by The Conference on Robot Learning (CoRL) 2021. Project page at http://haoran-song.github.io/prime

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.08963 2021-10-19 cs.AI 57%

SS-MAIL: Self-Supervised Multi-Agent Imitation Learning

Akshay Dharmavaram, Tejus Gupta, Jiachen Li, Katia P. Sycara

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Pre-Print

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.11470 2021-10-19 cs.RO cs.AI 57%

NeBula: Quest for Robotic Autonomy in Challenging Environments; TEAM CoSTAR at the DARPA Subterranean Challenge

Ali Agha, Kyohei Otsu, Benjamin Morrell, David D. Fan, Rohan Thakker, Angel Santamaria-Navarro, Sung-Kyun Kim, Amanda Bouman, Xianmei Lei, Jeffrey Edlund, Muhammad Fadhil Ginting, Kamak Ebadi, Matthew Anderson, Torkom Pailevanian, Edward Terry, Michael Wolf, Andrea Tagliabue, Tiago Stegun Vaquero, Matteo Palieri, Scott Tepsuporn, Yun Chang, Arash Kalantari, Fernando Chavez, Brett Lopez, Nobuhiro Funabiki, Gregory Miles, Thomas Touma, Alessandro Buscicchio, Jesus Tordesillas, Nikhilesh Alatur, Jeremy Nash, William Walsh, Sunggoo Jung, Hanseob Lee, Christoforos Kanellakis, John Mayo, Scott Harper, Marcel Kaufmann, Anushri Dixit, Gustavo Correa, Carlyn Lee, Jay Gao, Gene Merewether, Jairo Maldonado-Contreras, Gautam Salhotra, Maira Saboia Da Silva, Benjamin Ramtoula, Yuki Kubo, Seyed Fakoorian, Alexander Hatteland, Taeyeon Kim, Tara Bartlett, Alex Stephens, Leon Kim, Chuck Bergh, Eric Heiden, Thomas Lew, Abhishek Cauligi, Tristan Heywood, Andrew Kramer, Henry A. Leopold, Chris Choi, Shreyansh Daftry, Olivier Toupet, Inhwan Wee, Abhishek Thakur, Micah Feras, Giovanni Beltrame, George Nikolakopoulos, David Shim, Luca Carlone, Joel Burdick

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments For team website, see https://costar.jpl.nasa.gov/. Accepted for publication in the Journal of Field Robotics, 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.04097 2021-10-12 cs.RO cs.CV 57%

Deep Learning for Embodied Vision Navigation: A Survey

Fengda Zhu, Yi Zhu, Vincent CS Lee, Xiaodan Liang, Xiaojun Chang

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

Comments 20 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.07561 2021-09-17 cs.RO cs.CV 57%

A Framework for Multisensory Foresight for Embodied Agents

Xiaohui Chen, Ramtin Hosseini, Karen Panetta, Jivko Sinapov

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments ICRA 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.03413 2021-09-16 cs.CV 57%

YouRefIt: Embodied Reference Understanding with Language and Gesture

Yixin Chen, Qing Li, Deqian Kong, Yik Lun Kei, Song-Chun Zhu, Tao Gao, Yixin Zhu, Siyuan Huang

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments ICCV 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.15084 2021-09-16 cs.CV cs.LG 57%

Likelihood-Based Diverse Sampling for Trajectory Forecasting

Yecheng Jason Ma, Jeevana Priya Inala, Dinesh Jayaraman, Osbert Bastani

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments ICCV 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.06256 2021-08-30 q-bio.QM cs.CV 57%

A registration error estimation framework for correlative imaging

Guillaume Potier, Frédéric Lavancier, Stephan Kunne, Perrine Paul-Gilloteaux

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 10 pages 2 figures (made of 10 panels in total)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.05894 2021-07-14 cs.CV 57%

Automatic Seizure Detection Using the Pulse Transit Time

Eric Fiege, Salima Houta, Pinar Bisgin, Rainer Surges, Falk Howar

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.00563 2021-05-11 cs.RO cs.AI 57%

Flightmare: A Flexible Quadrotor Simulator

Yunlong Song, Selim Naji, Elia Kaufmann, Antonio Loquercio, Davide Scaramuzza

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Accepted for publication at 4th Conference on Robot Learning (CoRL), Cambridge MA, USA. 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.00762 2021-05-04 cs.AI 57%

VECA : A Toolkit for Building Virtual Environments to Train and Test Human-like Agents

Kwanyoung Park, Hyunseok Oh, Youngki Lee

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 7 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.08277 2021-04-19 cs.CV 57%

Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction

Sriram Narayanan, Ramin Moslemi, Francesco Pittaluga, Buyu Liu, Manmohan Chandraker

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments CVPR 21 (Oral)

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.15587 2021-03-30 cs.CV cs.LG 57%

IA-GCN: Interpretable Attention based Graph Convolutional Network for Disease prediction

Anees Kazi, Soroush Farghadani, Nassir Navab

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments 10 pages, 1 figure

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.13922 2021-03-30 cs.CV 57%

A Recurrent Vision-and-Language BERT for Navigation

Yicong Hong, Qi Wu, Yuankai Qi, Cristian Rodriguez-Opazo, Stephen Gould

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.12944 2021-03-25 cs.CV 57%

Scene-Intuitive Agent for Remote Embodied Visual Grounding

Xiangru Lin, Guanbin Li, Yizhou Yu

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

Comments Accepted by CVPR 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.00109 2021-03-25 cs.CV cs.MA 57%

SCAN: A Spatial Context Attentive Network for Joint Multi-Agent Intent Prediction

Jasmine Sekhon, Cody Fleming

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2002.03671 2021-02-24 cs.RO cs.AI 57%

Autonomous Planning Based on Spatial Concepts to Tidy Up Home Environments with Service Robots

Akira Taniguchi, Shota Isobe, Lotfi El Hafi, Yoshinobu Hagiwara, Tadahiro Taniguchi

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments This paper has been accepted to Advanced Robotics

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.10765 2021-02-23 cs.CV 57%

Post-hoc Overall Survival Time Prediction from Brain MRI

Renato Hermoza, Gabriel Maicas, Jacinto C. Nascimento, Gustavo Carneiro

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 5 pages, 2 figure

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.07266 2021-02-16 cs.LG cs.AI cs.RO stat.ML 57%

Sparse Attention Guided Dynamic Value Estimation for Single-Task Multi-Scene Reinforcement Learning

Jaskirat Singh, Liang Zheng

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments This work is a merger of arXiv:2005.12254 and arXiv:2011.12574

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.10281 2021-01-26 cs.CL 57%

PAWLS: PDF Annotation With Labels and Structure

Mark Neumann, Zejiang Shen, Sam Skjonsberg

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏