arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2777 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2777 篇

2303.02139 2023-08-03 cs.AI cs.RO 57%

Data Association Aware POMDP Planning with Hypothesis Pruning Performance Guarantees

Moran Barenboim, Idan Lev-Yehudi, Vadim Indelman

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.00291 2023-08-02 eess.IV cs.CV 57%

Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images

Lehan Wang, Weihang Dai, Mei Jin, Chubin Ou, Xiaomeng Li

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments Accepted as a conference paper at MICCAI 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.10810 2023-07-21 cs.LG cs.AI 57%

On Combining Expert Demonstrations in Imitation Learning via Optimal Transport

Ilana Sebag, Samuel Cohen, Marc Peter Deisenroth

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Journal ref NeurIPS Workshop on Optimal Transport and Machine Learning, 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.02280 2023-07-06 cs.CV 57%

Interactive Image Segmentation with Cross-Modality Vision Transformers

Kun Li, George Vosselman, Michael Ying Yang

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 16 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.12071 2023-06-30 cs.CV cs.RO 57%

ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposals

Xishun Wang, Tong Su, Fang Da, Xiaodong Yang

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments CVPR 2023 (Highlight)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.12387 2023-06-22 cs.CL cs.HC 57%

Solving Dialogue Grounding Embodied Task in a Simulated Environment using Further Masked Language Modeling

Weijie Jack Zhang

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CL

Comments Work in Progress

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.07857 2023-06-21 cs.RO cs.CV 57%

GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model

Hao Cheng, Mengmeng Liu, Lin Chen, Hellward Broszio, Monika Sester, Michael Ying Yang

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.18898 2023-05-31 cs.RO cs.AI 57%

AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation

Chuhao Jin, Wenhui Tan, Jiange Yang, Bei Liu, Ruihua Song, Limin Wang, Jianlong Fu

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.13076 2023-05-23 cs.CL 57%

An Abstract Specification of VoxML as an Annotation Language

Kiyong Lee, Nikhil Krishnaswamy, James Pustejovsky

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments 8 pages, 4 figures, Proceedings of 19th Joint ISO-ACL Workshop on Interoperable Semantic Annotation (ISA 2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.10783 2023-05-19 cs.AI 57%

Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions

Shrestha Mohanty, Negar Arabzadeh, Julia Kiseleva, Artem Zholus, Milagro Teruel, Ahmed Awadallah, Yuxuan Sun, Kavya Srinet, Arthur Szlam

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.09600 2023-05-17 cs.AI cs.LG 57%

Deep Reinforcement Learning to Maximize Arterial Usage during Extreme Congestion

Ashutosh Dutta, Milan Jain, Arif Khan, Arun Sathanur

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.07735 2023-05-04 cs.AI cs.RO 57%

Monte Carlo Planning in Hybrid Belief POMDPs

Moran Barenboim, Moshe Shienman, Vadim Indelman

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.08562 2023-03-16 cs.CV 57%

MGA: Medical generalist agent through text-guided knowledge transformation

Weijian Huang, Hao Yang, Cheng Li, Mingtong Dai, Rui Yang, Shanshan Wang

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.04129 2023-03-08 cs.AI cs.LG 57%

Foundation Models for Decision Making: Problems, Methods, and Opportunities

Sherry Yang, Ofir Nachum, Yilun Du, Jason Wei, Pieter Abbeel, Dale Schuurmans

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.08590 2023-02-20 cs.CL 57%

What A Situated Language-Using Agent Must be Able to Do: A Top-Down Analysis

David Schlangen

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.03062 2022-11-30 eess.IV cs.CV 57%

MyoPS-Net: Myocardial Pathology Segmentation with Flexible Combination of Multi-Sequence CMR Images

Junyi Qiu, Lei Li, Sihan Wang, Ke Zhang, Yinyin Chen, Shan Yang, Xiahai Zhuang

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.03049 2022-11-08 cs.RO cs.AI q-bio.NC 57%

Learning body models: from humans to humanoids

Matej Hoffmann

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 34 pages, 5 figures. Habilitation thesis, Faculty of Electrical Engineering, Czech Technical University in Prague (2021)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.09325 2022-11-08 q-bio.NC cs.AI 57%

Body models in humans, animals, and robots: mechanisms and plasticity

Matej Hoffmann

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 27 pages, 8 figures

Journal ref 2021, Body Schema and Body Image: New Directions, Oxford University Press, pp. 152-180

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.11746 2022-09-27 cs.AI 57%

Evaluating Agent Interactions Through Episodic Knowledge Graphs

Selene Báez Santamaría, Piek Vossen, Thomas Baier

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments Accepted to 1st Workshop on Customized Chat Grounding Persona and Knowledge, at COLING (2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.10126 2022-09-22 cs.CV cs.LG 57%

Exploring Modulated Detection Transformer as a Tool for Action Recognition in Videos

Tomás Crisol, Joel Ermantraut, Adrián Rostagno, Santiago L. Aggio, Javier Iparraguirre

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments 5 pages, 2 figures, 1 results chart

Journal ref JAIIO - JORNADAS ARGENTINAS DE INFORMATICA 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.06739 2022-08-16 eess.IV cs.CV cs.LG physics.med-ph 57%

Machine Learning Based Radiomics for Glial Tumor Classification and Comparison with Volumetric Analysis

Sevcan Turk, Kaya Oguz, Mehmet Orman, Emre Caliskan, Yesim Ertan, Erkin Ozgiray, Taner Akalin, Ashok Srinivasan, Omer Kitis

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.07505 2022-08-09 cs.AI 57%

Revisiting Some Common Practices in Cooperative Multi-Agent Reinforcement Learning

Wei Fu, Chao Yu, Zelai Xu, Jiaqi Yang, Yi Wu

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments 16 pages, published as a conference paper in ICML 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.08096 2022-07-19 cs.AI 57%

Nonmyopic Distilled Data Association Belief Space Planning Under Budget Constraints

Moshe Shienman, Vadim Indelman

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Accepted to International Symposium of Robotic Research (ISRR) 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.04954 2022-07-19 cs.AI 57%

D2A-BSP: Distilled Data Association Belief Space Planning with Performance Guarantees Under Budget Constraints

Moshe Shienman, Vadim Indelman

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments 8 pages, 2 figures, Accepted to IEEE International Conference on Robotics and Automation (ICRA) 2022, *Outstanding Paper Award Finalist*

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.15291 2022-07-01 cs.SD eess.AS 57%

Sonification as a Reliable Alternative to Conventional Visual Surgical Navigation

Sasan Matinfar, Mehrdad Salehi, Daniel Suter, Matthias Seibold, Navid Navab, Shervin Dehghani, Florian Wanivenhaus, Philipp Fürnstahl, Mazda Farshad, Nassir Navab

专题命中 多模态Agent :multimodal(abstract);分类 eess.AS

Comments 19 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.10312 2022-06-22 cs.RO cs.AI cs.LG 57%

SAMPLE-HD: Simultaneous Action and Motion Planning Learning Environment

Michal Nazarczuk, Tony Ng, Krystian Mikolajczyk

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments CVPRW, 2 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.10028 2022-06-22 cs.RO cs.AI 57%

Intention-Aware Navigation in Crowds with Extended-Space POMDP Planning

Himanshu Gupta, Bradley Hayes, Zachary Sunberg

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.11805 2022-06-06 cs.CG cs.AI cs.CE cs.RO 57%

Hybrid Manufacturing Process Planning for Arbitrary Part and Tool Shapes

George P. Harabin, Morad Behandish

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Special Issue on symposium on Solid and Physical Modeling (SPM'2022)

Journal ref Journal of Computer-Aided Design, 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.10466 2022-05-24 cs.HC cs.AI cs.LG 57%

A Survey on Physiological Signal Based Emotion Recognition

Zeeshan Ahmad, Naimul Khan

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.07904 2022-04-19 q-bio.NC cs.AI 57%

Turing's cascade instability supports the coordination of the mind, brain, and behavior

Damian G. Kelty-Stephen, Madhur Mangalam

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 53 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏