多模态大模型

Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control

Yongjun Kim, Sejin Seo, Jihong Park, Mehdi Bennis, Seong-Lyun Kim, Junil Choi

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

What Artificial Neural Networks Can Tell Us About Human Language Acquisition

Alex Warstadt, Samuel R. Bowman

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments Please cite the published version with the following information: @incollection{warstadt2022artificial, title={What artificial neural networks can tell us about human language acquisition}, author={Warstadt, Alex and Bowman, Samuel R.}, booktitle={Algebraic Structures in Natural Language}, pages={17--60}, year={2022}, publisher={CRC Press} }

Improving Agent Interactions in Virtual Environments with Language Models

Jack Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

AttentionLego: An Open-Source Building Block For Spatially-Scalable Large Language Model Accelerator With Processing-In-Memory Technology

Rongqing Cong, Wenyang He, Mingxuan Li, Bangning Luo, Zebin Yang, Yuchao Yang, Ru Huang, Bonan Yan

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments for associated source codes, see https://bonany.cc/attentionleg

Large Language Models for Robotics: Opportunities, Challenges, and Perspectives

Jiaqi Wang, Zihao Wu, Yiwei Li, Hanqi Jiang, Peng Shu, Enze Shi, Huawen Hu, Chong Ma, Yiheng Liu, Xuhui Wang, Yincheng Yao, Xuan Liu, Huaqin Zhao, Zhengliang Liu, Haixing Dai, Lin Zhao, Bao Ge, Xiang Li, Tianming Liu, Shu Zhang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Target-Grounded Graph-Aware Transformer for Aerial Vision-and-Dialog Navigation

Yifei Su, Dong An, Yuan Xu, Kehan Chen, Yan Huang

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Comments 1st Place Solution for the AVDN Challenge in ICCV CLVL 2023

Multimodality of AI for Education: Towards Artificial General Intelligence

Gyeong-Geon Lee, Lehong Shi, Ehsan Latif, Yizhu Gao, Arne Bewersdorff, Matthew Nyaaba, Shuchen Guo, Zihao Wu, Zhengliang Liu, Hui Wang, Gengchen Mai, Tiaming Liu, Xiaoming Zhai

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEs

Theodor Westny, Joel Oskarsson, Björn Olofsson, Erik Frisk

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Code: https://github.com/westny/mtp-go

Steve-Eye: Equipping LLM-based Embodied Agents with Visual Perception in Open Worlds

Sipeng Zheng, Jiazheng Liu, Yicheng Feng, Zongqing Lu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 19 pages, 19 figures

Heterogeneous Graph-based Trajectory Prediction using Local Map Context and Social Interactions

Daniel Grimm, Maximilian Zipfl, Felix Hertlein, Alexander Naumann, Jürgen Lüttin, Steffen Thoma, Stefan Schmid, Lavdim Halilaj, Achim Rettinger, J. Marius Zöllner

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted on IEEE ITSC 2023

Categorical Traffic Transformer: Interpretable and Diverse Behavior Prediction with Tokenized Latent

Yuxiao Chen, Sander Tonkens, Marco Pavone

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Agent as Cerebrum, Controller as Cerebellum: Implementing an Embodied LMM-based Agent on Drones

Haoran Zhao, Fengxing Pan, Huqiuyue Ping, Yaoming Zhou

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 17 pages, 12 figures

SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape

Hua Zheng, Kuang-Hung Liu, Igor Fedorov, Xin Zhang, Wen-Yen Chen, Wei Wen

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 24 pages, 7 figures

Diverse Shape Completion via Style Modulated Generative Adversarial Networks

Wesley Khademi, Li Fuxin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

In Time and Space: Towards Usable Adaptive Control for Assistive Robotic Arms

Max Pascher, Kirill Kronhardt, Felix Ferdinand Goldau, Udo Frese, Jens Gerken

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments RO-MAN'23: 32nd IEEE International Conference on Robot and Human Interactive Communication, Busan, Korea

FastSurfer-HypVINN: Automated sub-segmentation of the hypothalamus and adjacent structures on high-resolutional brain MRI

Santiago Estrada, David Kügler, Emad Bahrami, Peng Xu, Dilshad Mousa, Monique M. B. Breteler, N. Ahmad Aziz, Martin Reuter

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted in Imaging Neuroscience

Conceptual Framework for Autonomous Cognitive Entities

David Shapiro, Wangfan Li, Manuel Delaflor, Carlos Toxtli

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 34 pages, 12 figures

NetHack is Hard to Hack

Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments NeurIPS 2023

A Multi-Scale Spatial Transformer U-Net for Simultaneously Automatic Reorientation and Segmentation of 3D Nuclear Cardiac Images

Yangfan Ni, Duo Zhang, Gege Ma, Lijun Lu, Zhongke Huang, Wentao Zhu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 17 pages, 7 figures

Enhancing Agent Communication and Learning through Action and Language

Hugo Caselles-Dupré, Olivier Sigaud, Mohamed Chetouani

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments IMOL workshop, Paris 2023

The Wizard of Curiosities: Enriching Dialogues with Fun Facts

Frederico Vicente, Rafael Ferreira, David Semedo, João Magalhães

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Pointing out Human Answer Mistakes in a Goal-Oriented Visual Dialogue

Ryosuke Oshima, Seitaro Shinagawa, Hideki Tsunashima, Qi Feng, Shigeo Morishima

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted at ICCVW 2023

Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear

Ruohan Gao, Hao Li, Gokul Dharan, Zhuzhu Wang, Chengshu Li, Fei Xia, Silvio Savarese, Li Fei-Fei, Jiajun Wu

专题命中 多模态Agent ：audio-visual(abstract)；分类 cs.CV

Comments In ICRA 2023. Project page: https://ai.stanford.edu/~rhgao/sonicverse/. Code: https://github.com/StanfordVL/sonicverse. Gao and Li contributed equally to this work and are in alphabetical order

What Is Near?: Room Locality Learning for Enhanced Robot Vision-Language-Navigation in Indoor Living Environments

Muraleekrishna Gopinathan, Jumana Abu-Khalaf, David Suter, Sidike Paheding, Nathir A. Rawashdeh

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understanding

Cheng Shi, Sibei Yang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments ECCV 2022. Code: http://github.com/ChengShiest/REP-ERU

HARPS: An Online POMDP Framework for Human-Assisted Robotic Planning and Sensing

Luke Burks, Hunter M. Ray, Jamison McGinley, Sousheel Vunnam, Nisar Ahmed

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Accepted to IEEE Transactions on Robotics. 20 pages, 18 figures

PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classification

Miaoge Li, Dongsheng Wang, Xinyang Liu, Zequn Zeng, Ruiying Lu, Bo Chen, Mingyuan Zhou

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Comments accepted by ICCV23

CASPNet++: Joint Multi-Agent Motion Prediction

Maximilian Schäfer, Kun Zhao, Anton Kummert

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments 8 pages, 6 figures

Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction

Kaiqi Chen, Jing Yu Lim, Kingsley Kuan, Harold Soh

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AI

Hangjie Shi, Leslie Ball, Govind Thattai, Desheng Zhang, Lucy Hu, Qiaozi Gao, Suhaila Shakiah, Xiaofeng Gao, Aishwarya Padmakumar, Bofei Yang, Cadence Chung, Dinakar Guthy, Gaurav Sukhatme, Karthika Arumugam, Matthew Wen, Osman Ipek, Patrick Lange, Rohan Khanna, Shreyas Pansare, Vasu Sharma, Chao Zhang, Cris Flagg, Daniel Pressel, Lavina Vaz, Luke Dai, Prasoon Goyal, Sattvik Sahai, Shaohua Liu, Yao Lu, Anna Gottardi, Shui Hu, Yang Liu, Dilek Hakkani-Tur, Kate Bland, Heather Rocker, James Jeun, Yadunandana Rao, Michael Johnston, Akshaya Iyengar, Arindam Mandal, Prem Natarajan, Reza Ghanadan

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI