VLA / 视觉-语言-动作模型

VM-BHINet:Vision Mamba Bimanual Hand Interaction Network for 3D Interacting Hand Mesh Recovery From a Single RGB Image

Han Bi, Ge Yu, Yu He, Wenzhuo Liu, Zijie Zheng

专题命中 VLA模型 ：action model(abstract)；分类 cs.CV、cs.AI

Revealing the Relationship Between Publication Bias and Chemical Reactivity with Contrastive Learning

Wenhao Gao, Priyanka Raghavan, Ron Shprints, Connor W. Coley

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Finding the Trigger: Causal Abductive Reasoning on Video Events

Thao Minh Le, Vuong Le, Kien Do, Sunil Gupta, Svetha Venkatesh, Truyen Tran

专题命中 VLA模型 ：action model(abstract)；分类 cs.CV、cs.LG

Predicting Preschoolers' Externalizing Problems with Mother-Child Interaction Dynamics and Deep Learning

Xi Chen, Yu Ji, Cong Xia, Wen Wu

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments 34 pages, 3 figures, 2 tables

VANP: Learning Where to See for Navigation with Self-Supervised Vision-Action Pre-Training

Mohammad Nazeri, Junzhe Wang, Amirreza Payandeh, Xuesu Xiao

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.CV

Comments Extended version of the paper accepted at IROS 2024. Code: https://github.com/mhnazeri/VANP

Image Retrieval Methods in the Dissimilarity Space

Madhu Kiran, Kartikey Vishnu, Rafael M. O. Cruz, Eric Granger

专题命中 VLA模型 ：action model(abstract)；分类 cs.CV、cs.AI

Comments 7 pages

SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts

Royden Wagner, Ömer Sahin Tas, Marlon Steiner, Fabian Konstantinidis, Hendrik Königshof, Marvin Klemp, Carlos Fernandez, Christoph Stiller

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.CV

Comments ITSC'24; updated table VI

AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning

Jianguo Zhang, Tian Lan, Rithesh Murthy, Zhiwei Liu, Weiran Yao, Ming Zhu, Juntao Tan, Thai Hoang, Zuxin Liu, Liangwei Yang, Yihao Feng, Shirley Kokane, Tulika Awalgaonkar, Juan Carlos Niebles, Silvio Savarese, Shelby Heinecke, Huan Wang, Caiming Xiong

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments Add GitHub repo link at \url{https://github.com/SalesforceAIResearch/xLAM} and HuggingFace model link at \url{https://huggingface.co/Salesforce/xLAM-v0.1-r}

A Model for Intelligible Interaction Between Agents That Predict and Explain

A. Baskar, Ashwin Srinivasan, Michael Bain, Enrico Coiera

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments arXiv admin note: text overlap with arXiv:2205.08954

Deep Fusion: Capturing Dependencies in Contrastive Learning via Transformer Projection Heads

Huanran Li, Daniel Pimentel-Alarcón

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 2 figures

Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder

Matan Atad, David Schinz, Hendrik Moeller, Robert Graf, Benedikt Wiestler, Daniel Rueckert, Nassir Navab, Jan S. Kirschke, Matthias Keicher

专题命中 VLA模型 ：action model(abstract)；分类 cs.CV、cs.LG

Comments Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2024:024. arXiv admin note: text overlap with arXiv:2303.12031

Journal ref Machine.Learning.for.Biomedical.Imaging. 2 (2024)

Deep learning for fast segmentation and critical dimension metrology & characterization enabling AR/VR design and fabrication

Kundan Chaudhary, Subhei Shaar, Raja Muthinti

专题命中 VLA模型 ：action model(abstract)；分类 cs.CV、cs.LG

Using The Concept Hierarchy for Household Action Recognition

Andrei Costinescu, Luis Figueredo, Darius Burschka

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.AI

Comments 5 pages, 5 figures

Offline Imitation of Badminton Player Behavior via Experiential Contexts and Brownian Motion

Kuang-Da Wang, Wei-Yao Wang, Ping-Chun Hsieh, Wen-Chih Peng

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments Accepted by the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2024)

EPD: Long-term Memory Extraction, Context-awared Planning and Multi-iteration Decision @ EgoPlan Challenge ICML 2024

Letian Shi, Qi Lv, Xiang Deng, Liqiang Nie

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.CV

AutoTask: Task Aware Multi-Faceted Single Model for Multi-Task Ads Relevance

Shouchang Guo, Sonam Damani, Keng-hao Chang

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Efficient Document Ranking with Learnable Late Interactions

Ziwei Ji, Himanshu Jain, Andreas Veit, Sashank J. Reddi, Sadeep Jayasumana, Ankit Singh Rawat, Aditya Krishna Menon, Felix Yu, Sanjiv Kumar

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes

Hmrishav Bandyopadhyay, Subhadeep Koley, Ayan Das, Ayan Kumar Bhunia, Aneeshan Sain, Pinaki Nath Chowdhury, Tao Xiang, Yi-Zhe Song

专题命中 VLA模型 ：action model(abstract)；分类 cs.CV、cs.AI

Comments CVPR 2024, Project Page: https://hmrishavbandy.github.io/doodle23d/

The R2D2 deep neural network series paradigm for fast precision imaging in radio astronomy

Amir Aghabiglou, Chung San Chu, Arwa Dabbech, Yves Wiaux

专题命中 VLA模型 ：VLA(abstract)；分类 cs.CV、cs.LG

Comments Accepted for publication in ApJS

EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomy

Xiaoyi Cai, Siddharth Ancha, Lakshay Sharma, Philip R. Osteen, Bernadette Bucher, Stephen Phillips, Jiuguang Wang, Michael Everett, Nicholas Roy, Jonathan P. How

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.LG

Comments Under review. Journal extension for arXiv:2210.00153. Project website: https://xiaoyi-cai.github.io/evora/

Quantifying the biomimicry gap in biohybrid robot-fish pairs

Vaios Papaspyros, Guy Theraulaz, Clément Sire, Francesco Mondada

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.LG

Are Bounded Contracts Learnable and Approximately Optimal?

Yurong Chen, Zhaohua Chen, Xiaotie Deng, Zhiyi Huang

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Near-real-time Earthquake-induced Fatality Estimation using Crowdsourced Data and Large-Language Models

Chenguang Wang, Davis Engler, Xuechun Li, James Hou, David J. Wald, Kishor Jaiswal, Susu Xu

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 8 figures

Learning to Identify Graphs from Node Trajectories in Multi-Robot Networks

Eduardo Sebastian, Thai Duong, Nikolay Atanasov, Eduardo Montijano, Carlos Sagues

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.LG

Comments Accepted at IEEE MRS 2023

Stability Analysis of Non-Linear Classifiers using Gene Regulatory Neural Network for Biological AI

Adrian Ratwatte, Samitha Somathilaka, Sasitharan Balasubramaniam, Assaf A. Gilad

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

A Sign Language Recognition System with Pepper, Lightweight-Transformer, and LLM

JongYoon Lim, Inkyu Sa, Bruce MacDonald, Ho Seok Ahn

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.CV

Adaptive User-centered Neuro-symbolic Learning for Multimodal Interaction with Autonomous Systems

Amr Gomaa, Michael Feld

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments AI&HCI Workshop accepted paper at ICML2023 and accepted at ICMI2023 Blue Sky Papers. arXiv admin note: text overlap with arXiv:2211.03539

HuBo-VLM: Unified Vision-Language Model designed for HUman roBOt interaction tasks

Zichao Dong, Weikun Zhang, Xufeng Huang, Hang Ji, Xin Zhan, Junbo Chen

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.CV

MedMine: Examining Pre-trained Language Models on Medication Mining

Haifa Alrdahi, Lifeng Han, Hendrik Šuvalov, Goran Nenadic

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments Open Research Project. 7 pages, 1 figure, 5 tables

Towards Improving Harmonic Sensitivity and Prediction Stability for Singing Melody Extraction

Keren Shao, Ke Chen, Taylor Berg-Kirkpatrick, Shlomo Dubnov

专题命中 VLA模型 ：action model(abstract)；分类 cs.AI、cs.LG

Comments 7 pages, 4 figures, 2 tables, Proceedings of the 24th International Society for Music Information Retrieval Conference, ISMIR 2023