大模型推理能力 - arXivDaily 专题

2410.13510 2024-10-18 cs.CL cs.CV 57%

GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models

Aditya Sharma, Aman Dalmia, Mehran Kazemi, Amal Zouaq, Christopher J. Pal

专题命中视觉空间推理：reasoning(abstract)；分类 cs.CL

2410.11068 2024-10-16 cs.CV cs.LG cs.SD eess.AS 57%

Character-aware audio-visual subtitling in context

Jaesung Huh, Andrew Zisserman

专题命中视觉空间推理：reasoning(abstract)；分类 cs.LG

Comments ACCV 2024

2410.10745 2024-10-15 cs.CV cs.AI 57%

FlexGen: Flexible Multi-View Generation from Text and Image Inputs

Xinli Xu, Wenhang Ge, Jiantao Lin, Jiawei Feng, Lie Xu, HanFeng Zhao, Shunsi Zhang, Ying-Cong Chen

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

Comments 16 pages, 13 figures

2404.05465 2024-10-15 cs.CV cs.LG 57%

HAMMR: HierArchical MultiModal React agents for generic VQA

Lluis Castrejon, Thomas Mensink, Howard Zhou, Vittorio Ferrari, Andre Araujo, Jasper Uijlings

专题命中视觉空间推理：reasoning(abstract)；分类 cs.LG

2307.09206 2024-10-08 cs.RO cs.LG 57%

Context-Conditional Navigation with a Learning-Based Terrain- and Robot-Aware Dynamics Model

Suresh Guttikonda, Jan Achterhold, Haolong Li, Joschka Boedecker, Joerg Stueckler

专题命中视觉空间推理：planning(abstract)；分类 cs.LG

2410.03551 2024-10-07 cs.CV cs.AI cs.HC 57%

Constructive Apraxia: An Unexpected Limit of Instructible Vision-Language Models and Analog for Human Cognitive Disorders

David Noever, Samantha E. Miller Noever

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

2408.04102 2024-10-03 cs.CV cs.AI 57%

ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling

William Yicheng Zhu, Keren Ye, Junjie Ke, Jiahui Yu, Leonidas Guibas, Peyman Milanfar, Feng Yang

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

Comments Accepted at ECCV 2024. Contact: zhuwilliam[at]google[dot]com. GitHub: https://github.com/google-research/google-research/tree/master/attribute_with_prefixlm

2409.17922 2024-09-27 cs.AI 57%

Navigation in a simplified Urban Flow through Deep Reinforcement Learning

Federica Tonti, Jean Rabault, Ricardo Vinuesa

专题命中视觉空间推理：planning(abstract)；分类 cs.AI

2409.02522 2024-09-24 cs.AI cs.RO 57%

Cog-GA: A Large Language Models-based Generative Agent for Vision-Language Navigation in Continuous Environments

Zhiyuan Li, Yanfeng Lu, Yao Mu, Hong Qiao

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

2409.05865 2024-09-10 cs.RO cs.LG 57%

Robot Utility Models: General Policies for Zero-Shot Deployment in New Environments

Haritheja Etukuru, Norihito Naka, Zijin Hu, Seungjae Lee, Julian Mehu, Aaron Edsinger, Chris Paxton, Soumith Chintala, Lerrel Pinto, Nur Muhammad Mahi Shafiullah

专题命中视觉空间推理：verifier(abstract)；分类 cs.LG

Comments Project website https://robotutilitymodels.com

2409.04576 2024-09-10 cs.RO cs.AI 57%

ActionFlow: Equivariant, Accurate, and Efficient Policies with Spatially Symmetric Flow Matching

Niklas Funk, Julen Urain, Joao Carvalho, Vignesh Prasad, Georgia Chalvatzaki, Jan Peters

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

2409.01630 2024-09-04 cs.RO cs.AI cs.ET 57%

SafeEmbodAI: a Safety Framework for Mobile Robots in Embodied AI Systems

Wenxiao Zhang, Xiangrui Kong, Thomas Braunl, Jin B. Hong

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

2404.15228 2024-08-27 cs.CV cs.CL 57%

Re-Thinking Inverse Graphics With Large Language Models

Peter Kulits, Haiwen Feng, Weiyang Liu, Victoria Abrevaya, Michael J. Black

专题命中视觉空间推理：reasoning(abstract)；分类 cs.CL

Comments TMLR camera-ready; 31 pages; project page: https://ig-llm.is.tue.mpg.de/

2408.10388 2024-08-21 cs.CV cs.CL 57%

Narrowing the Gap between Vision and Action in Navigation

Yue Zhang, Parisa Kordjamshidi

专题命中视觉空间推理：reasoning(abstract)；分类 cs.CL

2403.12488 2024-07-24 cs.CV cs.AI 57%

DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLM

Yixuan Wu, Yizhou Wang, Shixiang Tang, Wenhao Wu, Tong He, Wanli Ouyang, Philip Torr, Jian Wu

专题命中视觉空间推理：chain-of-thought(abstract)；分类 cs.AI

2407.04699 2024-07-17 cs.CV cs.AI 57%

LaRa: Efficient Large-Baseline Radiance Fields

Anpei Chen, Haofei Xu, Stefano Esposito, Siyu Tang, Andreas Geiger

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

Comments Project Page: https://apchenstu.github.io/LaRa/

2407.08470 2024-07-12 cs.CV cs.AI 57%

Brain Tumor Segmentation in MRI Images with 3D U-Net and Contextual Transformer

Thien-Qua T. Nguyen, Hieu-Nghia Nguyen, Thanh-Hieu Bui, Thien B. Nguyen-Tat, Vuong M. Ngo

专题命中视觉空间推理：CoT(abstract)；分类 cs.AI

Comments 6 pages, 7 figures

2407.00632 2024-07-02 cs.RO cs.CL cs.CV cs.MA 57%

CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations

Pengying Wu, Yao Mu, Kangjie Zhou, Ji Ma, Junting Chen, Chang Liu

专题命中视觉空间推理：planning(abstract)；分类 cs.CL

Comments Accepted to the RSS 2024 Workshop: GROUND

2406.18115 2024-06-27 cs.RO cs.AI cs.CV 57%

Open-vocabulary Mobile Manipulation in Unseen Dynamic Environments with 3D Semantic Maps

Dicong Qiu, Wenzong Ma, Zhenfu Pan, Hui Xiong, Junwei Liang

专题命中视觉空间推理：planning(abstract)；分类 cs.AI

Comments Open-vocabulary, Mobile Manipulation, Dynamic Environments, 3D Semantic Maps, Zero-shot, LLMs, VLMs, 18 pages, 2 figures

2305.17455 2024-06-17 cs.CV cs.CL 57%

CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers

Dachuan Shi, Chaofan Tao, Anyi Rao, Zhendong Yang, Chun Yuan, Jiaqi Wang

专题命中视觉空间推理：reasoning(abstract)；分类 cs.CL

Comments ICML 2024. Code: https://github.com/sdc17/CrossGET

2406.06865 2024-06-12 cs.AI 57%

Eyeballing Combinatorial Problems: A Case Study of Using Multimodal Large Language Models to Solve Traveling Salesman Problems

Mohammed Elhenawy, Ahmed Abdelhay, Taqwa I. Alhadidi, Huthaifa I Ashqar, Shadi Jaradat, Ahmed Jaber, Sebastien Glaser, Andry Rakotonirainy

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

2401.04218 2024-06-05 cs.CL 57%

Distortions in Judged Spatial Relations in Large Language Models

Nir Fulman, Abdulkadir Memduhoğlu, Alexander Zipf

专题命中视觉空间推理：reasoning(abstract)；分类 cs.CL

Comments This manuscript has been accepted for publication in The Professional Geographer

2405.19586 2024-05-31 cs.CV cs.LG cs.RO 57%

SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation

Junjie Zhang, Chenjia Bai, Haoran He, Wenke Xia, Zhigang Wang, Bin Zhao, Xiu Li, Xuelong Li

专题命中视觉空间推理：reasoning(abstract)；分类 cs.LG

Comments ICML 2024. Project page: https://sam-embodied.github.io

2403.10171 2024-05-28 cs.AI cs.CV 57%

AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation

Arkajit Datta, Tushar Verma, Rajat Chawla, Mukunda N. S, Ishaan Bhola

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

Comments Accepted in MIPR-2024

2402.07630 2024-05-28 cs.LG 57%

G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering

Xiaoxin He, Yijun Tian, Yifei Sun, Nitesh V. Chawla, Thomas Laurent, Yann LeCun, Xavier Bresson, Bryan Hooi

专题命中视觉空间推理：reasoning(abstract)；分类 cs.LG

2405.15684 2024-05-27 cs.CV cs.AI 57%

Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models

Yue Zhang, Hehe Fan, Yi Yang

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

2405.14128 2024-05-27 cs.RO cs.CV cs.LG 57%

Transformers for Image-Goal Navigation

Nikhilanj Pelluri

专题命中视觉空间推理：planning(abstract)；分类 cs.LG

Comments NOTE: This work was submitted as part of a Master's Capstone Project and must be treated as such. This is still an early work in progress and not the final version

2403.19838 2024-05-10 cs.CV cs.AI 57%

Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Driving

Akshay Gopalkrishnan, Ross Greer, Mohan Trivedi

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

Comments 9 pages, 3 figures, Accepted at CVPR 2024 Vision and Language for Autonomous Driving and Robotics Workshop

2304.00962 2024-05-07 cs.CV cs.AI 57%

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

Jihan Yang, Runyu Ding, Weipeng Deng, Zhe Wang, Xiaojuan Qi

专题命中视觉空间推理：reasoning(abstract)；分类 cs.AI

Comments To appear in CVPR2024 .project page: https://jihanyang.github.io/projects/RegionPLC

2310.10586 2024-04-30 cs.CV cs.CL 57%

VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools

Ji Qi, Kaixuan Ji, Jifan Yu, Duokang Wang, Bin Xu, Lei Hou, Juanzi Li

专题命中视觉空间推理：reasoning(abstract)；分类 cs.CL

1. 视觉空间推理 3363 篇

GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models

Character-aware audio-visual subtitling in context

FlexGen: Flexible Multi-View Generation from Text and Image Inputs

HAMMR: HierArchical MultiModal React agents for generic VQA

Context-Conditional Navigation with a Learning-Based Terrain- and Robot-Aware Dynamics Model

Constructive Apraxia: An Unexpected Limit of Instructible Vision-Language Models and Analog for Human Cognitive Disorders

ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling

Navigation in a simplified Urban Flow through Deep Reinforcement Learning

Cog-GA: A Large Language Models-based Generative Agent for Vision-Language Navigation in Continuous Environments

Robot Utility Models: General Policies for Zero-Shot Deployment in New Environments

ActionFlow: Equivariant, Accurate, and Efficient Policies with Spatially Symmetric Flow Matching

SafeEmbodAI: a Safety Framework for Mobile Robots in Embodied AI Systems

Re-Thinking Inverse Graphics With Large Language Models

Narrowing the Gap between Vision and Action in Navigation

DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLM

LaRa: Efficient Large-Baseline Radiance Fields

Brain Tumor Segmentation in MRI Images with 3D U-Net and Contextual Transformer

CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversations

Open-vocabulary Mobile Manipulation in Unseen Dynamic Environments with 3D Semantic Maps

CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers

Eyeballing Combinatorial Problems: A Case Study of Using Multimodal Large Language Models to Solve Traveling Salesman Problems

Distortions in Judged Spatial Relations in Large Language Models

SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation

AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation

G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering

Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models

Transformers for Image-Goal Navigation

Multi-Frame, Lightweight & Efficient Vision-Language Models for Question Answering in Autonomous Driving

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools