大模型推理能力

Radiology's Last Exam (RadLE): Benchmarking Frontier Multimodal AI Against Human Experts and a Taxonomy of Visual Reasoning Errors in Radiology

Suvrankar Datta, Divya Buchireddygari, Lakshmi Vennela Chowdary Kaza, Mrudula Bhalke, Kautik Singh, Ayush Pandey, Sonit Sai Vasipalli, Upasana Karnwal, Hakikat Bir Singh Bhatti, Bhavya Ratan Maroo, Sanjana Hebbar, Rahul Joseph, Gurkawal Kaur, Devyani Singh, Akhil V, Dheeksha Devasya Shama Prasad, Nishtha Mahajan, Ayinaparthi Arisha, Rajesh Vanagundi, Reet Nandy, Kartik Vuthoo, Snigdhaa Rajvanshi, Nikhileswar Kondaveeti, Suyash Gunjal, Rishabh Jain, Rajat Jain, Anurag Agrawal

机构 * Centre for Responsible Autonomous Systems in Healthcare (CRASH) Lab, Koita Centre for Digital Health（负责任的自主医疗系统中心（CRASH）实验室、Koita数字健康中心） ； Ashoka University（阿什oka大学） ； Independent Researcher（独立研究者） ； Koita Centre for Digital Health（Koita数字健康中心） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 29 pages, 7 figures, 7 tables, includes Annexure (1). Part of the work accepted at RSNA 2025 (Cutting Edge Oral Presentation)

Interpretable Physics Reasoning and Performance Taxonomy in Vision-Language Models

Pranav Pawar, Kavish Shah, Akshat Bhalani, Komal Kasat, Dev Mittal, Hadi Gala, Deepali Patil, Nikita Raichada, Monali Deshmukh

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

11Plus-Bench: Demystifying Multimodal LLM Spatial Reasoning with Cognitive-Inspired Analysis

Chengzu Li, Wenshan Wu, Huanyu Zhang, Qingtao Li, Zeyu Gao, Yan Xia, José Hernández-Orallo, Ivan Vulić, Furu Wei

机构 * Microsoft Research（微软研究院） ； Language Technology Lab, University of Cambridge（语言技术实验室，剑桥大学） ； Institute of Automation, Chinese Academy of Sciences（自动化研究所，中国科学院） ； Department of Oncology, University of Cambridge（癌症部门，剑桥大学） ； Leverhulme Centre for the Future of Intelligence, University of Cambridge（未来智能中心，剑桥大学） ； VRAIN, Universitat Politècnica de València（VRAIN，巴塞罗那理工大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 4 figures (22 pages, 7 figures, 7 tables including references and appendices)

CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting

Atin Pothiraj, Elias Stengel-Eskin, Jaemin Cho, Mohit Bansal

机构 * UNC Chapel Hill（北卡罗来纳大学教堂山分校） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ICCV 2025

Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses

Bin Han, Robert Wolfe, Anat Caspi, Bill Howe

机构 * University of Washington（华盛顿大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Reinforcing VLMs to Use Tools for Detailed Visual Reasoning Under Resource Constraints

Sunil Kumar, Bowen Zhao, Leo Dirac, Paulina Varshavskaya

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding

Jie Feng, Shengyuan Wang, Tianhui Liu, Yanxin Xi, Yong Li

机构 * Department of Electronic Engineering, BNRist, Tsinghua University, Beijing, China（电子工程系，北京理工大学，清华大学，北京，中国） ； Department of Computer Science and Technology, Tsinghua University, Beijing, China（计算机科学与技术系，清华大学，北京，中国） ； School of Electronic and Information Engineering, Beijing Jiaotong University, China（电子与信息工程学院，北京交通大学，中国） ； University of Helsinki, Finland（赫尔辛基大学，芬兰） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ICCV 2025

Reasoning Limitations of Multimodal Large Language Models. A Case Study of Bongard Problems

Mikołaj Małkiński, Szymon Pawlonka, Jacek Mańdziuk

机构 * Warsaw University of Technology, Warsaw, Poland（华沙技术大学） ； AGH University of Krakow, Krakow, Poland（克拉科夫AGH大学） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted to The Forty-Second International Conference on Machine Learning (ICML 2025)

Foundation Models for Geospatial Reasoning: Assessing Capabilities of Large Language Models in Understanding Geometries and Topological Spatial Relations

Yuhan Ji, Song Gao, Ying Nie, Ivan Majić, Krzysztof Janowicz

机构 * GeoDS Lab, Department of Geography, University of Wisconsin-Madison, USA（威斯康星大学麦迪逊分校地理系GeoDS实验室） ； Department of Geography and Regional Research, University of Vienna, Austria（维也纳大学地理与区域研究系） ； Department of Geography, University of California-Santa Barbara, USA（加州大学圣塔芭芭拉分校地理系） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 33 pages, 13 figures, IJGIS GeoFM Special Issue

Journal ref International Journal of Geographical Information Science, 2025 International Journal of Geographical Information Science International Journal of Geographical Information Science

SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Models

Shun Taguchi, Hideki Deguchi, Takumi Hamazaki, Hiroyuki Sakai

机构 * Toyota Central R&D Labs., Inc.（丰田中央研究实验室） 纠错

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 18 pages, 11 figures

On Data Synthesis and Post-training for Visual Abstract Reasoning

Ke Zhu, Yu Wang, Jiangjiang Liu, Qunyi Xie, Shanshan Liu, Gang Zhang

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion

Shoubin Yu, Jaehong Yoon, Mohit Bansal

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ICLR 2025; first two authors contributed equally. Project page: https://CREMA-VideoLLM.github.io/

R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model

Hengguang Zhou, Xirui Li, Ruochen Wang, Minhao Cheng, Tianyi Zhou, Cho-Jui Hsieh

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 6 figures

ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation

Abrar Anwar, John Welsh, Joydeep Biswas, Soha Pouya, Yan Chang

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models

Gengze Zhou, Yicong Hong, Zun Wang, Xin Eric Wang, Qi Wu

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to ECCV 2024

GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding

Yibo Yan, Joey Lee

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by International Conference on Information and Knowledge Management 2024

MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains

Zhaohuan Zhan, Lisha Yu, Sijie Yu, Guang Tan

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling

Haider Al-Tahan, Quentin Garrido, Randall Balestriero, Diane Bouchacourt, Caner Hazirbas, Mark Ibrahim

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

ConTextual: Evaluating Context-Sensitive Text-Rich Visual Reasoning in Large Multimodal Models

Rohan Wadhawan, Hritik Bansal, Kai-Wei Chang, Nanyun Peng

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Journal ref PMLR 235:49733-49787, 2024

Can Large Language Models Create New Knowledge for Spatial Reasoning Tasks?

Thomas Greatrix, Roger Whitaker, Liam Turner, Walter Colombo

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Towards Truly Zero-shot Compositional Visual Reasoning with LLMs as Programmers

Aleksandar Stanić, Sergi Caelles, Michael Tschannen

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation

Xiwen Liang, Liang Ma, Shanshan Guo, Jianhua Han, Hang Xu, Shikui Ma, Xiaodan Liang

专题命中 视觉空间推理 ：planning(title,abstract)；分类 cs.CL、cs.AI

Comments 22 pages

Learning Abstract Visual Reasoning via Task Decomposition: A Case Study in Raven Progressive Matrices

Jakub Kwiatkowski, Krzysztof Krawiec

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 22 pages, 10 figures

Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models

Navid Rajabi, Jana Kosecka

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to DMLR @ ICLR 2024

LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations

Yudong Xu, Wenhao Li, Pashootan Vaezipoor, Scott Sanner, Elias B. Khalil

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 26 pages, 15 figures, published in Transactions on Machine Learning Research (TMLR)

Exploring and Improving the Spatial Reasoning Abilities of Large Language Models

Manasi Sharma

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Published in NeurIPS 2023 Workshop on Instruction Tuning and Instruction Following

What's "up" with vision-language models? Investigating their struggle with spatial reasoning

Amita Kamath, Jack Hessel, Kai-Wei Chang

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2023

Multimodal Analysis Of Google Bard And GPT-Vision: Experiments In Visual Reasoning

David Noever, Samantha Elizabeth Miller Noever

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

EuclidNet: Deep Visual Reasoning for Constructible Problems in Geometry

Man Fai Wong, Xintong Qi, Chee Wei Tan

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by 2nd MATH-AI Workshop at NeurIPS'22

Journal ref Adv. Artif. Intell. Mach. Learn.(2023), 3(1):839-852

Infusing Lattice Symmetry Priors in Attention Mechanisms for Sample-Efficient Abstract Geometric Reasoning

Mattia Atzeni, Mrinmaya Sachan, Andreas Loukas

专题命中 视觉空间推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication at the International Conference on Machine Learning, ICML 2023