视觉大模型 / VLM

Recov-Vision: Linking Street View Imagery and Vision-Language Models for Post-Disaster Recovery

Recov-Vision：通过街道视图影像与视觉-语言模型实现灾害后恢复

Yiming Xiao, Archit Gupta, Miguel Esparza, Yu-Hsuan Ho, Antonia Sebastian, Hannah Weas, Rose Houck, Ali Mostafavi

机构 * UrbanResilience.AI Lab（UrbanResilience.AI 实验室） ； Zachry Department of Civil and Environmental Engineering（Zachry 土木与环境工程系） ； Texas A&M University（德克萨斯A&M大学） ； Department of Earth, Marine and Environmental Sciences（地球、海洋与环境科学系） ； The University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

AI总结 Recov-Vision通过结合街道视图影像与视觉-语言模型，实现灾害后建筑占用的高精度评估与可解释决策支持。

Comments 20 pages, 10 figures

From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D

从二维空间到三维空间：教视觉语言模型感知和推理三维世界

Jiahui Zhang, Yurui Chen, Yanpeng Zhou, Yueming Xu, Ze Huang, Jilin Mei, Junhui Chen, Yu-Jie Yuan, Xinyue Cai, Guowei Huang, Xingyue Quan, Hang Xu, Li Zhang

机构 * School of Data Science, Fudan University（复旦大学数据科学学院） ； Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

AI总结 本文提出了一种基于2D空间数据生成和标注的管道，构建了SPAR-7M数据集和SPAR-Bench基准，通过训练和微调提升视觉语言模型在三维空间感知和推理中的性能。

Comments Project page: https://logosroboticsgroup.github.io/SPAR/

OmniDexVLG: Learning Dexterous Grasp Generation from Vision Language Model-Guided Grasp Semantics, Taxonomy and Functional Affordance

OmniDexVLG: 从视觉语言模型引导的抓取语义、分类法和功能可及性中学习灵巧抓取生成

Lei Zhang, Diwen Zheng, Kaixin Bai, Zhenshan Bing, Zoltan-Csaba Marton, Zhaopeng Chen, Alois Christian Knoll, Jianwei Zhang

机构 * University of Hamburg（汉堡大学） ； Agile Robots SE（敏捷机器人公司） ； Technical University of Munich（慕尼黑技术大学） 纠错

专题命中 视觉推理 ：vision language model(title)；分类 cs.LG

AI总结 OmniDexVLG通过多模态语义推理和统一视觉语言模型，实现从自然语言指令中生成多样且语义连贯的灵巧抓取。

Comments Project Website: https://sites.google.com/view/omnidexvlg, 16 pages

CartoMapQA: A Fundamental Benchmark Dataset Evaluating Vision-Language Models on Cartographic Map Understanding

CartoMapQA: 一个评估视觉-语言模型在制图地图理解上的基础基准数据集

Huy Quang Ung, Guillaume Habault, Yasutaka Nishimura, Hao Niu, Roberto Legaspi, Tomoki Oya, Ryoichi Kojima, Masato Taya, Chihiro Ono, Atsunori Minamikawa, Yan Liu

机构 * KDDI Research, Inc.（KDDI研究公司） ； University of Southern California（南加州大学） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

AI总结 CartoMapQA通过问答任务评估视觉-语言模型在制图地图理解上的能力，揭示了模型在地图语义和地理推理方面的不足。

Comments Accepted at SIGSPATIAL 2025 (Best paper candidates), 15 pages

Vision-Language Models for Automated 3D PET/CT Report Generation

用于自动化3D PET/CT报告生成的视觉-语言模型

Wenpei Jiao, Kun Shang, Hui Li, Ke Yan, Jiajin Zhang, Guangjie Yang, Lijuan Guo, Yan Wan, Xing Yang, Dakai Jin, Zhaoheng Xie

机构 * Institute of Medical Technology and National Biomedical Imaging Center, Peking University（北京大学医学技术研究院和国家生物医学成像中心） ； Peking University People’s Hospital（北京大学人民医院） ； Peking University Third Hospital（北京大学第三医院） ； DAMO Academy, Alibaba Group（阿里巴巴集团达摩院） ； The Affiliated Hospital of Qingdao University（青岛大学附属医院） ； The First Affiliated Hospital of Henan Medical University（河南医科大学第一附属医院） ； Jiujiang City Key Laboratory of Cell Therapy, Jiu Jiang NO.1 People’s Hospital（九江市细胞治疗重点实验室，九江市第一人民医院） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

AI总结 本文提出PETRG-3D模型，通过3D双分支框架和风格适应提示，提升PET/CT报告生成的自动化水平，实验显示其在自然语言和临床指标上均优于现有方法。

SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning

Yang Liu, Ming Ma, Xiaomin Yu, Pengxiang Ding, Han Zhao, Mingyang Sun, Siteng Huang, Donglin Wang

机构 * Westlake University（西湖大学） ； Zhejiang University（浙江大学） ； Harbin Institute of Technology（哈尔滨工业大学） ； The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； Shanghai Innovation Institute（上海创新研究院） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Comments Accepted by NeurIPS 2025

LOGicalThought: Logic-Based Ontological Grounding of LLMs for High-Assurance Reasoning

Navapat Nananukul, Yue Zhang, Ryan Lee, Eric Boxer, Jonathan May, Vibhav Giridhar Gogate, Jay Pujara, Mayank Kejriwal

专题命中 视觉推理 ：grounding(title)；分类 cs.AI

PathoHR: Hierarchical Reasoning for Vision-Language Models in Pathology

Yating Huang, Ziyan Huang, Lintao Xiang, Qijun Yang, Hujun Yin

机构 * University of Manchester（曼彻斯特大学） ； South China University of Technology（华南理工大学） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Comments Accept by EMNLP2025

Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models

Tan-Hanh Pham, Chris Ngo

机构 * Harvard Medical School, Harvard University（哈佛医学院、哈佛大学） ； Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital（阿提尼乌拉A.马丁努斯生物医学成像中心、麻省总医院） ； Knovel Engineering Lab, Singapore（Knovel工程实验室、新加坡） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

AURA: A Fine-Grained Benchmark and Decomposed Metric for Audio-Visual Reasoning

Siminfar Samakoush Galougah, Rishie Raj, Sanjoy Chowdhury, Sayan Nag, Ramani Duraiswami

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

HumanPCR: Probing MLLM Capabilities in Diverse Human-Centric Scenes

Keliang Li, Hongze Shen, Hao Shi, Ruibing Hou, Hong Chang, Jie Huang, Chenghao Jia, Wen Wang, Yiling Wu, Dongmei Jiang, Shiguang Shan, Xilin Chen

机构 * Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, China（中国科学院智能信息处理重点实验室（中国科学院）、计算技术研究所、中国） 纠错

专题命中 视觉推理 ：MLLM(title)；分类 cs.CV

X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoning

Chee Ng, Liliang Sun, Shaoqing Tang

机构 * Universiti Teknologi Malaysia（马来西亚技术大学） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Diagnostic Accuracy of Open-Source Vision-Language Models on Diverse Medical Imaging Tasks

Gustav Müller-Franzes, Debora Jutz, Jakob Nikolas Kather, Christiane Kuhl, Sven Nebelung, Daniel Truhn

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Learning to Tune Like an Expert: Interpretable and Scene-Aware Navigation via MLLM Reasoning and CVAE-Based Adaptation

Yanbo Wang, Zipeng Fang, Lei Zhao, Weidong Chen

专题命中 视觉推理 ：MLLM(title)；分类 cs.CV

Enhancing Spatial Reasoning in Multimodal Large Language Models through Reasoning-based Segmentation

Zhenhua Ning, Zhuotao Tian, Shaoshuai Shi, Guangming Lu, Daojing He, Wenjie Pei, Li Jiang

机构 * Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）） ； Pengcheng Laboratory（鹏城实验室） ； The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； Voyager Research, Didi Chuxing 纠错

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Domain Specific Benchmarks for Evaluating Multimodal Large Language Models

Khizar Anjum, Muhammad Arbab Arshad, Kadhim Hayawi, Efstathios Polyzos, Asadullah Tariq, Mohamed Adel Serhani, Laiba Batool, Brady Lund, Nishith Reddy Mannuru, Ravi Varma Kumar Bevara, Taslim Mahbub, Muhammad Zeeshan Akram, Sakib Shahriar

机构 * Rutgers University（罗切斯特大学） ； Iowa State University（爱荷华州立大学） ； Zayed University（扎耶德大学） ； United Arab Emirates University（阿拉伯联合酋长国大学） ； University of Sharjah（沙迦大学） ； University of North Texas（北德克萨斯大学） ； George Washington University（乔治·华盛顿大学） ； University of Louisville（路易斯维尔大学） ； University of Guelph（圭尔夫大学） 纠错

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.LG

X-Driver: Explainable Autonomous Driving with Vision-Language Models

Wei Liu, Jiyuan Zhang, Binxiong Zheng, Yufeng Hu, Yingzhan Lin, Zengfeng Zeng

机构 * Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）） ； Baidu Inc.（百度公司） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

RBench-V: A Primary Assessment for Visual Reasoning Models with Multi-modal Outputs

Meng-Hao Guo, Xuanyu Chu, Qianrui Yang, Zhe-Han Mo, Yiqing Shen, Pei-lin Li, Xinjie Lin, Jinnian Zhang, Xin-Sheng Chen, Yi Zhang, Kiyohiro Nakayama, Zhengyang Geng, Houwen Peng, Han Hu, Shi-Min Hu

机构 * Tsinghua University（清华大学） ； Tencent Hunyuan X（腾讯文英实验室） ； Stanford University（斯坦福大学） ； Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

Comments 12 pages

Unified Modeling Language Code Generation from Diagram Images Using Multimodal Large Language Models

Averi Bates, Ryan Vavricka, Shane Carleton, Ruosi Shao, Chongle Pan

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.LG

Comments Published in the Journal of Machine Learning with Applications, Author Contributions: Averi Bates: Methodology, Development, Analysis, Data Curation, Drafting, Review. Ryan Vavricka: Data Curation, Development, Review. Shane Carleton: Supervision, Funding. Ruosi Shao: Review. Chongle Pan: Supervision, Review

Journal ref Mach. Learn. Appl. 20 (2025) 100660

R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation

Meng-Hao Guo, Jiajun Xu, Yi Zhang, Jiaxi Song, Haoyang Peng, Yi-Xuan Deng, Xinzhi Dong, Kiyohiro Nakayama, Zhengyang Geng, Chen Wang, Bolin Ni, Guo-Wei Yang, Yongming Rao, Houwen Peng, Han Hu, Gordon Wetzstein, Shi-min Hu

专题命中 视觉推理 ：MLLM(title)；分类 cs.CV

Comments 18pages

Grounding Agent Reasoning in Image Schemas: A Neurosymbolic Approach to Embodied Cognition

François Olivier, Zied Bouraoui

专题命中 视觉推理 ：grounding(title)；分类 cs.AI

Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models

Chengkai Huang, Junda Wu, Yu Xia, Zixu Yu, Ruhan Wang, Tong Yu, Ruiyi Zhang, Ryan A. Rossi, Branislav Kveton, Dongruo Zhou, Julian McAuley, Lina Yao

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.AI

Do Multimodal Large Language Models Understand Welding?

Grigorii Khvatskii, Yong Suk Lee, Corey Angst, Maria Gibbs, Robert Landers, Nitesh V. Chawla

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Comments 16 pages

Can Large Vision Language Models Read Maps Like a Human?

Shuo Xing, Zezhou Sun, Shuangyu Xie, Kaiyuan Chen, Yanjia Huang, Yuping Wang, Jiachen Li, Dezhen Song, Zhengzhong Tu

专题命中 视觉推理 ：vision language model(title)；分类 cs.CV

Comments 35 pages

GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing

Rongyao Fang, Chengqi Duan, Kun Wang, Linjiang Huang, Hao Li, Shilin Yan, Hao Tian, Xingyu Zeng, Rui Zhao, Jifeng Dai, Xihui Liu, Hongsheng Li

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Comments Dataset and models are released in https://github.com/rongyaofang/GoT

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models

Zhongzhan Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Zitnik, Liang Lin

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.AI

Comments Accepted by TPAMI. arXiv admin note: text overlap with arXiv:2312.02439

SIFT: Grounding LLM Reasoning in Contexts via Stickers

Zihao Zeng, Xuyao Huang, Boxiu Li, Zhijie Deng

专题命中 视觉推理 ：grounding(title)；分类 cs.AI

Atari-GPT: Benchmarking Multimodal Large Language Models as Low-Level Policies in Atari Games

Nicholas R. Waytowich, Devin White, MD Sunbeam, Vinicius G. Goecks

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.AI

Comments Currently under review

FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models

Zhikai Zhang, Yitang Li, Haofeng Huang, Mingxian Lin, Li Yi

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Jiwan Chung, Sungjae Lee, Minseo Kim, Seungju Han, Ashkan Yousefpour, Jack Hessel, Youngjae Yu

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

Comments 12 pages, 6 figures. Accepted as main paper in EMNLP 2024