大模型推理能力

VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity

Jing Bi, Junjia Guo, Susan Liang, Guangyu Sun, Luchuan Song, Yunlong Tang, Jinxi He, Jiarui Wu, Ali Vosoughi, Chen Chen, Chenliang Xu

专题命中 推理评测 ：reasoning(title,abstract)

Road Rage Reasoning with Vision-language Models (VLMs): Task Definition and Evaluation Dataset

Yibing Weng, Yu Gu, Fuji Ren

专题命中 推理评测 ：reasoning(title,abstract)

CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVs

Artem Lykov, Valerii Serpiva, Muhammad Haris Khan, Oleg Sautenkov, Artyom Myshlyaev, Grik Tadevosyan, Yasheerah Yaqoot, Dzmitry Tsetserukou

专题命中 推理评测 ：reasoning(title,abstract)

Comments Paper submitted to the IEEE conference

STUPD: A Synthetic Dataset for Spatial and Temporal Relation Reasoning

Palaash Agrawal, Haidi Azaman, Cheston Tan

专题命中 推理评测 ：reasoning(title,abstract)

video-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language Model

Guangzhi Sun, Yudong Yang, Jimin Zhuang, Changli Tang, Yixuan Li, Wei Li, Zejun MA, Chao Zhang

专题命中 推理评测 ：reasoning(title,abstract)

GraphEval36K: Benchmarking Coding and Reasoning Capabilities of Large Language Models on Graph Datasets

Qiming Wu, Zichen Chen, Will Corcoran, Misha Sra, Ambuj K. Singh

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

Comments The first two authors contributed equally to this work. This paper has been accepted by NAACL 2025. GraphEval36K is available at https://grapheval36k.github.io/

SMIR: Efficient Synthetic Data Pipeline To Improve Multi-Image Reasoning

Andrew Li, Rahul Thapa, Rahul Chalamala, Qingyang Wu, Kezhen Chen, James Zou

专题命中 推理评测 ：reasoning(title,abstract)

TinyEmo: Scaling down Emotional Reasoning via Metric Projection

Cristian Gutierrez

专题命中 推理评测 ：reasoning(title,abstract)

Comments I am withdrawing this work in favour of the confidentiality of research ideas that are still under development.

A Tool for In-depth Analysis of Code Execution Reasoning of Large Language Models

Changshu Liu, Reyhaneh Jabbarvand

专题命中 推理评测 ：reasoning(title,abstract)

Comments 5 pages

LLM is Knowledge Graph Reasoner: LLM's Intuition-aware Knowledge Graph Reasoning for Cold-start Sequential Recommendation

Keigo Sakurai, Ren Togo, Takahiro Ogawa, Miki Haseyama

专题命中 推理评测 ：reasoning(title,abstract)

Comments Accepted to the 47th European Conference on Information Retrieval (ECIR2025)

Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoning

Melanie Sclar, Jane Yu, Maryam Fazel-Zarandi, Yulia Tsvetkov, Yonatan Bisk, Yejin Choi, Asli Celikyilmaz

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

Temporal Contrastive Learning for Video Temporal Reasoning in Large Vision-Language Models

Rafael Souza, Jia-Hao Lim, Alexander Davis

专题命中 推理评测 ：reasoning(title,abstract)

Benchmarking VLMs' Reasoning About Persuasive Atypical Images

Sina Malakouti, Aysan Aghazadeh, Ashmit Khandelwal, Adriana Kovashka

专题命中 推理评测 ：reasoning(title,abstract)

Language hooks: a modular framework for augmenting LLM reasoning that decouples tool usage from the model and its prompt

Damien de Mijolla, Wen Yang, Philippa Duckett, Christopher Frye, Mark Worrall

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

Comments This work was conducted during Summer 2023. Experimental results and references reflect the state of the field at that time and may not account for subsequent developments

Visual-Linguistic Agent: Towards Collaborative Contextual Object Reasoning

Jingru Yang, Huan Yu, Yang Jingxin, Chentianye Xu, Yin Biao, Yu Sun, Shengfeng He

专题命中 推理评测 ：reasoning(title,abstract)

ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs

Irene Huang, Wei Lin, M. Jehanzeb Mirza, Jacob A. Hansen, Sivan Doveh, Victor Ion Butoi, Roei Herzig, Assaf Arbelle, Hilde Kuehne, Trevor Darrell, Chuang Gan, Aude Oliva, Rogerio Feris, Leonid Karlinsky

专题命中 推理评测 ：reasoning(title,abstract)

Comments NeurIPS 2024 Camera Ready

A Hitchhikers Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoning

Niki Maria Foteinopoulou, Enjie Ghorbel, Djamila Aouada

专题命中 推理评测 ：reasoning(title,abstract)

Comments Accepted at NeurIPS'2024 (D&B)

Reasoning Grasping via Multimodal Large Language Model

Shiyu Jin, Jinxuan Xu, Yutian Lei, Liangjun Zhang

专题命中 推理评测 ：reasoning(title,abstract)

Comments CoRL 2024

SPARK: Multi-Vision Sensor Perception and Reasoning Benchmark for Large-scale Vision-Language Models

Youngjoon Yu, Sangyun Chung, Byung-Kwan Lee, Yong Man Ro

专题命中 推理评测 ：reasoning(title,abstract)

Comments Codes and data are available at https://github.com/top-yun/SPARK

MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models

Wentian Wang, Sarthak Jain, Paul Kantor, Jacob Feldman, Lazaros Gallos, Hao Wang

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM Reasoning

Zhipeng Li, Christoph Gebhardt, Yves Inglin, Nicolas Steck, Paul Streli, Christian Holz

专题命中 推理评测 ：reasoning(title,abstract)

Comments 13 pages

PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns

Yew Ken Chia, Vernon Toh Yan Han, Deepanway Ghosal, Lidong Bing, Soujanya Poria

专题命中 推理评测 ：reasoning(title,abstract)

Comments ACL 2024 Camera Ready

CRQBench: A Benchmark of Code Reasoning Questions

Elizabeth Dinella, Satish Chandra, Petros Maniatis

专题命中 推理评测 ：reasoning(title,abstract)

ContPhy: Continuum Physical Concept Learning and Reasoning from Videos

Zhicheng Zheng, Xin Yan, Zhenfang Chen, Jingzhou Wang, Qin Zhi Eddie Lim, Joshua B. Tenenbaum, Chuang Gan

专题命中 推理评测 ：reasoning(title,abstract)

Comments The first three authors contributed equally to this work

Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Driving

Ming Nie, Renyuan Peng, Chunwei Wang, Xinyue Cai, Jianhua Han, Hang Xu, Li Zhang

专题命中 推理评测 ：reasoning(title,abstract)

Comments ECCV 2024

VISA: Reasoning Video Object Segmentation via Large Language Models

Cilin Yan, Haochen Wang, Shilin Yan, Xiaolong Jiang, Yao Hu, Guoliang Kang, Weidi Xie, Efstratios Gavves

专题命中 推理评测 ：reasoning(title,abstract)

Remember This Event That Year? Assessing Temporal Information and Reasoning in Large Language Models

Himanshu Beniwal, Dishant Patel, Kowsik Nandagopan D, Hritik Ladia, Ankit Yadav, Mayank Singh

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videos

Jr-Jen Chen, Yu-Chien Liao, Hsi-Che Lin, Yu-Chu Yu, Yen-Chun Chen, Yu-Chiang Frank Wang

专题命中 推理评测 ：reasoning(title,abstract)

Comments Project page: https://rextime.github.io/

ChartBench: A Benchmark for Complex Visual Reasoning in Charts

Zhengzhuo Xu, Sinan Du, Yiyan Qi, Chengjin Xu, Chun Yuan, Jian Guo

专题命中 推理评测 ：reasoning(title,abstract)

mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans

Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at Findings of ACL 2024