大模型推理能力

Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoning

Xintong Li, Jalend Bantupalli, Ria Dharmani, Yuwei Zhang, Jingbo Shang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Preprint

Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answering

Guangyi Liu, Yongqi Zhang, Yong Li, Quanming Yao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences

Jiaxin Shen, Jinan Xu, Huiqi Hu, Luyi Lin, Fei Zheng, Guoyang Ma, Fandong Meng, Jie Zhou, Wenjuan Han

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 20 pages, 13 figures

ActionReasoningBench: Reasoning about Actions with and without Ramification Constraints

Divij Handa, Pavel Dolin, Shrinidhi Kumbhar, Tran Cao Son, Chitta Baral

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted in ICLR 2025

ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation

Cheng Yang, Chufan Shi, Yaxin Liu, Bo Shui, Junjie Wang, Mohan Jing, Linran Xu, Xinyu Zhu, Siheng Li, Yuxiang Zhang, Gongye Liu, Xiaomei Nie, Deng Cai, Yujiu Yang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to ICLR 2025. Data and code are available at https://github.com/ChartMimic/ChartMimic

DocPuzzle: A Process-Aware Benchmark for Evaluating Realistic Long-Context Reasoning Capabilities

Tianyi Zhuang, Chuqiao Kuang, Xiaoguang Li, Yihua Teng, Jihao Wu, Yasheng Wang, Lifeng Shang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning

Bohao Yang, Yingji Zhang, Dong Liu, André Freitas, Chenghua Lin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Benchmarking Temporal Reasoning and Alignment Across Chinese Dynasties

Zhenglin Wang, Jialong Wu, Pengfei LI, Yong Jiang, Deyu Zhou

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Preprint

Visual Reasoning Evaluation of Grok, Deepseek Janus, Gemini, Qwen, Mistral, and ChatGPT

Nidhal Jegham, Marwan Abdelatti, Abdeltawab Hendawi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

ThinkBench: Dynamic Out-of-Distribution Evaluation for Robust LLM Reasoning

Shulin Huang, Linyi Yang, Yan Song, Shuang Chen, Leyang Cui, Ziyu Wan, Qingcheng Zeng, Ying Wen, Kun Shao, Weinan Zhang, Jun Wang, Yue Zhang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning

Kepu Zhang, Haoyue Yang, Xu Tang, Weijie Yu, Jun Xu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral

Shivani Kumar, David Jurgens

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 21 pages, 10 figures, 8 tables

STEER-ME: Assessing the Microeconomic Reasoning of Large Language Models

Narun Raman, Taylor Lundy, Thiago Amin, Jesse Perla, Kevin Leyton-Brown

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 18 pages, 11 figures

Can Multimodal LLMs do Visual Temporal Understanding and Reasoning? The answer is No!

Mohamed Fazli Imam, Chenyang Lyu, Alham Fikri Aji

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Our dataset can be found at \url{https://huggingface.co/datasets/fazliimam/temporal-vqa}

Pixel-Level Reasoning Segmentation via Multi-turn Conversations

Dexian Cai, Xiaocui Yang, Yongkang Liu, Daling Wang, Shi Feng, Yifei Zhang, Soujanya Poria

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Medicine on the Edge: Comparative Performance Analysis of On-Device LLMs for Clinical Reasoning

Leon Nissen, Philipp Zagar, Vishnu Ravi, Aydin Zahedivash, Lara Marie Reimer, Stephan Jonas, Oliver Aalami, Paul Schmiedmayer

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks

Alejandro Cuadron, Dacheng Li, Wenjie Ma, Xingyao Wang, Yichuan Wang, Siyuan Zhuang, Shu Liu, Luis Gaspar Schroeder, Tian Xia, Huanzhi Mao, Nicholas Thumiger, Aditya Desai, Ion Stoica, Ana Klimovic, Graham Neubig, Joseph E. Gonzalez

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoning

Vy Vo, Lizhen Qu, Tao Feng, Yuncheng Hua, Xiaoxi Kang, Songhai Fan, Tim Dwyer, Lay-Ki Soon, Gholamreza Haffari

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Journal ref Proceedings of the 2025 Conference of the North American Chapter of the Association for Computational Linguistics

Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning

Rujing Yao, Yang Wu, Chenghao Wang, Jingwei Xiong, Fang Wang, Xiaozhong Liu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning

Julian Perry, Surasakdi Siripong, Thanakorn Phonchai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

What Are They Doing? Joint Audio-Speech Co-Reasoning

Yingzhi Wang, Pooneh Mousavi, Artem Ploujnikov, Mirco Ravanelli

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to ICASSP 2025

ToolComp: A Multi-Tool Reasoning & Process Supervision Benchmark

Vaskar Nath, Pranav Raja, Claire Yoon, Sean Hendryx

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoning

Zheng Li, Yang Du, Mao Zheng, Mingyang Song

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by COLING 2025

OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning

Yuxiang Zhang, Yuqi Yang, Jiangming Shu, Yuhang Wang, Jinlin Xiao, Jitao Sang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Models

Yucheng Zhou, Zhi Rao, Jun Wan, Jianbing Shen

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

QUENCH: Measuring the gap between Indic and Non-Indic Contextual General Reasoning in LLMs

Mohammad Aflah Khan, Neemesh Yadav, Sarah Masud, Md. Shad Akhtar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 17 Pages, 6 Figures, 8 Tables, COLING 2025

Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning

Phakphum Artkaew

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to SEALP 2025 Workshop

From Laws to Motivation: Guiding Exploration through Law-Based Reasoning and Rewards

Ziyu Chen, Zhiqing Xiao, Xinbei Jiang, Junbo Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

What Do Learning Dynamics Reveal About Generalization in LLM Reasoning?

Katie Kang, Amrith Setlur, Dibya Ghosh, Jacob Steinhardt, Claire Tomlin, Sergey Levine, Aviral Kumar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

GRS-QA -- Graph Reasoning-Structured Question Answering Dataset

Anish Pahilajani, Devasha Trivedi, Jincen Shuai, Khin S. Yone, Samyak Rajesh Jain, Namyong Park, Ryan A. Rossi, Nesreen K. Ahmed, Franck Dernoncourt, Yu Wang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 15 pages, 24 figures, 10 tables