大模型推理能力

Plan before Solving: Problem-Aware Strategy Routing for Mathematical Reasoning with LLMs

Shihao Qi, Jie Ma, Ziang Yin, Lingling Zhang, Jian Zhang, Jun Liu, Feng Tian, Tongliang Liu

机构 * School of Computer Science and Technology, Xi’an Jiaotong University（西安交通大学计算机科学与技术学院） ； MOE KLINNS Lab, Xi’an Jiaotong University（西安交通大学MOE KLINNS实验室） ； Shaanxi Province Key Laboratory of Big Data Knowledge Engineering（陕西省大数据知识工程重点实验室） ； Sydney AI Centre, The University of Sydney（悉尼大学悉尼人工智能中心） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；planning(abstract)；分类 cs.AI

Beyond English-Centric Training: How Reinforcement Learning Improves Cross-Lingual Reasoning in LLMs

Shulin Huang, Yiran Ding, Junshu Pan, Yue Zhang

机构 * Zhejiang University（浙江大学） ； Westlake University（西湖大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

GRIP: A Graph-Based Reasoning Instruction Producer

Jiankang Wang, Jianjun Xu, Xiaorui Wang, Yuxin Wang, Mengting Xing, Shancheng Fang, Hongtao Xie

机构 * University of Science and Technology of China（中国科学技术大学） ； MetaStone Technology（MetaStone技术） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

Multimodal Mathematical Reasoning Embedded in Aerial Vehicle Imagery: Benchmarking, Analysis, and Exploration

Yue Zhou, Litong Feng, Mengcheng Lan, Xue Yang, Qingyun Li, Yiping Ke, Xue Jiang, Wayne Zhang

机构 * Department of Physics, J.K. Institute of Science（J.K.科学研究院物理系） ； World Scientific University（世界科学大学） ； University of Intelligent Studies（智能研究大学） ； East China Normal University（华东师范大学） ； Nanyang Technological University（南洋理工大学） ； SenseTime Research（商汤科技研究院） ； Shanghai Jiao Tong University（上海交通大学） ； Harbin Institute of Technology（哈尔滨工业大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.AI

Comments 17 pages, 16 figures

Staying in the Sweet Spot: Responsive Reasoning Evolution via Capability-Adaptive Hint Scaffolding

Ziheng Li, Zexu Sun, Jinman Zhao, Erxue Min, Yongcheng Zeng, Hui Wu, Hengyi Cai, Shuaiqiang Wang, Dawei Yin, Xu Chen, Zhi-Hong Deng

机构 * School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院） ； Baidu Inc.（百度公司） ； Department of Computer Science, University of Toronto（多伦多大学计算机科学系） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院航天信息研究所） ； Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学光荣人工智能学院） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.LG

Comments Work in progress

CRANE: Reasoning with constrained LLM generation

Debangshu Banerjee, Tarun Suresh, Shubham Ugare, Sasa Misailovic, Gagandeep Singh

机构 * Department of Computer Science, University of Illinois Urbana-Champaign, USA（计算机科学系，伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.LG

Comments Accepted at ICML 2025, Code at: https://github.com/uiuc-focal-lab/CRANE

StructVRM: Aligning Multimodal Reasoning with Structured and Verifiable Reward Models

Xiangxiang Zhang, Jingxuan Wei, Donghong Zhong, Qi Chen, Caijun Jia, Cheng Tan, Jinming Gu, Xiaobo Qin, Zhiping Liu, Liang Hu, Tong Sun, Yuchen Wu, Zewei Sun, Chenwei Lou, Hua Zheng, Tianyang Zhan, Changbao Wang, Shuangzhi Wu, Zefa Lin, Chang Guo, Sihang Yuan, Riwei Chen, Shixiong Zhao, Yingping Zhang, Gaowei Wu, Bihui Yu, Jiahui Wu, Zhehui Zhao, Qianqian Liu, Ruofeng Tang, Xingyue Huang, Bing Zhao, Mengyang Zhang, Youqiang Zhou

专题命中 数学推理 ：reasoning(title,abstract)；verifier(abstract)；分类 cs.AI

KG-Augmented Executable CoT for Mathematical Coding

Xingyu Chen, Junxiu An, Jun Guo, Li Wang, Jingcai Guo

专题命中 数学推理 ：CoT(title)；reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Comments 9 pages,2figures,6 tables

Good Learners Think Their Thinking: Generative PRM Makes Large Reasoning Model More Efficient Math Learner

Tao He, Rongchuan Mu, Lizi Liao, Yixin Cao, Ming Liu, Bing Qin

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.LG

Comments 33 pages, 3 figures, 19 tables

Evaluating Intermediate Reasoning of Code-Assisted Large Language Models for Mathematics

Zena Al-Khalili, Nick Howell, Dietrich Klakow

机构 * Saarland University（萨尔兰大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

RefCritic: Training Long Chain-of-Thought Critic Models with Refinement Feedback

Qiaoyu Tang, Hao Xiang, Le Yu, Bowen Yu, Hongyu Lin, Yaojie Lu, Xianpei Han, Le Sun, Junyang Lin

机构 * Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所信息处理实验室） ； Alibaba Group（阿里巴巴集团） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 数学推理 ：chain-of-thought(title,abstract)；reasoning(abstract)；分类 cs.CL

MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimization

Xingxuan Li, Yao Xiao, Dianwen Ng, Hai Ye, Yue Deng, Xiang Lin, Bin Wang, Zhanfeng Mo, Chong Zhang, Yueyi Zhang, Zonglin Yang, Ruilin Li, Lei Lei, Shihao Xu, Han Zhao, Weiling Chen, Feng Ji, Lidong Bing

机构 * MiroMind AI 纠错

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Comments Technical report

Improving Rationality in the Reasoning Process of Language Models through Self-playing Game

Pinzheng Wang, Juntao Li, Zecheng Tang, Haijia Gui, Min zhang

机构 * School of Computer Science and Technology, Soochow University（苏州大学计算机科学与技术学院） ； Key Laboratory of Data Intelligence and Advanced Computing, Soochow University（苏州大学数据智能与先进计算重点实验室） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；self-correction(abstract)；分类 cs.AI

Comments Accepted by ICML 2025

ClozeMath: Improving Mathematical Reasoning in Language Models by Learning to Fill Equations

Quang Hieu Pham, Thuy Duong Nguyen, Tung Pham, Anh Tuan Luu, Dat Quoc Nguyen

机构 * Qualcomm AI Research（高通人工智能研究） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments Accepted to ACL 2025 Findings

GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking

Yufei Zhan, Ziheng Wu, Yousong Zhu, Rongkun Xue, Ruipu Luo, Zhenghao Chen, Can Zhang, Yifan Li, Zhentao He, Zheming Yang, Ming Tang, Minghui Qiu, Jinqiao Wang

机构 * Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences（基础模型研究中心，自动化研究所，中国科学院） ； ByteDance（字节跳动） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（人工智能学院，中国科学院大学） ； Peng Cheng Laboratory（鹏城实验室） ； Wuhan AI Research（武汉人工智能研究所） ； Xi’an Jiaotong University（西安交通大学） ； Renmin University of China（中国人民大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.AI

Comments Tech report

Benchmarking Abstract and Reasoning Abilities Through A Theoretical Perspective

Qingchuan Ma, Yuhang Wu, Xiawu Zheng, Rongrong Ji

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Can LLMs Reason Abstractly Over Math Word Problems Without CoT? Disentangling Abstract Formulation From Arithmetic Computation

Ziling Cheng, Meng Cao, Leila Pishdad, Yanshuai Cao, Jackie Chi Kit Cheung

专题命中 数学推理 ：CoT(title,abstract)；reasoning(abstract)；分类 cs.CL

RaDeR: Reasoning-aware Dense Retrieval Models

Debrup Das, Sam O' Nuallain, Razieh Rahimi

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments 26 pages

DialogueReason: Rule-Based RL Sparks Dialogue Reasoning in LLMs

Yubo Shu, Zhewei Huang, Xin Wu, Chen Hu, Shuchang Zhou, Daxin Jiang

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.AI

TypedThinker: Diversify Large Language Model Reasoning with Typed Thinking

Danqing Wang, Jianxin Ma, Fei Fang, Lei Li

机构 * Carnegie Mellon University（卡内基梅隆大学） ； Qwen Team（通义实验室） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.CL

Comments work in process

What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secret

Yufeng Yuan, Yu Yue, Ruofei Zhu, Tiantian Fan, Lin Yan

专题命中 数学推理 ：CoT(title,abstract)；reasoning(abstract)；分类 cs.LG

Step-by-Step Reasoning for Math Problems via Twisted Sequential Monte Carlo

Shengyu Feng, Xiang Kong, Shuang Ma, Aonan Zhang, Dong Yin, Chong Wang, Ruoming Pang, Yiming Yang

专题命中 数学推理 ：reasoning(title,abstract)；verifier(abstract)；分类 cs.LG

Comments ICLR 2025

Large Language Models and Mathematical Reasoning Failures

Johan Boye, Birger Moell

专题命中 数学推理 ：reasoning(title,abstract)；planning(abstract)；分类 cs.AI

PersonaMath: Boosting Mathematical Reasoning via Persona-Driven Data Augmentation

Jing Luo, Longze Chen, Run Luo, Liang Zhu, Chang Ao, Jiaming Li, Yukun Chen, Xin Cheng, Wen Yang, Jiayuan Su, Ahmadreza Argha, Hamid Alinejad-Rokny, Chengming Li, Shiwen Ni, Min Yang

专题命中 数学推理 ：reasoning(title)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL

Reasoning with Reinforced Functional Token Tuning

Kongcheng Zhang, Qi Yao, Baisheng Lai, Jiaxing Huang, Wenkai Fang, Dacheng Tao, Mingli Song, Shunyu Liu

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.AI

BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation

Bo Pang, Hanze Dong, Jiacheng Xu, Silvio Savarese, Yingbo Zhou, Caiming Xiong

专题命中 数学推理 ：chain-of-thought(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments 36 pages

Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models

Leonardo Ranaldi, Andrè Freitas

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

Journal ref Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

OpenAI-o1 AB Testing: Does the o1 model really do good reasoning in math problem solving?

Leo Li, Ye Luo, Tingyou Pan

专题命中 数学推理 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.AI

CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models

Wentao Liu, Qianjun Pan, Yi Zhang, Zhuo Liu, Ji Wu, Jie Zhou, Aimin Zhou, Qin Chen, Bo Jiang, Liang He

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

ReasonAgain: Using Extractable Symbolic Programs to Evaluate Mathematical Reasoning

Xiaodong Yu, Ben Zhou, Hao Cheng, Dan Roth

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.AI