大模型推理能力

Parameter-Efficient Checkpoint Merging via Metrics-Weighted Averaging

Shi Jie Yu, Sehyun Choi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

SRPO: A Cross-Domain Implementation of Large-Scale Reinforcement Learning on LLM

Xiaojiang Zhang, Jinghui Wang, Zifei Cheng, Wenhao Zhuang, Zheng Lin, Minglei Zhang, Shaojie Wang, Yinghan Cui, Chao Wang, Junyi Peng, Shimiao Jiang, Shiqi Kuang, Shouyu Yin, Chaohang Wen, Haotian Zhang, Bin Chen, Bing Yu

机构 * Kuaishou Kwaipilot Team（快手Kwaipilot团队） ； HuggingFace 纠错

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Benchmarking Large Language Models for Calculus Problem-Solving: A Comparative Analysis

In Hak Moon

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Constitution or Collapse? Exploring Constitutional AI with Llama 3-8B

Xue Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 6 pages, 2 figures. Conducted as part of research on alignment techniques for language models

UNDO: Understanding Distillation as Optimization

Kushal Jain, Piyushi Goyal, Kumar Shridhar

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Exploring Data Scaling Trends and Effects in Reinforcement Learning from Human Feedback

Wei Shen, Guanlin Liu, Zheng Wu, Ruofei Zhu, Qingping Yang, Chao Xin, Yu Yue, Lin Yan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains

Yi Su, Dian Yu, Linfeng Song, Juntao Li, Haitao Mi, Zhaopeng Tu, Min Zhang, Dong Yu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Entropy-Based Adaptive Weighting for Self-Training

Xiaoxuan Wang, Yihe Deng, Mingyu Derek Ma, Wei Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

ToRL: Scaling Tool-Integrated RL

Xuefeng Li, Haoyang Zou, Pengfei Liu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

RL-finetuning LLMs from on- and off-policy data with a single algorithm

Yunhao Tang, Taco Cohen, David W. Zhang, Michal Valko, Rémi Munos

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate

Yubo Wang, Xiang Yue, Wenhu Chen

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

RaSA: Rank-Sharing Low-Rank Adaptation

Zhiwei He, Zhaopeng Tu, Xing Wang, Xingyu Chen, Zhijie Wang, Jiahao Xu, Tian Liang, Wenxiang Jiao, Zhuosheng Zhang, Rui Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments ICLR 2025

Exploiting Edited Large Language Models as General Scientific Optimizers

Qitan Lv, Tianyu Liu, Hong Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Can Vision-Language Models Evaluate Handwritten Math?

Oikantik Nath, Hanani Bathina, Mohammed Safi Ur Rahman Khan, Mitesh M. Khapra

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Pretrained Embeddings as a Behavior Specification Mechanism

Parv Kapoor, Abigail Hammer, Ashish Kapoor, Karen Leung, Eunsuk Kang

专题命中 数学推理 ：planning(abstract)；分类 cs.AI

Comments 18 pages, 6 figures

It Helps to Take a Second Opinion: Teaching Smaller LLMs to Deliberate Mutually via Selective Rationale Optimisation

Sohan Patnaik, Milan Aggarwal, Sumit Bhatia, Balaji Krishnamurthy

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted at ICLR 2025

Automated Design of Agentic Systems

Shengran Hu, Cong Lu, Jeff Clune

专题命中 数学推理 ：chain-of-thought(abstract)；分类 cs.AI

Comments Website: https://shengranhu.com/ADAS

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs

Tanja Baeumel, Josef van Genabith, Simon Ostermann

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Pre-print

Is Mathematics Obsolete?

Jeremy Avigad

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Can LLMs Solve longer Math Word Problems Better?

Xin Xu, Tong Xiao, Zitong Chao, Zhenya Huang, Can Yang, Yang Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to ICLR 2025

Journal ref International Conference on Learning Representations (ICLR 2025)

World Models for Math Story Problems

Andreas Opedal, Niklas Stoehr, Abulhair Saparov, Mrinmaya Sachan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments ACL Findings 2023

Earlier Tokens Contribute More: Learning Direct Preference Optimization From Temporal Decay Perspective

Ruichen Shao, Bei Li, Gangao Liu, Yang Chen, Xiang Zhou, Jingang Wang, Xunliang Cai, Peng Li

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ICLR 2025

Selective Self-to-Supervised Fine-Tuning for Generalization in Large Language Models

Sonam Gupta, Yatin Nandwani, Asaf Yehudai, Dinesh Khandelwal, Dinesh Raghu, Sachindra Joshi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 10 pages, Accepted to NAACL Findings 2025. arXiv admin note: text overlap with arXiv:2409.04787

RM-PoT: Reformulating Mathematical Problems and Solving via Program of Thoughts

Yu Zhang, Shujun Peng, Nengwu Wu, Xinhan Lin, Yang Hu, Jie Tang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

On Representational Dissociation of Language and Arithmetic in Large Language Models

Riku Kisako, Tatsuki Kuribayashi, Ryohei Sasano

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models

Jiyue Jiang, Pengan Chen, Liheng Chen, Sheng Wang, Qinghang Bao, Lingpeng Kong, Yu Li, Chuan Wu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by NAACL 2025

O1 Embedder: Let Retrievers Think Before Action

Ruiran Yan, Zheng Liu, Defu Lian

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Franken-Adapter: Cross-Lingual Adaptation of LLMs by Embedding Surgery

Fan Jiang, Honglin Yu, Grace Chung, Trevor Cohn

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 33 pages

Exploring Safety-Utility Trade-Offs in Personalized Language Models

Anvesh Rao Vijjini, Somnath Basu Roy Chowdhury, Snigdha Chaturvedi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments NAACL 2025

Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling

Runze Liu, Junqi Gao, Jian Zhao, Kaiyan Zhang, Xiu Li, Biqing Qi, Wanli Ouyang, Bowen Zhou

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL