大模型推理能力

Self-Training Large Language Models for Tool-Use Without Demonstrations

Ne Luo, Aryo Pradipta Gema, Xuanli He, Emile van Krieken, Pietro Lesci, Pasquale Minervini

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks

Amir Saeidi, Shivanshu Verma, Md Nayem Uddin, Chitta Baral

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization

Yinjie Wang, Ling Yang, Guohao Li, Mengdi Wang, Bryon Aragam

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Project: https://github.com/Gen-Verse/ScoreFlow

Qrazor: Reliable and Effortless 4-bit LLM Quantization by Significant Data Razoring

Dongyoung Lee, Seungkyu Choi, Ik Joon Chang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Comments 16 pages

SoftSRV: Learn to Generate Targeted Synthetic Data

Giulia DeSalvo, Jean-Fracois Kagy, Lazaros Karydas, Afshin Rostamizadeh, Sanjiv Kumar

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Token-by-Token Regeneration and Domain Biases: A Benchmark of LLMs on Advanced Mathematical Problem-Solving

Evgenii Evstafev

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Comments 8 pages, 8 figures

Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokens

Zhepeng Cen, Yao Liu, Siliang Zeng, Pratik Chaudhari, Huzefa Rangwala, George Karypis, Rasool Fakoor

专题命中 数学推理 ：self-correction(abstract)；分类 cs.LG

Comments Published in TMLR

Explainable AI based System for Supply Air Temperature Forecast

Marika Eik, Ahmet Kose, Hossein Nourollahi Hokmabad, Juri Belikov

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 5 pages, 7 figures, 1 table, conference paper

End-to-End Bangla AI for Solving Math Olympiad Problem Benchmark: Leveraging Large Language Model Using Integrated Approach

H. M. Shadman Tabib, Jaber Ahmed Deedar

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Journal ref IJNLC,vol:13, Issue:5/6, page 49-59,2024

Mathematical Definition and Systematization of Puzzle Rules

Itsuki Maeda, Yasuhiro Inoue

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 16pages

Enhancing Lifelong Multi-Agent Path Finding with Cache Mechanism

Yimin Tang, Zhenghong Yu, Yi Zheng, T. K. Satish Kumar, Jiaoyang Li, Sven Koenig

专题命中 数学推理 ：planning(abstract)；分类 cs.AI

Comments arXiv admin note: substantial text overlap with arXiv:2403.13421

Qwen2.5 Technical Report

Qwen, :, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng Xue, Pei Zhang, Qin Zhu, Rui Men, Runji Lin, Tianhao Li, Tianyi Tang, Tingyu Xia, Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zihan Qiu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

DIVE: Diversified Iterative Self-Improvement

Yiwei Qin, Yixiu Liu, Pengfei Liu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Mathematical Language Models: A Survey

Wentao Liu, Hanglei Hu, Jie Zhou, Yuyang Ding, Junsong Li, Jiayi Zeng, Mengliang He, Qin Chen, Bo Jiang, Aimin Zhou, Liang He

专题命中 数学推理 ：CoT(abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:1705.04146, arXiv:2304.10977, arXiv:2112.00114, arXiv:1905.13319, arXiv:2304.12244, arXiv:2206.01347, arXiv:2006.09265 by other authors

Plug-and-Play Training Framework for Preference Optimization

Jingyuan Ma, Rui Li, Zheng Li, Lei Sha, Zhifang Sui

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 12 pages, 9 figures

Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models

Bofei Gao, Feifan Song, Zhe Yang, Zefan Cai, Yibo Miao, Qingxiu Dong, Lei Li, Chenghao Ma, Liang Chen, Runxin Xu, Zhengyang Tang, Benyou Wang, Daoguang Zan, Shanghaoran Quan, Ge Zhang, Lei Sha, Yichang Zhang, Xuancheng Ren, Tianyu Liu, Baobao Chang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 30 pages

Scalable Influence and Fact Tracing for Large Language Model Pretraining

Tyler A. Chang, Dheeraj Rajagopal, Tolga Bolukbasi, Lucas Dixon, Ian Tenney

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Template-Driven LLM-Paraphrased Framework for Tabular Math Word Problem Generation

Xiaoqiang Kang, Zimu Wang, Xiaobo Jin, Wei Wang, Kaizhu Huang, Qiufeng Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted at AAAI 2025, extended version with appendix

On Convex Optimal Value Functions For POSGs

Rafael F. Cunha, Jacopo Castellini, Johan Peralez, Jilles S. Dibangoye

专题命中 数学推理 ：planning(abstract)；分类 cs.LG

Comments Currently under review at JAIR

CoinMath: Harnessing the Power of Coding Instruction for Math LLMs

Chengwei Wei, Bin Wang, Jung-jae Kim, Guimei Liu, Nancy F. Chen

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Low-Rank Adaptation with Task-Relevant Feature Enhancement for Fine-tuning Language Models

Changqun Li, Chaofan Ding, Kexin Luan, Xinhan Di

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 6 Pages, 3 figures accepted by AAAI 2025 CoLoRAI - Connecting Low-Rank Representations in AI Workshop

How to Leverage Digit Embeddings to Represent Numbers?

Jasivan Alex Sivakumar, Nafise Sadat Moosavi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted at COLING 2025

Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students

Tiffany Zhu, Kexun Zhang, William Yang Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 6 main pages, 5 figures

Learning by Analogy: Enhancing Few-Shot Prompting for Math Word Problem Solving with Computational Graph-Based Retrieval

Xiaocong Yang, Jiacheng Lin, Ziqi Wang, Chengxiang Zhai

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

MoD: A Distribution-Based Approach for Merging Large Language Models

Quy-Anh Dang, Chris Ngo

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Testing GPT-4-o1-preview on math and science problems: A follow-up study

Ernest Davis

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks

Yang Li, Shaobo Han, Shihao Ji

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments NeurIPS 2024

Decoding-Time Language Model Alignment with Multiple Objectives

Ruizhe Shi, Yifang Chen, Yushi Hu, Alisa Liu, Hannaneh Hajishirzi, Noah A. Smith, Simon S. Du

专题命中 数学推理 ：CoT(abstract)；分类 cs.LG

Comments NeurIPS accepted version

As Simple as Fine-tuning: LLM Alignment via Bidirectional Negative Feedback Loss

Xin Mao, Feng-Lin Li, Huimin Xu, Wei Zhang, Wang Chen, Anh Tuan Luu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 20 pages, 9 figures

P3: A Policy-Driven, Pace-Adaptive, and Diversity-Promoted Framework for data pruning in LLM Training

Yingxuan Yang, Huayi Wang, Muning Wen, Xiaoyun Mo, Qiuying Peng, Jun Wang, Weinan Zhang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL