大模型推理能力

SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs

Sultan Alrashed

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 4 figures, and 13 tables. For the SmolTulu-1.7b-instruct model, see: https://huggingface.co/SultanR/SmolTulu-1.7b-Instruct

Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning

Michael Hersche, Giacomo Camposampiero, Roger Wattenhofer, Abu Sebastian, Abbas Rahimi

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Improving Mathematical Reasoning Capabilities of Small Language Models via Feedback-Driven Distillation

Xunyu Zhu, Jian Li, Can Ma, Weiping Wang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning

Di Zhang, Jianbo Wu, Jingdi Lei, Tong Che, Jiatong Li, Tong Xie, Xiaoshui Huang, Shufei Zhang, Marco Pavone, Yuqiang Li, Wanli Ouyang, Dongzhan Zhou

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Flow-DPO: Improving LLM Mathematical Reasoning through Online Multi-Agent Learning

Yihe Deng, Paul Mineiro

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments 5 pages, 4 figures, 1 table

Self-training Language Models for Arithmetic Reasoning

Marek Kadlčík, Michal Štefánik

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments To appear in Findings of EMNLP 2024. Reproducible implementations and references to resulting models can be found on https://github.com/prompteus/calc-x

Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning

Gisang Lee, Sangwoo Park, Junyoung Park, Andrew Chung, Sieun Park, Yoonah Park, Byungju Kim, Min-gyu Cho

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 4 figures

Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models

Wenting Tan, Dongxiao Chen, Jieting Xue, Zihao Wang, Taijie Chen

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoning

Jun Zhao, Jingqi Tong, Yurong Mou, Ming Zhang, Qi Zhang, Xuanjing Huang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024

Beyond Captioning: Task-Specific Prompting for Improved VLM Performance in Mathematical Reasoning

Ayush Singh, Mansi Gupta, Shivank Garg, Abhinav Kumar, Vansh Agrawal

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Weak-to-Strong Reasoning

Yuqing Yang, Yan Ma, Pengfei Liu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP Findings 2024

Step-level Value Preference Optimization for Mathematical Reasoning

Guoxin Chen, Minpeng Liao, Chengxi Li, Kai Fan

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Camera ready version for EMNLP2024-Findings

MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs

Zimu Lu, Aojun Zhou, Houxing Ren, Ke Wang, Weikang Shi, Junting Pan, Mingjie Zhan, Hongsheng Li

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ACL 2024 camera ready

MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models

Shuai Peng, Di Fu, Liangcai Gao, Xiuqin Zhong, Hongguang Fu, Zhi Tang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems

Ding Kai, Ma Zhenguo, Yan Xiaoran

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

CodeGraph: Enhancing Graph Reasoning of LLMs with Code

Qiaolong Cai, Zhaowei Wang, Shizhe Diao, James Kwok, Yangqiu Song

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments In Progress

Timo: Towards Better Temporal Reasoning for Language Models

Zhaochen Su, Jun Zhang, Tong Zhu, Xiaoye Qu, Juntao Li, Min Zhang, Yu Cheng

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted to the COLM 2024 conference

On the consistent reasoning paradox of intelligence and optimal trust in AI: The power of 'I don't know'

Alexander Bastounis, Paolo Campodonico, Mihaela van der Schaar, Ben Adcock, Anders C. Hansen

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 12 pages and 50 pages of supplementary material, 7 figures

FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models

Yiyuan Li, Shichao Sun, Pengfei Liu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Under review

Improving Arithmetic Reasoning Ability of Large Language Models through Relation Tuples, Verification and Dynamic Feedback

Zhongtao Miao, Kaiyan Zhao, Yoshimasa Tsuruoka

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Under review, 25 figures, 8 tables, 29 pages

GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local Refinements

Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, Jane Dwivedi-Yu, Maksym Zhuravinskyi, Eric Hambro, Roberta Raileanu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation

Chengwei Dai, Kun Li, Wei Zhou, Songlin Hu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Arithmetic Reasoning with LLM: Prolog Generation & Permutation

Xiaocheng Yang, Bingsen Chen, Yik-Cheung Tam

专题命中 数学推理 ：reasoning(title)；CoT(abstract)；分类 cs.CL、cs.AI

Comments 12 pages, 4 figures, accepted by NAACL 2024 Main Conference

Premise Order Matters in Reasoning with Large Language Models

Xinyun Chen, Ryan A. Chi, Xuezhi Wang, Denny Zhou

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Published at ICML 2024. Xinyun and Ryan contribute equally

JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models

Kun Zhou, Beichen Zhang, Jiapeng Wang, Zhipeng Chen, Wayne Xin Zhao, Jing Sha, Zhichao Sheng, Shijin Wang, Ji-Rong Wen

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 28 pages, SOTA math LLM using Well-trained Data Synthesis LLM

Paraphrase and Solve: Exploring and Exploiting the Impact of Surface Form on Mathematical Reasoning in Large Language Models

Yue Zhou, Yada Zhu, Diego Antognini, Yoon Kim, Yang Zhang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to the main conference of NAACL (2024)

A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers

Jordan Meadows, Marco Valentino, Damien Teney, Andre Freitas

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments NAACL 2024

Look Before You Leap: Problem Elaboration Prompting Improves Mathematical Reasoning in Large Language Models

Haoran Liao, Jidong Tian, Shaohua Hu, Hao He, Yaohui Jin

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models

Yanan Wu, Jie Liu, Xingyuan Bu, Jiaheng Liu, Zhanhui Zhou, Yuanxing Zhang, Chenchen Zhang, Zhiqi Bai, Haibin Chen, Tiezheng Ge, Wanli Ouyang, Wenbo Su, Bo Zheng

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments The benchmark dataset will be released soon

Democratizing Reasoning Ability: Tailored Learning from Large Language Model

Zhaoyang Wang, Shaohan Huang, Yuxuan Liu, Jiahai Wang, Minghui Song, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments To appear at EMNLP 2023