大模型推理能力 - arXivDaily 专题

2405.20192 2024-10-18 cs.CL 57%

TAIA: Large Language Models are Out-of-Distribution Data Learners

Shuyang Jiang, Yusheng Liao, Ya Zhang, Yanfeng Wang, Yu Wang

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments 29 pages. Accepted as a 2024 NeurIPS paper

2410.07896 2024-10-11 cs.AI 57%

Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines

Junyu Lai, Jiahe Xu, Yao Yang, Yunpeng Huang, Chun Cao, Jingwei Xu

专题命中数学推理：reasoning(abstract)；分类 cs.AI

Comments 30 pages

2409.12917 2024-10-07 cs.LG 57%

Training Language Models to Self-Correct via Reinforcement Learning

Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, John D Co-Reyes, Avi Singh, Kate Baumli, Shariq Iqbal, Colton Bishop, Rebecca Roelofs, Lei M Zhang, Kay McKinney, Disha Shrivastava, Cosmin Paduraru, George Tucker, Doina Precup, Feryal Behbahani, Aleksandra Faust

专题命中数学推理：self-correction(abstract)；分类 cs.LG

2405.14092 2024-10-04 cs.CL 57%

Large Language Models Can Self-Correct with Key Condition Verification

Zhenyu Wu, Qingkai Zeng, Zhihan Zhang, Zhaoxuan Tan, Chao Shen, Meng Jiang

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments EMNLP 2024 - Camera Ready

2410.01748 2024-10-03 cs.LG 57%

Not All LLM Reasoners Are Created Equal

Arian Hosseini, Alessandro Sordoni, Daniel Toyama, Aaron Courville, Rishabh Agarwal

专题命中数学推理：reasoning(abstract)；分类 cs.LG

2404.18384 2024-10-02 cs.CL 57%

Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions

Jordan Meadows, Tamsin James, Andre Freitas

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments EMNLP 2024 (Findings)

2404.09486 2024-09-27 cs.CL cs.CV cs.SE 57%

MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems

Kaixin Li, Yuchen Tian, Qisheng Hu, Ziyang Luo, Zhiyong Huang, Jing Ma

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments EMNLP 2024

2409.16779 2024-09-26 cs.AI 57%

LLaMa-SciQ: An Educational Chatbot for Answering Science MCQ

Marc-Antoine Allard, Matin Ansaripour, Maria Yuffa, Paul Teiletche

专题命中数学推理：reasoning(abstract)；分类 cs.AI

2402.06120 2024-09-06 cs.CL 57%

Exploring Group and Symmetry Principles in Large Language Models

Shima Imani, Hamid Palangi

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2409.01659 2024-09-04 cs.CL 57%

Interpreting and Improving Large Language Models in Arithmetic Calculation

Wei Zhang, Chaoqun Wan, Yonggang Zhang, Yiu-ming Cheung, Xinmei Tian, Xu Shen, Jieping Ye

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments Accepted by ICML 2024 (oral)

2404.03028 2024-08-30 cs.CL 57%

An Incomplete Loop: Instruction Inference, Instruction Following, and In-context Learning in Language Models

Emmy Liu, Graham Neubig, Jacob Andreas

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments COLM 2024

2401.08565 2024-08-26 cs.CL 57%

Tuning Language Models by Proxy

Alisa Liu, Xiaochuang Han, Yizhong Wang, Yulia Tsvetkov, Yejin Choi, Noah A. Smith

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments COLM 2024 camera-ready, code available at https://github.com/alisawuffles/proxy-tuning

2408.03092 2024-08-07 cs.CL 57%

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, Yongbin Li

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments 17 pages

2407.19672 2024-07-30 cs.CL 57%

SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languages

Wenxuan Zhang, Hou Pong Chan, Yiran Zhao, Mahani Aljunied, Jianyu Wang, Chaoqun Liu, Yue Deng, Zhiqiang Hu, Weiwen Xu, Yew Ken Chia, Xin Li, Lidong Bing

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2407.18743 2024-07-29 cs.CL 57%

Towards Effective and Efficient Continual Pre-training of Large Language Models

Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments 16 pages, 10 figures, 16 tables

2405.06624 2024-07-09 cs.AI 57%

Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

David "davidad" Dalrymple, Joar Skalse, Yoshua Bengio, Stuart Russell, Max Tegmark, Sanjit Seshia, Steve Omohundro, Christian Szegedy, Ben Goldhaber, Nora Ammann, Alessandro Abate, Joe Halpern, Clark Barrett, Ding Zhao, Tan Zhi-Xuan, Jeannette Wing, Joshua Tenenbaum

专题命中数学推理：verifier(abstract)；分类 cs.AI

2407.04212 2024-07-08 cs.AI 57%

Smart Vision-Language Reasoners

Denisa Roberts, Lucas Roberts

专题命中数学推理：reasoning(abstract)；分类 cs.AI

Comments Accepted in ICML 2024 MATH AI Workshop

2407.00497 2024-07-02 cs.CL 57%

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Jiahao Ying, Mingbao Lin, Yixin Cao, Wei Tang, Bo Wang, Qianru Sun, Xuanjing Huang, Shuicheng Yan

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2306.05731 2024-07-02 cs.AI 57%

Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directions

Nikolaos Rodis, Christos Sardianos, Panagiotis Radoglou-Grammatikis, Panagiotis Sarigiannidis, Iraklis Varlamis, Georgios Th. Papadopoulos

专题命中数学推理：reasoning(abstract)；分类 cs.AI

Comments 49 pages, 11 figures

2406.20060 2024-07-01 cs.CL 57%

Applying RLAIF for Code Generation with API-usage in Lightweight LLMs

Sujan Dutta, Sayantan Mahinder, Raviteja Anantha, Bortik Bandyopadhyay

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2406.13764 2024-06-21 cs.CL 57%

Can LLMs Reason in the Wild with Programs?

Yuan Yang, Siheng Xiong, Ali Payani, Ehsan Shareghi, Faramarz Fekri

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2312.04511 2024-06-06 cs.CL 57%

An LLM Compiler for Parallel Function Calling

Sehoon Kim, Suhong Moon, Ryan Tabrizi, Nicholas Lee, Michael W. Mahoney, Kurt Keutzer, Amir Gholami

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments ICML 2024

2406.02100 2024-06-05 cs.CL 57%

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

Haolong Li, Yu Ma, Yinqi Zhang, Chen Ye, Jie Chen

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments Accept by Findings of ACL 2024

2402.11896 2024-06-04 cs.CL 57%

SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning

Zhihao Wen, Jie Zhang, Yuan Fang

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments Accepted by ACL 2024, 17 pages

2401.02415 2024-05-31 cs.CL 57%

LLaMA Pro: Progressive LLaMA with Block Expansion

Chengyue Wu, Yukang Gan, Yixiao Ge, Zeyu Lu, Jiahao Wang, Ye Feng, Ying Shan, Ping Luo

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments Accepted by ACL 2024, Main Conference

2405.18718 2024-05-30 cs.CL 57%

Efficient Model-agnostic Alignment via Bayesian Persuasion

Fengshuo Bai, Mingzhi Wang, Zhaowei Zhang, Boyuan Chen, Yinda Xu, Ying Wen, Yaodong Yang

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2405.17950 2024-05-29 cs.AI 57%

Self-Guiding Exploration for Combinatorial Problems

Zangir Iklassov, Yali Du, Farkhad Akimov, Martin Takac

专题命中数学推理：reasoning(abstract)；分类 cs.AI

Comments 22 pages

2405.12100 2024-05-21 cs.CL 57%

DOP: Diagnostic-Oriented Prompting for Large Language Models in Mathematical Correction

Hao Chen, Biaojie Zeng, Xin Lin, Liang He, Aimin Zhou

专题命中数学推理：reasoning(abstract)；分类 cs.CL

2404.16574 2024-04-26 cs.CL 57%

Exploring Internal Numeracy in Language Models: A Case Study on ALBERT

Ulme Wennberg, Gustav Eje Henter

专题命中数学推理：reasoning(abstract)；分类 cs.CL

Comments 4 pages + references, 4 figures. Accepted for publication at the MathNLP Workshop at LREC-COLING 2024

2404.13925 2024-04-23 cs.CL 57%

MARIO Eval: Evaluate Your Math LLM with your Math LLM--A mathematical dataset evaluation toolkit

Boning Zhang, Chengxi Li, Kai Fan

专题命中数学推理：reasoning(abstract)；分类 cs.CL

1. 数学推理 3222 篇

TAIA: Large Language Models are Out-of-Distribution Data Learners

Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines

Training Language Models to Self-Correct via Reinforcement Learning

Large Language Models Can Self-Correct with Key Condition Verification

Not All LLM Reasoners Are Created Equal

Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions

MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems

LLaMa-SciQ: An Educational Chatbot for Answering Science MCQ

Exploring Group and Symmetry Principles in Large Language Models

Interpreting and Improving Large Language Models in Arithmetic Calculation

An Incomplete Loop: Instruction Inference, Instruction Following, and In-context Learning in Language Models

Tuning Language Models by Proxy

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languages

Towards Effective and Efficient Continual Pre-training of Large Language Models

Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

Smart Vision-Language Reasoners

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directions

Applying RLAIF for Code Generation with API-usage in Lightweight LLMs

Can LLMs Reason in the Wild with Programs?

An LLM Compiler for Parallel Function Calling

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning

LLaMA Pro: Progressive LLaMA with Block Expansion

Efficient Model-agnostic Alignment via Bayesian Persuasion

Self-Guiding Exploration for Combinatorial Problems

DOP: Diagnostic-Oriented Prompting for Large Language Models in Mathematical Correction

Exploring Internal Numeracy in Language Models: A Case Study on ALBERT

MARIO Eval: Evaluate Your Math LLM with your Math LLM--A mathematical dataset evaluation toolkit