RuPLaR : Efficient Latent Compression of LLM Reasoning Chains with Rule-Based Priors From Multi-Step to One-Step
RuPLaR : 通过基于规则的先验概率实现LLM推理链的高效潜在压缩
机构 * School of Computer Science and Technology(计算机科学与技术学院) ; Department of Electrical and Computer Engineering(电气与计算机工程系)
专题命中 复杂问题求解 :reasoning(title,abstract);chain-of-thought(abstract,abstract_cn);CoT(abstract,abstract_cn);分类 cs.CL、cs.AI
AI总结 本文提出RuPLaR框架,通过基于规则的先验概率指导LLM生成单阶段潜在推理令牌,提升推理效率与准确性,实验表明其比现有方法提升11.1%的准确率且消耗更少token。
Comments 15 pages, 15 figures