LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
LightReasoner: 小型语言模型能否教会大型语言模型推理?
机构 * University of Hong Kong(香港大学) ; University of Chicago(芝加哥大学)
AI总结 本文提出LightReasoner框架,通过利用强专家模型与弱业余模型之间的行为差异,发现高价值推理时刻,从而提升大型语言模型的推理能力,同时减少资源消耗。
Comments Updated to ACL 2026 camera-ready version with improved method presentation, expanded related work discussion, additional analyses, and presentation refinements