K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling
K-Forcing:通过前推语言建模进行联合下一K词解码
机构 * DAMO Academy, Alibaba Group(阿里巴巴达摩院) ; Hupan Lab(湖畔实验室) ; Zhejiang University(浙江大学) ; The Hong Kong University of Science and Technology(香港科技大学)
AI总结 提出K-Forcing范式,通过前推映射将自回归模型蒸馏为单次前向传播生成多个未来词,实现2.4-3.5倍加速,质量损失小。
Comments Code: https://github.com/alibaba-damo-academy/K-Forcing