Yoshua Bengio

Scaling Latent Reasoning via Looped Language Models

通过循环语言模型扩展潜在推理

Rui-Jie Zhu, Zixuan Wang, Kai Hua, Tianyu Zhang, Ziniu Li, Haoran Que, Boyi Wei, Zixin Wen, Fan Yin, He Xing, Lu Li, Jiajun Shi, Kaijing Ma, Shanda Li, Taylor Kergan, Andrew Smith, Xingwei Qu, Mude Hui, Bohong Wu, Qiyang Min, Hongzhi Huang, Xun Zhou, Wei Ye, Jiaheng Liu, Jian Yang, Yunfeng Shi, Chenghua Lin, Enduo Zhao, Tianle Cai, Ge Zhang, Wenhao Huang, Yoshua Bengio, Jason Eshraghian

AI总结 提出Ouro系列循环语言模型，通过在潜在空间迭代计算、熵正则化深度分配和扩展至7.7T令牌，实现优于更大模型的推理性能，并展示其知识操控能力。