A Simple Baseline for Unifying Understanding, Generation, and Editing via Vanilla Next-token Prediction
一种通过 vanilla next-token 预测统一理解、生成和编辑的简单基线
机构 * Key Lab of High Confidence Software Technologies (Peking University), Ministry of Education, China(高可信软件技术重点实验室(北京大学),教育部,中国) ; School of Computer Science, Peking University, Beijing, China(北京大学计算机学院,北京,中国) ; School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学计算机科学与技术学院,北京,中国)
AI总结 本文提出 Wallaroo,一种通过 vanilla next-token 预测统一多模态理解、生成和编辑的简单基线模型,展示了其在多任务中的竞争力。
Comments Technical report. This work serves as a straightforward autoregressive baseline for unifying understanding, generation, and editing