ServiceNow

Super Apriel: One Checkpoint, Many Speeds

Super Apriel：一个检查点，多种速度

SLAM Labs, :, Oleksiy Ostapenko, Raymond Li, Torsten Scholak, Alireza Mousavi-Hosseini, Aman Tiwari, Denis Kocetkov, Joel Lamy Poirier, Kelechi Ogueji, Nanda H Krishna, Rafael Pardinas, Sathwik Tejaswi Madhusudhan, Shruthan Radhakrishna, Srinivas Sunkara, Valerie Becaert

机构 * ServiceNow Research（ServiceNow研究院） ； University of Toronto（多伦多大学） ； Vector Institute（向量研究所） 纠错

AI总结 Super Apriel通过在解码器层中提供四种预训练的混合器选择，实现单检查点下的多种速度预设，提升解码吞吐量并保持质量。

Comments Models: https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Base and https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct . Dev model: https://huggingface.co/ServiceNow-AI/SuperApriel-0.5B-Base . Training code: https://github.com/ServiceNow/Fast-LLM . Async RL: https://github.com/ServiceNow/pipeline-rl . Training logs: https://wandb.ai/servicenow-team/Super_Apriel