2510.14686
2026-03-04
cs.DC
cs.AI
xLLM Technical Report
xLLM 技术报告
Tongxuan Liu, Tao Peng, Peijun Yang, Xiaoyang Zhao, Xiusheng Lu, Weizhe Huang, Zirui Liu, Xiaoyu Chen, Zhiwei Liang, Jun Xiong, Donghe Jin, Minchao Zhang, Jinrong Guo, Yingxu Deng, Xu Zhang, Xianzhe Dong, Siqi Wang, Siyu Wu, Yu Wu, Zihan Tang, Yuting Zeng, Yanshu Wang, Jinguang Liu, Meng Kang, Menxin Li, Yunlong Wang, Yiming Liu, Xiaolong Ma, Yifan Wang, Yichen Zhang, Jinrun Yin, Keyang Zheng, Jiawei Yin, Jun Zhang, Ziyue Wang, Xiaobo Lin, Liangyu Liu, Liwei Lan, Yang Liu, Chunhua Peng, Han Liu, Songcheng Ren, Xuezhu Wang, Yunheng Shen, Yi Wang, Guyue Liu, Yitao Hu, Hui Chen, Tong Yang, Hailong Yang, Jing Li, Guiguang Ding, Ke Zhang
机构
*
THU(清华大学)
;
USTC(University of Science and Technology of China)
;
BUAA(Beijing University of Aeronautics and Automation)
;
PKU(Peking University)
;
TJU(Tianjin University)
纠错
AI总结
xLLM是一种针对高性能大规模企业级服务设计的高效LLM推理框架,通过解耦服务引擎架构和多层优化提升吞吐量和推理效率。