Disaggregated Prefill and Decoding Inference System for Large Language Model Serving on Multi-Vendor GPUs
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
AI 大模型
大语言模型、预训练、指令微调、后训练和语言模型应用。
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
机构 * Zhejiang University(浙江大学) ; Zhejiang University - Ant Group Joint Lab of Knowledge Graph(浙江大学-蚂蚁集团知识图谱联合实验室) ; National University of Singapore, NUS-NCS Joint Lab(新加坡国立大学NUS-NCS联合实验室)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments EMNLP 2025 Main Conference. 23 pages (8+ for main); 25 figures; 1 table
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments 29 pages, 6 figures, 7 tables, published in "Object-Oriented Programming, Systems, Languages & Applications" (OOPSLA), 2025
机构 * Mohamed bin Zayed University of Artificial Intelligence(莫扎伊德·本·扎耶德人工智能大学) ; Brave Software(Brave软件公司) ; Imperial College London(帝国理工学院) ; National University of Singapore(新加坡国立大学)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
机构 * Xin Tong School of Information and Cyber Security People’s Public Security University of China(信息与网络安全学院 中国人民公安大学) ; Zhi Lin School of Safety Science Tsinghua University(安全科学学院 清华大学) ; Jingya Wang School of Information and Cyber Security People’s Public Security University of China(信息与网络安全学院 中国人民公安大学) ; Meng Han Intelligent Fusion Research Center Zhejiang University(智能融合研究中心 浙江大学) ; Bo Jin* The Third Research Institute of the Ministry of Public Security of China(中华人民共和国公安部第三研究所)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments Under Review
机构 * Graduate School of Artificial Intelligence(人工智能研究生院) ; Department of Convergence IT Engineering(融合IT工程系) ; Pohang University of Science and Technology (POSTECH)(釜山科学技术大学)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments EMNLP 2025 Main Conference, Long Paper (Oral)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments Accepted in EMNLP 2025
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments SIGIR 2025
机构 * The Hong Kong Polytechnic University(香港理工大学) ; The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全国家重点实验室)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments To appear at EMNLP 25 main conference
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments Accepted by EMNLP2025 Main
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments CIKM 2025
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments 6 pages, 4 figures, 1 table, To appear in IEEE Globecom 2025 SAC - MLCN
机构 * Nanjing University(南京大学) ; Alibaba Group(阿里巴巴集团) ; University of Arizona(亚利桑那大学)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
机构 * School of Mechanical Engineering, Beijing Institute of Technology(北京理工大学机械工程学院) ; Division of Energy-Mobility Convergence, Beijing Institute of Technology(北京理工大学能源-移动融合 division) ; Department of Mechanical Engineering, The University of Tokyo(东京大学机械工程系)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
机构 * Arizona State University(亚利桑那州立大学) ; Clemson University(克莱姆森大学) ; LinkedIn Corporation(领英公司) ; Ludwig Maximilian University of Munich(慕尼黑路德维希-马克西米利安大学)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments 15 pages, 9 figures
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
机构 * AI Safety x Physics Grand Challenge(AI安全x物理大挑战)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments 19 pages, 2 figures
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments Preprint, under review
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments This paper has been submitted to IEEE TMC
机构 * IBM Research(IBM研究院)
专题命中 效率与部署 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments 12 pages, 3 figures