机构
*
University of Chicago(芝加哥大学)
;
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
;
Stanford University(斯坦福大学)
;
University of Science and Technology of China(中国科学技术大学)
;
Meituan(美团)
STEB: A Speech-to-Speech Translation Expressiveness Benchmark for Evaluating Beyond Translation Fidelity
STEB:用于评估超越翻译保真度的语音到语音翻译表现力基准
Sitong Cheng, Weizhen Bian, Songjun Cao, Jin Li, Bei Liu, Chunyang Jiang, Yike Zhang, Weihao Wu, Yiming Li, Chi-Min Chan, Long Ma, Wei Xue
机构
*
Hong Kong University of Science and Technology(香港科技大学)
;
Tencent Youtu Lab(腾讯优图实验室)
;
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
机构
*
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
;
Data Science and Analytics Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)数据科学与分析学域)
;
Huawei Technologies Ltd.(华为技术有限公司)
Geometry-Aware Online Scheduling for LLM Serving: From Theoretical Bound to System Practice
面向LLM服务的几何感知在线调度:从理论界到系统实践
Li Kong, Qi Qi, Yinyu Ye, Zijie Zhou
机构
*
Gaoling School of Artificial Intelligence(人工智能学院)
;
Renmin University of China(中国人民大学)
;
Department of Management Science and Engineering(管理科学与工程系)
;
Stanford University(斯坦福大学)
;
Department of Industrial Engineering and Decision Analytics(工业工程与决策分析系)
;
HKUST(香港科技大学)
AI总结
针对LLM推理中KV缓存动态内存占用问题,提出Smallest Volume First (SVF)算法,通过几何感知调度优化性能,理论证明将竞争比从48降至5,并在vLLM中实现即插即用,显著降低平均和尾部延迟。
FlexMS: A Unified Public Benchmark for Molecule Tandem Mass Spectrum Prediction
FlexMS:分子串联质谱预测的统一公共基准
Yunhua Zhong, Yixuan Tang, Yifan Li, Pan Liu, Zhiwen Yang, Zanyi Wang, Jie Yang, Jun Xia
机构
*
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
;
The Hong Kong University of Science and Technology(香港科学与技术大学)
;
The University of Hong Kong(香港大学)
;
Yangzhou University(扬州大学)
;
Fudan University(复旦大学)
Distribution Preference Optimization: A Fine-grained Perspective for LLM Unlearning
分布偏好优化:大语言模型遗忘的细粒度视角
Kai Qin, Jiaqi Wu, Jianxiang He, Haoyuan Sun, Yifei Zhao, Xu Wang, Bin Liang, Yongzhe Chang, Cheng Li, Tiantian Zhang, Houde Liu
机构
*
Tsinghua University(清华大学)
;
The Hong Kong University of Science and Technology(香港科技大学)
;
Jianghuai Advanced Technology Center(江淮先进技术中心)
;
University of Technology Sydney(悉尼大学)