EPTS: Elastic Post-Training Sparsity for Efficient Large Language Model Compression
EPTS:弹性后训练稀疏性用于高效大型语言模型压缩
Ke Xu, Jiaqi Wan, Wenhao Hu, Han Pu, Xiaoyun Wang
机构
*
School of Artificial Intelligence(人工智能学院)
;
Anhui University(安徽大学)
;
School of Computer Science and Technology(计算机科学与技术学院)
;
Tiangong University(天工大学)
专题命中
效率与部署
:large language model(title,abstract);language model(title,abstract);post-training(title,abstract);分类 cs.AI、cs.LG
Geometry-Aware Online Scheduling for LLM Serving: From Theoretical Bound to System Practice
面向LLM服务的几何感知在线调度:从理论界到系统实践
Li Kong, Qi Qi, Yinyu Ye, Zijie Zhou
机构
*
Gaoling School of Artificial Intelligence(人工智能学院)
;
Renmin University of China(中国人民大学)
;
Department of Management Science and Engineering(管理科学与工程系)
;
Stanford University(斯坦福大学)
;
Department of Industrial Engineering and Decision Analytics(工业工程与决策分析系)
;
HKUST(香港科技大学)
专题命中
效率与部署
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI
AI总结
针对LLM推理中KV缓存动态内存占用问题,提出Smallest Volume First (SVF)算法,通过几何感知调度优化性能,理论证明将竞争比从48降至5,并在vLLM中实现即插即用,显著降低平均和尾部延迟。
A Probabilistic Framework for LLM-Based Model Discovery
基于LLM的模型发现的概率框架
Stefan Wahl, Raphaela Schenk, Ali Farnoud, Jakob H. Macke, Daniel Gedon
机构
*
Machine Learning in Science, University of Tübingen, Tübingen, Germany(图宾根大学机器学习科学系,图宾根,德国)
;
Tübingen AI Center, Tübingen, Germany(图宾根人工智能中心,图宾根,德国)
;
Department Empirical Inference, Max Planck Institute for Intelligent Systems, Tübingen, Germany(经验推断部门,智能系统马克斯·普朗克研究所,图宾根,德国)
机构
*
Department of Computer and Network Engineering, United Arab Emirates University, UAE(计算机与网络工程系,阿联酋大学)
;
Research Institute for Digital Future, Khalifa University, UAE(未来数字研究院,哈利法大学)
专题命中
效率与部署
:language model(title,abstract);small language model(title);large language model(abstract);分类 cs.AI
机构
*
Technical University of Munich(慕尼黑技术大学)
;
Huawei Hilbert Research Center (Dresden)(华为希利伯特研究中心(德累斯顿))
;
Huawei Central Software Institute(华为中央软件研究所)
;
Shanghai Jiao Tong University(上海交通大学)
Efficient Remote Sensing Instance Segmentation with Linear-Time State Space Distilled Visual Foundation Models
高效遥感实例分割:基于线性时间状态空间蒸馏的视觉基础模型
Qinzhe Yang, Keyan Chen, Jia Xu, Zhenwei Shi, Zhengxia Zou
机构
*
Shen Yuan Honors College, Beihang University(北京航空航天大学沈元荣誉学院)
;
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北京航空航天大学虚拟现实技术与系统国家重点实验室)
;
Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology(中国空间技术研究院钱学森空间技术实验室)
专题命中
效率与部署
:foundation model(title,abstract);large language model(abstract);language model(abstract)
机构
*
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
;
Data Science and Analytics Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)数据科学与分析学域)
;
Huawei Technologies Ltd.(华为技术有限公司)
专题命中
效率与部署
:large language model(abstract);language model(abstract);post-training(abstract);分类 cs.AI
Streaming-dLLM: Accelerating Diffusion LLMs via Suffix Pruning and Dynamic Decoding
Streaming-dLLM: 通过后缀剪枝和动态解码加速扩散大语言模型
Zhongyu Xiao, Zhiwei Hao, Jianyuan Guo, Yong Luo, Jia Liu, Jie Xu, Han Hu
机构
*
School of information(信息学院)
;
Electronics, Beijing Institute of Technology, Beijing(电子学院,北京理工大学,北京)
;
Department of Computer Science, City University of Hong Kong, Hong Kong(计算机科学系,香港城市大学,香港)
;
School of Computer Science, Wuhan University, Wuhan(计算机科学学院,武汉大学,武汉)
;
School of Economics(经济学院)
;
Management, Communication University of China, Beijing(管理学院,中国传媒大学,北京)
;
School of Science(科学学院)
;
Engineering, The Chinese University of Hong Kong (Shenzhen), Shenzhen(工程学院,香港中文大学(深圳),深圳)
专题命中
效率与部署
:large language model(abstract);language model(abstract);分类 cs.CL、cs.AI、cs.LG
Security and Privacy in Retrieval-Augmented Generation: Architectures, Threats, Defenses, and Future Directions for Building Trustworthy Systems
检索增强生成中的安全与隐私:构建可信系统的架构、威胁、防御与未来方向
Balamurugan Palanisamy, G S S Chalapathi, Vikas Hassija, Rajkumar Buyya
机构
*
Department of Electrical and Electronics Engineering(电子与电气工程系)
;
Birla Institute of Technology and Science, Pilani, Pilani Campus(比拉理工学院和科学学院,比拉校区)
;
Department of Computer Engineering, KIIT University(计算机工程系,KIIT大学)
;
Quantum Cloud Computing and Distributed Systems (qCLOUDS) Laboratory(量子云计算与分布式系统(qCLOUDS)实验室)
;
Department of Computing and Information Systems(计算与信息系统系)
;
The University of Melbourne(墨尔本大学)
专题命中
效率与部署
:large language model(abstract);language model(abstract);分类 cs.CL