SimDiff: Depth Pruning via Similarity and Difference
SimDiff:通过相似性与差异进行深度剪枝
机构 * State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(网络与交换技术国家重点实验室,北京邮电大学) ; Hong Kong University of Science and Technology(香港科学与技术大学) ; Laboratory of Data Science and Information Studies, Beijing Information Science and Technology University(数据科学与信息研究实验室,北京信息科技大学) ; Beijing Advanced Innovation Center for Materials Genome Engineering, Beijing Information Science and Technology University(材料基因组工程北京先进创新中心,北京信息科技大学)
AI总结 SimDiff通过结合表征相似性和变换差异两个视角,改进大语言模型的部署效率,实验表明其在多种剪枝比例下均优于现有方法,显著提升推理速度并保持模型性能。