Distill on a Diet: Efficient Knowledge Distillation via Learnable Data Pruning
精简蒸馏:通过可学习数据剪枝实现高效知识蒸馏
机构 * School of Data Science, Fudan University(复旦大学数据科学学院) ; Faculty of Engineering, The Chinese University of Hong Kong(香港中文大学工程学院) ; College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院) ; School of Computer Engineering and Science, Shanghai University(上海大学计算机工程与科学学院)
AI总结 提出IF-Beta框架,结合影响函数与可学习Beta分布采样策略,通过双层优化实现高效数据剪枝,在减少数据和计算量的同时提升蒸馏性能。
Comments Acceepted by ECCV 2026