STEEL: Sparsity-Aware Fused Attention for Energy-Efficient Long-Sequence Inference on AMD's XDNA NPU
STEEL:用于在AMD的XDNA NPU上进行节能长序列推理的稀疏感知融合注意力
Victor J. B. Jung, Gagandeep Singh, Joseph Melber, Kristof Denolf, Francesco Conti, Luca Benini
机构
*
AMD Research and Advanced Development (RAD)(AMD研究与先进开发)
;
Integrated Systems Laboratory (IIS)(集成系统实验室)
;
ETH Zürich(苏黎世联邦理工学院)
;
Department of Electrical, Electronic and Information Engineering (DEI)(电气电子信息工程系)
;
University of Bologna(博洛尼亚大学)
VL2Spike: Spike-driven Distillation from VLMs for Low-Power Visual Perception in Embodied AI
VL2Spike:面向具身AI低功耗视觉感知的VLM脉冲驱动蒸馏
Zinan Liu, Eric Zheng, Soumyaratna Debnath, Hao Shi, Ling Xiao, Lin Wang
机构
*
School of EEE, Nanyang Technological University (NTU)(南洋理工大学电气与电子工程学院)
;
Department of Computer Science, University of Toronto(多伦多大学计算机科学系)
;
Advanced Micro Devices, Inc.(超威半导体公司)
;
State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University(浙江大学极端光子学与仪器国家重点实验室)
;
Faculty of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术学院)