Matterhorn: Masked Time-to-First-Spike Encoding by Reassigning the Silent State for Sparse and Energy-Efficient Spiking Transformers
Matterhorn: 一种高效的类脑稀疏脉冲变压器架构与掩码时间到首次脉冲编码
机构 * Department of computer science, National University of Singapore(新加坡国立大学计算机科学系) ; School of Artificial Intelligence, Shandong University(山东大学人工智能学院) ; Shanghai Advanced Research Institute, Chinese Academy of Science(中国科学院上海先进研究院) ; University of Chinese Academy of Sciences, Beijing(中国科学院大学北京校区)
AI总结 Matterhorn通过引入掩码时间到首次脉冲编码和类比计算在内存技术,实现高效稀疏脉冲变压器架构,提升能效并达到新的准确率水平。