On the Performance Analysis of Momentum Method: A Frequency Domain Perspective
机构 * Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院) ; University of Chinese Academy of Sciences(中国科学院大学) ; University of California, Berkeley(加州大学伯克利分校) ; Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所) ; Sun Yat-sen University(中山大学) ; Shanghai Astronomical Observatory, Chinese Academy of Sciences(中国科学院上海天文台) ; University of Luxembourg(卢森堡大学)
Comments ICLR 2025. 22 pages, 14 figures. Keywords: Momentum Method, Stochastic Gradient Descent, Z-Transform, Frequency Domain Analysis, Deep Learning