Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer
深度网络中的谱动力学:特征学习、异常值逃逸和学习率转移
Clarissa Lauditi, Cengiz Pehlevan, Blake Bordelon
机构
*
John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰A·保罗森工程与应用科学学院)
;
Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University(哈佛大学自然与人工智能研究学院)
;
Center for Mathematical Sciences and Applications, Harvard University(哈佛大学数学科学中心)
;
Oden Institute for Computational Engineering and Sciences & Dept. of Neuroscience, UT Austin(得克萨斯大学奥斯汀分校奥登计算工程与科学学院及神经科学系)