Leveraging Extragradient for Effective Sharpness-Aware Minimization in Deep Learning
利用外梯度实现深度学习中有效的锐度感知最小化
Yao Fu, Chunxia Zhang, Junmin Liu, Yihang Jin, Haishan Ye, Yuanao Yang
机构
*
SGIT AI Lab, State Grid Corporation of China(国网SGIT人工智能实验室)
;
School of Management, Xi’an Jiaotong University(西安交通大学管理学院)
;
School of Software, Xi’an Jiaotong University(西安交通大学软件学院)
机构
*
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University(数学与统计学学院和教育部智能网络与网络安全重点实验室,西安交通大学)
;
Tencent AI Lab(腾讯AI实验室)
;
ByteDance(字节跳动)
;
SINGPATH AI Lab, SingPath Medical Technology Pte. Ltd.(SingPath AI实验室,SingPath医疗科技私人有限公司)
;
School of Mathematics and Statistics, Xidian University(数学与统计学学院,西安电子科技大学)
;
College of Biomedical Engineering, Sichuan University(生物医学工程学院,四川大学)
;
School of Mathematics and Statistics, Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University(数学与统计学学院和教育部智能网络与网络安全重点实验室,西安交通大学)
;
Macao Institute of Systems Engineering, Macau University of Science and Technology(澳门系统工程研究院,澳门科技大学)