Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization
弥合承诺与性能之间的差距:为微缩FP4量化 bridging the gap between promise and performance for microscaling FP4 quantization
Vage Egiazarian, Roberto L. Castro, Denis Kuznedelev, Andrei Panferov, Eldar Kurtic, Shubhra Pandit, Alexandre Marques, Mark Kurtz, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh
机构
*
Institute of Science and Technology Austria(奥地利科学与技术研究院)
;
Yandex Research(Yandex研究)
;
Red Hat AI(红帽人工智能)
;
ETH Zürich(苏黎世联邦理工学院)
Ilenia Carboni, Elia Cereda, Lorenzo Lamberti, Daniele Malpetti, Francesco Conti, Daniele Palossi
机构
*
Dalle Molle Institute for Artificial Intelligence, USI-SUPSI(达摩院人工智能研究所,USI-SUPSI)
;
Integrated Systems Laboratory, ETH Zürich(集成系统实验室,ETH Zurich)
;
Department of Electrical, Electronic and Information Engineering, University of Bologna(电子、电气与信息工程系,博洛尼亚大学)
机构
*
Dalle Molle Institute for Artificial Intelligence (IDSIA)(达勒莫尔人工智能研究所)
;
USI-SUPSI
;
Integrated Systems Laboratory (IIS)(集成系统实验室)
;
ETH Zürich(苏黎世联邦理工学院)
The GeometricKernels Package: Heat and Matérn Kernels for Geometric Learning on Manifolds, Meshes, and Graphs
几何核包:用于流形、网格和图上几何学习的热核和Matérn核
Peter Mostowsky, Vincent Dutordoir, Iskander Azangulov, Noémie Jaquier, Michael John Hutchinson, Aditya Ravuri, Leonel Rozo, Alexander Terenin, Viacheslav Borovitskiy
机构
*
University of Cambridge(剑桥大学)
;
University of Oxford(牛津大学)
;
KTH Royal Institute of Technology(皇家理工学院)
;
Italian Institute of Artificial Intelligence for Industry(意大利人工智能工业研究所)
;
Cornell University(康奈尔大学)
;
ETH Zürich and University of Edinburgh(苏黎世联邦理工学院和爱丁堡大学)
Super-resolution of turbulent reacting flows on complex meshes using graph neural networks
利用图神经网络在复杂网格上实现湍流反应流的超分辨率
Priyabrat Dash, Konduri Aditya, Christos E. Frouzakis, Mathis Bode
机构
*
FLAME Laboratory, Department of Computational and Data Sciences, Indian Institute of Science, Bengaluru, 560012, India(印度科学研究院流体动力学与能源实验室,班加罗尔)
;
CAPS Laboratory, Department of Mechanical and Process Engineering, ETH Zürich, 8092 Zürich, Switzerland(苏黎世联邦理工学院机械与过程工程实验室,苏黎世)
;
Jülich Supercomputing Centre, Forschungszentrum Jülich GmbH, Jülich, 52425, Germany(尤利希超算中心,尤利希)
Investigating Disability Representations in Text-to-Image Models
探究文本到图像模型中的残疾表示
Yang Tian, Yu Fan, Liudmila Zavolokina, Sarah Ebling
机构
*
Department of Computational Linguistics University of Zurich(计算语言学系 苏黎世大学)
;
Center for Law & Economics ETH Zurich(法律与经济学中心 伯尔尼联邦理工学院)
;
Department of Information Systems University of Lausanne(信息系统系 瑞士洛桑大学)
Domain Generalization and Adaptation in Intensive Care with Anchor Regression
重症监护中的领域泛化与适应:锚点回归
Malte Londschien, Manuel Burger, Gunnar Rätsch, Peter Bühlmann
机构
*
Seminar for Statistics, ETH Zürich(统计研究所,苏黎世联邦理工学院)
;
AI Center, ETH Zürich(人工智能中心,苏黎世联邦理工学院)
;
Department of Computer Science, ETH Zürich(计算机科学系,苏黎世联邦理工学院)
;
Swiss Institute for Bioinformatics, Zürich(瑞士生物信息学研究所)
CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers
CMT-Benchmark:由专家研究人员构建的凝聚态理论基准
Haining Pan, James V. Roggeveen, Erez Berg, Juan Carrasquilla, Debanjan Chowdhury, Surya Ganguli, Federico Ghimenti, Juraj Hasik, Henry Hunt, Hong-Chen Jiang, Mason Kamb, Ying-Jer Kao, Ehsan Khatami, Michael J. Lawler, Di Luo, Titus Neupert, Xiaoliang Qi, Michael P. Brenner, Eun-Ah Kim
机构
*
Rutgers University(罗格斯大学)
;
Harvard University(哈佛大学)
;
Weizmann Institute of Science(魏茨曼科学研究所)
;
ETH Zürich(苏黎世联邦理工学院)
;
Cornell University(康奈尔大学)
;
Stanford University(斯坦福大学)
;
University of Zürich(苏黎世大学)
;
Stanford Institute for Materials and Energy Sciences(斯坦福材料与能源科学研究所)
;
SLAC National Accelerator Laboratory(斯坦福直线加速器实验室)
;
University of California, Los Angeles(加州大学洛杉矶分校)
;
National Taiwan University(台湾大学)
;
San José State University(圣何塞州立大学)
Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization
通过通道级功能分解和流形正则化实现高效的退化无关图像恢复
Bin Ren, Yawei Li, Xu Zheng, Yuqian Fu, Danda Pani Paudel, Hong Liu, Ming-Hsuan Yang, Luc Van Gool, Nicu Sebe
机构
*
Mohamed bin Zayed University of Artificial Intelligence(莫扎德·本·泽德人工智能大学)
;
University of Trento(特伦托大学)
;
ETH Zürich(苏黎世联邦理工学院)
;
HKUST (GZ)(香港科技大学(广州))
;
Peking University(北京大学)
;
University of California, Merced(加州大学默塞德分校)
Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent
梯度是全部需要吗?如何将基于共识的优化解释为梯度下降的随机松弛
Konstantin Riedl, Timo Klock, Carina Geldhauser, Massimo Fornasier
机构
*
University of Oxford, Mathematical Institute(牛津大学数学研究所)
;
Deeptech Consulting(德普科技咨询)
;
ETH Zurich, Department of Mathematics(苏黎世联邦理工学院数学系)
;
Technical University of Munich, School of Computation, Information and Technology, Department of Mathematics(慕尼黑技术大学计算、信息与技术学院数学系)
;
Munich Center for Machine Learning Munich Data Science Institute(慕尼黑机器学习中心慕尼黑数据科学研究所)
Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact case
平稳核与李群及其齐性空间上的高斯过程 I:紧致情况
Iskander Azangulov, Andrei Smolensky, Alexander Terenin, Viacheslav Borovitskiy
机构
*
St. Petersburg State University and University of Oxford(圣彼得堡国立大学和牛津大学)
;
St. Petersburg State University and Neapolis University Pafos(圣彼得堡国立大学和纳皮奥斯大学帕福斯)
;
University of Cambridge and Cornell University(剑桥大学和康奈尔大学)
;
ETH Zürich(苏黎世联邦理工学院)
CommentsThis version fixes two mathematical typos, in equations (58) and (65), where both sums should be taken only over the diagonal part $π^{(λ)}_{jj}$ and not over $π^{(λ)}_{jk}$ as had erroneously been written in the previous version. The proofs for both statements remain unchanged. We thank Nathaël Da Costa for making us aware of this pair of typos
Journal refJournal of Machine Learning Research, 2024