ReQAT: Achieving Full-Precision Reasoning Accuracy with 4-bit Floating-Point Quantization-Aware Training
ReQAT: 实现全精度推理精度的4位浮点量化感知训练
机构 * Hanyang University(汉阳大学) ; Samsung Advanced Institute of Technology(三星综合技术院)
专题命中 逻辑推理 :reasoning(title,abstract);chain-of-thought(abstract);分类 cs.LG
AI总结 针对大推理模型在低比特量化(W4A4KV4)下推理精度严重下降的问题,提出ReQAT框架,通过迹对齐QAT、选择性熵最小化和量化友好初始化,恢复并超越BF16微调精度,实现最高3.9倍吞吐加速。
Comments ICML 2026