FlashOptim: Optimizers for Memory-Efficient Training
FlashOptim: 用于内存高效训练的优化器
机构 * Databricks AI Research(Databricks AI研究院)
AI总结 FlashOptim通过减少每参数内存消耗50%以上,同时保持模型质量和API兼容性,显著提升内存高效训练性能。
Comments Source code is available at https://github.com/databricks/flashoptim