Dataset-Level Metrics Attenuate Non-Determinism: A Fine-Grained Non-Determinism Evaluation in Diffusion Language Models
数据层面指标削弱非确定性:扩散语言模型中的细粒度非确定性评估
机构 * Department of Computer ; Data Sciences, Case Western Reserve University, Cleveland, USA ; Department of Computer Science \& Engineering, Texas A\&M University, College Station, USA ; Department of Biochemistry, Case Western Reserve University, Cleveland, USA ; Center for RNA Science ; Therapeutics, Case Western Reserve University, Cleveland, USA ; Department of Biomedical Engineering, Case Western Reserve University, Cleveland, USA
专题命中 图像生成评测 :diffusion(title,abstract)
AI总结 本文研究了扩散语言模型中非确定性问题,指出数据层面指标限制了对模型行为变化的洞察,并提出基于样本级预测差异的细粒度评估方法,揭示了非确定性在代码生成中的高敏感性。