The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth
概念分配区:追踪概念如何跨越Transformer深度形成
机构 * Independent Researcher(独立研究者)
专题命中 知识编辑与模型理解 :language model(abstract);分类 cs.AI、cs.LG
AI总结 提出概念分配区(CAZ)框架,通过层间度量(分离度、概念一致性、概念速度)检测概念在残差流中逐渐形成的深度区间,并在34个模型上验证了分离曲线的多模态性及温和CAZ的因果活性。
Comments v2: substantial revision. Cross-architecture ordering statistic and MHA/GQA cohort-split claim retracted per recomputation; corpus and companion-paper citations refreshed. See paper's "Changes from Version 1" section for the full list of superseded values