SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation
SHIFT: 门控调制激活引导用于检索增强生成中的知识冲突缓解
机构 * School of Computer Science and Engineering, Northeastern University, Shenyang, China(东北大学计算机科学与工程学院,沈阳,中国) ; Department of Computer Science and Technology, Tsinghua University, Beijing, China(清华大学计算机科学与技术系,北京,中国)
AI总结 提出SHIFT框架,通过轻量级门控模块调节LLM内部激活,以自适应解决检索上下文与参数知识间的冲突,仅优化0.01%参数,在六个数据集上验证有效性。
Comments 19 pages, 13 Figures