MHA-RAG: Improving Efficiency, Accuracy, and Consistency by Encoding Exemplars as Soft Prompts
MHA-RAG:通过将示例编码为软提示来提高效率、准确性和一致性
机构 * Department of Computer Science, Rice University(计算机科学系,里士大学) ; Department of Computer Science, University of Wisconsin–Madison(计算机科学系,威斯康星大学麦迪逊分校)
专题命中 检索器与排序 :RAG(title,title_cn);retrieval-augmented generation(abstract);分类 cs.AI
AI总结 提出MHA-RAG框架,将领域示例编码为软提示,通过多头注意力机制控制生成,在多个问答基准上相比标准RAG提升20点性能,同时降低10倍推理成本。
Comments 17 pages, 5 figures