EverydayGPT: Confidence-Gated Routing for Efficient and Safe Hybrid GPT-RAG Conversational QA
EverydayGPT: 用于高效安全混合GPT-RAG对话问答的置信门控路由
机构 * Dr. A.P.J. Abdul Kalam Technical University(阿卜杜尔·卡拉姆技术大学)
专题命中 知识库问答 :RAG(title,title_cn);retrieval-augmented generation(abstract);分类 cs.CL
AI总结 提出置信门控路由机制,通过联合策略决定检索与生成路径,使85%的查询使用快速RAG提取,延迟降低120倍以上,同时保持答案质量。
Comments 12 pages, 10 figures, 6 tables. Code and evaluation scripts available at: https://github.com/merciless-admiral-3083/EverydayGPT. This paper studies routing strategies for hybrid GPT-RAG systems under resource constraints, focusing on efficiency-safety tradeoffs rather than state-of-the-art accuracy