From Deferral to Learning: Online In-Context Knowledge Distillation for LLM Cascades
从延迟到学习:在线上下文知识蒸馏用于LLM级联
机构 * Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,地点,国家) ; School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,地点,国家) ; Department of Electrical and Computer Engineering, Rutgers University, NJ, USA(电气与计算机工程系,Rutgers大学,新泽西州,美国) ; Computer Engineering Department, University of Illinois Chicago, Illinois, USA(计算机工程系,伊利诺伊大学芝加哥分校,伊利诺伊州,美国)
专题命中 仓库级理解 :repository(abstract);分类 cs.CL、cs.AI
AI总结 Inter-Cascade通过在线上下文知识蒸馏提升LLM级联性能,实现弱模型在任务中学习,减少强模型调用并提高整体准确率。
Comments 32 pages, 6 figures, 23 tables, under review