Insider Knowledge: How Much Can RAG Systems Gain from Evaluation Secrets?
内部知识:RAG系统能从评估秘密中获得多少收益?
Laura Dietz, Bryan Li, Eugene Yang, Dawn Lawrie, William Walden, James Mayfield
机构
*
University of New Hampshire(新罕布什尔大学)
;
University of Pennsylvania(宾夕法尼亚大学)
;
Human Language Technology Center of Excellence, Johns Hopkins University(约翰霍普金斯大学人类语言技术卓越中心)
AI总结
本文通过对比实验探讨RAG系统在评估秘密泄露时的评估风险,指出盲评和方法多样性的重要性。
CommentsTo appear in ECIR 2026, Lecture Notes in Computer Science, Volume 16483
Incorporating Q&A Nuggets into Retrieval-Augmented Generation
将问答 nugget 融入检索增强生成
Laura Dietz, Bryan Li, Gabrielle Liu, Jia-Huei Ju, Eugene Yang, Dawn Lawrie, William Walden, James Mayfield
机构
*
University of New Hampshire(新罕布什尔大学)
;
University of Pennsylvania(宾夕法尼亚大学)
;
Yale University(耶鲁大学)
;
University of Amsterdam(阿姆斯特丹大学)
;
Human Language Technology Center of Excellence, Johns Hopkins University(约翰霍普金斯大学人类语言技术卓越中心)
CommentsTo appear in the GenBench 2023 workshop proceedings, the first workshop on (benchmarking) generalisation in NLP. GenBench 2023 will be held at EMNLP 2023 on December 6, 2023
Adapting Segment Anything Model 3 for Concept-Driven Lesion Segmentation in Medical Images: An Experimental Study
为医学图像中的概念驱动病变分割适应Segment Anything Model 3:一项实验研究
Guoping Xu, Jayaram K. Udupa, Yubing Tong, Xin Long, Ying Zhang, Jie Deng, Weiguo Lu, You Zhang
机构
*
The Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center(德克萨斯大学西南医学中心放射肿瘤学系医学人工智能与自动化(MAIA)实验室)
;
Medical Image Processing Group, Department of Radiology, University of Pennsylvania(宾夕法尼亚大学放射学系医学图像处理组)
;
Division of Digestive and Liver Diseases, Department of Internal Medicine, University of Texas Southwestern Medical Center(德克萨斯大学西南医学中心内科学系消化与肝脏疾病科)