Ten Headache Specialists versus Artificial Intelligence for Clinical Literature Summarization: A Critical Evaluation and Comparison
十位头痛专家与人工智能在临床文献总结中的比较:一项关键评估与对比
机构 * Stanford University Palo Alto CA USA(斯坦福大学) ; Department of Neurology Mayo Clinic Rochester MN USA(梅奥诊所神经科) ; Department of Neurology Dalhousie University Halifax Canada(达尔豪斯大学神经科) ; Jefferson Headache Center Department of Neurology Thomas Jefferson University PA USA(泰勒大学神经科) ; Beth Israel Deaconess Medical Center Boston MA USA(贝斯以色列医疗中心) ; Department of Neurology University of Florida Gainesville FL USA(佛罗里达大学神经科) ; University of Colorado School of Medicine Department of Pediatrics Division of Child Neurology Aurora CO USA(科罗拉多医学院儿科部儿童神经科) ; Department of Medicine Mount Sinai Hospital Icahn School of Medicine at Mount Sinai New York NY USA(西奈医院医学部) ; Department of Neurology Mayo Clinic Scottsdale AZ USA(梅奥诊所Scottsdale分部) ; Harvard Medical School Boston MA USA(哈佛医学院) ; Department of Neurology Mount Sinai Hospital Icahn School of Medicine at Mount Sinai New York NY USA(西奈医院神经科)
专题命中 RAG评测 :RAG(summary_cn,abstract);分类 cs.IR、cs.CL、cs.AI
AI总结 本研究通过构建基于RAG的AI框架,比较了三种大语言模型与十位头痛专家在临床文献总结方面的表现,发现专家撰写的摘要更受青睐,但专家有时难以区分人类与AI生成的摘要。