Clinician-Level Agreement Without Clinical Caution: LLM Evaluator Limits in Medical AI Benchmarking
临床医生级别的一致性缺乏临床谨慎:LLM评估者在医学AI基准测试中的局限性
William Philipp, Finn Fassbender, Daniel Fister, Thorsten Langer, Martje G. Pauly, Rebecca Herzog, Markus A. Hobert, Theresa Paulus, Alexander Baumann, Chi Wang Ip, Lukas L. Goede, Johanna Reimer, Sebastian Löns, Ronald Böck, Sebastian Fudickar
机构
*
University of Luebeck(吕贝克大学)
;
University of Tübingen(图宾根大学)
;
University Hospital Schleswig-Holstein(石勒苏益格-荷尔斯泰因大学医院)
;
University Hospital Würzburg(维尔茨堡大学医院)
;
Charité – Universitätsmedizin Berlin(柏林夏里特医学院)
;
Genie Enterprise Deutschland GmbH
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.CL
机构
*
School of Electrical and Computer Engineering, University of Tehran, Iran(伊朗塔里哈大学电气与计算机工程学院)
;
Tehran Institute for Advanced Studies, Khatam University, Iran(伊朗卡塔姆大学泰赫兰高级研究院)
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI
Comments10 pages, conference: Proceedings of the 34th International Conference on Computers in Education. Asia-Pacific Society for Computers in Education
机构
*
Department of Computer Science, University of Chile(智利大学计算机科学系)
;
National Center for Artificial Intelligence (CENIA)(国家人工智能中心)
;
School of Government, Adolfo Ibáñez University(阿道弗·伊巴涅斯大学政府学院)
;
Millennium Institute for Foundational Research on Data (IMFD)(数据基础研究千年研究所)
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.LG
Journal refProceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD '26), August 09--13, 2026, Jeju Island, Republic of Korea
机构
*
East China Normal University Shanghai China
;
Beijing Jiaotong University Beijing China
;
Shandong University Jinan, Shandong China
;
East China Normal University \& Shanghai Innovation Institute Shanghai China
;
East China Normal University
;
Beijing Jiaotong University
;
Shandong University
;
East China Normal University \& Shanghai Innovation Institute
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.CL
Compass: Navigating Global Marine Lead Data Integration through Expert-Guided LLM Agent
Compass: 通过专家引导的LLM代理导航全球海洋铅数据整合
Yiming Liu, Bin Lu, Meng Jin, Ziyuan Sang, Shuo Jiang, Lei Zhou, Xinbing Wang, Chenghu Zhou, Jing Zhang
机构
*
School of Information Science
;
Electronic Engineering,\ Jiao Tong University Shanghai China
;
School of Artificial Intelligence,\ Jiao Tong University Shanghai China
;
State Key Laboratory of Estuarine
;
Coastal Research,\ China Normal University Shanghai China
;
School of Oceanography,\ Jiao Tong University Shanghai China
;
Institute of Geographical Science
;
Natural Resources Research,\ Academy of Sciences Beijing China
;
Electronic Engineering,\ Jiao Tong University
;
School of Artificial Intelligence,\ Jiao Tong University
;
Coastal Research,\ China Normal University
;
School of Oceanography,\ Jiao Tong University
;
Natural Resources Research,\ Academy of Sciences
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI
Fine-Tuned LLM as a Complementary Predictor Improving Ads System
微调LLM作为改进广告系统的互补预测器
Hui Yang, Daiwei He, Kevin Jiang, Taejin Park, Kungang Li, Jiajun Luo, Yuying Chen, Xinyi Zhang, Sihan Wang, Haoyu He, Yu Liu, Lakshmi Manoharan, David Xue, Shubham Barhate, Runze Su, Duna Zhan, Ling Leng, Siping Ji, Jinfeng Zhuang, Alice Wu, Leo Lu, Han Sun, Zhifang Liu
机构
*
Pinterest, Inc., USA(Pinterest公司,美国)
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI
LLM-assisted sentiment analysis for integrated computational and qualitative mixed methods education research: A case study of students' written reflection assignments
机构
*
Chandra Family Department of Electrical and Computer Engineering, University of Texas at Austin(德克萨斯大学奥斯汀分校电子与计算机工程系)
;
Department of Engineering Education, Virginia Polytechnic Institute and State University(弗吉尼亚理工大学工程教育系)
;
Gallogly College of Engineering, University of Oklahoma(俄克拉荷马大学加洛格利工程学院)
;
Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln(内布拉斯加大学林肯分校机械与材料工程系)
专题命中
领域大模型
:LLM(title,title_cn);large language model(abstract);language model(abstract);分类 cs.AI