When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
当AI基准测试达到平台期:基准饱和的系统性研究
Mubashara Akhtar, Anka Reuel, Prajna Soni, Sanchit Ahuja, Pawan Sasanka Ammanamanchi, Ruchit Rawal, Vilém Zouhar, Srishti Yadav, Chenxi Whitehouse, Dayeon Ki, Jennifer Mickel, Leshem Choshen, Marek Šuppa, Jan Batzner, Jenny Chim, Jeba Sania, Yanan Long, Hossein A. Rahmani, Christina Knight, Yiyang Nan, Jyoutir Raj, Yu Fan, Shubham Singh, Subramanyam Sahoo, Eliya Habba, Usman Gohar, Siddhesh Pawar, Robert Scholz, Arjun Subramonian, Jingwei Ni, Mykel Kochenderfer, Sanmi Koyejo, Mrinmaya Sachan, Stella Biderman, Zeerak Talat, Avijit Ghosh, Irene Solaiman
机构
*
University of California, Berkeley(加州大学伯克利分校)
;
University of Toronto(多伦多大学)
;
University of Washington(华盛顿大学)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
University of Michigan(密歇根大学)
;
University of Texas at Austin(德克萨斯大学奥斯汀分校)
机构
*
The Chinese University of Hong Kong(香港中文大学)
;
Nagoya University(名古屋大学)
;
Institute of Science Tokyo(东京科学大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构
*
University of Illinois Chicago(伊利诺伊大学芝加哥分校)
;
Manteia Technologies Co., Ltd(Manteia技术有限公司)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
University of California Los Angeles(加州大学洛杉矶分校)
Trust but Verify:Evidence-Linked Multi-Agent Clinical Information Extraction in Pathology
从细则中发现幽门螺杆菌:基于证据关联的多智能体胃活检报告病例发现
Yufan Wang, Anit Kumar Sahu, Yan Fei Ng, Daniel Kang, Shayan Vassef, Soorya Ram Shimgekar, Koustuv Saha, Piyum Zonooz, Navin Kumar, Chee Leong Cheng, Li Yan Khor
机构
*
Department of Anatomical Pathology, Singapore General Hospital(新加坡中央医院解剖病理科)
;
Duke–NUS Medical School(新加坡国立大学Duke-NUS医学院)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
Independent Researcher(独立研究者)
机构
*
Peking University(北京大学)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
University of Pennsylvania(宾夕法尼亚大学)
;
Purdue University(普渡大学)
;
Stanford University(斯坦福大学)
Vector-Valued Distributional Reinforcement Learning Policy Evaluation: A Hilbert Space Embedding Approach
向量值分布式强化学习策略评估:一个希尔伯特空间嵌入方法
Mehrdad Mohammadi, Qi Zheng, Ruoqing Zhu
机构
*
Department of Statistics, University of Illinois Urbana-Champaign(统计系,伊利诺伊大学厄巴纳-香槟分校)
;
Department of Bioinformatics and Biostatistics, University of Louisville(生物信息学与生物统计学系,路易斯维尔大学)
Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents
谁买单?面向真实世界网络代理的以利益相关者为中心的提示注入基准测试
Zihao Wang, Yiming Li, Yutong Wu, Kangjie Chen, Zheyu Liu, Fok Kar Wai, Pin-Yu Chen, Vrizlynn L. L. Thing, Bo Li, Dacheng Tao, Tianwei Zhang
机构
*
Nanyang Technological University, Singapore(南洋理工大学,新加坡)
;
ST Engineering, Singapore(ST工程,新加坡)
;
IBM Research, USA(IBM研究院,美国)
;
University of Illinois Urbana-Champaign, USA(伊利诺伊大学厄巴纳-香槟分校,美国)
机构
*
Grainger College of Engineering, Department of Civil and Environmental Engineering, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校格拉inger工程学院土木与环境工程系)
Rethinking Prospect Theory for LLMs: Revealing the Instability of Decision-Making under Epistemic Uncertainty
重新思考用于大语言模型的前景理论:在认知不确定性下决策的不稳定性
Rui Wang, Qihan Lin, Jiayu Liu, Qing Zong, Tianshi Zheng, Dadi Guo, Haochen Shi, Peixuan Han, Weiqi Wang, Yangqiu Song
机构
*
Hong Kong University of Science and Technology(香港科技大学)
;
Huazhong University of Science and Technology(华中科技大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)