When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
当AI基准测试达到平台期:基准饱和的系统性研究
Mubashara Akhtar, Anka Reuel, Prajna Soni, Sanchit Ahuja, Pawan Sasanka Ammanamanchi, Ruchit Rawal, Vilém Zouhar, Srishti Yadav, Chenxi Whitehouse, Dayeon Ki, Jennifer Mickel, Leshem Choshen, Marek Šuppa, Jan Batzner, Jenny Chim, Jeba Sania, Yanan Long, Hossein A. Rahmani, Christina Knight, Yiyang Nan, Jyoutir Raj, Yu Fan, Shubham Singh, Subramanyam Sahoo, Eliya Habba, Usman Gohar, Siddhesh Pawar, Robert Scholz, Arjun Subramonian, Jingwei Ni, Mykel Kochenderfer, Sanmi Koyejo, Mrinmaya Sachan, Stella Biderman, Zeerak Talat, Avijit Ghosh, Irene Solaiman
机构
*
University of California, Berkeley(加州大学伯克利分校)
;
University of Toronto(多伦多大学)
;
University of Washington(华盛顿大学)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
University of Michigan(密歇根大学)
;
University of Texas at Austin(德克萨斯大学奥斯汀分校)
Galaxy Phase-Space and Field-Level Cosmology: The Strength of Semi-Analytic Models
星系相空间与场级宇宙学:半经验模型的强度
Natalí S. M. de Santi, Francisco Villaescusa-Navarro, Pablo Araya-Araya, Gabriella De Lucia, Fabio Fontanot, Lucia A. Perez, Manuel Arnés-Curto, Violeta Gonzalez-Perez, Ángel Chandro-Gómez, Rachel S. Somerville, Tiago Castro
机构
*
Berkeley Center for Cosmological Physics, University of California, Berkeley(伯克利宇宙学物理中心,加州大学伯克利分校)
;
Physics Division, Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室物理系)
;
Center for Computational Astrophysics, Flatiron Institute(Flatiron研究所计算天文学中心)
;
Department of Astrophysical Sciences, Princeton University(普林斯顿大学天体物理科学系)
;
Cosmic Dawn Center (DAWN), Copenhagen, Denmark(宇宙黎明中心(DAWN),哥本哈根,丹麦)
;
DTU Space, Technical University of Denmark(技术大学丹麦分校DTU空间)
;
IFPU - Institute for Fundamental Physics of the Universe, via Beirut 2, 34151, Trieste, Italy(IFPU——宇宙基本物理研究所,意大利特里斯特)
;
International Centre for Radio Astronomy Research, The University of Western Australia(国际射电天文研究中心,西澳大利亚大学)
;
ARC Centre for All-Sky Astrophysics in 3 Dimensions (ASTRO 3D)(三维全天空天体物理中心(ASTRO 3D))
Automated Visualization Code Synthesis via Multi-Path Reasoning and Feedback-Driven Optimization
通过多路径推理和反馈驱动优化实现自动化可视化代码合成
Wonduk Seo, Daye Kang, Hyunjin An, Taehan Kim, Soohyuk Cho, Seungyong Lee, Minhyeong Yu, Jian Park, Yi Bu, Seunghyun Lee
机构
*
AI Research, Enhans, Seoul, South Korea Innovation \& Technology, KAIST, Daejeon, South Korea Department of Computer Science, University of California, Berkeley, CA, United States Department of Electrical
AI总结
VisPath通过多路径推理和反馈驱动优化,提升自动化可视化代码生成的可靠性与准确性。
CommentsAccepted by International Conference on Pattern Recognization (ICPR 2026)
Loud or Silent? A Reusable Framework for Per-Modality Failure Analysis in Multimodal Clinical AI
大声还是沉默?一种用于多模态临床AI中模态级失败分析的可复用框架
Quang Bui, Shlok Jaiswal, Samuel Paik-Heintz, Kevin Zhou, Kaushik Madapati, Krittaphas Chaisutyakorn, Noah Dane Hebdon, Dimitrios Proios, Sebastián Andrés Cajas Ordóñez, Kacper Dobek, Boya Zhang, Aly Dhedhi, Ahram Han, Kushul Reddy Palakala, Rahul Gorijavolu, Jacques Kpodonu, Leo Anthony Celi
机构
*
Massachusetts Institute of Technology(麻省理工学院)
;
American International School Vienna(维也纳美国国际学校)
;
Neuqua Valley High School(纽夸谷高中)
;
North Hollywood High School(北好莱坞高中)
;
Hopewell Valley Central High School(霍普韦尔谷中央高中)
;
University of California, Berkeley(加州大学伯克利分校)
;
Siriraj Hospital(诗里拉吉医院)
;
Harvard University(哈佛大学)
;
Agency for Science, Technology and Research(新加坡科技研究局)
;
Johns Hopkins University(约翰斯·霍普金斯大学)
;
University of Geneva(日内瓦大学)
;
Poznan University of Technology(波兹南理工大学)
机构
*
University of Southern California(南加利福尼亚大学)
;
University of Chicago(芝加哥大学)
;
University of California, Berkeley(加利福尼亚大学伯克利分校)
;
Massachusetts Institute of Technology(麻省理工学院)
;
Stanford University(斯坦福大学)
;
University of California, Davis(加利福尼亚大学戴维斯分校)
;
Pennsylvania State University(宾夕法尼亚州立大学)
;
Harvard University(哈佛大学)
;
University of Oxford(牛津大学)
Ruisi Wang, Zhongang Cai, Fanyi Pu, Junxiang Xu, Wanqi Yin, Maijunxian Wang, Ran Ji, Chenyang Gu, Bo Li, Ziqi Huang, Hokin Deng, Dahua Lin, Ziwei Liu, Lei Yang
机构
*
SenseTime Research(商汤科技研究院)
;
Nanyang Technological University(南洋理工大学)
;
University of California, Berkeley(加州大学伯克利分校)
;
University of California, San Diego(加州大学圣地亚哥分校)
;
Carnegie Mellon University(卡内基梅隆大学)
gp2Scale: A Class of Compactly Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Points
gp2Scale:一类紧凑支持非平稳核及分布式计算用于精确高斯过程在1000万数据点上的应用
Marcus M. Noack, Mark D. Risser, Hengrui Luo, Vardaan Tekriwal, Ronald J. Pandolfi
机构
*
Applied Mathematics and Computational Research Division Lawrence Berkeley National Laboratory(应用数学与计算研究部伯克利国家实验室)
;
Climate and Ecosystem Sciences Division Lawrence Berkeley National Laboratory(气候与生态系统科学部伯克利国家实验室)
;
Department of Statistics Rice University(统计学系里德大学)
;
UC Berkeley(加州大学伯克利分校)
DuplexGen: Adaptive Synthesis of Human-AI Turn-Taking Dialogues
DuplexGen:人机交替对话的自适应合成
Takyoung Kim, Kang-wook Kim, Sang Hoon Woo, Julia Hirschberg, Gunhee Kim, Dilek Hakkani-Tür
机构
*
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
Seoul National University(首尔大学)
;
Columbia University(哥伦比亚大学)
;
University of California, Berkeley(加州大学伯克利分校)
;
Georgia Institute of Technology(佐治亚理工学院)
Mert Cemri, Andrei Cojocaru, Melissa Pan, Shu Liu, Shubham Agarwal, Alexander Krentsel, Jay Tang, Kannan Ramchandran, Joseph E. Gonzalez, Matei Zaharia, Alex Dimakis, Ion Stoica
机构
*
University of California, Berkeley(加州大学伯克利分校)
;
Apple(苹果公司)
;
Bespoke Labs(Bespoke实验室)