AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite
AstaBench:通过科学研究套件严格评估AI代理
Jonathan Bragg, Mike D'Arcy, Nishant Balepur, Dan Bareket, Bhavana Dalvi, Sergey Feldman, Dany Haddad, Jena D. Hwang, Peter Jansen, Varsha Kishore, Bodhisattwa Prasad Majumder, Aakanksha Naik, Sigal Rahamimov, Kyle Richardson, Amanpreet Singh, Harshit Surana, Aryeh Tiktinsky, Rosni Vasu, Guy Wiener, Chloe Anastasiades, Stefan Candra, Jason Dunkelberger, Dan Emery, Rob Evans, Malachi Hamada, Regan Huff, Rodney Kinney, Matt Latzke, Jaron Lochner, Ruben Lozano-Aguilera, Cecile Nguyen, Smita Rao, Amber Tanaka, Brooke Vlahos, Peter Clark, Doug Downey, Yoav Goldberg, Ashish Sabharwal, Daniel S. Weld
机构
*
Asta Team, Allen Institute for AI(Asta团队,人工智能研究所)
;
University of Maryland(马里兰大学)
;
University of Arizona(亚利桑那大学)
;
University of Zurich(苏黎世大学)
;
Bar-Ilan University(巴伊兰大学)
;
University of Washington(华盛顿大学)
DR. INFO at the Point of Care: A Prospective Pilot Study of Physician-Perceived Value of an Agentic AI Clinical Assistant
DR. INFO在临床一线:医师对代理AI临床助手的感知价值前瞻性试点研究
Rogerio Corga Da Silva, Miguel Romano, Tiago Mendes, Marta Isidoro, Sandhanakrishnan Ravichandran, Shivesh Kumar, Michiel van der Heijden, Olivier Fail, Valentine Emmanuel Gnanapragasam
Self-Aware Vector Embeddings for Retrieval-Augmented Generation: A Neuroscience-Inspired Framework for Temporal, Confidence-Weighted, and Relational Knowledge
具有自我意识的向量嵌入用于检索增强生成:一种受神经科学启发的框架,用于时间、置信度加权和关系知识
Naizhong Xu
机构
*
Principal Consultant, CMC APAC(CMC APAC 主任顾问)
Aishik Mandal, Hiba Arnaout, Clarissa W. Ong, Juliet Bockhorst, Kate Sheehan, Rachael Moldow, Tanmoy Chakraborty, Iryna Gurevych
机构
*
UKP Lab, Department of Computer Science and Hessian Center for AI (hessian.AI), Technische Universität Darmstadt(德国达姆施塔特技术大学UKP实验室、计算机科学系和海森人工智能中心(hessian.AI))
;
Zuse School ELIZA(Zuse学院ELIZA)
;
National Research Center for Applied Cybersecurity ATHENE(应用网络安全国家研究中心ATHENE)
;
Indian Institute of Technology Delhi(印度德里理工学院)
;
Yardi School of Artificial Intelligence(Yardi人工智能学院)
;
University of Louisville(路易斯维尔大学)
;
University of Toledo(托莱多大学)
Toward Safe Autonomous Robotic Endovascular Interventions using World Models
迈向安全的自主机器人内血管干预的世模型
Harry Robertshaw, Nikola Fischer, Han-Ru Wu, Andrea Walker Perez, Weiyuan Deng, Benjamin Jackson, Christos Bergeles, Alejandro Granados, Thomas C Booth
机构
*
Surgical & Interventional Engineering, School of Biomedical Engineering & Imaging Sciences, King’s College London(外科与介入工程系,生物医学工程与成像科学学院,伦敦国王学院)
;
Department of Radiology, National Taiwan University Hospital(放射科,台湾大学医院)
;
Department of Neuroradiology, King’s College Hospital(神经放射科,伦敦国王医院)
X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis
X-PCR:眼科诊断中跨模态渐进临床推理的基准测试
Gui Wang, Zehao Zhong, YongSong Zhou, Yudong Li, Ende Wu, Wooi Ping Cheah, Rong Qu, Jianfeng Ren, Linlin Shen
机构
*
School of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院)
;
Tsinghua University(清华大学)
;
University of Nottingham(诺丁汉大学)
;
School of AI, Shenzhen University(深圳大学人工智能学院)
;
Wenzhou Medical University(温州医科大学)
;
Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen University(广东省智能信息处理重点实验室)
机构
*
College of Computer Science and Engineering(计算机科学与工程学院)
;
College of Artificial Intelligence(人工智能学院)
;
Department of Pharmacy(药学部)
;
Department of Prosthodontics(修复学部)
;
Chongqing Key Laboratory of Oral Diseases(重庆口腔疾病重点实验室)
;
Chongqing Municipal Key Laboratory of Oral Biomedical Engineering of Higher Education(重庆市口腔生物医学工程高等教育重点实验室)
;
School of Computer Science and Engineering(计算机科学与工程学院)
;
Southeast University(东南大学)