SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents
Muhammad Shihab Rashid, Christian Bock, Yuan Zhuang, Alexander Buchholz, Tim Esler, Simon Valentin, Luca Franceschi, Martin Wistuba, Prabhu Teja Sivaprasad, Woo Jung Kim, Anoop Deoras, Giovanni Zappella, Laurent Callot
机构
*
Department of Computer Science, Columbia University, New York, USA(哥伦比亚大学计算机科学系)
;
Computer Science Department, University of California, Los Angeles, California, USA(加州大学洛杉矶分校计算机科学系)
Ethan Shen, Daniel Tormoen, Saurabh Shah, Ali Farhadi, Tim Dettmers
机构
*
Allen Institute for AI(艾伦人工智能研究所)
;
University of Washington(华盛顿大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
Paul G. Allen School of Computer Science and Engineering(保罗·G·艾伦计算机科学与工程学院)
;
Allen Institute of Artificial Intelligence(艾伦人工智能研究所)
;
Machine Learning Department(机器学习系)