ACES: Who Tests the Tests? Leave-One-Out AUC Consistency for Code Generation
ACES: 谁测试测试?留一法AUC一致性用于代码生成
Hui Sun, Yun-Ji Zhang, Zheng Xie, Ren-Biao Liu, Yali Du, Xin-Ye Li, Ming Li
机构
*
National Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室)
;
School of Artificial Intelligence, Nanjing University(南京大学人工智能学院)
BackendForge: Benchmarking Agentic End-to-End Code Generation with Backend Services
BackendForge:使用后端服务对智能端到端代码生成进行基准测试
Yuzhe Guo, Mengzhou Wu, Yuan Cao, Jialei Wei, Dezhi Ran, Wei Yang, Tao Xie
机构
*
Key Lab of HCST (PKU), MOE(北京大学计算机科学与技术国家重点实验室;软件学院,北京大学)
;
SCS, Peking University(北京通明湖信息技术应用创新中心)
;
Beijing Tongming Lake Information Technology Application Innovation Center (TLAIC)(复旦大学高级计算系统研究所)
;
Fudan University Institute of Systems for Advanced Computing(上海开放计算系统研究所)
;
Shanghai Institute of Systems for Open Computing
NVAITC AI Scientist: A Governed End-to-End Research System -- A Hypertension GWAS Case Study
NVAITC人工智能科学家:一个受治理的端到端研究系统——以高血压全基因组关联研究为例
Eddie Huang, Ken Liao, Iven Fu, Yang-Hsien Lin, Chao-Shun Zhan, Andy Liao, Virginia Chen, Johnson Sun, Pika Wang, Richard Huang, Jiun-Cheng Jiang, Ting-Yuan Liu, Hsing-Fang Lu, Ray Y. Lee, Chi-Chou Liao, Simon See, Fuu-Jen Tsai
机构
*
Department of Medical Research, China Medical University Hospital(中国医药大学附设医院医学研究部)
;
Master Program for Digital Health Innovation, China Medical University(中国医药大学数字健康创新硕士项目)
;
Laboratory for Statistical and Translational Genetics, RIKEN Center for Integrative Medical Sciences(理化学研究所综合医学科学中心统计与转化遗传学实验室)
;
AI-Driven Genomic Medicine and Drug Discovery Lab, China Medical University Hospital(中国医药大学附设医院人工智能驱动的基因组医学与药物发现实验室)
Program-Synthesis-Driven Autodesign of Universal Unitary Operators
程序合成驱动的通用酉算子自动设计
Yifei Zhang, Dong Chen, Fan Wang, Wenrui Zhang, Yan Chen, Dingding Han, Jianmin Yuan, Xiangjin Kong, Yu-Gang Ma
机构
*
Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Institute of Modern Physics, Fudan University, Shanghai 200433, China(核物理与离子束应用重点实验室(教育部),现代物理研究所,复旦大学,上海200433,中国)
;
Research Center for Theoretical Nuclear Physics, NSFC and Fudan University, Shanghai 200438, China(理论核物理研究中心,国家自然科学基金委员会和复旦大学,上海200438,中国)
;
Huawei Technologies Co., Ltd, Beijing 100095, China(华为技术有限公司,北京100095,中国)
;
Department of Industrial Engineering and Decision Analytics, Hong Kong University of Science and Technology, HongKong, China(工业工程与决策分析系,香港科技大学,香港,中国)
;
Hunan Key Laboratory of Mechanism and Technology of Quantum Information, Changsha 410073, China(湖南量子信息机制与技术重点实验室,长沙410073,中国)
;
School of Information Science and Technology, Fudan University, Shanghai 200433, China(信息科学与技术学院,复旦大学,上海200433,中国)
;
Research Institute of Intelligent Complex Systems, Fudan University, Shanghai 200433, China(智能复杂系统研究所,复旦大学,上海200433,中国)
;
Institute of Atomic and Molecular Physics, Jilin University, Changchun 130012, China(原子与分子物理研究所,吉林大学,长春130012,中国)
;
School of Physics, East China Normal University, Shanghai 200062, China(物理学院,华东师范大学,上海200062,中国)
Imaging-101: Benchmarking LLM Coding Agents on Scientific Computational Imaging
成像101:在科学计算成像上对大语言模型编码智能体进行基准测试
Siyi Chen, Jiahe Ying, Yixuan Jia, Yuxuan Gu, Enze Ye, Weimin Bai, Zhijun Zeng, Shaochi Ren, Binhong Gao, Yubing Li, Tianhan Zhang, He Sun
机构
*
College of Future Technology and the National Biomedical Imaging Center, Peking University(北京大学未来技术学院和国家生物医学成像中心)
;
AI for Science Institute (AISI)(科学人工智能研究所)
;
University of Michigan(密歇根大学)
;
State Key Laboratory of Acoustics and Marine Information, Institute of Acoustics, Chinese Academy of Sciences(中国科学院声学研究所声场声信息国家重点实验室)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
School of Astronautics, Beihang University(北京航空航天大学宇航学院)
;
Key Laboratory of Spacecraft Design Optimization and Dynamic Simulation Technologies, Ministry of Education(教育部航天器设计优化与动态仿真技术重点实验室)
Gauge dependence and structured-output corruption in sign-branched repetition penalties: measurements across models, inference stacks, and alternative repetition controls
Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions
计算机视觉中的持续测试时间适应:方法、基准和未来方向
Sarthak Kumar Maharana, Shambhavi Mishra, Yunbei Zhang, Shuaicheng Niu, Taki Hasan Rafi, Jihun Hamm, Marco Pedersoli, Jose Dolz, Yunhui Guo
机构
*
The University of Texas at Dallas(德克萨斯大学达拉斯分校)
;
LIVIA ETS Montreal, ILLS International Laboratory on Learning Systems (ILLS)(蒙特利尔LIVIA ETS,学习系统国际实验室(ILLS))
;
Tulane University(路易斯安那州立大学)
;
Nanyang Technological University(南洋理工大学)
;
Hanyang University(翰阳大学)