代码大模型 / AI 编程

From MIM-Based GAN to Anomaly Detection:Event Probability Influence on Generative Adversarial Networks

Rui She, Pingyi Fan

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Software Vulnerability and Functionality Assessment using LLMs

Rasmus Ingemann Tuffveson Jensen, Vali Tawosi, Salwa Alamir

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.AI

Comments 4 pages, accepted to NLBSE'24

AutoDev: Automated AI-Driven Development

Michele Tufano, Anisha Agarwal, Jinu Jang, Roshanak Zilouchian Moghaddam, Neel Sundaresan

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.AI

Pre-Trained Model Recommendation for Downstream Fine-tuning

Jiameng Bai, Sai Wu, Jie Song, Junbo Zhao, Gang Chen

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

CodeApex: A Bilingual Programming Evaluation Benchmark for Large Language Models

Lingyue Fu, Huacan Chai, Shuang Luo, Kounianhua Du, Weiming Zhang, Longteng Fan, Jiayi Lei, Renting Rui, Jianghao Lin, Yuchen Fang, Yifan Liu, Jingkuan Wang, Siyuan Qi, Kangning Zhang, Weinan Zhang, Yong Yu

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Comments 33pages

LEGION: Harnessing Pre-trained Language Models for GitHub Topic Recommendations with Distribution-Balance Loss

Yen-Trang Dang, Thanh-Le Cong, Phuc-Thanh Nguyen, Anh M. T. Bui, Phuong T. Nguyen, Bach Le, Quyet-Thang Huynh

专题命中 代码评测 ：repository(abstract)；分类 cs.SE、cs.LG

Comments Accepted to EASE'24

CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text

Zhenru Lin, Yiqun Yao, Yang Yuan

专题命中 代码评测 ：code generation(abstract)；分类 cs.AI、cs.PL

Comments 10 pages, 5 figures

LabelBench: A Comprehensive Framework for Benchmarking Adaptive Label-Efficient Learning

Jifan Zhang, Yifang Chen, Gregory Canal, Stephen Mussmann, Arnav M. Das, Gantavya Bhatt, Yinglun Zhu, Jeffrey Bilmes, Simon Shaolei Du, Kevin Jamieson, Robert D Nowak

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey

Yunpeng Huang, Jingwei Xu, Junyu Lai, Zixu Jiang, Taolue Chen, Zenan Li, Yuan Yao, Xiaoxing Ma, Lijuan Yang, Hao Chen, Shupeng Li, Penghao Zhao

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.LG

Comments 40 pages, 3 figures, 4 tables

Copilot Evaluation Harness: Evaluating LLM-Guided Software Programming

Anisha Agarwal, Aaron Chan, Shubham Chandel, Jinu Jang, Shaun Miller, Roshanak Zilouchian Moghaddam, Yevhen Mohylevskyy, Neel Sundaresan, Michele Tufano

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.AI

Continual Learning on Graphs: Challenges, Solutions, and Opportunities

Xikun Zhang, Dongjin Song, Dacheng Tao

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning

Yejie Wang, Keqing He, Guanting Dong, Pei Wang, Weihao Zeng, Muxi Diao, Yutao Mou, Mengdi Zhang, Jingang Wang, Xunliang Cai, Weiran Xu

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 6 figures

Green Runner: A tool for efficient deep learning component selection

Jai Kannan

专题命中 代码评测 ：repository(abstract)；分类 cs.SE、cs.AI

Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs

Ziyu Li, Donghwan Shin

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.AI

Comments This is an author-preprint. The published version will be included in the proceedings of CAIN 2024 (co-located with ICSE 2024)

RewriteLM: An Instruction-Tuned Large Language Model for Text Rewriting

Lei Shu, Liangchen Luo, Jayakumar Hoskere, Yun Zhu, Yinxiao Liu, Simon Tong, Jindong Chen, Lei Meng

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Journal ref AAAI 2024

A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity

Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, Wenliang Dai, Dan Su, Bryan Wilie, Holy Lovenia, Ziwei Ji, Tiezheng Yu, Willy Chung, Quyet V. Do, Yan Xu, Pascale Fung

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Comments 45 pages, AACL 2023

Machine Learning For An Explainable Cost Prediction of Medical Insurance

Ugochukwu Orji, Elochukwu Ukwandu

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments 42 pages, 16 figures and 9 tables

MARBLE: Music Audio Representation Benchmark for Universal Evaluation

Ruibin Yuan, Yinghao Ma, Yizhi Li, Ge Zhang, Xingran Chen, Hanzhi Yin, Le Zhuo, Yiqi Liu, Jiawen Huang, Zeyue Tian, Binyue Deng, Ningzhi Wang, Chenghua Lin, Emmanouil Benetos, Anton Ragni, Norbert Gyenge, Roger Dannenberg, Wenhu Chen, Gus Xia, Wei Xue, Si Liu, Shi Wang, Ruibo Liu, Yike Guo, Jie Fu

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments camera-ready version for NeurIPS 2023

GenCodeSearchNet: A Benchmark Test Suite for Evaluating Generalization in Programming Language Understanding

Andor Diera, Abdelhalim Dahou, Lukas Galke, Fabian Karl, Florian Sihler, Ansgar Scherp

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.PL

Comments accepted at GenBench workshop, EMNLP 2023

Sociotechnical Safety Evaluation of Generative AI Systems

Laura Weidinger, Maribeth Rauh, Nahema Marchal, Arianna Manzini, Lisa Anne Hendricks, Juan Mateos-Garcia, Stevie Bergman, Jackie Kay, Conor Griffin, Ben Bariach, Iason Gabriel, Verena Rieser, William Isaac

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Comments main paper p.1-29, 5 figures, 2 tables

Off-the-Grid MARL: Datasets with Baselines for Offline Multi-Agent Reinforcement Learning

Claude Formanek, Asad Jeewa, Jonathan Shock, Arnu Pretorius

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments Extended Abstract at Autonomous Agents and Multi-Agent Systems Conference 2023

Beyond Static Datasets: A Deep Interaction Approach to LLM Evaluation

Jiatong Li, Rui Li, Qi Liu

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Benchmarking Causal Study to Interpret Large Language Models for Source Code

Daniel Rodriguez-Cardenas, David N. Palacio, Dipin Khati, Henry Burke, Denys Poshyvanyk

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.AI

Comments 6 pages, 4 tables, 3 figures, accepted to ICSME 2023

Comprehensive Algorithm Portfolio Evaluation using Item Response Theory

Sevvandi Kandanaarachchi, Kate Smith-Miles

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

WYWEB: A NLP Evaluation Benchmark For Classical Chinese

Bo Zhou, Qianglong Chen, Tianyu Wang, Xiaomi Zhong, Yin Zhang

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL 2023

Journal ref https://aclanthology.org/2023.findings-acl.204

StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code

Hannah McLean Babe, Sydney Nguyen, Yangtian Zi, Arjun Guha, Molly Q Feldman, Carolyn Jane Anderson

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.LG

QCBA: Improving Rule Classifiers Learned from Quantitative Data by Recovering Information Lost by Discretisation

Tomas Kliegr, Ebroul Izquierdo

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments online-first. Appl Intell (2023)

Search-Based Regular Expression Inference on a GPU

Mojtaba Valizadeh, Martin Berger

专题命中 代码评测 ：program synthesis(abstract)；分类 cs.AI、cs.PL

A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capability

Aiwei Liu, Xuming Hu, Lijie Wen, Philip S. Yu

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 1 figures

Deep Latent State Space Models for Time-Series Generation

Linqi Zhou, Michael Poli, Winnie Xu, Stefano Massaroli, Stefano Ermon

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG