代码大模型 / AI 编程

Fixseeker: An Empirical Driven Graph-based Approach for Detecting Silent Vulnerability Fixes in Open Source Software

Yiran Cheng, Ting Zhang, Lwin Khin Shar, Zhe Lang, David Lo, Shichao Lv, Dongliang Fang, Zhiqiang Shi, Limin Sun

专题命中 代码评测 ：repository(abstract)；分类 cs.SE

Software Testing for Extended Reality Applications: A Systematic Mapping Study

Ruizhen Gu, José Miguel Rojas, Donghwan Shin

专题命中 代码评测 ：repository(abstract)；分类 cs.SE

Comments 51 pages, 10 figures

Domain Adaptation for Japanese Sentence Embeddings with Contrastive Learning based on Synthetic Sentence Generation

Zihao Chen, Hisashi Handa, Miho Ohsaki, Kimiaki Shirahama

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

Comments 39 pages, 7 figures

ClimDetect: A Benchmark Dataset for Climate Change Detection and Attribution

Sungduk Yu, Brian L. White, Anahita Bhiwandiwalla, Musashi Hinck, Matthew Lyle Olson, Yaniv Gurwicz, Raanan Y. Rohekar, Tung Nguyen, Vasudev Lal

专题命中 代码评测 ：repository(abstract)；分类 cs.LG

LONGCODEU: Benchmarking Long-Context Language Models on Long Code Understanding

Jia Li, Xuyuan Guo, Lei Li, Kechi Zhang, Ge Li, Jia Li, Zhengwei Tao, Fang Liu, Chongyang Tao, Yuqi Zhu, Zhi Jin

专题命中 代码评测 ：code model(abstract)；分类 cs.SE

Comments 18 pages

VirtualXAI: A User-Centric Framework for Explainability Assessment Leveraging GPT-Generated Personas

Georgios Makridis, Vasileios Koukos, Georgios Fatouros, Dimosthenis Kyriazis

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

Comments 8 pages, 6 figures

Counterfactual Learning on Graphs: A Survey

Zhimeng Guo, Teng Xiao, Zongyu Wu, Charu Aggarwal, Hui Liu, Suhang Wang

专题命中 代码评测 ：repository(abstract)；分类 cs.LG

Journal ref Machine Intelligence Research (vol. 22, no. 1, pp. 17-59), https://link.springer.com/article/10.1007/s11633-024-1519-z, 2025

CodeCriticBench: A Holistic Code Critique Benchmark for Large Language Models

Alexander Zhang, Marcus Dong, Jiaheng Liu, Wei Zhang, Yejie Wang, Jian Yang, Ge Zhang, Tianyu Liu, Zhongyuan Peng, Yingshui Tan, Yuanxing Zhang, Zhexu Wang, Weixun Wang, Yancheng He, Ken Deng, Wangchunshu Zhou, Wenhao Huang, Zhaoxiang Zhang

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models

Zhongzhan Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Zitnik, Liang Lin

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

Comments Accepted by TPAMI. arXiv admin note: text overlap with arXiv:2312.02439

How to Get Your LLM to Generate Challenging Problems for Evaluation

Arkil Patel, Siva Reddy, Dzmitry Bahdanau

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

Robust Feature Engineering Techniques for Designing Efficient Motor Imagery-Based BCI-Systems

Syed Saim Gardezi, Soyiba Jawed, Mahnoor Khan, Muneeba Bukhari, Rizwan Ahmed Khan

专题命中 代码评测 ：repository(abstract)；分类 cs.LG

Comments 26 pages

How well can a large language model explain business processes as perceived by users?

Dirk Fahland, Fabiana Fournier, Lior Limonad, Inna Skarbovsky, Ava J. E. Swevels

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

Comments 42 pages, 13 figures

Journal ref Data & Knowledge Engineering, Volume 157, May 2025

Performance Evaluation of Large Language Models in Statistical Programming

Xinyi Song, Kexin Xie, Lina Lee, Ruizhe Chen, Jared M. Clark, Hao He, Haoran He, Jie Min, Xinlei Zhang, Simin Zheng, Zhiyang Zhang, Xinwei Deng, Yili Hong

专题命中 代码评测 ：code generation(abstract)；分类 cs.AI

Comments 27 pages, 8 figures

LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insights

Ze Sheng, Zhicheng Chen, Shuning Gu, Heqing Huang, Guofei Gu, Jeff Huang

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

Comments 33 pages, 12 figures

HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks

Fengji Zhang, Linquan Wu, Huiyu Bai, Guancheng Lin, Xiao Li, Xiao Yu, Yue Wang, Bei Chen, Jacky Keung

专题命中 代码评测 ：code generation(abstract)；分类 cs.AI

Comments homepage https://humaneval-v.github.io/

Copilot Arena: A Platform for Code LLM Evaluation in the Wild

Wayne Chi, Valerie Chen, Anastasios Nikolas Angelopoulos, Wei-Lin Chiang, Aditya Mittal, Naman Jain, Tianjun Zhang, Ion Stoica, Chris Donahue, Ameet Talwalkar

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE

MetRex: A Benchmark for Verilog Code Metric Reasoning Using LLMs

Manar Abdelatty, Jingxiao Ma, Sherief Reda

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL

WanJuanSiLu: A High-Quality Open-Source Webtext Dataset for Low-Resource Languages

Jia Yu, Fei Yuan, Rui Min, Jing Yu, Pei Chu, Jiayang Li, Wei Li, Ruijie Zhang, Zhenxiang Li, Zhifei Ren, Dong Zheng, Wenjian Zhang, Yan Teng, Lingyu Meng, ZhenJiang Jin, Jiantao Qiu, ShaSha Wang, Zhongying Tu, Dahua Lin, Yu Wang, Yu Qiao, Yanfeng Wang, Conghui He

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

CLOFAI: A Dataset of Real And Fake Image Classification Tasks for Continual Learning

William Doherty, Anton Lee, Heitor Murilo Gomes

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

SST-EM: Advanced Metrics for Evaluating Semantic, Spatial and Temporal Aspects in Video Editing

Varun Biyyala, Bharat Chanderprakash Kathuria, Jialu Li, Youshan Zhang

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

Comments WACV workshop

LLM4SR: A Survey on Large Language Models for Scientific Research

Ziming Luo, Zonglin Yang, Zexin Xu, Wei Yang, Xinya Du

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

ARC Prize 2024: Technical Report

Francois Chollet, Mike Knoop, Gregory Kamradt, Bryan Landers

专题命中 代码评测 ：program synthesis(abstract)；分类 cs.AI

SecBench: A Comprehensive Multi-Dimensional Benchmarking Dataset for LLMs in Cybersecurity

Pengfei Jing, Mengyun Tang, Xiaorong Shi, Xing Zheng, Sen Nie, Shi Wu, Yong Yang, Xiapu Luo

专题命中 代码评测 ：code generation(abstract)；分类 cs.AI

Unified dimensionality reduction techniques in chronic liver disease detection

Anand Karna, Naina Khan, Rahul Rauniyar, Prashant Giridhar Shambharkar

专题命中 代码评测 ：repository(abstract)；分类 cs.LG

GIRAFE: Glottal Imaging Dataset for Advanced Segmentation, Analysis, and Facilitative Playbacks Evaluation

G. Andrade-Miranda, K. Chatzipapas, J. D. Arias-Londoño, J. I. Godino-Llorente

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

Comments 18 pages, 8 figures

ExecRepoBench: Multi-level Executable Code Completion Evaluation

Jian Yang, Jiajun Zhang, Jiaxi Yang, Ke Jin, Lei Zhang, Qiyao Peng, Ken Deng, Yibo Miao, Tianyu Liu, Zeyu Cui, Binyuan Hui, Junyang Lin

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

CharacterBench: Benchmarking Character Customization of Large Language Models

Jinfeng Zhou, Yongkang Huang, Bosi Wen, Guanqun Bi, Yuxuan Chen, Pei Ke, Zhuang Chen, Xiyao Xiao, Libiao Peng, Kuntian Tang, Rongsheng Zhang, Le Zhang, Tangjie Lv, Zhipeng Hu, Hongning Wang, Minlie Huang

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

Comments AAAI 2025

Zero-Shot Prompting Approaches for LLM-based Graphical User Interface Generation

Kristian Kolthoff, Felix Kretzer, Lennart Fiebig, Christian Bartelt, Alexander Maedche, Simone Paolo Ponzetto

专题命中 代码评测 ：repository(abstract)；分类 cs.SE

Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey

Xuannan Liu, Xing Cui, Peipei Li, Zekun Li, Huaibo Huang, Shuhan Xia, Miaoxuan Zhang, Yueying Zou, Ran He

专题命中 代码评测 ：repository(abstract)；分类 cs.CL

Comments ongoing work

Can Large Language Models Serve as Effective Classifiers for Hierarchical Multi-Label Classification of Scientific Documents at Industrial Scale?

Seyed Amin Tabatabaei, Sarah Fancher, Michael Parsons, Arian Askari

专题命中 代码评测 ：repository(abstract)；分类 cs.AI

Comments This paper has been accepted at COLING 2025 (Industry Track)