语言大模型 / LLM - arXivDaily 专题

2405.14388 2024-05-24 cs.SE cs.CL cs.CR 89%

Evaluation of the Programming Skills of Large Language Models

Luc Bryan Heitz, Joun Chamas, Christopher Scherb

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.09346 2024-05-24 cs.AI 89%

LLMAuditor: A Framework for Auditing Large Language Models Using Human-in-the-Loop

Maryam Amirizaniani, Jihan Yao, Adrian Lavergne, Elizabeth Snell Okada, Aman Chadha, Tanya Roosta, Chirag Shah

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2402.04105 2024-05-24 cs.CY cs.CL 89%

Measuring Implicit Bias in Explicitly Unbiased Large Language Models

Xuechunzi Bai, Angelina Wang, Ilia Sucholutsky, Thomas L. Griffiths

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2405.12174 2024-05-21 cs.CL 89%

CT-Eval: Benchmarking Chinese Text-to-Table Performance in Large Language Models

Haoxiang Shi, Jiaan Wang, Jiarong Xu, Cen Wang, Tetsuya Sakai

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 10 pages

2405.11579 2024-05-21 cs.CL 89%

Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications

Subhankar Maity, Aniket Deroy, Sudeshna Sarkar

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted at EDM 2024

2405.10166 2024-05-17 cs.CL cs.PF 89%

LFED: A Literary Fiction Evaluation Dataset for Large Language Models

Linhao Yu, Qun Liu, Deyi Xiong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2308.03825 2024-05-16 cs.CR cs.LG 89%

"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models

Xinyue Shen, Zeyuan Chen, Michael Backes, Yun Shen, Yang Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2405.08477 2024-05-15 cs.CL 89%

Enhancing Gender-Inclusive Machine Translation with Neomorphemes and Large Language Models

Andrea Piergentili, Beatrice Savoldi, Matteo Negri, Luisa Bentivogli

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted at EAMT 2024

2404.19093 2024-05-01 cs.IR cs.AI cs.HC 89%

Large Language Models as Conversational Movie Recommenders: A User Study

Ruixuan Sun, Xinyi Li, Avinash Akella, Joseph A. Konstan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.AI

2404.18001 2024-04-30 cs.SE cs.AI 89%

LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing

Zeyang Ma, An Ran Chen, Dong Jae Kim, Tse-Hsun Chen, Shaowei Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2404.13161 2024-04-23 cs.CR cs.LG 89%

CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models

Manish Bhatt, Sahana Chennabasappa, Yue Li, Cyrus Nikolaidis, Daniel Song, Shengye Wan, Faizan Ahmad, Cornelius Aschermann, Yaohui Chen, Dhaval Kapil, David Molnar, Spencer Whitman, Joshua Saxe

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2404.12283 2024-04-19 cs.CL 89%

Enhancing Embedding Performance through Large Language Model-based Text Enrichment and Rewriting

Nicholas Harris, Anand Butani, Syed Hashmy

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2404.05970 2024-04-19 cs.CL cs.IR 89%

Optimization Methods for Personalizing Large Language Models through Retrieval Augmentation

Alireza Salemi, Surya Kallumadi, Hamed Zamani

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2404.11072 2024-04-18 cs.HC cs.AI 89%

Large Language Models Meet User Interfaces: The Case of Provisioning Feedback

Stanislav Pozdniakov, Jonathan Brazil, Solmaz Abdi, Aneesha Bakharia, Shazia Sadiq, Dragan Gasevic, Paul Denny, Hassan Khosravi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments submission to C&E AI

2404.10922 2024-04-18 cs.CL cs.SD eess.AS 89%

Teaching a Multilingual Large Language Model to Understand Multilingual Speech via Multi-Instructional Training

Pavel Denisov, Ngoc Thang Vu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL Findings 2024

2404.08488 2024-04-15 cs.CL 89%

Thematic Analysis with Large Language Models: does it work with languages other than English? A targeted test in Italian

Stefano De Paoli

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2311.09214 2024-04-09 cs.CL 89%

Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models

Weize Liu, Guocong Li, Kai Zhang, Bang Du, Qiyuan Chen, Xuming Hu, Hongxia Xu, Jintai Chen, Jian Wu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；small language model(abstract)；分类 cs.CL

Comments Accepted to NAACL 2024 Main Conference

2310.15147 2024-04-09 cs.CL 89%

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models

Fangyu Lei, Qian Liu, Yiming Huang, Shizhu He, Jun Zhao, Kang Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2024

2306.02612 2024-04-09 cs.CR cs.CL 89%

Building Resilient SMEs: Harnessing Large Language Models for Cyber Security in Australia

Benjamin Kereopa-Yorke

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 8 pages, 1 figure

Journal ref Journal of AI, Robotics & Workplace Automation, Volume 3 / Number 1 / Autumn/Fall 2024, pp. 15-27(13)

2404.02512 2024-04-04 cs.CL 89%

Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Languages

Vandan Mujadia, Pruthwik Mishra, Arafat Ahsan, Dipti Misra Sharma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:2311.09216

2401.11033 2024-04-04 cs.CL 89%

FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?

Shaina Raza, Shardul Ghuge, Chen Ding, Elham Dolatabadi, Deval Pandya

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted

2308.10168 2024-04-04 cs.CL 89%

Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?

Kai Sun, Yifan Ethan Xu, Hanwen Zha, Yue Liu, Xin Luna Dong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments To appear in NAACL 2024

2404.01754 2024-04-03 cs.SE cs.AI 89%

Peer-aided Repairer: Empowering Large Language Models to Repair Advanced Student Assignments

Qianhui Zhao, Fang Liu, Li Zhang, Yang Liu, Zhen Yan, Zhenghao Chen, Yufei Zhou, Jing Jiang, Ge Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments On-going work

2404.00930 2024-04-02 cs.CL 89%

PSYDIAL: Personality-based Synthetic Dialogue Generation using Large Language Models

Ji-Eun Han, Jun-Seok Koh, Hyeon-Tae Seo, Du-Seong Chang, Kyung-Ah Sohn

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments LREC-COLING 2024 Main

2404.00227 2024-04-02 cs.SE cs.CL 89%

A Survey of using Large Language Models for Generating Infrastructure as Code

Kalahasti Ganesh Srivatsa, Sabyasachi Mukhopadhyay, Ganesh Katrapati, Manish Shrivastava

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted in ICON2023

2403.17532 2024-03-27 cs.AI 89%

KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion

Yilin Wang, Minghao Hu, Zhen Huang, Dongsheng Li, Dong Yang, Xicheng Lu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.AI

Comments This paper has been accepted for publication in the proceedings of LREC-COLING 2024

2403.04786 2024-03-26 cs.CR cs.CL 89%

Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Models

Arijit Ghosh Chowdhury, Md Mofijul Islam, Vaibhav Kumar, Faysal Hossain Shezan, Vaibhav Kumar, Vinija Jain, Aman Chadha

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.14988 2024-03-25 cs.CL 89%

Risk and Response in Large Language Models: Evaluating Key Threat Categories

Bahareh Harandizadeh, Abel Salinas, Fred Morstatter

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 19 pages, 14 figures

2402.07234 2024-03-22 cs.AI 89%

CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domain

Xin Tong, Bo Jin, Zhi Lin, Binjun Wang, Ting Yu, Qiang Cheng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2310.16343 2024-03-22 cs.CL 89%

Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models

Xiang Chen, Xiaojun Wan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Work in progress

1. 评测与基准 32006 篇

Evaluation of the Programming Skills of Large Language Models

LLMAuditor: A Framework for Auditing Large Language Models Using Human-in-the-Loop

Measuring Implicit Bias in Explicitly Unbiased Large Language Models

CT-Eval: Benchmarking Chinese Text-to-Table Performance in Large Language Models

Exploring the Capabilities of Prompted Large Language Models in Educational and Assessment Applications

LFED: A Literary Fiction Evaluation Dataset for Large Language Models

"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models

Enhancing Gender-Inclusive Machine Translation with Neomorphemes and Large Language Models

Large Language Models as Conversational Movie Recommenders: A User Study

LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing

CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models

Enhancing Embedding Performance through Large Language Model-based Text Enrichment and Rewriting

Optimization Methods for Personalizing Large Language Models through Retrieval Augmentation

Large Language Models Meet User Interfaces: The Case of Provisioning Feedback

Teaching a Multilingual Large Language Model to Understand Multilingual Speech via Multi-Instructional Training

Thematic Analysis with Large Language Models: does it work with languages other than English? A targeted test in Italian

Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models

Building Resilient SMEs: Harnessing Large Language Models for Cyber Security in Australia

Towards Large Language Model driven Reference-less Translation Evaluation for English and Indian Languages

FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?

Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?

Peer-aided Repairer: Empowering Large Language Models to Repair Advanced Student Assignments

PSYDIAL: Personality-based Synthetic Dialogue Generation using Large Language Models

A Survey of using Large Language Models for Generating Infrastructure as Code

KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion

Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Models

Risk and Response in Large Language Models: Evaluating Key Threat Categories

CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domain

Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models