语言大模型 / LLM - arXivDaily 专题

2411.07140 2024-11-14 cs.CL 90%

Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models

Yancheng He, Shilong Li, Jiaheng Liu, Yingshui Tan, Weixun Wang, Hui Huang, Xingyuan Bu, Hangyu Guo, Chengwei Hu, Boren Zheng, Zhuoran Lin, Xuepeng Liu, Dekai Sun, Shirong Lin, Zhicheng Zheng, Xiaoyong Zhu, Wenbo Su, Bo Zheng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；foundation model(abstract)

2410.12478 2024-10-21 cs.CL 90%

MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models

Boyang Xue, Hongru Wang, Rui Wang, Sheng Wang, Zezhong Wang, Yiming Du, Bin Liang, Kam-Fai Wong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Comments: This work was intended as a replacement of arXiv:2402.13606 and any subsequent updates will appear there

2403.06765 2024-10-21 cs.CL 90%

ConspEmoLLM: Conspiracy Theory Detection Using an Emotion-Based Large Language Model

Zhiwei Liu, Boyang Liu, Paul Thompson, Kailai Yang, Sophia Ananiadou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；instruction tuning(abstract)

Comments Work in progress

2410.12835 2024-10-18 cs.CE cs.CL 90%

A Dutch Financial Large Language Model

Sander Noels, Jorne De Blaere, Tijl De Bie

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；instruction tuning(abstract)

Comments 9 pages, 1 figure, accepted at ACM ICAIF'24

2410.03278 2024-10-10 cs.CL 90%

What do Large Language Models Need for Machine Translation Evaluation?

Shenbin Qian, Archchana Sindhujan, Minnie Kabra, Diptesh Kanojia, Constantin Orăsan, Tharindu Ranasinghe, Frédéric Blain

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted to EMNLP 2024 Main Conference

2410.03312 2024-10-07 cs.CL eess.AS 90%

Context and System Fusion in Post-ASR Emotion Recognition with Large Language Models

Pavel Stepachev, Pinzhen Chen, Barry Haddow

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2404.04941 2024-10-07 cs.CL 90%

Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoring

Sanwoo Lee, Yida Cai, Desong Meng, Ziyang Wang, Yunfang Wu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2403.04222 2024-09-30 cs.CL 90%

Self-Evaluation of Large Language Model based on Glass-box Features

Hui Huang, Yingqi Qu, Jing Liu, Muyun Yang, Bing Xu, Tiejun Zhao, Wenpeng Lu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments accepted as Findings of EMNLP2024

2409.13952 2024-09-24 cs.CL cs.HC 90%

Exploring Automated Keyword Mnemonics Generation with Large Language Models via Overgenerate-and-Rank

Jaewook Lee, Hunter McNichols, Andrew Lan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments EMNLP 2024 findings

2408.08892 2024-09-23 cs.DB cs.AI 90%

Leveraging Large Language Models for Enhanced Process Model Comprehension

Humam Kourani, Alessandro Berti, Jasmin Hennrich, Wolfgang Kratsch, Robin Weidlich, Chiao-Yun Li, Ahmad Arslan, Daniel Schuster, Wil M. P. van der Aalst

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2409.10756 2024-09-18 cs.SE cs.AI 90%

VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching

Arastoo Zibaeirad, Marco Vieira

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2407.18276 2024-09-11 cs.AR cs.AI 90%

Rome was Not Built in a Single Step: Hierarchical Prompting for LLM-based Chip Design

Andre Nakkab, Sai Qian Zhang, Ramesh Karri, Siddharth Garg

专题命中评测与基准：LLM(title,abstract)；prompting(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted at MLCAD '24. 10 pages, 7 figures, 5 tables

2408.12547 2024-09-06 cs.CL 90%

Towards Evaluating and Building Versatile Large Language Models for Medicine

Chaoyi Wu, Pengcheng Qiu, Jinxin Liu, Hongfei Gu, Na Li, Ya Zhang, Yanfeng Wang, Weidi Xie

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；prompting(abstract)

2408.16276 2024-08-30 cs.CL 90%

Enhancing AI-Driven Psychological Consultation: Layered Prompts with Large Language Models

Rafael Souza, Jia-Hao Lim, Alexander Davis

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2408.15040 2024-08-29 cs.CL 90%

A Survey of Large Language Models for European Languages

Wazir Ali, Sampo Pyysalo

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；pretraining(abstract)

2408.12194 2024-08-26 cs.CL 90%

Large Language Models as Foundations for Next-Gen Dense Retrieval: A Comprehensive Empirical Assessment

Kun Luo, Minghao Qin, Zheng Liu, Shitao Xiao, Jun Zhao, Kang Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；pretraining(abstract)

Comments Submitted to EMNLP24

2408.06929 2024-08-14 cs.CL 90%

Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas

Louis Kwok, Michal Bravansky, Lewis D. Griffin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 18 pages, 8 figures, Published as a conference paper at COLM 2024

2407.11852 2024-07-17 cs.DB cs.AI 90%

Schema Matching with Large Language Models: an Experimental Study

Marcel Parciak, Brecht Vandevoort, Frank Neven, Liesbet M. Peeters, Stijn Vansummeren

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted at the 2nd International Workshop on Tabular Data Analysis (TaDA24), collocated with the 50th International Conference on Very Large Data Bases (VLDB 2024) Guangzhou, China - August 29, 2024

2309.17447 2024-06-28 cs.CL 90%

A Large Language Model Approach to Educational Survey Feedback Analysis

Michael J. Parker, Caitlin Anderson, Claire Stone, YeaRim Oh

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Journal ref Int J Artif Intell Educ (2024)

2402.07844 2024-06-12 cs.SE cs.CL 90%

Mercury: A Code Efficiency Benchmark for Code Large Language Models

Mingzhe Du, Anh Tuan Luu, Bin Ji, Qian Liu, See-Kiong Ng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；preference optimization(abstract)

2405.04753 2024-05-09 cs.CR cs.AI 90%

AttacKG+:Boosting Attack Knowledge Graph Construction with Large Language Models

Yongheng Zhang, Tingwen Du, Yunshan Ma, Xiang Wang, Yi Xie, Guozheng Yang, Yuliang Lu, Ee-Chien Chang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 20 pages, 5 figures

2405.03695 2024-05-08 cs.CL 90%

Evaluating Large Language Models for Material Selection

Daniele Grandi, Yash Patawari Jain, Allin Groom, Brandon Cramer, Christopher McComb

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments arXiv admin note: text overlap with arXiv:2307.03109 by other authors

2404.16859 2024-04-29 cs.CL cs.SI 90%

Rumour Evaluation with Very Large Language Models

Dahlia Shehata, Robin Cohen, Charles Clarke

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2404.09129 2024-04-16 cs.CL 90%

When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models

Yanhong Li, Chenghao Yang, Allyson Ettinger

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments NAACL 2024 Findings paper (Camera-Ready Version)

2309.08963 2024-04-08 cs.CL 90%

Struc-Bench: Are Large Language Models Really Good at Generating Complex Structured Data?

Xiangru Tang, Yiming Zong, Jason Phang, Yilun Zhao, Wangchunshu Zhou, Arman Cohan, Mark Gerstein

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2402.00097 2024-04-04 cs.SE cs.LG 90%

Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLM

Gabriel Ryan, Siddhartha Jain, Mingyue Shang, Shiqi Wang, Xiaofei Ma, Murali Krishna Ramanathan, Baishakhi Ray

专题命中评测与基准：LLM(title,abstract)；prompting(title,abstract)；large language model(abstract)；language model(abstract)

2402.11734 2024-03-26 cs.PL cs.AI cs.SE 90%

Solving Data-centric Tasks using Large Language Models

Shraddha Barke, Christian Poelitz, Carina Suzana Negreanu, Benjamin Zorn, José Cambronero, Andrew D. Gordon, Vu Le, Elnaz Nouri, Nadia Polikarpova, Advait Sarkar, Brian Slininger, Neil Toronto, Jack Williams

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Paper accepted to NAACL 2024 (Findings)

2402.15754 2024-02-27 cs.CL 90%

HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition

Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 20 pages, 13 figures

2309.13567 2024-02-14 cs.CL 90%

MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models

Kailai Yang, Tianlin Zhang, Ziyan Kuang, Qianqian Xie, Jimin Huang, Sophia Ananiadou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；foundation model(abstract)

Comments Accepted by WWW 2024

2302.06527 2023-12-12 cs.SE cs.AI 90%

An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generation

Max Schäfer, Sarah Nadi, Aryaz Eghbali, Frank Tip

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

1. 评测与基准 31906 篇

Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models

MlingConf: A Comprehensive Study of Multilingual Confidence Estimation on Large Language Models

ConspEmoLLM: Conspiracy Theory Detection Using an Emotion-Based Large Language Model

A Dutch Financial Large Language Model

What do Large Language Models Need for Machine Translation Evaluation?

Context and System Fusion in Post-ASR Emotion Recognition with Large Language Models

Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoring

Self-Evaluation of Large Language Model based on Glass-box Features

Exploring Automated Keyword Mnemonics Generation with Large Language Models via Overgenerate-and-Rank

Leveraging Large Language Models for Enhanced Process Model Comprehension

VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching

Rome was Not Built in a Single Step: Hierarchical Prompting for LLM-based Chip Design

Towards Evaluating and Building Versatile Large Language Models for Medicine

Enhancing AI-Driven Psychological Consultation: Layered Prompts with Large Language Models

A Survey of Large Language Models for European Languages

Large Language Models as Foundations for Next-Gen Dense Retrieval: A Comprehensive Empirical Assessment

Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas

Schema Matching with Large Language Models: an Experimental Study

A Large Language Model Approach to Educational Survey Feedback Analysis

Mercury: A Code Efficiency Benchmark for Code Large Language Models

AttacKG+:Boosting Attack Knowledge Graph Construction with Large Language Models

Evaluating Large Language Models for Material Selection

Rumour Evaluation with Very Large Language Models

When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models

Struc-Bench: Are Large Language Models Really Good at Generating Complex Structured Data?

Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLM

Solving Data-centric Tasks using Large Language Models

HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition

MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models

An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generation