语言大模型 / LLM - arXivDaily 专题

2406.11191 2024-06-19 cs.CL 89%

A Survey on Human Preference Learning for Large Language Models

Ruili Jiang, Kehai Chen, Xuefeng Bai, Zhixuan He, Juntao Li, Muyun Yang, Tiejun Zhao, Liqiang Nie, Min Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL

Comments IEEE copyright statement added (also applied to the former version)

2402.15862 2024-06-19 cs.CL 89%

SportQA: A Benchmark for Sports Understanding in Large Language Models

Haotian Xia, Zhengbang Yang, Yuqing Wang, Rhys Tracy, Yun Zhao, Dongdong Huang, Zezhi Chen, Yan Zhu, Yuan-fang Wang, Weining Shen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments NAACL 2024

2406.11289 2024-06-18 cs.CL 89%

A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models

Haopeng Zhang, Philip S. Yu, Jiawei Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 30 pages, 8 figures, 6 tables

2404.13599 2024-06-18 cs.CL 89%

"A good pun is its own reword": Can Large Language Models Understand Puns?

Zhijun Xu, Siyu Yuan, Lingjie Chen, Deqing Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.00822 2024-06-18 cs.IR cs.AI 89%

InteraRec: Screenshot Based Recommendations Using Multimodal Large Language Models

Saketh Reddy Karra, Theja Tulabandhula

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2406.08680 2024-06-14 cs.CL 89%

Analyzing Large Language Models for Classroom Discussion Assessment

Nhat Tran, Benjamin Pierce, Diane Litman, Richard Correnti, Lindsay Clare Matsumura

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EDM 2024 Short Paper

2406.07739 2024-06-13 cs.CL cs.HC cs.SE 89%

UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback

Jason Wu, Eldon Schoop, Alan Leung, Titus Barik, Jeffrey P. Bigham, Jeffrey Nichols

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to NAACL 2024

2401.07103 2024-06-13 cs.CL 89%

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges

Zhen Li, Xiaohan Xu, Tao Shen, Can Xu, Jia-Chen Gu, Yuxuan Lai, Chongyang Tao, Shuai Ma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 21 pages, 5 figures

2406.06637 2024-06-12 cs.SE cs.AI 89%

Exploring the Efficacy of Large Language Models (GPT-4) in Binary Reverse Engineering

Saman Pordanesh, Benjamin Tan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2406.06451 2024-06-11 cs.HC cs.AI cs.CY 89%

Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Course

Aadarsh Padiyath, Xinying Hou, Amy Pang, Diego Viramontes Vargas, Xingjian Gu, Tamara Nelson-Fromm, Zihan Wu, Mark Guzdial, Barbara Ericson

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted to the ACM Conference on International Computing Education Research V.1 (ICER '24 Vol. 1)

2406.05900 2024-06-11 cs.LG eess.SP 89%

Large Language Models Memorize Sensor Datasets! Implications on Human Activity Recognition Research

Harish Haresamudram, Hrudhai Rajasekhar, Nikhil Murlidhar Shanbhogue, Thomas Ploetz

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2406.05651 2024-06-11 cs.RO cs.CL cs.CV 89%

A Superalignment Framework in Autonomous Driving with Large Language Models

Xiangrui Kong, Thomas Braunl, Marco Fahmi, Yue Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 6 pages, 5 figures, ieeeiv24

2406.04752 2024-06-10 cs.CL 89%

CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models

Ling Shi, Deyi Xiong

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 28 pages, 5 figures

2406.04244 2024-06-07 cs.CL 89%

Benchmark Data Contamination of Large Language Models: A Survey

Cheng Xu, Shuhao Guan, Derek Greene, M-Tahar Kechadi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 31 pages, 7 figures, 3 tables

2402.11894 2024-06-07 cs.CL 89%

Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models

Jiahao Ying, Yixin Cao, Yushi Bai, Qianru Sun, Bo Wang, Wei Tang, Zhaojun Ding, Yizhe Yang, Xuanjing Huang, Shuicheng Yan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2406.02622 2024-06-06 cs.CR cs.AI 89%

Safeguarding Large Language Models: A Survey

Yi Dong, Ronghui Mu, Yanghao Zhang, Siqi Sun, Tianle Zhang, Changshun Wu, Gaojie Jin, Yi Qi, Jinwei Hu, Jie Meng, Saddek Bensalem, Xiaowei Huang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments under review. arXiv admin note: text overlap with arXiv:2402.01822

2401.15641 2024-06-04 cs.IR cs.CL 89%

PRE: A Peer Review Based Large Language Model Evaluator

Zhumin Chu, Qingyao Ai, Yiteng Tu, Haitao Li, Yiqun Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 11 pages

2311.09154 2024-06-04 cs.CL 89%

CLEAN-EVAL: Clean Evaluation on Contaminated Large Language Models

Wenhong Zhu, Hongkun Hao, Zhiwei He, Yunze Song, Yumeng Zhang, Hanxu Hu, Yiran Wei, Rui Wang, Hongyuan Lu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL2024(findings)

2406.00018 2024-06-04 cs.CL cs.IR 89%

Large Language Models' Detection of Political Orientation in Newspapers

Alessio Buscemi, Daniele Proverbio

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2405.12063 2024-06-04 cs.CL 89%

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models

Tong Zhang, Peixin Qin, Yang Deng, Chen Huang, Wenqiang Lei, Junhong Liu, Dingnan Jin, Hongru Liang, Tat-Seng Chua

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted to ACL 2024. Camera Ready. Our dataset is available at https://github.com/zt991211/CLAMBER

2405.20389 2024-06-03 astro-ph.IM cs.AI cs.HC cs.IR 89%

Designing an Evaluation Framework for Large Language Models in Astronomy Research

John F. Wu, Alina Hyk, Kiera McCormick, Christine Ye, Simone Astarita, Elina Baral, Jo Ciuca, Jesse Cranney, Anjalie Field, Kartheik Iyer, Philipp Koehn, Jenn Kotler, Sandor Kruk, Michelle Ntampaka, Charles O'Neill, Joshua E. G. Peek, Sanjib Sharma, Mikaeel Yunus

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 7 pages, 3 figures. Code available at https://github.com/jsalt2024-evaluating-llms-for-astronomy/astro-arxiv-bot

2312.06717 2024-06-03 cs.AI 89%

Privacy Issues in Large Language Models: A Survey

Seth Neel, Peter Chang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments May 2024 update

2405.20183 2024-05-31 cs.AI cs.SE 89%

A Survey Study on the State of the Art of Programming Exercise Generation using Large Language Models

Eduard Frankford, Ingo Höhn, Clemens Sauerwein, Ruth Breu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 5 pages, 0 figures, CSEE&T 2024

2405.19694 2024-05-31 cs.AI 89%

Grade Like a Human: Rethinking Automated Assessment with Large Language Models

Wenjing Xie, Juxin Niu, Chun Jason Xue, Nan Guan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2405.17732 2024-05-31 cs.CL 89%

C$^{3}$Bench: A Comprehensive Classical Chinese Understanding Benchmark for Large Language Models

Jiahuan Cao, Yongxin Shi, Dezhi Peng, Yang Liu, Lianwen Jin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2405.15924 2024-05-31 cs.CL 89%

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation

Kun Zhao, Bohao Yang, Chen Tang, Chenghua Lin, Liang Zhan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；SLM(abstract)；分类 cs.CL

Comments Accepted by ACL2024 Findings

2405.18632 2024-05-30 cs.CY cs.AI 89%

Large Language Models as Partners in Student Essay Evaluation

Toru Ishida, Tongxi Liu, Hailong Wang, William K. Cheung

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2405.18581 2024-05-30 cs.AI 89%

Unleashing the Potential of Text-attributed Graphs: Automatic Relation Decomposition via Large Language Models

Hyunjin Seo, Taewon Kim, June Yong Yang, Eunho Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2405.16281 2024-05-28 cs.CL 89%

ConStat: Performance-Based Contamination Detection in Large Language Models

Jasper Dekoninck, Mark Niklas Müller, Martin Vechev

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2405.14486 2024-05-24 cs.CL 89%

RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models

Xiangkun Hu, Dongyu Ru, Lin Qiu, Qipeng Guo, Tianhang Zhang, Yang Xu, Yun Luo, Pengfei Liu, Yue Zhang, Zheng Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 评测与基准 32006 篇

A Survey on Human Preference Learning for Large Language Models

SportQA: A Benchmark for Sports Understanding in Large Language Models

A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models

"A good pun is its own reword": Can Large Language Models Understand Puns?

InteraRec: Screenshot Based Recommendations Using Multimodal Large Language Models

Analyzing Large Language Models for Classroom Discussion Assessment

UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges

Exploring the Efficacy of Large Language Models (GPT-4) in Binary Reverse Engineering

Insights from Social Shaping Theory: The Appropriation of Large Language Models in an Undergraduate Programming Course

Large Language Models Memorize Sensor Datasets! Implications on Human Activity Recognition Research

A Superalignment Framework in Autonomous Driving with Large Language Models

CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models

Benchmark Data Contamination of Large Language Models: A Survey

Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models

Safeguarding Large Language Models: A Survey

PRE: A Peer Review Based Large Language Model Evaluator

CLEAN-EVAL: Clean Evaluation on Contaminated Large Language Models

Large Language Models' Detection of Political Orientation in Newspapers

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models

Designing an Evaluation Framework for Large Language Models in Astronomy Research

Privacy Issues in Large Language Models: A Survey

A Survey Study on the State of the Art of Programming Exercise Generation using Large Language Models

Grade Like a Human: Rethinking Automated Assessment with Large Language Models

C$^{3}$Bench: A Comprehensive Classical Chinese Understanding Benchmark for Large Language Models

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation

Large Language Models as Partners in Student Essay Evaluation

Unleashing the Potential of Text-attributed Graphs: Automatic Relation Decomposition via Large Language Models

ConStat: Performance-Based Contamination Detection in Large Language Models

RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models