语言大模型 / LLM - arXivDaily 专题

2407.15248 2024-07-23 cs.CL 89%

XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models

Erik Cambria, Lorenzo Malandri, Fabio Mercorio, Navid Nobani, Andrea Seveso

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.08495 2024-07-23 cs.CL 89%

Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulator

Yusheng Liao, Yutong Meng, Yuhao Wang, Hongcheng Liu, Yanfeng Wang, Yu Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 23 pages, 5 figures

2401.07598 2024-07-23 cs.CL 89%

MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models

Divyanshu Aggarwal, Ashutosh Sathe, Ishaan Watts, Sunayana Sitaram

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments 46 pages, 23 figures, 45 tables. Accepted in ACL 2024 findings

2407.12024 2024-07-18 cs.HC cs.AI 89%

Leveraging Large Language Models for enhanced personalised user experience in Smart Homes

Jordan Rey-Jouanchicot, André Bottaro, Eric Campo, Jean-Léon Bouraoui, Nadine Vigouroux, Frédéric Vella

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.10873 2024-07-16 cs.NE cs.AI 89%

Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Models

Rui Zhang, Fei Liu, Xi Lin, Zhenkun Wang, Zhichao Lu, Qingfu Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by the 18th International Conference on Parallel Problem Solving From Nature (PPSN 2024)

2407.08940 2024-07-16 cs.CL 89%

Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

Biqing Qi, Kaiyan Zhang, Kai Tian, Haoxiang Li, Zhang-Ren Chen, Sihang Zeng, Ermo Hua, Hu Jinfang, Bowen Zhou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to COLM 2024. This is an extended version of the paper at arXiv:2311.05965

2401.17043 2024-07-16 cs.CL 89%

CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models

Yuanjie Lyu, Zhiyu Li, Simin Niu, Feiyu Xiong, Bo Tang, Wenjin Wang, Hao Wu, Huanyong Liu, Tong Xu, Enhong Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 40 Pages

2407.09424 2024-07-15 eess.SP cs.AI 89%

TelecomGPT: A Framework to Build Telecom-Specfic Large Language Models

Hang Zou, Qiyang Zhao, Yu Tian, Lina Bariah, Faouzi Bader, Thierry Lestable, Merouane Debbah

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments arXiv admin note: text overlap with arXiv:1303.2654 by other authors

2407.07531 2024-07-11 cs.CL 89%

Beyond Benchmarking: A New Paradigm for Evaluation and Assessment of Large Language Models

Jin Liu, Qingquan Li, Wenlong Du

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2306.14027 2024-07-11 cs.CR cs.AI 89%

(Security) Assertions by Large Language Models

Rahul Kande, Hammond Pearce, Benjamin Tan, Brendan Dolan-Gavitt, Shailja Thakur, Ramesh Karri, Jeyavijayan Rajendran

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments This article has been accepted for publication in IEEE Transactions on Information Forensics and Security. This is the author's version. See https://ieeexplore.ieee.org/document/10458667 for the published version of the paper. Citation information: DOI 10.1109/TIFS.2024.3372809. See https://www.ieee.org/publications/rights/index.html for information on publication rights

Journal ref IEEE Transactions on Information Forensics and Security. 2024 Mar 4

2407.07019 2024-07-10 cs.CL 89%

Using Large Language Models for Generating Smart Contracts for Health Insurance from Textual Policies

Inwon Kang, William Van Woensel, Oshani Seneviratne

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.13887 2024-07-10 cs.CL 89%

Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models

Chenyang Lyu, Minghao Wu, Alham Fikri Aji

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to KnowledgeableLMs @ ACL 2024

2306.05817 2024-07-10 cs.IR cs.AI 89%

How Can Recommender Systems Benefit from Large Language Models: A Survey

Jianghao Lin, Xinyi Dai, Yunjia Xi, Weiwen Liu, Bo Chen, Hao Zhang, Yong Liu, Chuhan Wu, Xiangyang Li, Chenxu Zhu, Huifeng Guo, Yong Yu, Ruiming Tang, Weinan Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by ACM Transactions on Information Systems (TOIS); Look-up table in appendix

2407.06089 2024-07-09 cs.CL 89%

Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Models

Jinliang Lu, Ziliang Pang, Min Xiao, Yaochen Zhu, Rui Xia, Jiajun Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2310.17110 2024-07-09 cs.LG 89%

LLM4DyG: Can Large Language Models Solve Spatial-Temporal Problems on Dynamic Graphs?

Zeyang Zhang, Xin Wang, Ziwei Zhang, Haoyang Li, Yijian Qin, Wenwu Zhu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.LG

Comments Accepted by ACM KDD'24

2407.02402 2024-07-03 cs.SE cs.AI 89%

Assessing the Code Clone Detection Capability of Large Language Models

Zixian Zhang, Takfarinas Saber

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.02005 2024-07-03 cs.CL cs.SD eess.AS 89%

An End-to-End Speech Summarization Using Large Language Model

Hengchao Shang, Zongyao Li, Jiaxin Guo, Shaojun Li, Zhiqiang Rao, Yuanchang Luo, Daimeng Wei, Hao Yang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments InterSpeech 2024

2407.01896 2024-07-03 cs.CL cs.IR 89%

LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis

Tianyu Cui, Shiyu Ma, Ziang Chen, Tong Xiao, Shimin Tao, Yilun Liu, Shenglin Zhang, Duoming Lin, Changchang Liu, Yuzhe Cai, Weibin Meng, Yongqian Sun, Dan Pei

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2306.09296 2024-07-02 cs.CL 89%

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

Jifan Yu, Xiaozhi Wang, Shangqing Tu, Shulin Cao, Daniel Zhang-Li, Xin Lv, Hao Peng, Zijun Yao, Xiaohan Zhang, Hanming Li, Chunyang Li, Zheyuan Zhang, Yushi Bai, Yantao Liu, Amy Xin, Nianyi Lin, Kaifeng Yun, Linlu Gong, Jianhui Chen, Zhili Wu, Yunjia Qi, Weikai Li, Yong Guan, Kaisheng Zeng, Ji Qi, Hailong Jin, Jinxin Liu, Yu Gu, Yuan Yao, Ning Ding, Lei Hou, Zhiyuan Liu, Bin Xu, Jie Tang, Juanzi Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ICLR 2024

2407.00365 2024-07-02 cs.CL 89%

Financial Knowledge Large Language Model

Cehao Yang, Chengjin Xu, Yiyan Qi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 66 pages

2406.19358 2024-06-28 cs.CL 89%

The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

Xiliang Zhu, Shayna Gardiner, Tere Roldán, David Rossouw

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to WASSA workshop at ACL2024

2406.19065 2024-06-28 cs.CL 89%

STBench: Assessing the Ability of Large Language Models in Spatio-Temporal Analysis

Wenbin Li, Di Yao, Ruibo Zhao, Wenjie Chen, Zijie Xu, Chengxue Luo, Chang Gong, Quanliang Jing, Haining Tan, Jingping Bi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2406.00697 2024-06-26 cs.CL 89%

Comprehensive Evaluation of Large Language Models for Topic Modeling

Tomoki Doi, Masaru Isonuma, Hitomi Yanaka

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.14903 2024-06-25 cs.AI 89%

GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Models

Leyan Wang, Yonggang Jin, Tianhao Shen, Tianyu Zheng, Xinrun Du, Chenchen Zhang, Wenhao Huang, Jiaheng Liu, Shi Wang, Ge Zhang, Liuyu Xiang, Zhaofeng He

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2403.17209 2024-06-25 cs.AI cs.IR cs.MA cs.SE 89%

Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.0

Yuchen Xia, Zhewen Xiao, Nasser Jazdi, Michael Weyrich

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Published in IEEE Access

2406.16382 2024-06-25 cs.CL 89%

UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.13990 2024-06-25 cs.CL 89%

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation

Qin Zhu, Qingyuan Cheng, Runyu Peng, Xiaonan Li, Tengxiao Liu, Ru Peng, Xipeng Qiu, Xuanjing Huang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2311.16421 2024-06-21 cs.CL cs.CY 89%

CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models

Yuhang Wang, Yanxu Zhu, Chao Kong, Shuyu Wei, Xiaoyuan Yi, Xing Xie, Jitao Sang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by the Cross-Cultural Considerations in NLP Workshop @ ACL 2024

2305.13112 2024-06-21 cs.CL cs.IR 89%

Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models

Xiaolei Wang, Xinyu Tang, Wayne Xin Zhao, Jingyuan Wang, Ji-Rong Wen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023

2406.12386 2024-06-19 cs.CL 89%

IPEval: A Bilingual Intellectual Property Agency Consultation Evaluation Benchmark for Large Language Models

Qiyao Wang, Jianguo Huang, Shule Lu, Yuan Lin, Kan Xu, Liang Yang, Hongfei Lin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 评测与基准 32006 篇

XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models

Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulator

MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models

Leveraging Large Language Models for enhanced personalised user experience in Smart Homes

Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Models

Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models

TelecomGPT: A Framework to Build Telecom-Specfic Large Language Models

Beyond Benchmarking: A New Paradigm for Evaluation and Assessment of Large Language Models

(Security) Assertions by Large Language Models

Using Large Language Models for Generating Smart Contracts for Health Insurance from Textual Policies

Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models

How Can Recommender Systems Benefit from Large Language Models: A Survey

Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Models

LLM4DyG: Can Large Language Models Solve Spatial-Temporal Problems on Dynamic Graphs?

Assessing the Code Clone Detection Capability of Large Language Models

An End-to-End Speech Summarization Using Large Language Model

LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

Financial Knowledge Large Language Model

The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

STBench: Assessing the Ability of Large Language Models in Spatio-Temporal Analysis

Comprehensive Evaluation of Large Language Models for Topic Modeling

GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Models

Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.0

UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation

CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models

Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models

IPEval: A Bilingual Intellectual Property Agency Consultation Evaluation Benchmark for Large Language Models