语言大模型 / LLM - arXivDaily 专题

2405.19323 2024-10-22 cs.CL cs.AI cs.CY cs.LG 90%

Are Large Language Models Chameleons? An Attempt to Simulate Social Surveys

Mingmeng Geng, Sihong He, Roberto Trotta

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 17 pages

2410.12865 2024-10-18 cs.CL cs.AI cs.LG 90%

ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction

Yanlin Zhang, Ning Li, Quan Gan, Weinan Zhang, David Wipf, Minjie Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.09084 2024-10-15 cs.CL cs.AI cs.LG cs.RO 90%

Diagnosing Robotics Systems Issues with Large Language Models

Jordis Emilia Herrmann, Aswath Mandakath Gopinath, Mikael Norrlof, Mark Niklas Müller

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.11370 2024-10-15 cs.CL cs.AI cs.CY cs.LG 90%

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024

2406.09923 2024-10-15 cs.CL cs.AI cs.LG 90%

CliBench: A Multifaceted and Multigranular Evaluation of Large Language Models for Clinical Decision Making

Mingyu Derek Ma, Chenchen Ye, Yu Yan, Xiaoxuan Wang, Peipei Ping, Timothy S Chang, Wei Wang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project page: https://clibench.github.io

2409.19339 2024-10-08 cs.CL cs.AI cs.CV cs.LG 90%

Visual Question Decomposition on Multimodal Large Language Models

Haowei Zhang, Jianzhe Liu, Zhen Han, Shuo Chen, Bailan He, Volker Tresp, Zhiqiang Xu, Jindong Gu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP2024 Findings

2407.01920 2024-10-08 cs.CL cs.AI cs.CV cs.LG cs.MM 90%

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models

Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng, Qingbin Liu, Mengru Wang, Dianbo Sui, Xi Chen, Huajun Chen, Ningyu Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024 Findings; Code and dataset are released at https://github.com/zjunlp/KnowUnDo

2407.04069 2024-10-04 cs.CL cs.AI cs.LG 90%

A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations

Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, Mizanur Rahman, Mohammad Abdullah Matin Khan, Haidar Khan, Israt Jahan, Amran Bhuiyan, Chee Wei Tan, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty, Jimmy Huang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at EMNLP 2024 (Main Conference)

2406.18181 2024-09-26 cs.SE 90%

On the Evaluation of Large Language Models in Unit Test Generation

Lin Yang, Chen Yang, Shutao Gao, Weijing Wang, Bo Wang, Qihao Zhu, Xiao Chu, Jianyi Zhou, Guangtai Liang, Qianxiang Wang, Junjie Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted by ASE 2024, Research Paper Track

2401.08438 2024-09-25 cs.CL cs.AI cs.LG 90%

CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models

Yaojia Lv, Haojie Pan, Zekun Wang, Jiafeng Liang, Yuanxing Liu, Ruiji Fu, Ming Liu, Zhongyuan Wang, Bing Qin

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2024 (Findings)

2311.11415 2024-09-24 cs.CR cs.AI cs.CL cs.HC cs.LG 90%

A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models

Erik Derner, Kristina Batistič, Jan Zahálka, Robert Babuška

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2409.03375 2024-09-06 cs.CL cs.AI cs.LG 90%

Leveraging Large Language Models through Natural Language Processing to provide interpretable Machine Learning predictions of mental deterioration in real time

Francisco de Arriba-Pérez, Silvia García-Méndez

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2409.00091 2024-09-04 cs.CL cs.AI cs.LG 90%

Classification of Safety Events at Nuclear Sites using Large Language Models

Mishca de Costa, Muhammad Anwar, Daniel Lau, Issam Hammad

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Journal ref 43rd Annual CNS Conference and the 48th Annual CNS/CNA Student Conference Sheraton Cavalier Saskatoon Hotel, Saskatoon, SK, Canada, June 16-19, 2024

2408.16296 2024-08-30 cs.CV cs.IR 90%

Rethinking Sparse Lexical Representations for Image Retrieval in the Age of Rising Multi-Modal Large Language Models

Kengo Nakata, Daisuke Miyashita, Youyang Ng, Yasuto Hoshi, Jun Deguchi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted to ECCV 2024 Workshops: 2nd Workshop on Traditional Computer Vision in the Age of Deep Learning (TradiCV)

2311.18743 2024-08-27 cs.CL cs.AI cs.LG 90%

AlignBench: Benchmarking Chinese Alignment of Large Language Models

Xiao Liu, Xuanyu Lei, Shengyuan Wang, Yue Huang, Zhuoer Feng, Bosi Wen, Jiale Cheng, Pei Ke, Yifan Xu, Weng Lam Tam, Xiaohan Zhang, Lichao Sun, Xiaotao Gu, Hongning Wang, Jing Zhang, Minlie Huang, Yuxiao Dong, Jie Tang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024

2408.12263 2024-08-23 cs.CL cs.AI cs.LG 90%

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates

Yusuke Sakai, Adam Nohejl, Jiangnan Hang, Hidetaka Kamigaito, Taro Watanabe

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages, 7 figures

2408.10474 2024-08-21 cs.SE cs.AI cs.CL cs.CR cs.LG 90%

LeCov: Multi-level Testing Criteria for Large Language Models

Xuan Xie, Jiayang Song, Yuheng Huang, Da Song, Fuyuan Zhang, Felix Juefei-Xu, Lei Ma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2408.03281 2024-08-08 cs.CL cs.AI cs.LG 90%

StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation

Boxi Cao, Mengjie Ren, Hongyu Lin, Xianpei Han, Feng Zhang, Junfeng Zhan, Le Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2024;Benchmark at https://github.com/c-box/StructEval ;Leaderboard at https://huggingface.co/spaces/Bowieee/StructEval_leaderboard

2403.10795 2024-08-08 cs.CL cs.AI cs.LG cs.RO 90%

Can Large Language Models Solve Robot Routing?

Zhehui Huang, Guangyao Shi, Gaurav S. Sukhatme

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Submitted to International Symposium of Robotics Research (ISRR 2024)

2307.12469 2024-07-30 cs.CR 90%

How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation

Cen Zhang, Yaowen Zheng, Mingqiang Bai, Yeting Li, Wei Ma, Xiaofei Xie, Yuekang Li, Limin Sun, Yang Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 13 pages, 9 figures

Journal ref ISSTA 2024

2307.06290 2024-07-30 cs.CL cs.AI cs.LG 90%

Instruction Mining: Instruction Data Selection for Tuning Large Language Models

Yihan Cao, Yanbin Kang, Chi Wang, Lichao Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 24 pages, 7 figures

2307.04346 2024-07-23 cs.SE 90%

Can Large Language Models Write Good Property-Based Tests?

Vasudev Vikram, Caroline Lemieux, Joshua Sunshine, Rohan Padhye

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2407.10817 2024-07-16 cs.CL cs.AI cs.LG 90%

Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Tu Vu, Kalpesh Krishna, Salaheddin Alzubi, Chris Tar, Manaal Faruqui, Yun-Hsuan Sung

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 31 pages, 5 figures, 7 tables

2406.10552 2024-07-09 cs.CL cs.AI cs.LG 90%

Large Language Model Enhanced Clustering for News Event Detection

Adane Nega Tarekegn

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.01781 2024-07-04 cs.CL cs.AI cs.LG 90%

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, Sultan Alrashed, Shaykhah Alsubaie, Yusef Almushaykeh, Faisal Mirza, Nouf Alotaibi, Nora Altwairesh, Areeb Alowisheq, M Saiful Bari, Haidar Khan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments updated with ACL 2024 camera ready version

2407.01725 2024-07-03 cs.CL cs.AI cs.LG 90%

DiscoveryBench: Towards Data-Driven Discovery with Large Language Models

Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Bhavana Dalvi Mishra, Abhijeetsingh Meena, Aryan Prakhar, Tirth Vora, Tushar Khot, Ashish Sabharwal, Peter Clark

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Website: https://github.com/allenai/discoverybench

2406.11434 2024-06-18 cs.DB 90%

DB-GPT-Hub: Towards Open Benchmarking Text-to-SQL Empowered by Large Language Models

Fan Zhou, Siqiao Xue, Danrui Qi, Wenhui Shi, Wang Zhao, Ganglin Wei, Hongyang Zhang, Caigai Jiang, Gangwei Jiang, Zhixuan Chu, Faqiang Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2406.10890 2024-06-18 cs.CL cs.AI cs.LG 90%

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

Zhuoran Jin, Pengfei Cao, Chenhao Wang, Zhitao He, Hongbang Yuan, Jiachun Li, Yubo Chen, Kang Liu, Jun Zhao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 48 pages, 7 figures, 12 tables

2406.04845 2024-06-10 cs.CL cs.AI cs.DC cs.LG cs.MA 90%

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

Rui Ye, Rui Ge, Xinyu Zhu, Jingyi Chai, Yaxin Du, Yang Liu, Yanfeng Wang, Siheng Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 22 pages

2402.05044 2024-06-10 cs.CL cs.AI cs.CR cs.LG 90%

SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models

Lijun Li, Bowen Dong, Ruohui Wang, Xuhao Hu, Wangmeng Zuo, Dahua Lin, Yu Qiao, Jing Shao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at ACL 2024 Findings

1. 评测与基准 31906 篇

Are Large Language Models Chameleons? An Attempt to Simulate Social Surveys

ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction

Diagnosing Robotics Systems Issues with Large Language Models

Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

CliBench: A Multifaceted and Multigranular Evaluation of Large Language Models for Clinical Decision Making

Visual Question Decomposition on Multimodal Large Language Models

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models

A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations

On the Evaluation of Large Language Models in Unit Test Generation

CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models

A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Models

Leveraging Large Language Models through Natural Language Processing to provide interpretable Machine Learning predictions of mental deterioration in real time

Classification of Safety Events at Nuclear Sites using Large Language Models

Rethinking Sparse Lexical Representations for Image Retrieval in the Age of Rising Multi-Modal Large Language Models

AlignBench: Benchmarking Chinese Alignment of Large Language Models

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates

LeCov: Multi-level Testing Criteria for Large Language Models

StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation

Can Large Language Models Solve Robot Routing?

How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation

Instruction Mining: Instruction Data Selection for Tuning Large Language Models

Can Large Language Models Write Good Property-Based Tests?

Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Large Language Model Enhanced Clustering for News Event Detection

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

DiscoveryBench: Towards Data-Driven Discovery with Large Language Models

DB-GPT-Hub: Towards Open Benchmarking Text-to-SQL Empowered by Large Language Models

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language Models