语言大模型 / LLM - arXivDaily 专题

2310.15123 2024-06-10 cs.CL cs.AI cs.LG 90%

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation

Swarnadeep Saha, Omer Levy, Asli Celikyilmaz, Mohit Bansal, Jason Weston, Xian Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NAACL 2024 (19 pages, 7 figures, 11 tables)

2406.00083 2024-06-07 cs.CR cs.AI cs.CL cs.IR cs.LG 90%

BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

Jiaqi Xue, Mengxin Zheng, Yebowen Hu, Fei Liu, Xun Chen, Qian Lou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.17811 2024-06-06 cs.CL cs.AI cs.LG 90%

TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space

Shaolei Zhang, Tian Yu, Yang Feng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024 main conference, Project Page: https://ictnlp.github.io/TruthX-site/

2312.04455 2024-06-05 cs.CL cs.AI cs.LG 90%

Fortify the Shortest Stave in Attention: Enhancing Context Awareness of Large Language Models for Effective Tool Use

Yuhan Chen, Ang Lv, Ting-En Lin, Changyu Chen, Yuchuan Wu, Fei Huang, Yongbin Li, Rui Yan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2024 main

2402.15043 2024-06-04 cs.CL cs.AI cs.LG 90%

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Wei Ye, Jindong Wang, Xing Xie, Yue Zhang, Shikun Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2024 (main conference); 19 pages, 5 figures, 19 tables, code is available at: https://github.com/zhuohaoyu/KIEval

2402.15938 2024-06-03 cs.CL cs.AI cs.CR cs.LG cs.SE 90%

Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

Yihong Dong, Xue Jiang, Huanyu Liu, Zhi Jin, Bin Gu, Mengfei Yang, Ge Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL

2405.16136 2024-05-28 cs.AI cs.CL cs.LG cs.SD eess.AS 90%

C3LLM: Conditional Multimodal Content Generation Using Large Language Models

Zixuan Wang, Qinkai Duan, Yu-Wing Tai, Chi-Keung Tang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2311.16543 2024-05-22 cs.AR 90%

RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Models

Yun-Da Tsai, Mingjie Liu, Haoxing Ren

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2403.12403 2024-05-09 cs.CL cs.AI cs.LG 90%

Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationales

Ayushi Nirmal, Amrita Bhattacharjee, Paras Sheth, Huan Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Camera-ready for NAACL WOAH 2024 (Workshop on Online Abuse and Harms). First two authors contributed equally

2404.13013 2024-04-22 cs.CV cs.AI cs.CL cs.LG 90%

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

Chuofan Ma, Yi Jiang, Jiannan Wu, Zehuan Yuan, Xiaojuan Qi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

2310.17722 2024-04-17 cs.LG cs.AI cs.CL 90%

Large Language Models as Generalizable Policies for Embodied Tasks

Andrew Szot, Max Schwarzer, Harsh Agrawal, Bogdan Mazoure, Walter Talbott, Katherine Metcalf, Natalie Mackraz, Devon Hjelm, Alexander Toshev

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2310.17526 2024-04-11 cs.CL cs.AI cs.LG 90%

Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages

Qusai Khraisha, Sophie Put, Johanna Kappenberg, Azza Warraitch, Kristin Hadfield

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 2 figures, 1 table

2404.02456 2024-04-08 cs.CL cs.AI cs.LG cs.SD eess.AS 90%

PhonologyBench: Evaluating Phonological Skills of Large Language Models

Ashima Suvarna, Harshita Khandelwal, Nanyun Peng

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 17 pages, 7 figures, 6 tables

2404.00942 2024-04-02 cs.CL cs.AI cs.LG 90%

Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs

Xiaoze Liu, Feijie Wu, Tianyang Xu, Zhuo Chen, Yichi Zhang, Xiaoqian Wang, Jing Gao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2305.15852 2024-03-19 cs.CL cs.AI cs.LG 90%

Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation

Niels Mündler, Jingxuan He, Slobodan Jenko, Martin Vechev

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

2306.08018 2024-03-05 q-bio.QM cs.AI cs.CE cs.CL cs.IR cs.LG 90%

Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models

Yin Fang, Xiaozhuan Liang, Ningyu Zhang, Kangwei Liu, Rui Huang, Zhuo Chen, Xiaohui Fan, Huajun Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2024. Project homepage: https://github.com/zjunlp/Mol-Instructions

2310.04668 2024-02-27 cs.LG cs.AI cs.CL 90%

Label-free Node Classification on Graphs with Large Language Models (LLMS)

Zhikai Chen, Haitao Mao, Hongzhi Wen, Haoyu Han, Wei Jin, Haiyang Zhang, Hui Liu, Jiliang Tang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The code is available via https://github.com/CurryTang/LLMGNN; ICLR 2024

2308.08493 2024-02-23 cs.CL cs.AI cs.CR cs.LG 90%

Time Travel in LLMs: Tracing Data Contamination in Large Language Models

Shahriar Golchin, Mihai Surdeanu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published at ICLR 2024 as a Spotlight paper (notable top 5%)

2309.10245 2024-01-23 cs.HC 90%

Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models

Hyung-Kwon Ko, Hyeon Jeon, Gwanmo Park, Dae Hyun Kim, Nam Wook Kim, Juho Kim, Jinwook Seo

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments 22 pages, 5 figures

Journal ref In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA

2310.02567 2024-01-11 cs.CV cs.AI cs.CL cs.LG 90%

Improving Automatic VQA Evaluation Using Large Language Models

Oscar Mañas, Benno Krojer, Aishwarya Agrawal

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at AAAI 2024 (main track)

2312.09300 2023-12-18 cs.CL cs.AI cs.LG 90%

Self-Evaluation Improves Selective Generation in Large Language Models

Jie Ren, Yao Zhao, Tu Vu, Peter J. Liu, Balaji Lakshminarayanan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2311.14126 2023-11-27 cs.CL cs.AI cs.CY cs.LG 90%

Towards Auditing Large Language Models: Improving Text-based Stereotype Detection

Wu Zekun, Sahan Bulathwela, Adriano Soares Koshiyama

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 2023 NeurIPS SoLaR Workshop Accepted

2311.07911 2023-11-15 cs.CL cs.AI cs.LG 90%

Instruction-Following Evaluation for Large Language Models

Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, Le Hou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2311.05720 2023-11-13 cs.CL cs.AI cs.LG 90%

Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models

Simon Stepputtis, Joseph Campbell, Yaqi Xie, Zhengyang Qi, Wenxin Sharon Zhang, Ruiyi Wang, Sanketh Rangreji, Michael Lewis, Katia Sycara

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP, Findings of the Association for Computational Linguistics)

2311.04532 2023-11-10 cs.SE 90%

Evaluating Diverse Large Language Models for Automatic and General Bug Reproduction

Sungmin Kang, Juyeon Yoon, Nargiz Askarbekkyzy, Shin Yoo

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments This work is an extension of our prior work, available at arXiv:2209.11515

2304.00457 2023-10-13 cs.CL cs.AI cs.GR cs.LG 90%

LLMMaps -- A Visual Metaphor for Stratified Evaluation of Large Language Models

Patrik Puchert, Poonam Poonam, Christian van Onzenoodt, Timo Ropinski

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2309.10917 2023-09-21 eess.AS cs.AI cs.CL cs.LG cs.SD 90%

End-to-End Speech Recognition Contextualization with Large Language Models

Egor Lakomkin, Chunyang Wu, Yassir Fathullah, Ozlem Kalinli, Michael L. Seltzer, Christian Fuegen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2309.07623 2023-09-15 cs.CV 90%

SwitchGPT: Adapting Large Language Models for Non-Text Outputs

Xinyu Wang, Bohan Zhuang, Qi Wu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；pretraining(abstract)

2308.01415 2023-08-04 cs.CL cs.AI cs.LG 90%

An Effective Data Creation Pipeline to Generate High-quality Financial Instruction Data for Large Language Model

Ziao Wang, Jianning Wang, Junda Wu, Xiaofeng Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments (FinLLM 2023)@IJCAI 2023

2307.04251 2023-07-18 cs.CL cs.AI cs.LG 90%

ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey

Salman Mohamadi, Ghulam Mujtaba, Ngan Le, Gianfranco Doretto, Donald A. Adjeroh

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The paper was uploaded in error, before it was ready for submission. The paper requires a deep revision, and significant changes and modifications before uploading to the archive

1. 评测与基准 31906 篇

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation

BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space

Fortify the Shortest Stave in Attention: Enhancing Context Awareness of Large Language Models for Effective Tool Use

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models

C3LLM: Conditional Multimodal Content Generation Using Large Language Models

RTLFixer: Automatically Fixing RTL Syntax Errors with Large Language Models

Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationales

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

Large Language Models as Generalizable Policies for Embodied Tasks

Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages

PhonologyBench: Evaluating Phonological Skills of Large Language Models

Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs

Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation

Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models

Label-free Node Classification on Graphs with Large Language Models (LLMS)

Time Travel in LLMs: Tracing Data Contamination in Large Language Models

Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models

Improving Automatic VQA Evaluation Using Large Language Models

Self-Evaluation Improves Selective Generation in Large Language Models

Towards Auditing Large Language Models: Improving Text-based Stereotype Detection

Instruction-Following Evaluation for Large Language Models

Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models

Evaluating Diverse Large Language Models for Automatic and General Bug Reproduction

LLMMaps -- A Visual Metaphor for Stratified Evaluation of Large Language Models

End-to-End Speech Recognition Contextualization with Large Language Models

SwitchGPT: Adapting Large Language Models for Non-Text Outputs

An Effective Data Creation Pipeline to Generate High-quality Financial Instruction Data for Large Language Model

ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey