语言大模型 / LLM - arXivDaily 专题

2310.18454 2023-10-31 cs.CL cs.LG 88%

T5 meets Tybalt: Author Attribution in Early Modern English Drama Using Large Language Models

Rebecca M. M. Hicke, David Mimno

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published in CHR 2023

2310.12580 2023-10-24 cs.CL cs.AI 88%

Pretraining Language Models with Text-Attributed Heterogeneous Graphs

Tao Zou, Le Yu, Yifei Huang, Leilei Sun, Bowen Du

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2023 Findings

2310.13343 2023-10-23 cs.CL cs.AI 88%

Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

Xiaoliang Chen, Liangbin Li, Le Chang, Yunhe Huang, Yuxuan Zhao, Yuxiao Zhang, Dinuo Li

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2310.13013 2023-10-23 cs.CL cs.AI cs.SD eess.AS 88%

Generative error correction for code-switching speech recognition using large language models

Chen Chen, Yuchen Hu, Chao-Han Huck Yang, Hexin Liu, Sabato Marco Siniscalchi, Eng Siong Chng

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Submitted to ICASSP2024

2310.09536 2023-10-17 cs.CL cs.IR cs.LG 88%

CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answering

Md Rashad Al Hasan Rony, Christian Suess, Sinchana Ramakanth Bhat, Viju Sudhi, Julia Schneider, Maximilian Vogel, Roman Teucher, Ken E. Friedl, Soumya Sahoo

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted into EMNLP 2023 (industry track), corresponding Author: Md Rashad Al Hasan Rony

2310.03376 2023-10-06 cs.CL cs.AI cs.IT math.IT 88%

Procedural Text Mining with Large Language Models

Anisa Rula, Jennifer D'Souza

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 8 pages, 4 figures, Accepted to The Twelfth International Conference on Knowledge Capture (K-Cap 2023)

2308.14921 2023-08-30 cs.CL cs.CY cs.LG 88%

Gender bias and stereotypes in Large Language Models

Hadas Kotek, Rikker Dockum, David Q. Sun

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACM Collective Intelligence

Journal ref In Collective Intelligence Conference (CI '23), November 06-09, 2023, Delft, Netherlands. ACM, New York, NY, USA (2023)

2308.08610 2023-08-21 cs.CL cs.AI 88%

FootGPT : A Large Language Model Development Experiment on a Minimal Setting

Eren Unlu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 3 figures

2211.08411 2023-07-28 cs.CL cs.LG 88%

Large Language Models Struggle to Learn Long-Tail Knowledge

Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, Colin Raffel

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICML 2023 Camera Ready Version

2306.14583 2023-06-27 cs.CL cs.AI cs.SE 88%

Exploring the Robustness of Large Language Models for Solving Programming Problems

Atsushi Shirafuji, Yutaka Watanobe, Takumi Ito, Makoto Morishita, Yuki Nakamura, Yusuke Oda, Jun Suzuki

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2306.07567 2023-06-19 cs.LG cs.CL 88%

Large Language Models Sometimes Generate Purely Negatively-Reinforced Text

Fabien Roger

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 6 pages, 5 figures, LaTeX; added a related work section

2305.11759 2023-05-22 cs.CL cs.AI 88%

Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning

Mustafa Safa Ozdayi, Charith Peris, Jack FitzGerald, Christophe Dupuy, Jimit Majmudar, Haidar Khan, Rahil Parikh, Rahul Gupta

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 5 pages, 3 Figures, ACL 2023

2302.01339 2023-05-10 cs.CL cs.AI 88%

Creating a Large Language Model of a Philosopher

Eric Schwitzgebel, David Schwitzgebel, Anna Strasser

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Earlier version (Nov 2, 2022) available at http://www.faculty.ucr.edu/~eschwitz/SchwitzPapers/GPT-3-Dennett-221102.pdf; stable URL for updated versions http://faculty.ucr.edu/~eschwitz/SchwitzAbs/GPT3Dennett.htm

2304.09948 2023-04-21 cs.CL cs.AI 88%

Catch Me If You Can: Identifying Fraudulent Physician Reviews with Large Language Models Using Generative Pre-Trained Transformers

Aishwarya Deep Shukla, Laksh Agarwal, Jie Mein, Goh, Guodong, Gao, Ritu Agarwal

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2303.14425 2023-03-28 cs.CL cs.AI 88%

Sem4SAP: Synonymous Expression Mining From Open Knowledge Graph For Language Model Synonym-Aware Pretraining

Zhouhong Gu, Sihang Jiang, Wenhao Huang, Jiaqing Liang, Hongwei Feng, Yanghua Xiao

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI

2110.05679 2022-11-11 cs.LG cs.CL 88%

Large Language Models Can Be Strong Differentially Private Learners

Xuechen Li, Florian Tramèr, Percy Liang, Tatsunori Hashimoto

专题命中预训练与数据：language model(title,abstract)；large language model(title)；pretraining(abstract)；分类 cs.CL、cs.LG

Comments 31 pages; update ethics statement to clarify benefits and potential long-term harms

2208.12367 2022-08-30 cs.CL cs.LG 88%

A Compact Pretraining Approach for Neural Language Models

Shahriar Golchin, Mihai Surdeanu, Nazgol Tavabi, Ata Kiapour

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments First Version

2208.02957 2022-08-15 cs.CL cs.AI 88%

Meaning without reference in large language models

Steven T. Piantadosi, Felix Hill

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2108.10904 2022-05-17 cs.CV cs.CL cs.LG 88%

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments Published at ICLR 2022

2204.05832 2022-04-13 cs.CL cs.LG stat.ML 88%

What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?

Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

2204.01959 2022-04-06 cs.CL cs.AI 88%

Data Augmentation for Intent Classification with Off-the-shelf Large Language Models

Gaurav Sahu, Pau Rodriguez, Issam H. Laradji, Parmida Atighehchian, David Vazquez, Dzmitry Bahdanau

专题命中预训练与数据：language model(title,abstract)；large language model(title)；prompting(abstract)；分类 cs.CL、cs.AI

Comments Accepted to 4th Workshop on NLP for Conversational AI, ACL 2022

2203.15827 2022-03-31 cs.CL cs.LG 88%

LinkBERT: Pretraining Language Models with Document Links

Michihiro Yasunaga, Jure Leskovec, Percy Liang

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments Published at ACL 2022. Code, data, and pretrained models are available at https://github.com/michiyasunaga/LinkBERT

2102.08473 2021-10-28 cs.CL cs.LG 88%

COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments NeurIPS 2021. (Code and Models: https://github.com/microsoft/COCO-LM)

2007.15779 2021-09-20 cs.CL cs.LG 88%

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments ACM Transactions on Computing for Healthcare (HEALTH)

2012.07805 2021-06-16 cs.CR cs.CL cs.LG 88%

Extracting Training Data from Large Language Models

Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, Alina Oprea, Colin Raffel

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2104.10649 2021-06-01 cs.CL cs.AI 88%

K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining

Ruiqing Yan, Lanchang Sun, Fang Wang, Xiaoming Zhang

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI

2007.00655 2021-02-05 cs.CL cs.LG stat.ML 88%

Knowledge-Aware Language Model Pretraining

Corby Rosset, Chenyan Xiong, Minh Phan, Xia Song, Paul Bennett, Saurabh Tiwary

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

2007.14587 2020-07-30 cs.CV cs.CL cs.LG 88%

Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining

TJ Tsai, Kevin Ji

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments 8 pages, 7 figures. Accepted paper at the International Society for Music Information Retrieval Conference (ISMIR) 2020

2004.10964 2020-05-07 cs.CL cs.LG 88%

Don't Stop Pretraining: Adapt Language Models to Domains and Tasks

Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, Noah A. Smith

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments ACL 2020

1809.01962 2018-09-07 cs.CL cs.LG 88%

Code-switched Language Models Using Dual RNNs and Same-Source Pretraining

Saurabh Garg, Tanmay Parekh, Preethi Jyothi

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at EMNLP 2018

1. 预训练与数据 12353 篇

T5 meets Tybalt: Author Attribution in Early Modern English Drama Using Large Language Models

Pretraining Language Models with Text-Attributed Heterogeneous Graphs

Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

Generative error correction for code-switching speech recognition using large language models

CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answering

Procedural Text Mining with Large Language Models

Gender bias and stereotypes in Large Language Models

FootGPT : A Large Language Model Development Experiment on a Minimal Setting

Large Language Models Struggle to Learn Long-Tail Knowledge

Exploring the Robustness of Large Language Models for Solving Programming Problems

Large Language Models Sometimes Generate Purely Negatively-Reinforced Text

Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning

Creating a Large Language Model of a Philosopher

Catch Me If You Can: Identifying Fraudulent Physician Reviews with Large Language Models Using Generative Pre-Trained Transformers

Sem4SAP: Synonymous Expression Mining From Open Knowledge Graph For Language Model Synonym-Aware Pretraining

Large Language Models Can Be Strong Differentially Private Learners

A Compact Pretraining Approach for Neural Language Models

Meaning without reference in large language models

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?

Data Augmentation for Intent Classification with Off-the-shelf Large Language Models

LinkBERT: Pretraining Language Models with Document Links

COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Extracting Training Data from Large Language Models

K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining

Knowledge-Aware Language Model Pretraining

Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining

Don't Stop Pretraining: Adapt Language Models to Domains and Tasks

Code-switched Language Models Using Dual RNNs and Same-Source Pretraining