语言大模型 / LLM

Generative Adversarial Training Can Improve Neural Language Models

Sajad Movahedi, Azadeh Shakery

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments An extended abstract selected for poster presentation at the Eastern European Machine Learning Summer School 2019

Collateral facilitation in humans and language models

James A. Michaelov, Benjamin K. Bergen

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at CoNLL 2022

Language Model Pre-Training with Sparse Latent Typing

Liliang Ren, Zixuan Zhang, Han Wang, Clare R. Voss, Chengxiang Zhai, Heng Ji

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2022 (Oral)

Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models

Mengzhou Xia, Mikel Artetxe, Jingfei Du, Danqi Chen, Ves Stoyanov

专题命中 其他LLM ：prompting(title)；language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted to EMNLP 2022; The code is available at https://github.com/facebookresearch/ELECTRA-Fewshot-Learning

Are Large Pre-Trained Language Models Leaking Your Personal Information?

Jie Huang, Hanyin Shao, Kevin Chen-Chuan Chang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of EMNLP 2022

Mitigating Unintended Memorization in Language Models via Alternating Teaching

Zhe Liu, Xuedong Zhang, Fuchun Peng

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasures

Eugene Bagdasaryan, Vitaly Shmatikov

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments IEEE S&P 2022. arXiv admin note: text overlap with arXiv:2107.10443

Making Pretrained Language Models Good Long-tailed Learners

Chen Zhang, Lei Ren, Jingang Wang, Wei Wu, Dawei Song

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 15 pages, 4 figures, 10 tables, accepted to EMNLP 2022. Code is available at https://github.com/GeneZC/Glee

Towards Interactive Language Modeling

Maartje ter Hoeve, Evgeny Kharitonov, Dieuwke Hupkes, Emmanuel Dupoux

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Negation, Coordination, and Quantifiers in Contextualized Language Models

Aikaterini-Lida Kalouli, Rita Sevastjanova, Christin Beck, Maribel Romero

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

On Unsupervised Training of Link Grammar Based Language Models

Nikolay Mikhaylovskiy

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Presented at INLP workshop at AGI-2022

Analyzing Encoded Concepts in Transformer Language Models

Hassan Sajjad, Nadir Durrani, Fahim Dalvi, Firoj Alam, Abdul Rafae Khan, Jia Xu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 20 pages, 10 figures

Journal ref 2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics

Text-Free Prosody-Aware Generative Spoken Language Modeling

Eugene Kharitonov, Ann Lee, Adam Polyak, Yossi Adi, Jade Copet, Kushal Lakhotia, Tu-Anh Nguyen, Morgane Rivière, Abdelrahman Mohamed, Emmanuel Dupoux, Wei-Ning Hsu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACL 2022

Evaluating BERT-based Pre-training Language Models for Detecting Misinformation

Rini Anggrainingsih, Ghulam Mubashar Hassan, Amitava Datta

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 17 pages, 2 figures, 10 tables

Exposing the Implicit Energy Networks behind Masked Language Models via Metropolis--Hastings

Kartik Goyal, Chris Dyer, Taylor Berg-Kirkpatrick

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICLR 2022 - camera ready

Examining Scaling and Transfer of Language Model Architectures for Machine Translation

Biao Zhang, Behrooz Ghorbani, Ankur Bapna, Yong Cheng, Xavier Garcia, Jonathan Shen, Orhan Firat

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

StonkBERT: Can Language Models Predict Medium-Run Stock Price Movements?

Stefan Pasch, Daniel Ehnes

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Language Models Explain Word Reading Times Better Than Empirical Predictability

Markus J. Hofmann, Steffen Remus, Chris Biemann, Ralph Radach, Lars Kuchinke

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref Frontiers in Artificial Intelligence, 4(730570), 1-20 (2022)

Pre-trained Language Models as Prior Knowledge for Playing Text-based Games

Ishika Singh, Gargi Singh, Ashutosh Modi

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 40 Pages (8 Pages main content + 1 Page references + 31 Pages Appendix). Some new results added

Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning

Amal Alabdulkarim, Winston Li, Lara J. Martin, Mark O. Riedl

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments preprint

Simple Text Detoxification by Identifying a Linear Toxic Subspace in Language Model Embeddings

Andrew Wang, Mohit Sudhakar, Yangfeng Ji

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Sparse Interventions in Language Models with Differentiable Masking

Nicola De Cao, Leon Schmid, Dieuwke Hupkes, Ivan Titov

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 12 pages, 4 figures, 6 tables

SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training

Ankur Bapna, Yu-an Chung, Nan Wu, Anmol Gulati, Ye Jia, Jonathan H. Clark, Melvin Johnson, Jason Riesa, Alexis Conneau, Yu Zhang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Language Models As or For Knowledge Bases

Simon Razniewski, Andrew Yates, Nora Kassner, Gerhard Weikum

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref DL4KG 2021

LM-Critic: Language Models for Unsupervised Grammatical Error Correction

Michihiro Yasunaga, Jure Leskovec, Percy Liang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2021. Code & data available at https://github.com/michiyasunaga/LM-Critic

BadPre: Task-agnostic Backdoor Attacks to Pre-trained NLP Foundation Models

Kangjie Chen, Yuxian Meng, Xiaofei Sun, Shangwei Guo, Tianwei Zhang, Jiwei Li, Chun Fan

专题命中 其他LLM ：foundation model(title)；language model(abstract)；分类 cs.CL、cs.AI

TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models

Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICML 2021

Language Models are Few-Shot Butlers

Vincent Micheli, François Fleuret

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2021

Language Models are Few-shot Multilingual Learners

Genta Indra Winata, Andrea Madotto, Zhaojiang Lin, Rosanne Liu, Jason Yosinski, Pascale Fung

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 14 pages

Towards Continual Entity Learning in Language Models for Conversational Agents

Ravi Teja Gadde, Ivan Bulyko

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Submitted to NeurIPS 2021. Paper is under review