语言大模型 / LLM

All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality

William Timkey, Marten van Schijndel

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at EMNLP 2021

Multilingual Chart-based Constituency Parse Extraction from Pre-trained Language Models

Taeuk Kim, Bowen Li, Sang-goo Lee

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2021 Findings

ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 edition

Afra Alishahi, Grzegorz Chrupała, Alejandrina Cristia, Emmanuel Dupoux, Bertrand Higy, Marvin Lavechin, Okko Räsänen, Chen Yu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Intersectional Bias in Causal Language Models

Liam Magee, Lida Ghahremanlou, Karen Soldatic, Shanthi Robertson

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 18 pages, 4 figures

Multimodal Few-Shot Learning with Frozen Language Models

Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, S. M. Ali Eslami, Oriol Vinyals, Felix Hill

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Librispeech Transducer Model with Internal Language Model Prior Correction

Albert Zeyer, André Merboldt, Wilfried Michel, Ralf Schlüter, Hermann Ney

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments accepted at Interspeech 2021

Alternating Recurrent Dialog Model with Large-scale Pre-trained Language Models

Qingyang Wu, Yichi Zhang, Yu Li, Zhou Yu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EACL 2021 (oral)

Detoxifying Language Models Risks Marginalizing Minority Voices

Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments NAACL 2021

Language model fusion for streaming end to end speech recognition

Rodrigo Cabrera, Xiaofeng Liu, Mohammadreza Ghodsi, Zebulun Matteson, Eugene Weinstein, Anjuli Kannan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 5 pages

LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring

Anton Mitrofanov, Mariya Korenevskaya, Ivan Podluzhny, Yuri Khokhlov, Aleksandr Laptev, Andrei Andrusenko, Aleksei Ilin, Maxim Korenevsky, Ivan Medennikov, Aleksei Romanenko

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Submitted to InterSpeech 2021

Alignment of Language Agents

Zachary Kenton, Tom Everitt, Laura Weidinger, Iason Gabriel, Vladimir Mikulik, Geoffrey Irving

专题命中 其他LLM ：language agent(title,abstract)；分类 cs.AI、cs.LG

Trojaning Language Models for Fun and Profit

Xinyang Zhang, Zheng Zhang, Shouling Ji, Ting Wang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Additional experiments and text editing; To appear in 2021 6th IEEE European Symposium on Security and Privacy

COVID-19 Tweets Analysis through Transformer Language Models

Abdul Hameed Azeemi, Adeel Waheed

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 5 pages, 5 figures

Automatic Code Generation using Pre-Trained Language Models

Luis Perez, Lizi Ottens, Sudharshan Viswanathan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 11 figures

Self-Training Pre-Trained Language Models for Zero- and Few-Shot Multi-Dialectal Arabic Sequence Labeling

Muhammad Khalifa, Muhammad Abdul-Mageed, Khaled Shaalan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at EACL 2021 (Camera Ready Version)

Contextual Temperature for Language Modeling

Pei-Hsin Wang, Sheng-Iou Hsieh, Shih-Chieh Chang, Yu-Ting Chen, Jia-Yu Pan, Wei Wei, Da-Chang Juan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog

Erik Ekstedt, Gabriel Skantze

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of ACL: EMNLP 2020

KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning

Bin He, Xin Jiang, Jinghui Xiao, Qun Liu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 3 figures

Blank Language Models

Tianxiao Shen, Victor Quach, Regina Barzilay, Tommi Jaakkola

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2020 camera-ready

Warped Language Models for Noise Robust Language Understanding

Mahdi Namazifar, Gokhan Tur, Dilek Hakkani Tür

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments To appear at IEEE SLT 2021

On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling

Rajat Patel, Francis Ferraro

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments To appear at the EMNLP 2020 Workshop on Deep Learning Inside Out

BERTweet: A pre-trained language model for English Tweets

Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments In Proceedings of EMNLP 2020: System Demonstrations

Consistency of a Recurrent Language Model With Respect to Incomplete Decoding

Sean Welleck, Ilia Kulikov, Jaedeok Kim, Richard Yuanzhe Pang, Kyunghyun Cho

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2020

QiaoNing at SemEval-2020 Task 4: Commonsense Validation and Explanation system based on ensemble of language model

Pai Liu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

6VecLM: Language Modeling in Vector Space for IPv6 Target Generation

Tianyu Cui, Gang Xiong, Gaopeng Gou, Junzheng Shi, Wei Xia

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments The paper has been accepted at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECMLPKDD 2020) (accepted/#ADSTab" target="_blank" rel="noopener">https://ecmlpkdd2020.net/programme/accepted/#ADSTab)

What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models

Allyson Ettinger

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Exploring Software Naturalness through Neural Language Models

Luca Buratti, Saurabh Pujar, Mihaela Bornea, Scott McCarley, Yunhui Zheng, Gaetano Rossiello, Alessandro Morari, Jim Laredo, Veronika Thost, Yufan Zhuang, Giacomo Domeniconi

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Position Masking for Language Models

Andy Wagner, Tiyasa Mitra, Mrinal Iyer, Godfrey Da Costa, Marc Tremblay

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Examination and Extension of Strategies for Improving Personalized Language Modeling via Interpolation

Liqun Shao, Sahitya Mantravadi, Tom Manzini, Alejandro Buendia, Manon Knoertzer, Soundar Srinivasan, Chris Quirk

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACL Natural Language Interface Workshop 2020, short paper

Unsupervised Paraphrase Generation using Pre-trained Language Models

Chaitra Hegde, Shrikumar Patil

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG