语言大模型 / LLM - arXivDaily 专题

2109.14723 2021-10-01 cs.CL 79%

BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief

Nora Kassner, Oyvind Tafjord, Hinrich Schütze, Peter Clark

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2021 Camera Ready. arXiv admin note: substantial text overlap with arXiv:2104.08401

2105.03994 2021-08-02 cs.CL 79%

Dispatcher: A Message-Passing Approach To Language Modelling

Alberto Cetoli

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2009.03954 2021-06-25 cs.CL cs.NE 79%

Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling

Yiding Hao, Simon Mendelsohn, Rachel Sterneck, Randi Martinez, Robert Frank

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments To appear in the proceedings of the Cognitive Modeling and Computational Linguistics workshop (CMCL) at EMNLP 2020

2106.08367 2021-06-17 cs.CL 79%

What Context Features Can Transformer Language Models Use?

Joe O'Connor, Jacob Andreas

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 14 pages, 7 figures, to be published at ACL 2021

2012.15832 2021-06-04 cs.CL 79%

Shortformer: Better Language Modeling using Shorter Inputs

Ofir Press, Noah A. Smith, Mike Lewis

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments To appear at ACL 2021

2103.00751 2021-03-02 cs.CL 79%

Long Document Summarization in a Low Resource Setting using Pretrained Language Models

Ahsaas Bajaj, Pavitra Dangati, Kalpesh Krishna, Pradhiksha Ashok Kumar, Rheeya Uppaal, Bradford Windsor, Eliot Brenner, Dominic Dotterrer, Rajarshi Das, Andrew McCallum

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2102.02557 2021-02-05 cs.CL 79%

Adaptive Semiparametric Language Models

Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted to TACL, pre MIT Press publication version

2010.15437 2020-10-30 cs.CL 79%

Memory Attentive Fusion: External Language Model Integration for Transformer-based Sequence-to-Sequence Model

Mana Ihori, Ryo Masumura, Naoki Makishima, Tomohiro Tanaka, Akihiko Takashima, Shota Orihashi

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted as a short paper at INLG 2020

2010.04887 2020-10-13 cs.CL 79%

Discourse structure interacts with reference but not syntax in neural language models

Forrest Davis, Marten van Schijndel

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Proceedings of the 2020 Conference on Computational Natural Language Learning (CoNLL 2020)

2008.01832 2020-08-06 eess.AS cs.CL cs.SD 79%

Future Vector Enhanced LSTM Language Model for LVCSR

Qi Liu, Yanmin Qian, Kai Yu

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted by ASRU-2017

2008.01532 2020-08-05 cs.CL cs.SD eess.AS 79%

A Study on Effects of Implicit and Explicit Language Model Information for DBLSTM-CTC Based Handwriting Recognition

Qi Liu, Lijuan Wang, Qiang Huo

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Accepted by ICDAR-2015

1909.03186 2020-04-29 cs.CL 79%

On Extractive and Abstractive Neural Document Summarization with Transformer Language Models

Sandeep Subramanian, Raymond Li, Jonathan Pilault, Christopher Pal

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

2003.01509 2020-03-05 cs.CL cs.SD eess.AS 79%

Improving Uyghur ASR systems with decoders using morpheme-based language models

Zicheng Qiu, Wei Jiang, Turghunjan Mamut

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 4 figures, 5 tables

1909.00556 2019-09-04 cs.CL 79%

Phrase-Level Class based Language Model for Mandarin Smart Speaker Query Recognition

Yiheng Huang, Liqiang He, Lei Han, Guangsen Wang, Dan Su

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 3 figures and 3 tables

1906.09379 2019-06-25 cs.CL 79%

Evaluating Computational Language Models with Scaling Properties of Natural Language

Shuntaro Takahashi, Kumiko Tanaka-Ishii

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 32 pages, accepted by Computational Linguistics

1904.06234 2019-04-15 cs.CL 79%

IIT (BHU) Varanasi at MSR-SRST 2018: A Language Model Based Approach for Natural Language Generation

Shreyansh Singh, Avi Chawla, Ayush Sharma, Anil Kumar Singh

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Journal ref Proceedings of the 1st Workshop on Multilingual Surface Realisation (MSR), 56th Annual Meeting of the Association for Computational Linguistics (ACL), July 2018, Melbourne, Australia

1808.09091 2018-08-29 cs.CL 79%

Disfluency Detection using a Noisy Channel Model and a Deep Neural Language Model

Paria Jamshid Lou, Mark Johnson

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

1804.08881 2018-04-25 cs.CL 79%

Assessing Language Models with Scaling Properties

Shuntaro Takahashi, Kumiko Tanaka-Ishii

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 14 pages, 16 figures

1709.06436 2017-09-20 cs.CL 79%

Language Modeling with Highway LSTM

Gakuto Kurata, Bhuvana Ramabhadran, George Saon, Abhinav Sethy

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments to appear in 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2017)

1703.08864 2017-07-18 cs.CL 79%

Learning Simpler Language Models with the Differential State Framework

Alexander G. Ororbia, Tomas Mikolov, David Reitter

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments Edits/revisions applied throughout document

1704.06851 2017-04-25 cs.CL 79%

Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Sayan Ghosh, Mathieu Chollet, Eugene Laksana, Louis-Philippe Morency, Stefan Scherer

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

1704.02813 2017-04-11 cs.CL 79%

Character-Word LSTM Language Models

Lyan Verwimp, Joris Pelemans, Hugo Van hamme, Patrick Wambacq

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Journal ref European Chapter of the Association for Computational Linguistics (EACL) 2017, Valencia, Spain, pp. 417-427

1610.03759 2017-02-07 cs.CL 79%

Language Models with Pre-Trained (GloVe) Word Embeddings

Victor Makarenkov, Bracha Shapira, Lior Rokach

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

1611.08656 2016-11-29 cs.CL 79%

Attention-based Memory Selection Recurrent Network for Language Modeling

Da-Rong Liu, Shun-Po Chuang, Hung-yi Lee

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

1606.01700 2016-10-14 cs.CL 79%

Gated Word-Character Recurrent Language Model

Yasumasa Miyamoto, Kyunghyun Cho

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

1608.04465 2016-08-17 cs.CL 79%

Fast, Small and Exact: Infinite-order Language Modelling with Compressed Suffix Trees

Ehsan Shareghi, Matthias Petri, Gholamreza Haffari, Trevor Cohn

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 14 pages in Transactions of the Association for Computational Linguistics (TACL) 2016

1601.01272 2016-04-25 cs.CL 79%

Recurrent Memory Networks for Language Modeling

Ke Tran, Arianna Bisazza, Christof Monz

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments 8 pages, 6 figures. Accepted at NAACL 2016

1602.02410 2016-02-15 cs.CL 79%

Exploring the Limits of Language Modeling

Rafal Jozefowicz, Oriol Vinyals, Mike Schuster, Noam Shazeer, Yonghui Wu

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

1508.06615 2015-12-03 cs.CL cs.NE stat.ML 79%

Character-Aware Neural Language Models

Yoon Kim, Yacine Jernite, David Sontag, Alexander M. Rush

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments AAAI 2016

1412.7119 2015-03-23 cs.CL 79%

Pragmatic Neural Language Modelling in Machine Translation

Paul Baltescu, Phil Blunsom

专题命中长上下文与记忆：language model(title,abstract)；分类 cs.CL

Comments NAACL 2015

1. 长上下文与记忆 4771 篇

BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief

Dispatcher: A Message-Passing Approach To Language Modelling

Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling

What Context Features Can Transformer Language Models Use?

Shortformer: Better Language Modeling using Shorter Inputs

Long Document Summarization in a Low Resource Setting using Pretrained Language Models

Adaptive Semiparametric Language Models

Memory Attentive Fusion: External Language Model Integration for Transformer-based Sequence-to-Sequence Model

Discourse structure interacts with reference but not syntax in neural language models

Future Vector Enhanced LSTM Language Model for LVCSR

A Study on Effects of Implicit and Explicit Language Model Information for DBLSTM-CTC Based Handwriting Recognition

On Extractive and Abstractive Neural Document Summarization with Transformer Language Models

Improving Uyghur ASR systems with decoders using morpheme-based language models

Phrase-Level Class based Language Model for Mandarin Smart Speaker Query Recognition

Evaluating Computational Language Models with Scaling Properties of Natural Language

IIT (BHU) Varanasi at MSR-SRST 2018: A Language Model Based Approach for Natural Language Generation

Disfluency Detection using a Noisy Channel Model and a Deep Neural Language Model

Assessing Language Models with Scaling Properties

Language Modeling with Highway LSTM

Learning Simpler Language Models with the Differential State Framework

Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Character-Word LSTM Language Models

Language Models with Pre-Trained (GloVe) Word Embeddings

Attention-based Memory Selection Recurrent Network for Language Modeling

Gated Word-Character Recurrent Language Model

Fast, Small and Exact: Infinite-order Language Modelling with Compressed Suffix Trees

Recurrent Memory Networks for Language Modeling

Exploring the Limits of Language Modeling

Character-Aware Neural Language Models

Pragmatic Neural Language Modelling in Machine Translation