语言大模型 / LLM - arXivDaily 专题

1909.08582 2019-09-19 cs.CL 79%

Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentences

Genta Indra Winata, Andrea Madotto, Chien-Sheng Wu, Pascale Fung

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted in CoNLL 2019

1909.04130 2019-09-11 cs.CL 79%

Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?

Lyan Verwimp, Jerome R. Bellegarda

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication at Interspeech 2019

1909.00107 2019-09-04 cs.CL 79%

Behavior Gated Language Models

Prashanth Gurunath Shivakumar, Shao-Yen Tseng, Panayiotis Georgiou, Shrikanth Narayanan

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1908.03734 2019-08-13 cs.CL eess.AS 79%

Unsupervised Stemming based Language Model for Telugu Broadcast News Transcription

Mythili Sharan Pala, Parayitam Laxminarayana, A. V. Ramana

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments first draft

1812.03919 2019-08-06 eess.AS cs.CL cs.SD 79%

Pretraining by Backtranslation for End-to-end ASR in Low-Resource Settings

Matthew Wiesner, Adithya Renduchintala, Shinji Watanabe, Chunxi Liu, Najim Dehak, Sanjeev Khudanpur

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1907.03187 2019-07-09 cs.CL 79%

Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction

Bobak Farzin, Piotr Czapla, Jeremy Howard

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments IberLEF 2019 Workshop

1905.09217 2019-05-23 cs.IR cs.CL 79%

Deeper Text Understanding for IR with Contextual Neural Language Modeling

Zhuyun Dai, Jamie Callan

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments In proceedings of SIGIR 2019

1905.07754 2019-05-21 cs.CV cs.LG 79%

Multimodal 3D Object Detection from Simulated Pretraining

Åsmund Brekke, Fredrik Vatsendvik, Frank Lindseth

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

Comments 12 pages, part of proceedings for the NAIS 2019 symposium

1905.06655 2019-05-17 cs.CL cs.SD eess.AS 79%

Effective Sentence Scoring Method using Bidirectional Language Model for Speech Recognition

Joongbo Shin, Yoonhyung Lee, Kyomin Jung

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments submitted to INTERSPEECH 2019, 5 pages

1905.06018 2019-05-16 cs.LG stat.ML 79%

Can Graph Neural Networks Go "Online"? An Analysis of Pretraining and Inference

Lukas Galke, Iacopo Vagliano, Ansgar Scherp

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

Comments 5 pages, 1 figure, Representation Learning on Graphs and Manifolds Workshop of the International Conference on Learning Representations (ICLR), 2019

1904.12104 2019-04-30 cs.CL 79%

Several Experiments on Investigating Pretraining and Knowledge-Enhanced Models for Natural Language Inference

Tianda Li, Xiaodan Zhu, Quan Liu, Qian Chen, Zhigang Chen, Si Wei

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1904.03035 2019-04-08 cs.CL 79%

Identifying and Reducing Gender Bias in Word-Level Language Models

Shikha Bordia, Samuel R. Bowman

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 12 pages with 8 tables and 1 figure; Published at NAACL SRW 2019

1903.07785 2019-03-20 cs.CL 79%

Cloze-driven Pretraining of Self-attention Networks

Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

1903.04167 2019-03-13 cs.CL 79%

Partially Shuffling the Training Data to Improve Language Models

Ofir Press

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1903.03260 2019-03-11 cs.CL 79%

Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State

Richard Futrell, Ethan Wilcox, Takashi Morita, Peng Qian, Miguel Ballesteros, Roger Levy

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted to NAACL 2019. Not yet edited into the camera-ready version

1901.09296 2019-01-29 cs.CL 79%

Variational Smoothing in Recurrent Neural Network Language Models

Lingpeng Kong, Gabor Melis, Wang Ling, Lei Yu, Dani Yogatama

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted as a conference paper at ICLR 2019

1809.00125 2019-01-25 cs.CL 79%

Simple Fusion: Return of the Language Model

Felix Stahlberg, James Cross, Veselin Stoyanov

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments WMT18 paper

1812.04647 2018-12-13 cs.CL 79%

Scalable language model adaptation for spoken dialogue systems

Ankur Gandhe, Ariya Rastrow, Bjorn Hoffmeister

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted at SLT 2018

1810.10254 2018-10-31 cs.CL 79%

Learn to Code-Switch: Data Augmentation using Copy Mechanism on Language Modeling

Genta Indra Winata, Andrea Madotto, Chien-Sheng Wu, Pascale Fung

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Submitted to ICASSP 2019

1810.10045 2018-10-25 cs.CL 79%

Language Modeling at Scale

Mostofa Patwary, Milind Chabbi, Heewoo Jun, Jiaji Huang, Gregory Diamos, Kenneth Church

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1807.00930 2018-09-27 cs.CL cs.NE 79%

Neural Random Projections for Language Modelling

Davide Nunes, Luis Antunes

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1809.05157 2018-09-21 cs.CL cs.IR 79%

On the Strength of Character Language Models for Multilingual Named Entity Recognition

Xiaodong Yu, Stephen Mayhew, Mark Sammons, Dan Roth

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 5 pages, EMNLP 2018 short paper

Journal ref EMNLP 2018

1809.07182 2018-09-20 cs.CL 79%

String Transduction with Target Language Models and Insertion Handling

Garrett Nicolai, Saeed Najafi, Grzegorz Kondrak

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 8 pages + 1 page Appendix, 4 figures and 8 tables, plus an additional 1 figure and 2 tables in appendix; to appear at SIGMORPHON 2018, October, 2018

1711.01048 2018-08-06 cs.CL 79%

Dual Language Models for Code Switched Speech Recognition

Saurabh Garg, Tanmay Parekh, Preethi Jyothi

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments Accepted at Interspeech 2018

1807.00993 2018-07-04 cs.CL stat.ML 79%

Improved training of neural trans-dimensional random field language models with dynamic noise-contrastive estimation

Bin Wang, Zhijian Ou

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments 6 pages. Has been submitted to SLT 2018

1805.04836 2018-05-15 cs.CL 79%

Building Language Models for Text with Named Entities

Md Rizwan Parvez, Saikat Chakraborty, Baishakhi Ray, Kai-Wei Chang

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1804.09552 2018-04-26 cs.CL cs.HC 79%

Automatic speech recognition for launch control center communication using recurrent neural networks with data augmentation and custom language model

Kyongsik Yun, Joseph Osborne, Madison Lee, Thomas Lu, Edward Chow

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments SPIE 2018

1711.03541 2017-11-13 cs.CL 79%

Language Modeling for Code-Switched Data: Challenges and Approaches

Ganji Sreeram, Rohit Sinha

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1709.07777 2017-11-03 cs.CL 79%

Sentence Correction Based on Large-scale Language Modelling

Ji Wen

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

1710.01809 2017-10-06 cs.CL 79%

Syntactic and Semantic Features For Code-Switching Factored Language Models

Heike Adel, Ngoc Thang Vu, Katrin Kirchhoff, Dominic Telaar, Tanja Schultz

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL

Comments IEEE/ACM Transactions on Audio, Speech, and Language Processing (Volume: 23, Issue: 3, March 2015)

1. 预训练与数据 12393 篇

Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentences

Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?

Behavior Gated Language Models

Unsupervised Stemming based Language Model for Telugu Broadcast News Transcription

Pretraining by Backtranslation for End-to-end ASR in Low-Resource Settings

Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction

Deeper Text Understanding for IR with Contextual Neural Language Modeling

Multimodal 3D Object Detection from Simulated Pretraining

Effective Sentence Scoring Method using Bidirectional Language Model for Speech Recognition

Can Graph Neural Networks Go "Online"? An Analysis of Pretraining and Inference

Several Experiments on Investigating Pretraining and Knowledge-Enhanced Models for Natural Language Inference

Identifying and Reducing Gender Bias in Word-Level Language Models

Cloze-driven Pretraining of Self-attention Networks

Partially Shuffling the Training Data to Improve Language Models

Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic State

Variational Smoothing in Recurrent Neural Network Language Models

Simple Fusion: Return of the Language Model

Scalable language model adaptation for spoken dialogue systems

Learn to Code-Switch: Data Augmentation using Copy Mechanism on Language Modeling

Language Modeling at Scale

Neural Random Projections for Language Modelling

On the Strength of Character Language Models for Multilingual Named Entity Recognition

String Transduction with Target Language Models and Insertion Handling

Dual Language Models for Code Switched Speech Recognition

Improved training of neural trans-dimensional random field language models with dynamic noise-contrastive estimation

Building Language Models for Text with Named Entities

Automatic speech recognition for launch control center communication using recurrent neural networks with data augmentation and custom language model

Language Modeling for Code-Switched Data: Challenges and Approaches

Sentence Correction Based on Large-scale Language Modelling

Syntactic and Semantic Features For Code-Switching Factored Language Models