语言大模型 / LLM - arXivDaily 专题

2303.01911 2023-05-10 cs.CL 79%

Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM

Rachel Bawden, François Yvon

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at EAMT 2023

2303.05313 2023-05-09 cs.CV cs.CL 79%

Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training

Lisai Zhang, Qingcai Chen, Zhijian Chen, Yunpeng Han, Zhonghua Li, Zhao Cao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Work in progress, v0.2

2305.01624 2023-05-08 cs.CL 79%

UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models

Deming Ye, Yankai Lin, Zhengyan Zhang, Maosong Sun

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 8 pages

2304.13597 2023-04-27 cs.CL 79%

Shades of meaning: Uncovering the geometry of ambiguous word representations through contextualised language models

Benedetta Cevoli, Chris Watkins, Yang Gao, Kathleen Rastle

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2304.05336 2023-04-12 cs.CL 79%

Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages

Gabriela Pałka, Artur Nowakowski

专题命中其他LLM ：foundation model(title,abstract)；分类 cs.CL

Comments Slavic NLP 2023 @ EACL 2023

2303.10893 2023-03-23 cs.CL 79%

Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models

Xinnian Liang, Zefan Zhou, Hui Huang, Shuangzhi Wu, Tong Xiao, Muyun Yang, Zhoujun Li, Chao Bian

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments preprint

2302.12299 2023-02-27 cs.CL 79%

In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages

Asım Ersoy, Gerson Vizcarra, Tasmiah Tahsin Mayeesha, Benjamin Muller

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 17 pages

2302.04761 2023-02-10 cs.CL 79%

Toolformer: Language Models Can Teach Themselves to Use Tools

Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, Thomas Scialom

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2302.02453 2023-02-07 cs.CL cs.CY 79%

FineDeb: A Debiasing Framework for Language Models

Akash Saravanan, Dhruv Mullick, Habibur Rahman, Nidhi Hegde

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Poster presentation at AAAI 2023: The Workshop on Artificial Intelligence for Social Good 2023 (https://amulyayadav.github.io/AI4SG2023/)

2212.12131 2022-12-26 cs.CL 79%

Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?

Byung-Doh Oh, William Schuler

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Transactions of the Association for Computational Linguistics (pre-MIT Press publication version)

2212.10536 2022-12-21 cs.CL 79%

Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion

Yuling Gu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2212.03979 2022-12-09 cs.LG q-bio.GN 79%

Unsupervised language models for disease variant prediction

Allan Zhou, Nicholas C. Landolfi, Daniel C. O'Neill

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments Machine Learning for Structural Biology Workshop, NeurIPS 2022

2212.02216 2022-12-06 cs.CL 79%

Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Feng Nie, Meixi Chen, Zhirui Zhang, Xu Cheng

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Work in progress

2211.14639 2022-11-29 cs.CL 79%

Gender Biases Unexpectedly Fluctuate in the Pre-training Stage of Masked Language Models

Kenan Tang, Hanchun Jiang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2210.14698 2022-11-18 cs.CL 79%

Autoregressive Structured Prediction with Language Models

Tianyu Liu, Yuchen Jiang, Nicholas Monath, Ryan Cotterell, Mrinmaya Sachan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 (findings)

2205.12558 2022-11-09 cs.CL 79%

Gradient-Based Constrained Sampling from Language Models

Sachin Kumar, Biswajit Paria, Yulia Tsvetkov

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2201.11627 2022-11-03 eess.AS cs.AI cs.SD 79%

Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASR

Yufei Liu, Rao Ma, Haihua Xu, Yi He, Zejun Ma, Weibin Zhang

专题命中其他LLM ：language model(title,abstract)；分类 cs.AI

Comments Proceedings of INTERSPEECH

2205.11463 2022-11-02 cs.CL 79%

Context Limitations Make Neural Language Models More Human-Like

Tatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro Inui

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP2022 (main long)

2210.15191 2022-10-28 cs.CL 79%

Truncation Sampling as Language Model Desmoothing

John Hewitt, Christopher D. Manning, Percy Liang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Findings of EMNLP, + small fixes

2210.13985 2022-10-26 cs.CL cs.CY 79%

This joke is [MASK]: Recognizing Humor and Offense with Prompting

Junze Li, Mengjie Zhao, Yubo Xie, Antonis Maronikolakis, Pearl Pu, Hinrich Schütze

专题命中其他LLM ：prompting(title,abstract)；分类 cs.CL

Comments Transfer Learning for Natural Language Processing Workshop at NeurIPS 2022

2203.15465 2022-10-25 q-bio.BM cs.LG q-bio.QM 79%

Protein language models trained on multiple sequence alignments learn phylogenetic relationships

Umberto Lupo, Damiano Sgarbossa, Anne-Florence Bitbol

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments 29 pages, 10 figures, 7 tables

Journal ref Nat Commun 13, 6298 (2022)

2210.12265 2022-10-25 cs.CL 79%

On the Calibration of Massively Multilingual Language Models

Kabir Ahuja, Sunayana Sitaram, Sandipan Dandapat, Monojit Choudhury

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2202.08827 2022-10-20 cs.LG cs.DC 79%

LAMP: Extracting Text from Gradients with Language Model Priors

Mislav Balunović, Dimitar I. Dimitrov, Nikola Jovanović, Martin Vechev

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

2210.09179 2022-10-18 cs.CL cs.IR 79%

Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time

Kiymet Akdemir, Ali Hürriyetoğlu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at CASE 2022

2205.12035 2022-10-18 cs.CL 79%

RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder

Shitao Xiao, Zheng Liu, Yingxia Shao, Zhao Cao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2022

2210.07093 2022-10-14 cs.CL 79%

Query Expansion Using Contextual Clue Sampling with Language Models

Linqing Liu, Minghan Li, Jimmy Lin, Sebastian Riedel, Pontus Stenetorp

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2210.05143 2022-10-12 cs.CL cs.SI 79%

Time-aware topic identification in social media with pre-trained language models: A case study of electric vehicles

Byeongki Jeong, Janghyeok Yoon, Jaewoong Choi

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2210.02526 2022-10-07 cs.CL 79%

"No, they did not": Dialogue response dynamics in pre-trained language models

Sanghee J. Kim, Lang Yu, Allyson Ettinger

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 8 figures, COLING 2022, see https://github.com/sangheek16/dialogue-response-dynamics for codes and material

2209.10875 2022-09-23 cs.CL 79%

Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model

Qiao Cheng, Jin Huang, Yitao Duan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2022 Main Conference (Long paper). https://coling2022.org/

2202.13558 2022-09-22 cs.CL 79%

CINO: A Chinese Minority Pre-trained Language Model

Ziqing Yang, Zihang Xu, Yiming Cui, Baoxin Wang, Min Lin, Dayong Wu, Zhigang Chen

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2022

1. 其他LLM 12169 篇

Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM

Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training

UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models

Shades of meaning: Uncovering the geometry of ambiguous word representations through contextualised language models

Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages

Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models

In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages

Toolformer: Language Models Can Teach Themselves to Use Tools

FineDeb: A Debiasing Framework for Language Models

Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?

Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion

Unsupervised language models for disease variant prediction

Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Gender Biases Unexpectedly Fluctuate in the Pre-training Stage of Masked Language Models

Autoregressive Structured Prediction with Language Models

Gradient-Based Constrained Sampling from Language Models

Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASR

Context Limitations Make Neural Language Models More Human-Like

Truncation Sampling as Language Model Desmoothing

This joke is [MASK]: Recognizing Humor and Offense with Prompting

Protein language models trained on multiple sequence alignments learn phylogenetic relationships

On the Calibration of Massively Multilingual Language Models

LAMP: Extracting Text from Gradients with Language Model Priors

Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time

RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder

Query Expansion Using Contextual Clue Sampling with Language Models

Time-aware topic identification in social media with pre-trained language models: A case study of electric vehicles

"No, they did not": Dialogue response dynamics in pre-trained language models

Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model

CINO: A Chinese Minority Pre-trained Language Model