语言大模型 / LLM - arXivDaily 专题

2207.07706 2022-07-19 cs.CL cs.IR cs.PL 79%

Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis

Shounak Naik, Rajaswa Patil, Swati Agarwal, Veeky Baths

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Under review at ADMA 2022

2207.06897 2022-07-15 cs.CL 79%

Beware the Rationalization Trap! When Language Model Explainability Diverges from our Mental Models of Language

Rita Sevastjanova, Mennatallah El-Assady

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2106.09063 2022-06-22 cs.CL 79%

Specializing Multilingual Language Models: An Empirical Study

Ethan C. Chau, Noah A. Smith

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Workshop on Multilingual Representation Learning (MRL) 2021

Journal ref Workshop on Multilingual Representation Learning (2021) 51-61

2205.01917 2022-06-15 cs.CV cs.LG cs.MM 79%

CoCa: Contrastive Captioners are Image-Text Foundation Models

Jiahui Yu, Zirui Wang, Vijay Vasudevan, Legg Yeung, Mojtaba Seyedhosseini, Yonghui Wu

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.LG

Comments Preprint

2206.04935 2022-06-13 cs.CL 79%

Sort by Structure: Language Model Ranking as Dependency Probing

Max Müller-Eberstein, Rob van der Goot, Barbara Plank

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2022 (Main Conference)

2205.13708 2022-05-30 cs.CL 79%

HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models

Minghuan Tan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2110.08173 2022-05-24 cs.CL 79%

Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models

Zaiqiao Meng, Fangyu Liu, Ehsan Shareghi, Yixuan Su, Charlotte Collins, Nigel Collier

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2022; code and data are released at https://github.com/cambridgeltl/medlama

2112.08787 2022-05-04 cs.CL 79%

AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models

Yue Yu, Lingkai Kong, Jieyu Zhang, Rongzhi Zhang, Chao Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments NAACL 2022 Main Conference (Code: https://github.com/yueyu1030/actune)

Journal ref NAACL 2022

2108.11857 2022-04-28 cs.CL 79%

Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognition

Elena V. Epure, Romain Hennequin

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication in LREC2022

2204.03162 2022-04-26 cs.CV cs.CL 79%

Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality

Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments CVPR 2022

2204.06201 2022-04-14 cs.CL 79%

Probing for Constituency Structure in Neural Language Models

David Arps, Younes Samih, Laura Kallmeyer, Hassan Sajjad

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 20 pages, 9 Figures, 9 tables

2204.04163 2022-04-11 cs.CL 79%

Contextual Representation Learning beyond Masked Language Modeling

Zhiyi Fu, Wangchunshu Zhou, Jingjing Xu, Hao Zhou, Lei Li

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2022

2204.02130 2022-04-07 q-bio.GN cs.LG 79%

SemanticCAP: Chromatin Accessibility Prediction Enhanced by Features Learning from a Language Model

Yikang Zhang, Xiaomin Chu, Yelu Jiang, Hongjie Wu, Lijun Quan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

2203.14139 2022-03-29 cs.CL 79%

Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages

Ehsan Aghazadeh, Mohsen Fayyaz, Yadollah Yaghoobzadeh

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2022 (main conference)

2203.07860 2022-03-22 cs.CL 79%

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Long paper accepted by ACL main conference. 17 pages

2202.06840 2022-02-15 cs.SE cs.AI 79%

What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code

Yao Wan, Wei Zhao, Hongyu Zhang, Yulei Sui, Guandong Xu, Hai Jin

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

Comments Accepted by ICSE 2022 (The 44th International Conference on Software Engineering)

2111.12174 2021-11-25 cs.CL 79%

Using Distributional Principles for the Semantic Study of Contextual Language Models

Olivier Ferret

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments PACLIC 35

2104.08768 2021-11-18 cs.CL 79%

Constrained Language Models Yield Few-Shot Semantic Parsers

Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Benjamin Van Durme

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2021. Code is available at https://github.com/microsoft/semantic_parsing_with_constrained_lm

2011.14039 2021-09-28 cs.CL 79%

An Investigation of Language Model Interpretability via Sentence Editing

Samuel Stevens, Yu Su

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 9 figures. Accepted at EMNLP BlackboxNLP 2021

2109.07848 2021-09-17 cs.CL 79%

The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation

Laura Aina, Tal Linzen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To appear in Proceedings of BlackboxNLP 2021: Analyzing and Interpreting Neural Networks for NLP

2109.02772 2021-09-14 cs.AI 79%

An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models

Tianxing He, Kyunghyun Cho, James Glass

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

2106.04832 2021-06-10 cs.CL 79%

Probing Multilingual Language Models for Discourse

Murathan Kurfalı, Robert Östling

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To be presented at RepL4NLP 2021

2005.10089 2021-04-22 eess.AS cs.CL cs.SD 79%

Investigation of Large-Margin Softmax in Neural Language Modeling

Jingjing Huo, Yingbo Gao, Weiyue Wang, Ralf Schlüter, Hermann Ney

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Proceedings of INTERSPEECH 2020

2104.07578 2021-04-16 cs.CL 79%

Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models

Matteo Alleman, Jonathan Mamou, Miguel A Del Rio, Hanlin Tang, Yoon Kim, SueYeon Chung

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 7 figures

2104.05882 2021-04-14 cs.CL 79%

Discourse Probing of Pretrained Language Models

Fajri Koto, Jey Han Lau, Timothy Baldwin

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2021

2005.00619 2021-04-14 cs.CL cs.CV 79%

Probing Contextual Language Models for Common Ground with Visual Representations

Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Proceedings of the 2021 North American Chapter of the Association for Computational Linguistics (NAACL 2021)

1912.00239 2021-03-05 cs.CL 79%

Neural language modeling of free word order argument structure

Charlotte Rochereau, Benoît Sagot, Emmanuel Dupoux

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2102.10848 2021-02-23 cs.CL 79%

Evaluating Contextualized Language Models for Hungarian

Judit Ács, Dániel Lévai, Dávid Márk Nemeskey, András Kornai

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Journal ref Hungarian NLP Conference (MSZNY2021)

1904.03799 2021-01-14 cs.CL 79%

Enriching Rare Word Representations in Neural Language Models by Embedding Matrix Augmentation

Yerbolat Khassanov, Zhiping Zeng, Van Tung Pham, Haihua Xu, Eng Siong Chng

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 5 pages, 2 figures, accepted to INTERSPEECH 2019

2012.03460 2021-01-07 cs.LG q-bio.MN 79%

Reprogramming Language Models for Molecular Representation Learning

Ria Vinod, Pin-Yu Chen, Payel Das

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments 6 pages, 5 tables, accepted at Learning Meaningful Representations of Life @ NeurIPS 2020, Women in Machine Learning @ NeurIPS 2020. 8 pages, LaTeX; typos corrected, references added

1. 知识编辑与模型理解 7552 篇

Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis

Beware the Rationalization Trap! When Language Model Explainability Diverges from our Mental Models of Language

Specializing Multilingual Language Models: An Empirical Study

CoCa: Contrastive Captioners are Image-Text Foundation Models

Sort by Structure: Language Model Ranking as Dependency Probing

HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models

Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models

AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models

Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognition

Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality

Probing for Constituency Structure in Neural Language Models

Contextual Representation Learning beyond Masked Language Modeling

SemanticCAP: Chromatin Accessibility Prediction Enhanced by Features Learning from a Language Model

Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code

Using Distributional Principles for the Semantic Study of Contextual Language Models

Constrained Language Models Yield Few-Shot Semantic Parsers

An Investigation of Language Model Interpretability via Sentence Editing

The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation

An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models

Probing Multilingual Language Models for Discourse

Investigation of Large-Margin Softmax in Neural Language Modeling

Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models

Discourse Probing of Pretrained Language Models

Probing Contextual Language Models for Common Ground with Visual Representations

Neural language modeling of free word order argument structure

Evaluating Contextualized Language Models for Hungarian

Enriching Rare Word Representations in Neural Language Models by Embedding Matrix Augmentation

Reprogramming Language Models for Molecular Representation Learning