语言大模型 / LLM

Masked Vision and Language Modeling for Multi-modal Representation Learning

Gukyeong Kwon, Zhaowei Cai, Avinash Ravichandran, Erhan Bas, Rahul Bhotika, Stefano Soatto

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments International Conference on Learning Representations (ICLR) 2023

Crawling the Internal Knowledge-Base of Language Models

Roi Cohen, Mor Geva, Jonathan Berant, Amir Globerson

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments To be published in EACL 2023 (Findings)

Why do Nearest Neighbor Language Models Work?

Frank F. Xu, Uri Alon, Graham Neubig

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Preprint, 21 pages

Reprogramming Pretrained Language Models for Protein Sequence Representation Learning

Ria Vinod, Pin-Yu Chen, Payel Das

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 11 pages, 5 figures

Probing for Incremental Parse States in Autoregressive Language Models

Tiwalayo Eisape, Vineet Gangireddy, Roger P. Levy, Yoon Kim

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Findings of EMNLP 2022

CPL: Counterfactual Prompt Learning for Vision and Language Models

Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning

Hugo Berg, Siobhan Mackenzie Hall, Yash Bhalgat, Wonsuk Yang, Hannah Rose Kirk, Aleksandar Shtedritski, Max Bain

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 17 pages, 4 figures, 7 tables. For code and trained token embeddings, see https://github.com/oxai/debias-vision-lang; Changed to use ACL layout, added joint training with comparison figure, corrected spelling and formatting errors; This paper is accepted for publication at AACL 2022, the official version of record is in the ACL Anthology

SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation

Zekun Li, Jina Kim, Yao-Yi Chiang, Muhao Chen

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2022

Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis

Yuxin Xiao, Paul Pu Liang, Umang Bhatt, Willie Neiswanger, Ruslan Salakhutdinov, Louis-Philippe Morency

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by EMNLP 2022 (Findings)

NamedMask: Distilling Segmenters from Complementary Foundation Models

Gyungin Shin, Weidi Xie, Samuel Albanie

专题命中 知识编辑与模型理解 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments Tech report. Code: https://github.com/NoelShin/namedmask

PTab: Using the Pre-trained Language Model for Modeling Tabular Data

Guang Liu, Jie Yang, Ledell Wu

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.AI、cs.LG

CommunityLM: Probing Partisan Worldviews from Language Models

Hang Jiang, Doug Beeferman, Brandon Roy, Deb Roy

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Paper accepted by COLING 2022

CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations

Borun Chen, Hongyin Tang, Jiahao Bu, Kai Zhang, Jingang Wang, Qifan Wang, Hai-Tao Zheng, Wei Wu, Liqian Yu

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted in COLING 2022

Visualizing and Explaining Language Models

Adrian M. P. Braşoveanu, Răzvan Andonie

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Probing Simile Knowledge from Pre-trained Language Models

Weijie Chen, Yongzhu Chang, Rongsheng Zhang, Jiashu Pu, Guandan Chen, Le Zhang, Yadong Xi, Yijiang Chen, Chang Su

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Long paper accepted at ACL 2022

When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes

Mycal Tucker, Tiwalayo Eisape, Peng Qian, Roger Levy, Julie Shah

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

TimeLMs: Diachronic Language Models from Twitter

Daniel Loureiro, Francesco Barbieri, Leonardo Neves, Luis Espinosa Anke, Jose Camacho-Collados

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACL 2022 (Demo Track) - https://github.com/cardiffnlp/timelms

DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting

Yongming Rao, Wenliang Zhao, Guangyi Chen, Yansong Tang, Zheng Zhu, Guan Huang, Jie Zhou, Jiwen Lu

专题命中 知识编辑与模型理解 ：prompting(title)；language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted to CVPR2022. Project page: https://denseclip.ivg-research.xyz

Can Pre-trained Language Models Interpret Similes as Smart as Human?

Qianyu He, Sijie Cheng, Zhixu Li, Rui Xie, Yanghua Xiao

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at ACL 2022 main conference

Self-Supervised Representation Learning for Speech Using Visual Grounding and Masked Language Modeling

Puyuan Peng, David Harwath

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments SAS workshop at AAAI2022, code and model weights available at https://github.com/jasonppy/FaST-VGS-Family

"Average" Approximates "First Principal Component"? An Empirical Analysis on Representations from Neural Language Models

Zihan Wang, Chengyu Dong, Jingbo Shang

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Quantum Language Model with Entanglement Embedding for Question Answering

Yiwei Chen, Yu Pan, Daoyi Dong

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models

Lei Li, Yankai Lin, Xuancheng Ren, Guangxiang Zhao, Peng Li, Jie Zhou, Xu Sun

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Florence: A New Foundation Model for Computer Vision

Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang

专题命中 知识编辑与模型理解 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Interpreting Language Models Through Knowledge Graph Extraction

Vinitra Swamy, Angelika Romanou, Martin Jaggi

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published at NeurIPS 2021: eXplainable AI for Debugging and Diagnosis Workshop

Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model

Liang He, Shizhuo Zhang, Lijun Wu, Huanhuan Xia, Fusong Ju, He Zhang, Siyuan Liu, Yingce Xia, Jianwei Zhu, Pan Deng, Bin Shao, Tao Qin, Tie-Yan Liu

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing

Qian Liu, Dejian Yang, Jiahui Zhang, Jiaqi Guo, Bin Zhou, Jian-Guang Lou

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL 2021 Findings. The first three authors contributed equally

Inspecting the concept knowledge graph encoded by modern language models

Carlos Aspillaga, Marcelo Mendoza, Alvaro Soto

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Predictive Representation Learning for Language Modeling

Qingfeng Lan, Luke Kumar, Martha White, Alona Fyshe

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

True Few-Shot Learning with Language Models

Ethan Perez, Douwe Kiela, Kyunghyun Cho

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Code at https://github.com/ethanjperez/true_few_shot