语言大模型 / LLM - arXivDaily 专题

2212.03760 2023-05-16 cs.IR cs.CL 79%

Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning

Kyuyong Shin, Hanock Kwak, Wonjae Kim, Jisu Jeong, Seungjae Jung, Kyung-Min Kim, Jung-Woo Ha, Sang-Woo Lee

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2023 main conference

2305.02160 2023-05-04 cs.CL 79%

Explaining Language Models' Predictions with High-Impact Concepts

Ruochen Zhao, Shafiq Joty, Yongjie Wang, Tan Wang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2211.11158 2023-04-27 cs.CV cs.CL 79%

Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

Yue Yang, Artemis Panagopoulou, Shenghao Zhou, Daniel Jin, Chris Callison-Burch, Mark Yatskar

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Published in CVPR 2023, 18 pages, 12 figures, 16 tables

2301.04347 2023-04-10 cs.CL 79%

Counteracts: Testing Stereotypical Representation in Pre-trained Language Models

Damin Zhang, Julia Rayz, Romila Pradhan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments WIP; to be submitted

2303.12371 2023-03-28 cs.CV cs.AI 79%

$P^{3}O$: Transferring Visual Representations for Reinforcement Learning via Prompting

Guoliang You, Xiaomeng Chu, Yifan Duan, Jie Peng, Jianmin Ji, Yu Zhang, Yanyong Zhang

专题命中知识编辑与模型理解：prompting(title,abstract)；分类 cs.AI

Comments This paper has been accepted to be presented at the upcoming IEEE International Conference on Multimedia & Expo (ICME) in 2023

2303.07226 2023-03-14 cs.CV cs.CL 79%

Scaling Vision-Language Models with Sparse Mixture of Experts

Sheng Shen, Zhewei Yao, Chunyuan Li, Trevor Darrell, Kurt Keutzer, Yuxiong He

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Preprint

2210.02875 2023-03-02 cs.CL 79%

Binding Language Models in Symbolic Languages

Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, Tao Yu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ICLR 2023 camera ready, 27 pages, 10 figures

2302.12297 2023-02-27 cs.CL 79%

Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views

Katerina Margatina, Shuai Wang, Yogarshi Vyas, Neha Anna John, Yassine Benajiba, Miguel Ballesteros

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To appear at EACL 2023. Our code will be available at https://github.com/amazon-science/temporal-robustness

2302.02178 2023-02-07 cs.CL 79%

Construction Grammar Provides Unique Insight into Neural Language Models

Leonie Weissweiler, Taiqi He, Naoki Otani, David R. Mortensen, Lori Levin, Hinrich Schütze

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments GURT 2023

2212.10408 2022-12-21 cs.CL 79%

Geographic and Geopolitical Biases of Language Models

Fahim Faisal, Antonios Anastasopoulos

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2205.12247 2022-11-30 cs.CL 79%

GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models

Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, Kai-Wei Chang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022. Code and data are released at https://github.com/WadeYin9712/GeoMLAMA/

2211.12677 2022-11-24 cs.CL 79%

Word-Level Representation From Bytes For Language Modeling

Chu-Tak Lee, Qipeng Guo, Xipeng Qiu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments preprint

2211.11678 2022-11-22 cs.CL 79%

Measuring Harmful Representations in Scandinavian Language Models

Samia Touileb, Debora Nozza

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at the 5th workshop on Natural Language Processing and Computational Social Science (NLP+CSS) at EMNLP 2022 in Abu Dhabi, Dec 7 2022

2211.08769 2022-11-17 cs.CL cs.IR 79%

RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models

Shitao Xiao, Zheng Liu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2211.04079 2022-11-09 cs.CL 79%

COPEN: Probing Conceptual Knowledge in Pre-trained Language Models

Hao Peng, Xiaozhi Wang, Shengding Hu, Hailong Jin, Lei Hou, Juanzi Li, Zhiyuan Liu, Qun Liu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2022

2210.12378 2022-11-01 cs.CL 79%

Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling

Vidhisha Balachandran, Hannaneh Hajishirzi, William W. Cohen, Yulia Tsvetkov

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2204.07367 2022-10-31 cs.CL 79%

On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART

Zebin Ou, Meishan Zhang, Yue Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments COLING 2022

2210.14328 2022-10-27 cs.CL 79%

Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models

Aaron Mueller, Yu Xia, Tal Linzen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to CoNLL 2022

2210.13181 2022-10-25 cs.CL 79%

The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative

Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, Hinrich Schütze

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2210.03575 2022-10-25 cs.CL 79%

Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models

Emmy Liu, Graham Neubig

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2205.10964 2022-10-25 cs.CL 79%

The Geometry of Multilingual Language Model Representations

Tyler A. Chang, Zhuowen Tu, Benjamin K. Bergen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2022

2210.10293 2022-10-20 cs.CL 79%

Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning

Hongqiu Wu, Ruixue Ding, Hai Zhao, Boli Chen, Pengjun Xie, Fei Huang, Min Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 (findings)

2206.06583 2022-10-18 q-bio.QM cs.AI 79%

Exploring evolution-aware & -free protein language models as protein function predictors

Mingyang Hu, Fajie Yuan, Kevin K. Yang, Fusong Ju, Jin Su, Hui Wang, Fei Yang, Qiuyang Ding

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

2204.12130 2022-10-14 cs.CL 79%

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

Mor Geva, Avi Caciularu, Guy Dar, Paul Roit, Shoval Sadde, Micah Shlain, Bar Tamir, Yoav Goldberg

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 System Demonstrations

2209.09406 2022-09-21 cond-mat.mtrl-sci cs.LG physics.chem-ph 79%

Probabilistic Generative Transformer Language models for Generative Design of Molecules

Lai Wei, Nihang Fu, Yuqi Song, Qian Wang, Jianjun Hu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments 13 pages

2209.08982 2022-09-20 cs.CL 79%

How to Adapt Pre-trained Vision-and-Language Models to a Text-only Input?

Lovisa Hagström, Richard Johansson

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2209.04811 2022-09-13 cs.CL 79%

Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models

David K. Yi, James V. Bruno, Jiayu Han, Peter Zukerman, Shane Steinert-Threlkeld

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments 8 pages, 6 figures

2208.12539 2022-09-01 cs.CL 79%

Task-specific Pre-training and Prompt Decomposition for Knowledge Graph Population with Language Models

Tianyi Li, Wenyu Huang, Nikos Papasarantopoulos, Pavlos Vougiouklis, Jeff Z. Pan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To appear in ISWC 2022

2208.08263 2022-08-18 cs.NE cs.AI cs.MM 79%

Multimodal foundation models are better simulators of the human brain

Haoyu Lu, Qiongyi Zhou, Nanyi Fei, Zhiwu Lu, Mingyu Ding, Jingyuan Wen, Changde Du, Xin Zhao, Hao Sun, Huiguang He, Ji-Rong Wen

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.AI

2206.14017 2022-08-09 cs.CL 79%

Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing

Lihan Wang, Bowen Qin, Binyuan Hui, Bowen Li, Min Yang, Bailin Wang, Binhua Li, Fei Huang, Luo Si, Yongbin Li

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at KDD 2022

1. 知识编辑与模型理解 7552 篇

Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning

Explaining Language Models' Predictions with High-Impact Concepts

Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

Counteracts: Testing Stereotypical Representation in Pre-trained Language Models

$P^{3}O$: Transferring Visual Representations for Reinforcement Learning via Prompting

Scaling Vision-Language Models with Sparse Mixture of Experts

Binding Language Models in Symbolic Languages

Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views

Construction Grammar Provides Unique Insight into Neural Language Models

Geographic and Geopolitical Biases of Language Models

GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models

Word-Level Representation From Bytes For Language Modeling

Measuring Harmful Representations in Scandinavian Language Models

RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models

COPEN: Probing Conceptual Knowledge in Pre-trained Language Models

Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infilling

On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART

Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models

The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative

Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models

The Geometry of Multilingual Language Model Representations

Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning

Exploring evolution-aware & -free protein language models as protein function predictors

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

Probabilistic Generative Transformer Language models for Generative Design of Molecules

How to Adapt Pre-trained Vision-and-Language Models to a Text-only Input?

Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models

Task-specific Pre-training and Prompt Decomposition for Knowledge Graph Population with Language Models

Multimodal foundation models are better simulators of the human brain

Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing