语言大模型 / LLM - arXivDaily 专题

2311.13508 2023-11-23 cs.SE cs.LG 79%

Naturalness of Attention: Revisiting Attention in Code Language Models

Mootez Saad, Tushar Sharma

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments Accepted at ICSE-NIER (2024) track

2311.03788 2023-11-08 cs.CL 79%

Language Representation Projection: Can We Transfer Factual Knowledge across Languages in Multilingual Language Models?

Shaoyang Xu, Junzhuo Li, Deyi Xiong

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023

2310.18930 2023-10-31 cs.CL 79%

Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning

Sapan Shah, Sreedhar Reddy, Pushpak Bhattacharyya

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2023 Camera Ready Version

2310.17271 2023-10-27 cs.CL 79%

Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance?

Ahmed Alajrami, Katerina Margatina, Nikolaos Aletras

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments To appear at EMNLP 2023

2310.16484 2023-10-26 cs.CL 79%

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

Max Müller-Eberstein, Rob van der Goot, Barbara Plank, Ivan Titov

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2023 (Findings)

2310.15420 2023-10-25 cs.CL 79%

Let the Pretrained Language Models "Imagine" for Short Texts Topic Modeling

Pritom Saha Akash, Jie Huang, Kevin Chen-Chuan Chang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2310.15109 2023-10-24 cs.CL 79%

GRENADE: Graph-Centric Language Model for Self-Supervised Representation Learning on Text-Attributed Graphs

Yichuan Li, Kaize Ding, Kyumin Lee

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Findings of EMNLP 2023

2310.12751 2023-10-20 cs.CL 79%

Character-level Chinese Backpack Language Models

Hao Sun, John Hewitt

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments BlackboxNLP 2023 Camera-Ready

2310.07929 2023-10-13 cs.CL 79%

Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models

Catherine Arnett, Tyler A. Chang, James A. Michaelov, Benjamin K. Bergen

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Extended abstract accepted to the 3rd Multilingual Representation Learning workshop at EMNLP 2023

2305.12696 2023-10-11 cs.CL 79%

Learning Interpretable Style Embeddings via Prompting LLMs

Ajay Patel, Delip Rao, Ansh Kothary, Kathleen McKeown, Chris Callison-Burch

专题命中知识编辑与模型理解：prompting(title,abstract)；分类 cs.CL

2310.05771 2023-10-10 cs.LG cs.HC 79%

Foundation Models Meet Visualizations: Challenges and Opportunities

Weikai Yang, Mengchen Liu, Zheng Wang, Shixia Liu

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.LG

Comments Submitted to Computational Visual Media

2310.02988 2023-10-05 cs.CV cs.AI 79%

Probing Intersectional Biases in Vision-Language Models with Counterfactual Examples

Phillip Howard, Avinash Madasu, Tiep Le, Gustavo Lujan Moreno, Vasudev Lal

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

2210.09996 2023-08-23 cs.CV cs.LG 79%

Perceptual Grouping in Contrastive Vision-Language Models

Kanchana Ranasinghe, Brandon McKinzie, Sachin Ravi, Yinfei Yang, Alexander Toshev, Jonathon Shlens

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments Accepted and presented at ICCV 2023

2308.02555 2023-08-08 cs.IR cs.AI 79%

Knowledge-aware Collaborative Filtering with Pre-trained Language Model for Personalized Review-based Rating Prediction

Quanxiu Wang, Xinlei Cao, Jianyong Wang, Wei Zhang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

Comments 13 pages, accepted by IEEE TKDE

2307.15460 2023-07-31 cs.CV cs.CL 79%

Cross-Modal Concept Learning and Inference for Vision-Language Models

Yi Zhang, Ce Zhang, Yushun Tang, Zhihai He

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2209.03143 2023-07-27 cs.SD cs.LG eess.AS 79%

AudioLM: a Language Modeling Approach to Audio Generation

Zalán Borsos, Raphaël Marinier, Damien Vincent, Eugene Kharitonov, Olivier Pietquin, Matt Sharifi, Dominik Roblek, Olivier Teboul, David Grangier, Marco Tagliasacchi, Neil Zeghidour

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

2306.08842 2023-06-30 cs.CV cs.CR cs.LG 79%

ViP: A Differentially Private Foundation Model for Computer Vision

Yaodong Yu, Maziar Sanjabi, Yi Ma, Kamalika Chaudhuri, Chuan Guo

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.LG

Comments Code: https://github.com/facebookresearch/ViP-MAE. V2 adds a GitHub link to the code

2305.11543 2023-06-28 cs.CL 79%

Constructing Word-Context-Coupled Space Aligned with Associative Knowledge Relations for Interpretable Language Modeling

Fanyu Wang, Zhenping Xie

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at ACL 2023, Findings

2212.09553 2023-06-28 cs.CL cs.SD eess.AS 79%

Mu$^{2}$SLAM: Multitask, Multilingual Speech and Language Models

Yong Cheng, Yu Zhang, Melvin Johnson, Wolfgang Macherey, Ankur Bapna

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ICML 2023

2306.10315 2023-06-21 cs.CL 79%

FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue

Weihao Zeng, Keqing He, Yejie Wang, Chen Zeng, Jingang Wang, Yunsen Xian, Weiran Xu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2023 Main Conference

2306.07489 2023-06-14 eess.AS cs.AI cs.SD eess.SP 79%

PauseSpeech: Natural Speech Synthesis via Pre-trained Language Model and Pause-based Prosody Modeling

Ji-Sang Hwang, Sang-Hoon Lee, Seong-Whan Lee

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.AI

Comments 13 pages, 4 figures, 3 tables, under reivew

2306.05076 2023-06-09 cs.CL 79%

DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models

Amr Keleg, Walid Magdy

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2023 (Findings)

2306.03598 2023-06-07 cs.CL 79%

CUE: An Uncertainty Interpretation Framework for Text Classifiers Built on Pre-Trained Language Models

Jiazheng Li, Zhaoyue Sun, Bin Liang, Lin Gui, Yulan He

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted to UAI 2023

2306.00645 2023-06-02 cs.CL 79%

Contextual Distortion Reveals Constituency: Masked Language Models are Implicit Parsers

Jiaxi Li, Wei Lu

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2023

2305.18657 2023-06-02 cs.CL 79%

Representation Of Lexical Stylistic Features In Language Models' Embedding Space

Qing Lyu, Marianna Apidianaki, Chris Callison-Burch

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Accepted at *SEM 2023

2305.16765 2023-05-29 cs.CL 79%

Backpack Language Models

John Hewitt, John Thickstun, Christopher D. Manning, Percy Liang

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments ACL 2023 Camera-Ready

2304.04662 2023-05-26 q-bio.QM cs.LG 79%

SELFormer: Molecular Representation Learning via SELFIES Language Models

Atakan Yüksel, Erva Ulusoy, Atabey Ünlü, Tunca Doğan

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.LG

Comments 22 pages, 4 figures, 8 tables

2305.15321 2023-05-25 cs.DB cs.CL 79%

Towards Foundation Models for Relational Databases [Vision Paper]

Liane Vogel, Benjamin Hilprecht, Carsten Binnig

专题命中知识编辑与模型理解：foundation model(title,abstract)；分类 cs.CL

Comments Accepted at the Tabular Representation Learning Workshop at NeurIPS 2022 (TRL@NeurIPS2022)

2305.13534 2023-05-24 cs.CL 79%

How Language Model Hallucinations Can Snowball

Muru Zhang, Ofir Press, William Merrill, Alisa Liu, Noah A. Smith

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

2305.10046 2023-05-18 cs.CL cs.CV 79%

Probing the Role of Positional Information in Vision-Language Models

Philipp J. Rösch, Jindřich Libovický

专题命中知识编辑与模型理解：language model(title,abstract)；分类 cs.CL

Comments Findings of the Association for Computational Linguistics: NAACL 2022, pages 1031-1041, Seattle, United States. Association for Computational Linguistics

1. 知识编辑与模型理解 7552 篇

Naturalness of Attention: Revisiting Attention in Code Language Models

Language Representation Projection: Can We Transfer Factual Knowledge across Languages in Multilingual Language Models?

Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning

Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance?

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

Let the Pretrained Language Models "Imagine" for Short Texts Topic Modeling

GRENADE: Graph-Centric Language Model for Self-Supervised Representation Learning on Text-Attributed Graphs

Character-level Chinese Backpack Language Models

Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models

Learning Interpretable Style Embeddings via Prompting LLMs

Foundation Models Meet Visualizations: Challenges and Opportunities

Probing Intersectional Biases in Vision-Language Models with Counterfactual Examples

Perceptual Grouping in Contrastive Vision-Language Models

Knowledge-aware Collaborative Filtering with Pre-trained Language Model for Personalized Review-based Rating Prediction

Cross-Modal Concept Learning and Inference for Vision-Language Models

AudioLM: a Language Modeling Approach to Audio Generation

ViP: A Differentially Private Foundation Model for Computer Vision

Constructing Word-Context-Coupled Space Aligned with Associative Knowledge Relations for Interpretable Language Modeling

Mu$^{2}$SLAM: Multitask, Multilingual Speech and Language Models

FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue

PauseSpeech: Natural Speech Synthesis via Pre-trained Language Model and Pause-based Prosody Modeling

DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models

CUE: An Uncertainty Interpretation Framework for Text Classifiers Built on Pre-Trained Language Models

Contextual Distortion Reveals Constituency: Masked Language Models are Implicit Parsers

Representation Of Lexical Stylistic Features In Language Models' Embedding Space

Backpack Language Models

SELFormer: Molecular Representation Learning via SELFIES Language Models

Towards Foundation Models for Relational Databases [Vision Paper]

How Language Model Hallucinations Can Snowball

Probing the Role of Positional Information in Vision-Language Models