语言大模型 / LLM

Linguistic Structure Induction from Language Models

Omar Momen

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Master's Thesis. Supervised by Laura Kallmeyer and David Arps

Tracing the Roots of Facts in Multilingual Language Models: Independent, Shared, and Transferred Knowledge

Xin Zhao, Naoki Yoshinaga, Daisuke Oba

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EACL 2024 main conference

Towards Understanding What Code Language Models Learned

Toufique Ahmed, Dian Yu, Chengxuan Huang, Cathy Wang, Prem Devanbu, Kenji Sagae

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Redundancy and Concept Analysis for Code-trained Language Models

Arushi Sharma, Zefu Hu, Christopher Quinn, Ali Jannesari

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 4 figures, 6 tables

Look Before You Leap: A Universal Emergent Decomposition of Retrieval Tasks in Language Models

Alexandre Variengien, Eric Winsor

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Minimally-Supervised Speech Synthesis with Conditional Diffusion Model and Language Model: A Comparative Study of Semantic Coding

Chunyu Qiang, Hao Li, Hao Ni, He Qu, Ruibo Fu, Tao Wang, Longbiao Wang, Jianwu Dang

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ICASSP 2024

Using Captum to Explain Generative Language Models

Vivek Miglani, Aobo Yang, Aram H. Markosyan, Diego Garcia-Olano, Narine Kokhlikyan

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding

Sicong Leng, Hang Zhang, Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, Lidong Bing

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting

Guande He, Peng Cui, Jianfei Chen, Wenbo Hu, Jun Zhu

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Navigating the Grey Area: How Expressions of Uncertainty and Overconfidence Affect Language Models

Kaitlyn Zhou, Dan Jurafsky, Tatsunori Hashimoto

专题命中 知识编辑与模型理解 ：language model(title)；pretraining(abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2023 (Oral)

Interpreting Pretrained Language Models via Concept Bottlenecks

Zhen Tan, Lu Cheng, Song Wang, Yuan Bo, Jundong Li, Huan Liu

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness Analysis

Josip Jukić, Jan Šnajder

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at Learning with Small Data 2023, Association for Computational Linguistics

Enhancing Illicit Activity Detection using XAI: A Multimodal Graph-LLM Framework

Jack Nicholls, Aditya Kuppa, Nhien-An Le-Khac

专题命中 知识编辑与模型理解 ：LLM(title,abstract)；分类 cs.AI、cs.LG

Comments 6 pages, 3 figures

Breaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection

Nayoung Choi

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Sparse Autoencoders Find Highly Interpretable Features in Language Models

Hoagy Cunningham, Aidan Ewart, Logan Riggs, Robert Huben, Lee Sharkey

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 20 pages, 18 figures, 2 tables

Simple is Better and Large is Not Enough: Towards Ensembling of Foundational Language Models

Nancy Tyagi, Aidin Shiri, Surjodeep Sarkar, Abhishek Kumar Umrawal, Manas Gaur

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at the 10th Mid-Atlantic Student Colloquium on Speech, Language and Learning (MASC-SLL 2023)

PEvoLM: Protein Sequence Evolutionary Information Language Model

Issar Arab

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 8

Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning

Hoang H. Nguyen, Chenwei Zhang, Ye Liu, Philip S. Yu

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at SIGDIAL 2023

Fountain -- an intelligent contextual assistant combining knowledge representation and language models for manufacturing risk identification

Saurabh Kumar, Daniel Fuchs, Klaus Spindler

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

SimpleMTOD: A Simple Language Model for Multimodal Task-Oriented Dialogue with Symbolic Scene Representation

Bhathiya Hemanthage, Christian Dondrup, Phil Bartie, Oliver Lemon

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Probing neural language models for understanding of words of estimative probability

Damien Sileo, Marie-Francine Moens

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at *SEM2023

Causality-aware Concept Extraction based on Knowledge-guided Prompting

Siyu Yuan, Deqing Yang, Jinxi Liu, Shuyu Tian, Jiaqing Liang, Yanghua Xiao, Rui Xie

专题命中 知识编辑与模型理解 ：prompting(title)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACL 2023

Sen2Pro: A Probabilistic Perspective to Sentence Embedding from Pre-trained Language Model

Lingfeng Shen, Haiyun Jiang, Lemao Liu, Shuming Shi

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACL2023 workshop Rep4NLP

Augmentation Invariant Discrete Representation for Generative Spoken Language Modeling

Itai Gat, Felix Kreuk, Tu Anh Nguyen, Ann Lee, Jade Copet, Gabriel Synnaeve, Emmanuel Dupoux, Yossi Adi

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Explainability Techniques for Chemical Language Models

Stefan Hödl, William Robinson, Yoram Bachrach, Wilhelm Huck, Tal Kachman

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.AI、cs.LG

Privacy Implications of Retrieval-Based Language Models

Yangsibo Huang, Samyak Gupta, Zexuan Zhong, Kai Li, Danqi Chen

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Concept-aware Training Improves In-context Learning Ability of Language Models

Michal Štefánik, Marek Kadlčík

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Work in progress

Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Models

Na Li, Hanane Kteich, Zied Bouraoui, Steven Schockaert

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.AI

Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models

Sixia Li, Shogo Okada

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 4 tables, 4 figures

Keeping it Simple: Language Models can learn Complex Molecular Distributions

Daniel Flam-Shepherd, Kevin Zhu, Alán Aspuru-Guzik

专题命中 知识编辑与模型理解 ：language model(title,abstract)；分类 cs.AI、cs.LG

Journal ref Nat Commun 13, 3293 (2022)