语言大模型 / LLM

RealBehavior: A Framework for Faithfully Characterizing Foundation Models' Human-like Behavior Mechanisms

Enyu Zhou, Rui Zheng, Zhiheng Xi, Songyang Gao, Xiaoran Fan, Zichu Fei, Jingting Ye, Tao Gui, Qi Zhang, Xuanjing Huang

专题命中 其他LLM ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of EMNLP 2023

NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Rails

Traian Rebedea, Razvan Dinu, Makesh Sreedhar, Christopher Parisien, Jonathan Cohen

专题命中 其他LLM ：LLM(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at EMNLP 2023 - Demo track

Toward Joint Language Modeling for Speech Units and Text

Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP findings 2023

Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base

Cunxiang Wang, Fuli Luo, Yanyang Li, Runxin Xu, Fei Huang, Yue Zhang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments NLPCC-2023

ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning

Wang Lu, Hao Yu, Jindong Wang, Damien Teney, Haohan Wang, Yiqiang Chen, Qiang Yang, Xing Xie, Xiangyang Ji

专题命中 其他LLM ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments Technical report; 26 pages; code will be available at https://github.com/microsoft/PersonalizedFL

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, Ahmed Hassan Awadallah, Ryen W White, Doug Burger, Chi Wang

专题命中 其他LLM ：LLM(title,abstract)；分类 cs.CL、cs.AI

Comments 43 pages (10 pages for the main text, 3 pages for references, and 30 pages for appendices)

COVER: A Heuristic Greedy Adversarial Attack on Prompt-based Learning in Language Models

Zihao Tan, Qingliang Chen, Wenbin Zhu, Yongjian Huang

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Kani: A Lightweight and Highly Hackable Framework for Building Language Model Applications

Andrew Zhu, Liam Dugan, Alyssa Hwang, Chris Callison-Burch

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments In submission to NLP-OSS

Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Models

Aidan O'Gara

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Added reference for McKenzie 2023; updated acknowledgements

How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data?

Huazheng Wang, Daixuan Cheng, Haifeng Sun, Jingyu Wang, Qi Qi, Jianxin Liao, Jing Wang, Cong Liu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ECAI 2023

SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control

Xiaochuang Han, Sachin Kumar, Yulia Tsvetkov

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ACL 2023

Language acquisition: do children and language models follow similar learning stages?

Linnea Evanson, Yair Lakretz, Jean-Rémi King

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACL 2023. *Equal Contribution

How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics

Joonyong Park, Shinnosuke Takamichi, Tomohiko Nakamura, Kentaro Seki, Detai Xin, Hiroshi Saruwatari

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to INTERSPEECH 2023

PaLI-X: On Scaling up a Multilingual Vision and Language Model

Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, AJ Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-In

Zichun Yu, Chenyan Xiong, Shi Yu, Zhiyuan Liu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2023

Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments

Yu Gu, Xiang Deng, Yu Su

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 18 pages, 6 figures, 6 tables; accepted to ACL'2023

Language Models Can Teach Themselves to Program Better

Patrick Haluptzok, Matthew Bowers, Adam Tauman Kalai

专题命中 其他LLM ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 22 pages, 14 figures

CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models

Yusheng Su, Xu Han, Zhengyan Zhang, Peng Li, Zhiyuan Liu, Yankai Lin, Jie Zhou, Maosong Sun

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref AI Open 2021

Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension

Son Quoc Tran, Phong Nguyen-Thuan Do, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at The 2023 EACL Student Research Workshop

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments We encourage readers to listen to the audio samples on our demo page: \url{https://aka.ms/vallex}

Towards Zero-Shot Functional Compositionality of Language Models

Hangyeol Yu, Myeongho Jeong, Jamin Shin, Hyeongdon Moon, Juneyoung Park, Seungtaek Choi

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

KILM: Knowledge Injection into Encoder-Decoder Language Models

Yan Xu, Mahdi Namazifar, Devamanyu Hazarika, Aishwarya Padmakumar, Yang Liu, Dilek Hakkani-Tür

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Multilingual Normalization of Temporal Expressions with Masked Language Models

Lukas Lange, Jannik Strötgen, Heike Adel, Dietrich Klakow

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at EACL 2023

Commonsense-Aware Prompting for Controllable Empathetic Dialogue Generation

Yiren Liu, Halil Kilicoglu

专题命中 其他LLM ：prompting(title)；language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted to Workshop on Knowledge Augmented Methods for Natural Language Processing, in conjunction with AAAI 2023

Self-Programming Artificial Intelligence Using Code-Generating Language Models

Alex Sheng, Shankar Padmanabhan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.AI、cs.LG

Understanding Finetuning for Factual Knowledge Extraction from Language Models

Mehran Kazemi, Sid Mittal, Deepak Ramachandran

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Language Model Detoxification in Dialogue with Contextualized Stance Control

Jing Qian, Xifeng Yan

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Findings of EMNLP 2022

SAS: Self-Augmentation Strategy for Language Model Pre-training

Yifei Xu, Jingqiao Zhang, Ru He, Liangzhu Ge, Chao Yang, Cheng Yang, Ying Nian Wu

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 5 figures

Are discrete units necessary for Spoken Language Modeling?

Tu Anh Nguyen, Benoit Sagot, Emmanuel Dupoux

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Entity-Assisted Language Models for Identifying Check-worthy Sentences

Ting Su, Craig Macdonald, Iadh Ounis

专题命中 其他LLM ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 22 pages, 15 tables, 3 figures