语言大模型 / LLM - arXivDaily 专题

2312.07141 2024-11-20 cs.CL 88%

Multilingual large language models leak human stereotypes across language boundaries

Yang Trista Cao, Anna Sotnikova, Jieyu Zhao, Linda X. Zou, Rachel Rudinger, Hal Daume

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2406.11214 2024-11-15 cs.CL 88%

Problematic Tokens: Tokenizer Bias in Large Language Models

Jin Yang, Zhiqiang Wang, Yanbin Lin, Zunduo Zhao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 11th IEEE Special session on Privacy and Security of Big Data (PSBD 2024)

2411.07715 2024-11-13 cs.AI 88%

Training Data for Large Language Model

Yiming Ju, Huanhuan Ma

专题命中预训练与数据：language model(title,abstract)；large language model(title)；pretraining(abstract)；分类 cs.AI

Comments in Chinese language

2410.14479 2024-10-21 cs.CR cs.LG 88%

Backdoored Retrievers for Prompt Injection Attacks on Retrieval Augmented Generation of Large Language Models

Cody Clop, Yannick Teglia

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 12 pages, 5 figures

2410.11451 2024-10-16 cs.CL 88%

Tending Towards Stability: Convergence Challenges in Small Language Models

Richard Diehl Martinez, Pietro Lesci, Paula Buttery

专题命中预训练与数据：language model(title,abstract)；small language model(title)；pretraining(abstract)；分类 cs.CL

2410.11084 2024-10-16 cs.CL 88%

Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts

Sharon Levy, William D. Adler, Tahilin Sanchez Karver, Mark Dredze, Michelle R. Kaufman

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments EMNLP Findings 2024

2410.10323 2024-10-15 cs.CL 88%

MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media

Wei Zhai, Nan Bai, Qing Zhao, Jianqiang Li, Fan Wang, Hongzhi Qi, Meng Jiang, Xiaoqin Wang, Bing Xiang Yang, Guanghui Fu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.10303 2024-10-15 cs.CL 88%

A Comparative Study of Translation Bias and Accuracy in Multilingual Large Language Models for Cross-Language Claim Verification

Aryan Singhal, Veronica Shao, Gary Sun, Ryan Ding, Jonathan Lu, Kevin Zhu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to ATTRIB @ NeurIPS 2024

2407.15489 2024-10-08 cs.CL 88%

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives

Zihao Li, Shaoxiong Ji, Timothee Mickus, Vincent Segonne, Jörg Tiedemann

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

Comments Proceedings of EMNLP 2024

2410.03341 2024-10-07 cs.CL 88%

Zero-Shot Fact Verification via Natural Logic and Large Language Models

Marek Strong, Rami Aly, Andreas Vlachos

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2024

2409.12278 2024-10-04 cs.CL 88%

Making Large Language Models into World Models with Precondition and Effect Knowledge

Kaige Xie, Ian Yang, John Gunerli, Mark Riedl

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2408.03560 2024-10-04 cs.LG stat.ML 88%

In2Core: Leveraging Influence Functions for Coreset Selection in Instruction Finetuning of Large Language Models

Ayrton San Joaquin, Bin Wang, Zhengyuan Liu, Nicholas Asher, Brian Lim, Philippe Muller, Nancy F. Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments EMNLP 2024 - Findings

2410.01708 2024-10-03 cs.CL cs.SI 88%

Examining the Role of Relationship Alignment in Large Language Models

Kristen M. Altenburger, Hongda Jiang, Robert E. Kraut, Yi-Chia Wang, Jane Dwivedi-Yu

专题命中预训练与数据：large language model(title)；language model(title)；LLM(abstract)；prompting(abstract)

2409.17391 2024-09-30 cs.CL 88%

Scaling Behavior for Large Language Models regarding Numeral Systems: An Example using Pythia

Zhejian Zhou, Jiayu Wang, Dahua Lin, Kai Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments EMNLP 2024 Findings

2409.17527 2024-09-27 cs.CL 88%

Data Proportion Detection for Optimized Data Management for Large Language Models

Hao Liang, Keshi Zhao, Yajie Yang, Bin Cui, Guosheng Dong, Zenan Zhou, Wentao Zhang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2310.12537 2024-09-23 cs.CL 88%

ExtractGPT: Exploring the Potential of Large Language Models for Product Attribute Value Extraction

Alexander Brinkmann, Roee Shraga, Christian Bizer

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2409.12695 2024-09-20 cs.CL cs.IR 88%

Exploring Large Language Models for Product Attribute Value Identification

Kassem Sabeh, Mouna Kacimi, Johann Gamper, Robert Litschko, Barbara Plank

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2407.00454 2024-09-18 cs.CL 88%

Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capability

Ryokan Ri, Shun Kiyono, Sho Takase

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2402.06120 2024-09-06 cs.CL 88%

Exploring Group and Symmetry Principles in Large Language Models

Shima Imani, Hamid Palangi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2408.17024 2024-09-04 cs.CL 88%

InkubaLM: A small language model for low-resource African languages

Atnafu Lambebo Tonja, Bonaventure F. P. Dossou, Jessica Ojo, Jenalea Rajab, Fadel Thior, Eric Peter Wairagala, Anuoluwapo Aremu, Pelonomi Moiloa, Jade Abbott, Vukosi Marivate, Benjamin Rosman

专题命中预训练与数据：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL

2311.09552 2024-08-16 cs.CL 88%

Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition

Tariq Alhindi, Smaranda Muresan, Preslav Nakov

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2408.07975 2024-08-16 cs.RO cs.CL cs.CV 88%

Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Models

Tianyu Wang, Haitao Lin, Junqiu Yu, Yanwei Fu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by IROS 2024. 8 pages, 5 figures. See https://star-uu-wang.github.io/Polaris/

2408.03524 2024-08-08 cs.CL 88%

EgyBERT: A Large Language Model Pretrained on Egyptian Dialect Corpora

Faisal Qarah

专题命中预训练与数据：language model(title,abstract)；large language model(title)；pretraining(abstract)；分类 cs.CL

2408.03506 2024-08-08 cs.CL 88%

1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality Data

Calvin Tan, Jerome Wang

专题命中预训练与数据：language model(title,abstract)；pretraining(title)；LLM(abstract)；分类 cs.CL

Comments Technical Report for 1.5-Pints

2407.18897 2024-07-29 cs.LG cs.NE q-bio.QM 88%

Small Molecule Optimization with Large Language Models

Philipp Guevorguian, Menua Bedrosian, Tigran Fahradyan, Gayane Chilingaryan, Hrant Khachatrian, Armen Aghajanyan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2407.13657 2024-07-19 cs.CL 88%

FuLG: 150B Romanian Corpus for Language Model Pretraining

Vlad-Andrei Bădoiu, Mihai-Valentin Dumitru, Alexandru M. Gherghescu, Alexandru Agache, Costin Raiciu

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

2407.12580 2024-07-18 cs.CL cs.CV cs.IR 88%

E5-V: Universal Embeddings with Multimodal Large Language Models

Ting Jiang, Minghui Song, Zihan Zhang, Haizhen Huang, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Code and models are available at https://github.com/kongds/E5-V

2407.09250 2024-07-15 cs.NI cs.LG 88%

FedsLLM: Federated Split Learning for Large Language Models over Communication Networks

Kai Zhao, Zhaohui Yang, Chongwen Huang, Xiaoming Chen, Zhaoyang Zhang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2407.07263 2024-07-11 cs.CL 88%

Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models

Jupinder Parmar, Sanjev Satheesh, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

Comments Preprint. Under review

2407.03611 2024-07-08 cs.SE cs.AI 88%

An Empirical Study on Capability of Large Language Models in Understanding Code Semantics

Thu-Trang Nguyen, Thanh Trong Vu, Hieu Dinh Vo, Son Nguyen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

1. 预训练与数据 12353 篇

Multilingual large language models leak human stereotypes across language boundaries

Problematic Tokens: Tokenizer Bias in Large Language Models

Training Data for Large Language Model

Backdoored Retrievers for Prompt Injection Attacks on Retrieval Augmented Generation of Large Language Models

Tending Towards Stability: Convergence Challenges in Small Language Models

Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts

MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media

A Comparative Study of Translation Bias and Accuracy in Multilingual Large Language Models for Cross-Language Claim Verification

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives

Zero-Shot Fact Verification via Natural Logic and Large Language Models

Making Large Language Models into World Models with Precondition and Effect Knowledge

In2Core: Leveraging Influence Functions for Coreset Selection in Instruction Finetuning of Large Language Models

Examining the Role of Relationship Alignment in Large Language Models

Scaling Behavior for Large Language Models regarding Numeral Systems: An Example using Pythia

Data Proportion Detection for Optimized Data Management for Large Language Models

ExtractGPT: Exploring the Potential of Large Language Models for Product Attribute Value Extraction

Exploring Large Language Models for Product Attribute Value Identification

Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capability

Exploring Group and Symmetry Principles in Large Language Models

InkubaLM: A small language model for low-resource African languages

Large Language Models are Few-Shot Training Example Generators: A Case Study in Fallacy Recognition

Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Models

EgyBERT: A Large Language Model Pretrained on Egyptian Dialect Corpora

1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality Data

Small Molecule Optimization with Large Language Models

FuLG: 150B Romanian Corpus for Language Model Pretraining

E5-V: Universal Embeddings with Multimodal Large Language Models

FedsLLM: Federated Split Learning for Large Language Models over Communication Networks

Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models

An Empirical Study on Capability of Large Language Models in Understanding Code Semantics