语言大模型 / LLM - arXivDaily 专题

2410.23956 2024-11-07 cs.CL 85%

Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Language

Jiayi Wang, Yao Lu, Maurice Weber, Max Ryabinin, Yihong Chen, Raphael Tang, Pontus Stenetorp

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2410.23933 2024-11-01 cs.CL 85%

Language Models can Self-Lengthen to Generate Long Texts

Shanghaoran Quan, Tianyi Tang, Bowen Yu, An Yang, Dayiheng Liu, Bofei Gao, Jianhong Tu, Yichang Zhang, Jingren Zhou, Junyang Lin

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；post-training(abstract)；分类 cs.CL

2402.09299 2024-11-01 cs.SE cs.LG 85%

Trained Without My Consent: Detecting Code Inclusion In Language Models Trained on Code

Vahid Majdinasab, Amin Nikanjam, Foutse Khomh

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.LG

Comments Accepted for publication in TOSEM (ACM Transactions on Software Engineering and Methodology)

2406.01441 2024-10-28 cs.CL 85%

LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

Yongjing Yin, Jiali Zeng, Yafu Li, Fandong Meng, Yue Zhang

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Journal ref EMNLP2024 Findings

2407.03585 2024-10-25 cs.CL 85%

Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrieval

Kazuaki Furumai, Roberto Legaspi, Julio Vizcarra, Yudai Yamazaki, Yasutaka Nishimura, Sina J. Semnani, Kazushi Ikeda, Weiyan Shi, Monica S. Lam

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Findings of EMNLP 2024

2405.19366 2024-10-25 eess.SP cs.AI 85%

ECG Semantic Integrator (ESI): A Foundation ECG Model Pretrained with LLM-Enhanced Cardiological Text

Han Yu, Peikun Guo, Akane Sano

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；pretraining(abstract)

2410.16166 2024-10-22 cs.CV cs.CL 85%

Beyond Filtering: Adaptive Image-Text Quality Enhancement for MLLM Pretraining

Han Huang, Yuqi Huo, Zijia Zhao, Haoyu Lu, Shu Wu, Bingning Wang, Qiang Liu, Weipeng Chen, Liang Wang

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2410.07304 2024-10-11 cs.HC cs.AI 85%

The Moral Turing Test: Evaluating Human-LLM Alignment in Moral Decision-Making

Basile Garcia, Crystal Qian, Stefano Palminteri

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2409.01882 2024-10-01 cs.CL 85%

Investigating Expert-in-the-Loop LLM Discourse Patterns for Ancient Intertextual Analysis

Ray Umphrey, Jesse Roberts, Lindsey Roberts

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2409.02727 2024-09-06 cs.CL cs.IR 85%

Pooling And Attention: What Are Effective Designs For LLM-Based Embedding Models?

Yixuan Tang, Yi Yang

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments https://github.com/yixuantt/PoolingAndAttn

2408.11746 2024-08-22 cs.LG 85%

Mixed Sparsity Training: Achieving 4$\times$ FLOP Reduction for Transformer Pretraining

Pihe Hu, Shaolong Li, Longbo Huang

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

2408.09215 2024-08-20 eess.AS cs.CL cs.SD 85%

Generating Data with Text-to-Speech and Large-Language Models for Conversational Speech Recognition

Samuele Cornell, Jordan Darefsky, Zhiyao Duan, Shinji Watanabe

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

Comments To appear at SynData4GenAI 2024 workshop

2403.01749 2024-07-25 cs.CL 85%

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

Chulin Xie, Zinan Lin, Arturs Backurs, Sivakanth Gopi, Da Yu, Huseyin A Inan, Harsha Nori, Haotian Jiang, Huishuai Zhang, Yin Tat Lee, Bo Li, Sergey Yekhanin

专题命中预训练与数据：foundation model(title)；LLM(abstract)；large language model(abstract)；language model(abstract)

Comments ICML'24 Spotlight

2407.00322 2024-07-02 cs.CL 85%

LLM-Generated Natural Language Meets Scaling Laws: New Explorations and Data Augmentation Methods

Zhenhua Wang, Guang Xu, Ming Ren

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2405.05506 2024-06-26 cs.CL 85%

Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias

Shan Chen, Jack Gallifant, Mingye Gao, Pedro Moreira, Nikolaj Munch, Ajay Muthukkumar, Arvind Rajan, Jaya Kolluri, Amelia Fiske, Janna Hastings, Hugo Aerts, Brian Anthony, Leo Anthony Celi, William G. La Cava, Danielle S. Bitterman

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

Comments Submitted for review, data visualization tool available at: www.crosscare.net

2401.06408 2024-06-24 cs.CL 85%

AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters

Li Lucy, Suchin Gururangan, Luca Soldaini, Emma Strubell, David Bamman, Lauren F. Klein, Jesse Dodge

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 28 pages, 13 figures. Association for Computational Linguistics (ACL) 2024

2401.05163 2024-06-21 cs.CV cs.AI 85%

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA

Jiawei Chen, Dingkang Yang, Yue Jiang, Yuxuan Lei, Lihua Zhang

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments ICANN, 2024

2312.12423 2024-06-21 cs.CV cs.AI 85%

Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Model

Shraman Pramanick, Guangxing Han, Rui Hou, Sayan Nag, Ser-Nam Lim, Nicolas Ballas, Qifan Wang, Rama Chellappa, Amjad Almahairi

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；instruction tuning(abstract)；分类 cs.AI

Comments CVPR 2024 Highlight

2403.07750 2024-06-10 cs.CV cs.AI 85%

Synth$^2$: Boosting Visual-Language Models with Synthetic Captions and Image Embeddings

Sahand Sharifzadeh, Christos Kaplanis, Shreya Pathak, Dharshan Kumaran, Anastasija Ilic, Jovana Mitrovic, Charles Blundell, Andrea Banino

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.AI

Comments 9 pages, 6 figures

2310.09676 2024-05-29 cs.RO cs.AI 85%

Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning

Jiachen Li, Qiaozi Gao, Michael Johnston, Xiaofeng Gao, Xuehai He, Suhaila Shakiah, Hangjie Shi, Reza Ghanadan, William Yang Wang

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted by ICML 2024. Project page: https://midas-icml.github.io

2402.16910 2024-05-27 cs.SE cs.AI 85%

NeSy is alive and well: A LLM-driven symbolic approach for better code comment data generation and classification

Hanna Abi Akl

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 19 pages, 5 figures, accepted for the GeNeSy workshop at the Extended Semantic Web Conference (ESWC) 2024

2401.00396 2024-05-20 cs.CL 85%

RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models

Cheng Niu, Yuanhao Wu, Juno Zhu, Siliang Xu, Kashun Shum, Randy Zhong, Juntong Song, Tong Zhang

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL

2405.09335 2024-05-16 cs.CL 85%

Prompting-based Synthetic Data Generation for Few-Shot Question Answering

Maximilian Schmidt, Andrea Bartezzaghi, Ngoc Thang Vu

专题命中预训练与数据：prompting(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments LREC-COLING 2024

2405.08502 2024-05-15 cs.CL 85%

Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure

Odysseas S. Chlapanis, Ion Androutsopoulos, Dimitrios Galanis

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments To be published in SemEval-2024

2405.08134 2024-05-15 cs.CL 85%

Many-Shot Regurgitation (MSR) Prompting

Shashank Sonkar, Richard G. Baraniuk

专题命中预训练与数据：prompting(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2310.05737 2024-04-01 cs.CV cs.AI cs.MM 85%

Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation

Lijun Yu, José Lezama, Nitesh B. Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Vighnesh Birodkar, Agrim Gupta, Xiuye Gu, Alexander G. Hauptmann, Boqing Gong, Ming-Hsuan Yang, Irfan Essa, David A. Ross, Lu Jiang

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.AI

Comments ICLR 2024

2401.15842 2024-03-26 cs.CV cs.AI 85%

LCV2: An Efficient Pretraining-Free Framework for Grounded Visual Question Answering

Yuhan Chen, Lumei Su, Lihua Chen, Zhiwei Lin

专题命中预训练与数据：pretraining(title)；LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 21 pages,9 figures

2403.02626 2024-03-21 cs.CV cs.LG 85%

Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use

Imad Eddine Toubal, Aditya Avinash, Neil Gordon Alldrin, Jan Dlabal, Wenlei Zhou, Enming Luo, Otilia Stretcu, Hao Xiong, Chun-Ta Lu, Howard Zhou, Ranjay Krishna, Ariel Fuxman, Tom Duerig

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；foundation model(abstract)

2402.04004 2024-02-12 cs.LG 85%

Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought

Alex Havrilla, Maia Iyer

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；pretraining(abstract)

2305.18582 2024-02-12 cs.CL 85%

Information Association for Language Model Updating by Mitigating LM-Logical Discrepancy

Pengfei Yu, Heng Ji

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL

1. 预训练与数据 12379 篇

Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Language

Language Models can Self-Lengthen to Generate Long Texts

Trained Without My Consent: Detecting Code Inclusion In Language Models Trained on Code

LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrieval

ECG Semantic Integrator (ESI): A Foundation ECG Model Pretrained with LLM-Enhanced Cardiological Text

Beyond Filtering: Adaptive Image-Text Quality Enhancement for MLLM Pretraining

The Moral Turing Test: Evaluating Human-LLM Alignment in Moral Decision-Making

Investigating Expert-in-the-Loop LLM Discourse Patterns for Ancient Intertextual Analysis

Pooling And Attention: What Are Effective Designs For LLM-Based Embedding Models?

Mixed Sparsity Training: Achieving 4$\times$ FLOP Reduction for Transformer Pretraining

Generating Data with Text-to-Speech and Large-Language Models for Conversational Speech Recognition

Differentially Private Synthetic Data via Foundation Model APIs 2: Text

LLM-Generated Natural Language Meets Scaling Laws: New Explorations and Data Augmentation Methods

Cross-Care: Assessing the Healthcare Implications of Pre-training Data on Language Model Bias

AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA

Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Model

Synth$^2$: Boosting Visual-Language Models with Synthetic Captions and Image Embeddings

Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning

NeSy is alive and well: A LLM-driven symbolic approach for better code comment data generation and classification

RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models

Prompting-based Synthetic Data Generation for Few-Shot Question Answering

Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure

Many-Shot Regurgitation (MSR) Prompting

Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation

LCV2: An Efficient Pretraining-Free Framework for Grounded Visual Question Answering

Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use

Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought

Information Association for Language Model Updating by Mitigating LM-Logical Discrepancy