语言大模型 / LLM - arXivDaily 专题

2408.03402 2024-08-08 cs.CL cs.IR 89%

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2408.03092 2024-08-07 cs.CL 89%

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, Yongbin Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 17 pages

2403.08229 2024-08-07 cs.CL 89%

Boosting Disfluency Detection with Large Language Model as Disfluency Generator

Zhenrong Cheng, Jiayan Guo, Hao Sun, Yan Zhang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.12793 2024-07-31 cs.CL 89%

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

Team GLM, :, Aohan Zeng, Bin Xu, Bowen Wang, Chenhui Zhang, Da Yin, Dan Zhang, Diego Rojas, Guanyu Feng, Hanlin Zhao, Hanyu Lai, Hao Yu, Hongning Wang, Jiadai Sun, Jiajie Zhang, Jiale Cheng, Jiayi Gui, Jie Tang, Jing Zhang, Jingyu Sun, Juanzi Li, Lei Zhao, Lindong Wu, Lucen Zhong, Mingdao Liu, Minlie Huang, Peng Zhang, Qinkai Zheng, Rui Lu, Shuaiqi Duan, Shudan Zhang, Shulin Cao, Shuxun Yang, Weng Lam Tam, Wenyi Zhao, Xiao Liu, Xiao Xia, Xiaohan Zhang, Xiaotao Gu, Xin Lv, Xinghan Liu, Xinyi Liu, Xinyue Yang, Xixuan Song, Xunkai Zhang, Yifan An, Yifan Xu, Yilin Niu, Yuantao Yang, Yueyan Li, Yushi Bai, Yuxiao Dong, Zehan Qi, Zhaoyu Wang, Zhen Yang, Zhengxiao Du, Zhenyu Hou, Zihan Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

2407.18723 2024-07-29 cs.LG cs.LO 89%

LLASP: Fine-tuning Large Language Models for Answer Set Programming

Erica Coppolillo, Francesco Calimeri, Giuseppe Manco, Simona Perri, Francesco Ricca

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2407.15415 2024-07-23 cs.CL 89%

LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models

Xi Chen, Songyang Zhang, Qibing Bai, Kai Chen, Satoshi Nakamura

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2407.15071 2024-07-23 cs.DB cs.CL 89%

Relational Database Augmented Large Language Model

Zongyue Qin, Chen Luo, Zhengyang Wang, Haoming Jiang, Yizhou Sun

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2305.14239 2024-07-19 cs.CL 89%

On Learning to Summarize with Large Language Models as References

Yixin Liu, Kejian Shi, Katherine S He, Longtian Ye, Alexander R. Fabbri, Pengfei Liu, Dragomir Radev, Arman Cohan

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2024, GitHub Repo: https://github.com/yixinL7/SumLLM

2404.06138 2024-07-09 cs.CL 89%

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

Samuel Cahyawijaya, Holy Lovenia, Fajri Koto, Rifki Afina Putri, Emmanuel Dave, Jhonson Lee, Nuur Shadieq, Wawan Cenggoro, Salsabil Maulana Akbar, Muhammad Ihza Mahendra, Dea Annisayanti Putri, Bryan Wilie, Genta Indra Winata, Alham Fikri Aji, Ayu Purwarianti, Pascale Fung

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；RLHF(abstract)；分类 cs.CL

Comments Cendol models are released under Apache 2.0 license and will be made publicly available soon

2407.03169 2024-07-04 cs.CL cs.SD eess.AS 89%

Investigating Decoder-only Large Language Models for Speech-to-text Translation

Chao-Wei Huang, Hui Lu, Hongyu Gong, Hirofumi Inaguma, Ilia Kulikov, Ruslan Mavlyutov, Sravya Popuri

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to Interspeech 2024

2402.13659 2024-07-03 cs.CR cs.CL 89%

Privacy-Preserving Instructions for Aligning Large Language Models

Da Yu, Peter Kairouz, Sewoong Oh, Zheng Xu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ICML 2024. Code available at https://github.com/google-research/google-research/tree/master/dp_instructions

2405.11290 2024-07-01 cs.CL 89%

MBIAS: Mitigating Bias in Large Language Models While Retaining Context

Shaina Raza, Ananya Raval, Veronica Chatrath

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.17272 2024-06-26 cs.LG 89%

A Comprehensive Solution to Connect Speech Encoder and Large Language Model for ASR

Van Tung Pham, Yist Lin, Tao Han, Wei Li, Jun Zhang, Lu Lu, Yuxuan Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2406.15981 2024-06-25 cs.CL 89%

Serial Position Effects of Large Language Models

Xiaobo Guo, Soroush Vosoughi

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.03907 2024-06-21 cs.HC cs.AI 89%

Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacy

Efe Bozkir, Süleyman Özdel, Ka Hei Carrie Lau, Mengdi Wang, Hong Gao, Enkelejda Kasneci

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments ACM Conversational User Interfaces 2024

2402.02207 2024-06-19 cs.LG 89%

Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models

Yongshuo Zong, Ondrej Bohdal, Tingyang Yu, Yongxin Yang, Timothy Hospedales

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments ICML 2024

2305.13718 2024-06-18 cs.CL 89%

Exploring Self-supervised Logic-enhanced Training for Large Language Models

Fangkai Jiao, Zhiyang Teng, Bosheng Ding, Zhengyuan Liu, Nancy F. Chen, Shafiq Joty

专题命中指令微调：language model(title,abstract)；large language model(title)；LLM(abstract)；post-training(abstract)

Comments 16 pages, NAACL 2024

2406.09617 2024-06-17 cs.CL cs.HC eess.AS 89%

Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection

Shruti Palaskar, Oggi Rudovic, Sameer Dharur, Florian Pesce, Gautam Krishna, Aswin Sivaraman, Jack Berkowitz, Ahmed Hussen Abdelaziz, Saurabh Adya, Ahmed Tewfik

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at Interspeech 2024

2406.09345 2024-06-14 cs.CL cs.SD eess.AS 89%

DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding

Suwon Shon, Kwangyoun Kim, Yi-Te Hsu, Prashant Sridhar, Shinji Watanabe, Karen Livescu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.10073 2024-06-13 cs.CL 89%

Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence

Weixiang Zhao, Zhuojun Li, Shilong Wang, Yang Wang, Yulin Hu, Yanyan Zhao, Chen Wei, Bing Qin

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments To appear at Findings of ACL 2024

2406.05892 2024-06-11 cs.CR cs.LG cs.SE 89%

Security Vulnerability Detection with Multitask Self-Instructed Fine-Tuning of Large Language Models

Aidan Z. H. Yang, Haoye Tian, He Ye, Ruben Martins, Claire Le Goues

专题命中指令微调：language model(title,abstract)；large language model(title)；LLM(abstract)；prompting(abstract)

2406.05130 2024-06-10 cs.CL 89%

An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models

Xiongtao Zhou, Jie He, Yuhua Ke, Guangyao Zhu, Víctor Gutiérrez-Basulto, Jeff Z. Pan

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ACL finding 2024

2406.04630 2024-06-10 cs.CL 89%

Low-Resource Cross-Lingual Summarization through Few-Shot Learning with Large Language Models

Gyutae Park, Seojin Hwang, Hwanhee Lee

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 7 pages,3 figures

2405.18203 2024-06-10 cs.CL 89%

IAPT: Instruction-Aware Prompt Tuning for Large Language Models

Wei Zhu, Aaron Xuxiang Tian, Congrui Yin, Yuan Ni, Xiaoling Wang, Guotong Xie

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ACL-2024

2406.01392 2024-06-07 cs.CL 89%

Sparsity-Accelerated Training for Large Language Models

Da Ma, Lu Chen, Pengyu Wang, Hongshen Xu, Hanqi Li, Liangtai Sun, Su Zhu, Shuai Fan, Kai Yu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to ACL 2024 Findings

2403.19121 2024-06-06 cs.CL 89%

Code Comparison Tuning for Code Large Language Models

Yufan Jiang, Qiaozhi He, Xiaomin Zhuang, Zhihua Wu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Preprint

2406.00793 2024-06-04 stat.ML cs.LG 89%

Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective

Fabian Falck, Ziyu Wang, Chris Holmes

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Accepted at International Conference on Machine Learning (ICML) 2024

2405.14906 2024-05-27 cs.SE cs.AI 89%

AutoCoder: Enhancing Code Large Language Model with \textsc{AIEV-Instruct}

Bin Lei, Yuchen Li, Qiuwu Chen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.AI

2310.07301 2024-05-24 cs.CL 89%

Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models

Yuchong Sun, Che Liu, Kun Zhou, Jinwen Huang, Ruihua Song, Wayne Xin Zhao, Fuzheng Zhang, Di Zhang, Kun Gai

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；preference optimization(abstract)；分类 cs.CL

2405.10626 2024-05-20 cs.CL 89%

Dynamic data sampler for cross-language transfer learning in large language models

Yudong Li, Yuhao Feng, Wen Zhou, Zhe Zhao, Linlin Shen, Cheng Hou, Xianxu Hou

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ICASSP 2024

1. 指令微调 11547 篇

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

Boosting Disfluency Detection with Large Language Model as Disfluency Generator

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

LLASP: Fine-tuning Large Language Models for Answer Set Programming

LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models

Relational Database Augmented Large Language Model

On Learning to Summarize with Large Language Models as References

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

Investigating Decoder-only Large Language Models for Speech-to-text Translation

Privacy-Preserving Instructions for Aligning Large Language Models

MBIAS: Mitigating Bias in Large Language Models While Retaining Context

A Comprehensive Solution to Connect Speech Encoder and Large Language Model for ASR

Serial Position Effects of Large Language Models

Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacy

Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models

Exploring Self-supervised Logic-enhanced Training for Large Language Models

Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection

DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding

Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence

Security Vulnerability Detection with Multitask Self-Instructed Fine-Tuning of Large Language Models

An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models

Low-Resource Cross-Lingual Summarization through Few-Shot Learning with Large Language Models

IAPT: Instruction-Aware Prompt Tuning for Large Language Models

Sparsity-Accelerated Training for Large Language Models

Code Comparison Tuning for Code Large Language Models

Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective

AutoCoder: Enhancing Code Large Language Model with \textsc{AIEV-Instruct}

Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models

Dynamic data sampler for cross-language transfer learning in large language models