语言大模型 / LLM

TTAQ: Towards Stable Post-training Quantization in Continuous Domain Adaptation

Junrui Xiao, Zhikai Li, Lianwei Yang, Yiduo Mei, Qingyi Gu

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

PTSBench: A Comprehensive Post-Training Sparsity Benchmark Towards Algorithms and Models

Zining Wnag, Jinyang Guo, Ruihao Gong, Yang Yong, Aishan Liu, Yushi Huang, Jiaheng Liu, Xianglong Liu

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

Catastrophic Goodhart: regularizing RLHF with KL divergence does not mitigate heavy-tailed reward misspecification

Thomas Kwa, Drake Thomas, Adrià Garriga-Alonso

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；分类 cs.LG

Comments Mechanistic Interpretability workshop at ICML 2024; Main conference poster at NeurIPS 2024

AGILE: A Novel Reinforcement Learning Framework of LLM Agents

Peiyuan Feng, Yichen He, Guanhua Huang, Yuan Lin, Hanchong Zhang, Yuchen Zhang, Hang Li

专题命中 后训练与偏好优化 ：LLM(title,abstract)；分类 cs.LG

Comments accepted by NeurIPS 2024

A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors

Naaman Tan, Josef Valvoda, Tianyu Liu, Anej Svete, Yanxia Qin, Kan Min-Yen, Ryan Cotterell

专题命中 后训练与偏好优化 ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2024

Decoding-Time Language Model Alignment with Multiple Objectives

Ruizhe Shi, Yifang Chen, Yushi Hu, Alisa Liu, Hannaneh Hajishirzi, Noah A. Smith, Simon S. Du

专题命中 后训练与偏好优化 ：language model(title,abstract)；分类 cs.LG

Comments NeurIPS accepted version

Antigen-Specific Antibody Design via Direct Energy-based Preference Optimization

Xiangxin Zhou, Dongyu Xue, Ruizhe Chen, Zaixiang Zheng, Liang Wang, Quanquan Gu

专题命中 后训练与偏好优化 ：preference optimization(title,abstract)；分类 cs.LG

Comments Accepted to NeurIPS 2024

A Post-Training Approach for Mitigating Overfitting in Quantum Convolutional Neural Networks

Aakash Ravindra Shinde, Charu Jain, Amir Kalev

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

Comments 9 pages, 14 images, 6 tables

Journal ref Phys Rev A 110 042409 (2024)

Mitigating the Alignment Tax of RLHF

Yong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao, Jianmeng Liu, Jipeng Zhang, Rui Pan, Haoxiang Wang, Wenbin Hu, Hanning Zhang, Hanze Dong, Renjie Pi, Han Zhao, Nan Jiang, Heng Ji, Yuan Yao, Tong Zhang

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；分类 cs.LG

Comments EMNLP 2024 Main

MetaAug: Meta-Data Augmentation for Post-Training Quantization

Cuong Pham, Hoang Anh Dung, Cuong C. Nguyen, Trung Le, Dinh Phung, Gustavo Carneiro, Thanh-Toan Do

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

Comments Accepted by ECCV 2024

Style Transfer with Multi-iteration Preference Optimization

Shuai Liu, Jonathan May

专题命中 后训练与偏好优化 ：preference optimization(title,abstract)；分类 cs.CL

Post-training Quantization for Text-to-Image Diffusion Models with Progressive Calibration and Activation Relaxing

Siao Tang, Xin Wang, Hong Chen, Chaoyu Guan, Zewen Wu, Yansong Tang, Wenwu Zhu

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

Comments Accepted by ECCV2024

Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF

Han Shen, Zhuoran Yang, Tianyi Chen

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；分类 cs.LG

Comments Shorter version accepted to ICML 2024

UniPTS: A Unified Framework for Proficient Post-Training Sparsity

Jingjing Xie, Yuxin Zhang, Mingbao Lin, Zhihang Lin, Liujuan Cao, Rongrong Ji

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.AI

Comments Accepted by CVPR2024

Mapping Social Choice Theory to RLHF

Jessica Dai, Eve Fleisig

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；分类 cs.AI

MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization

Shuaijie She, Wei Zou, Shujian Huang, Wenhao Zhu, Xiang Liu, Xiang Geng, Jiajun Chen

专题命中 后训练与偏好优化 ：preference optimization(title,abstract)；分类 cs.CL

Comments The project is available at https://github.com/NJUNLP/MAPO

Asymptotics of Language Model Alignment

Joy Qiping Yang, Salman Salamatian, Ziteng Sun, Ananda Theertha Suresh, Ahmad Beirami

专题命中 后训练与偏好优化 ：language model(title,abstract)；分类 cs.LG

The N+ Implementation Details of RLHF with PPO: A Case Study on TL;DR Summarization

Shengyi Huang, Michael Noukhovitch, Arian Hosseini, Kashif Rasul, Weixun Wang, Lewis Tunstall

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；分类 cs.LG

PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Prediction

Erxin Yu, Jing Li, Chunpu Xu

专题命中 后训练与偏好优化 ：language model(title,abstract)；分类 cs.CL

Comments Accepted by COLING 2024

Policy Optimization in RLHF: The Impact of Out-of-preference Data

Ziniu Li, Tian Xu, Yang Yu

专题命中 后训练与偏好优化 ：RLHF(title)；preference optimization(abstract)；分类 cs.LG

Post-Training Overfitting Mitigation in DNN Classifiers

Hang Wang, David J. Miller, George Kesidis

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

RLHF-Blender: A Configurable Interactive Interface for Learning from Diverse Human Feedback

Yannick Metz, David Lindner, Raphaël Baur, Daniel Keim, Mennatallah El-Assady

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；分类 cs.LG

Comments 14 pages, 3 figures

Journal ref ICML2023 Interactive Learning from Implicit Human Feedback Workshop

Lossy and Lossless (L$^2$) Post-training Model Size Compression

Yumeng Shi, Shihao Bai, Xiuying Wei, Ruihao Gong, Jianlei Yang

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.AI

MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statistic

Hang Wang, Zhen Xiang, David J. Miller, George Kesidis

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

SSP: Self-Supervised Post-training for Conversational Search

Quan Tu, Shen Gao, Xiaolong Wu, Zhao Cao, Ji-Rong Wen, Rui Yan

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2023 Findings, Long Paper

Influential Rank: A New Perspective of Post-training for Robust Model against Noisy Labels

Seulki Park, Hwanjun Song, Daeho Um, Dae Ung Jo, Sangdoo Yun, Jin Young Choi

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.AI

Comments 15 pages

Survey on Leveraging Uncertainty Estimation Towards Trustworthy Deep Neural Networks: The Case of Reject Option and Post-training Processing

Mehedi Hasan, Moloud Abdar, Abbas Khosravi, Uwe Aickelin, Pietro Lio', Ibrahim Hossain, Ashikur Rahman, Saeid Nahavandi

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

QFT: Post-training quantization via fast joint finetuning of all degrees of freedom

Alex Finkelstein, Ella Fuchs, Idan Tal, Mark Grobman, Niv Vosco, Eldad Meller

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

Comments Presented at CADL2022 workshop at ECCV2022

Journal ref Computer Vision - {ECCV} 2022 Workshops - Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part {VII}

CPT-V: A Contrastive Approach to Post-Training Quantization of Vision Transformers

Natalia Frumkin, Dibakar Gope, Diana Marculescu

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.AI

PoF: Post-Training of Feature Extractor for Improving Generalization

Ikuro Sato, Ryota Yamada, Masayuki Tanaka, Nakamasa Inoue, Rei Kawakami

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.LG

Comments Accepted to ICML2022. Contains a link to the code