语言大模型 / LLM

EASE: Practical and Efficient Safety Alignment for Small Language Models

Haonan Shi, Guoli Wang, Tu Ouyang, An Wang

专题命中 效率与部署 ：language model(title,abstract)；small language model(title,abstract)；分类 cs.LG

Comments Accepted to AAAI 2026

GlitchMiner: Mining Glitch Tokens in Large Language Models via Gradient-based Discrete Optimization

Zihui Wu, Haichang Gao, Ping Wang, Shudong Zhang, Zhaoxiang Liu, Shiguo Lian

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

The Role of High-Performance GPU Resources in Large Language Model Based Radiology Imaging Diagnosis

Jyun-Ping Kao

机构 * Graduate Institute of Biomedical Electronics and Bioinformatics（生物医学电子与生物信息学研究生院） ； National Taiwan University（台湾大学） 纠错

专题命中 效率与部署 ：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL

Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation

Martin Genzel, Patrick Putzky, Pengfei Zhao, Sebastian Schulze, Mattes Mollenhauer, Robert Seidel, Stefan Dietzel, Thomas Wollmann

机构 * Merantix Momentum（梅兰特克斯动力） 纠错

专题命中 效率与部署 ：large language model(title)；language model(title)；foundation model(abstract)；post-training(abstract)

Comments Code available under https://github.com/merantix-momentum/acip

Journal ref Transactions on Machine Learning Research, November 2025

LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model

Wei Shao, Lingchao Zheng, Pengyu Wang, Peizhen Zheng, Jun Li, Yuwei Fan

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Knowledge Graph-enhanced Large Language Model for Incremental Game PlayTesting

Enhong Mu, Jinyu Cai, Yijun Lu, Mingyue Zhang, Kenji Tei, Jialong Li

机构 * Southwest University（西南大学） ； Waseda University（早稻田大学） ； Institute of Science Tokyo（东京科学研究院） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

IG-Pruning: Input-Guided Block Pruning for Large Language Models

Kangyu Qiao, Shaolei Zhang, Yang Feng

机构 * Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences (ICT/CAS)（智能信息处理重点实验室，计算技术研究所，中国科学院） ； Key Laboratory of AI Safety, Chinese Academy of Sciences（人工智能安全重点实验室，中国科学院） ； University of Chinese Academy of Sciences, Beijing, China（中国科学院大学，北京，中国） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025. Code is available at https://github.com/ictnlp/IG-Pruning

Journal ref https://aclanthology.org/2025.emnlp-main.537/

ShortV: Efficient Multimodal Large Language Models by Freezing Visual Tokens in Ineffective Layers

Qianhao Yuan, Qingyu Zhang, Yanjiang Liu, Jiawei Chen, Yaojie Lu, Hongyu Lin, Jia Zheng, Xianpei Han, Le Sun

机构 * Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Published as a conference paper at ICCV 2025. Project page: https://github.com/icip-cas/ShortV

Modular Task Decomposition and Dynamic Collaboration in Multi-Agent Systems Driven by Large Language Models

Shuaidong Pan, Di Wu

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching

Sungmin Yun, Kwanhee Kyung, Juhwan Cho, Jaewan Choi, Jongmin Kim, Byeongho Kim, Sukhan Lee, Kyomin Sohn, Jung Ho Ahn

机构 * Seoul National University（首尔国立大学） ； Samsung Electronics（三星电子） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 15 pages, 16 figures, accepted at MICRO 2024

A Simple Linear Patch Revives Layer-Pruned Large Language Models

Xinrui Chen, Haoli Bai, Tao Yuan, Ruikang Liu, Kang Zhao, Xianzhi Yu, Lu Hou, Tian Guan, Yonghong He, Chun Yuan

机构 * Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院） ； Huawei Technologies（华为技术） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 26 pages, accepted to NeurIPS 2025

KARIPAP: Quantum-Inspired Tensor Network Compression of Large Language Models Using Infinite Projected Entangled Pair States and Tensor Renormalization Group

Azree Nazri

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 28 pages

Restoring Pruned Large Language Models via Lost Component Compensation

Zijian Feng, Hanzhang Zhou, Zixiao Zhu, Tianjiao Li, Jia Jim Deryl Chua, Lee Onn Mak, Gee Wah Ng, Kezhi Mao

机构 * School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore（电子与电气工程学院，南洋理工大学，新加坡） ； Home Team Science and Technology Agency (HTX), Singapore（科技局（HTX），新加坡） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments NeurIPS 2025 Spotlight

RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models

Xueyuan Lin, Cehao Yang, Ye Ma, Ming Li, Rongjunchen Zhang, Yang Ni, Xiaojun Wu, Chengjin Xu, Jian Guo, Hui Xiong

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）） ； IDEA Research（IDEA研究院） ； Hithink RoyalFlush Information Network Co., Ltd（慧思皇家Flush信息网络有限公司） ； DataArc Tech Ltd（DataArc科技有限公司） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

SecureInfer: Heterogeneous TEE-GPU Architecture for Privacy-Critical Tensors for Large Language Model Deployment

Tushar Nayan, Ziqi Zhang, Ruimin Sun

机构 * Florida International University（佛罗里达国际大学） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted at IEEE Intelligent Computing and Systems at the Edge (ICEdge) 2025

PruneHal: Reducing Hallucinations in Multi-modal Large Language Models through Adaptive KV Cache Pruning

Fengyuan Sun, Hui Chen, Xinhao Xu, Dandan Zheng, Jingdong Chen, Jun Zhou, Jungong Han, Guiguang Ding

机构 * School of Software, Tsinghua University（清华大学软件学院） ； Ant Group（蚂蚁集团） ； Department of Automation, Tsinghua University（清华大学自动化系） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Models

Zeyu Li, Chuanfu Xiao, Yang Wang, Xiang Liu, Zhenheng Tang, Baotong Lu, Mao Yang, Xinyu Chen, Xiaowen Chu

机构 * DSA Thrust, The Hong Kong University of Science and Technology (Guangzhou)（DSA团队，香港科学与技术大学（广州）） ； School of Mathematics and Computational Science, Xiangtan University（数学与计算科学学院，湘潭大学） ； Microsoft（微软） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Efficient and Responsible Adaptation of Large Language Models for Robust and Equitable Top-k Recommendations

Kirandeep Kaur, Vinayak Gupta, Manya Chadha, Chirag Shah

机构 * University of Washington（华盛顿大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments arXiv admin note: text overlap with arXiv:2405.00824

Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models

Rui Hu, Delai Qiu, Shuyu Wei, Jiaming Zhang, Yining Wang, Shengping Liu, Jitao Sang

机构 * Beijing Key Lab of Traffic Data Analysis and Mining（北京交通数据挖掘重点实验室） ； Beijing Jiaotong University（北京交通大学） ； Unisound AI Technology Co., Ltd.（Unisound人工智能技术有限公司） ； Peng Cheng Lab（鹏城实验室） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted to ACL 2025 Findings

Journal ref Findings of the Association for Computational Linguistics: ACL 2025

Cross-layer Attention Sharing for Pre-trained Large Language Models

Yongyu Mu, Yuzhang Wu, Yuchun Fan, Chenglong Wang, Hengyu Li, Jiali Zeng, Qiaozhi He, Murun Yang, Fandong Meng, Jie Zhou, Tong Xiao, Jingbo Zhu

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments A version accepted by TACL, prior to its publication by MIT Press

Language Surgery in Multilingual Large Language Models

Joanito Agili Lopo, Muhammad Ravi Shulthan Habibi, Tack Hwa Wong, Muhammad Ilham Ghozali, Fajri Koto, Genta Indra Winata, Peerat Limkonchotiwat, Alham Fikri Aji, Samuel Cahyawijaya

机构 * SEACrowd ； Kreasof AI ； Universitas Indonesia（印度尼西亚大学） ； MBZUAI ； Capital One ； AI Singapore（AI新加坡） ； Cohere 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

PredGen: Accelerated Inference of Large Language Models through Input-Time Speculation for Real-Time Speech Interaction

Shufan Li, Aditya Grover

机构 * University of California, Los Angeles（加州大学洛杉矶分校） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 16 pages,4 figures

Reliable End-to-End Material Information Extraction from the Literature with Source-Tracked Multi-Stage Large Language Models

Xin Wang, Anshu Raj, Matthew Luebbe, Haiming Wen, Shuozhi Xu, Kun Lu

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 27 pages, 4 figures, 7 tables

Self Speculative Decoding for Diffusion Large Language Models

Yifeng Gao, Ziang Ji, Yuxuan Wang, Biqing Qi, Hanlin Xu, Linfeng Zhang

机构 * School of AI, Shanghai Jiao Tong University（上海交通大学人工智能学院） ； University of Science and Technology of China（中国科学技术大学） ； Xidian University（西安电子科技大学） ； Shanghai AI Laboratory（上海人工智能实验室） ； Huawei Technologies Ltd.（华为技术有限公司） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

RAPID: An Efficient Reinforcement Learning Algorithm for Small Language Models

Lianghuan Huang, Sagnik Anupam, Insup Lee, Shuo Li, Osbert Bastani

机构 * University of Pennsylvania（宾夕法尼亚大学） 纠错

专题命中 效率与部署 ：language model(title,abstract)；small language model(title,abstract)；分类 cs.LG

Beyond the Final Layer: Intermediate Representations for Better Multilingual Calibration in Large Language Models

Ej Zhou, Caiqi Zhang, Tiancheng Hu, Chengzu Li, Nigel Collier, Ivan Vulić, Anna Korhonen

机构 * Language Technology Lab, University of Cambridge（剑桥大学语言技术实验室） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Dynamic Bundling with Large Language Models for Zero-Shot Inference on Text-Attributed Graphs

Yusheng Zhao, Qixin Zhang, Xiao Luo, Weizhi Zhang, Zhiping Xiao, Wei Ju, Philip S. Yu, Ming Zhang

机构 * Peking University（北京大学） ； Nanyang Technological University（南洋理工大学） ； University of Washington（华盛顿大学） ； University of California, Los Angeles（加州大学洛杉矶分校） ； University of Illinois Chicago（伊利诺伊大学芝加哥分校） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted by NeurIPS 2025

TVS Sidekick: Challenges and Practical Insights from Deploying Large Language Models in the Enterprise

Paula Reyero Lobo, Kevin Johnson, Bill Buchanan, Matthew Shardlow, Ashley Williams, Samuel Attwood

机构 * TVS Supply Chain Solutions（TVS供应链解决方案） ； Manchester Metropolitan University（曼彻斯特 Metropolitan 大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Accepted at EthicalLLMs@RANLP2025

Detecting (Un)answerability in Large Language Models with Linear Directions

Maor Juliet Lavi, Tova Milo, Mor Geva

机构 * Blavatnik School of Computer Science and AI, Tel Aviv University（巴尔-艾赫大学计算机科学与人工智能学院） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Position IDs Matter: An Enhanced Position Layout for Efficient Context Compression in Large Language Models

Runsong Zhao, Xin Liu, Xinyu Liu, Pengcheng Huang, Chunyang Xiao, Tong Xiao, Jingbo Zhu

机构 * NLP Lab, School of Computer Science and Engineering, Northeastern University, Shenyang, China（东北大学计算机科学与工程学院自然语言处理实验室） ； NiuTrans Research, Shenyang, China（NiuTrans研究院） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL