语言大模型 / LLM

GWQ: Gradient-Aware Weight Quantization for Large Language Models

Yihua Shao, Yan Gu, Siyu Chen, Haiyang Liu, Zixian Zhu, Zijian Ling, Minxi Yan, Ziyang Yan, Chenyu Zhang, Michele Magno, Haotong Qin, Yan Wang, Jingcai Guo, Ling Shao, Hao Tang

机构 * PKU（北京大学） ； CASIA（中国科学院自动化研究所） ； THU（清华大学） ； USTB（中国矿业大学） ； UNITN（意大利那不勒斯） ； ETHz（苏黎世联邦理工学院） ； PolyU（香港理工大学） ； UCAS（中国科学院大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

NanoFlow: Towards Optimal Large Language Model Serving Throughput

Kan Zhu, Yufei Gao, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Tian Tang, Qinyu Xu, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Ziren Wang, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Prompt Inference Attack on Distributed Large Language Model Inference Frameworks

Xinjian Luo, Ting Yu, Xiaokui Xiao

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted for publication at CCS 2025

CE-LSLM: Efficient Large-Small Language Model Inference and Communication via Cloud-Edge Collaboration

Pengyan Zhu, Tingting Yang

专题命中 效率与部署 ：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)

Comments 14 pages, 7 figures including subplots

EfficientQAT: Efficient Quantization-Aware Training for Large Language Models

Mengzhao Chen, Wenqi Shao, Peng Xu, Jiahao Wang, Peng Gao, Kaipeng Zhang, Ping Luo

机构 * The University of Hong Kong（香港大学） ； Shanghai AI Laboratory（上海人工智能实验室） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2025 Main, camera ready version

TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Models

Jaewoo Lee, Keyang Xuan, Chanakya Ekbote, Sandeep Polisetty, Yi R. Fung, Paul Pu Liang

机构 * University of North Carolina Chapel Hill（北卡罗来纳大学教堂山分校） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； Massachusetts Institute of Technology（麻省理工学院） ； University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） ； Hong Kong University of Science and Technology（香港科学与技术大学） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)

Comments ACL Findings 2025

Large Language Models for Automated Web-Form-Test Generation: An Empirical Study

Tao Li, Chenhui Cui, Rubing Huang, Dave Towey, Lei Ma

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments To be published in ACM Transactions on Software Engineering and Methodology

The Impact of Large Language Models on Task Automation in Manufacturing Services

Jochen Wulf, Juerg Meierhofer

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments arXiv admin note: text overlap with arXiv:2406.01407

FAS: Fast ANN-SNN Conversion for Spiking Large Language Models

Long Chen, Xiaotian Song, Andy Song, BaDong Chen, Jiancheng Lv, Yanan Sun

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Towards Human-Centric Autonomous Driving: A Fast-Slow Architecture Integrating Large Language Model Guidance with Reinforcement Learning

Chengkai Xu, Jiaqi Liu, Yicheng Guo, Yuhang Zhang, Peng Hang, Jian Sun

机构 * College of Transportation, Tongji University（同济大学交通学院） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

A Weighted Byzantine Fault Tolerance Consensus Driven Trusted Multiple Large Language Models Network

Haoxiang Luo, Gang Sun, Yinqiu Liu, Dongcheng Zhao, Dusit Niyato, Hongfang Yu, Schahram Dustdar

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

PIM Is All You Need: A CXL-Enabled GPU-Free System for Large Language Model Inference

Yufeng Gu, Alireza Khadem, Sumanth Umesh, Ning Liang, Xavier Servot, Onur Mutlu, Ravi Iyer, Reetuparna Das

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments In Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 (ASPLOS'25)

Prompt Inversion Attack against Collaborative Inference of Large Language Models

Wenjie Qu, Yuguang Zhou, Yongji Wu, Tingsong Xiao, Binhang Yuan, Yiming Li, Jiaheng Zhang

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments To appear at IEEE Symposium on Security and Privacy 2025

From Effectiveness to Efficiency: Uncovering Linguistic Bias in Large Language Model-based Code Generation

Weipeng Jiang, Xuanqi Gao, Juan Zhai, Shiqing Ma, Xiaoyu Zhang, Ziyan Lei, Chao Shen

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

X-Fusion: Introducing New Modality to Frozen Large Language Models

Sicheng Mo, Thao Nguyen, Xun Huang, Siddharth Srinivasan Iyer, Yijun Li, Yuchen Liu, Abhishek Tandon, Eli Shechtman, Krishna Kumar Singh, Yong Jae Lee, Bolei Zhou, Yuheng Li

机构 * University of California, Los Angeles（加州大学洛杉矶分校） ； University of Wisconsin–Madison（威斯康星大学麦迪逊分校） ； Adobe Research（Adobe研究院） 纠错

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Project Page: https://sichengmo.github.io/XFusion/

Large Language Models to Accelerate Organic Chemistry Synthesis

Yu Zhang, Yang Han, Shuai Chen, Ruijie Yu, Xin Zhao, Xianbin Liu, Kaipeng Zeng, Mengdi Yu, Jidong Tian, Feng Zhu, Xiaokang Yang, Yaohui Jin, Yanyan Xu

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

SeaLLM: Service-Aware and Latency-Optimized Resource Sharing for Large Language Model Inference

Yihao Zhao, Jiadun Chen, Peng Sun, Lei Li, Xuanzhe Liu, Xin Jin

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Hardware-based Heterogeneous Memory Management for Large Language Model Inference

Soojin Hwang, Jungwoo Kim, Sanghyeon Lee, Hongbeen Kim, Jaehyuk Huh

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

A Dual-Space Framework for General Knowledge Distillation of Large Language Models

Xue Zhang, Songming Zhang, Yunlong Liang, Fandong Meng, Yufeng Chen, Jinan Xu, Jie Zhou

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages, 9 figures, 11 tables, under review. Code is available at: https://github.com/songmzhang/DSKDv2. arXiv admin note: text overlap with arXiv:2406.17328

Large Language Models integration in Smart Grids

Seyyedreza Madani, Ahmadreza Tavasoli, Zahra Khoshtarash Astaneh, Pierre-Olivier Pineau

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Robust Steganography from Large Language Models

Neil Perry, Sanket Gupte, Nishant Pitta, Lior Rotem

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 36 pages, 9 figures

Thanos: A Block-wise Pruning Algorithm for Efficient Large Language Model Compression

Ivan Ilin, Peter Richtarik

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages, 3 Figures, 3 Tables, 2 Algorithms, paper comes with Appendix

Fox-1: Open Small Language Model for Cloud and Edge

Zijian Hu, Jipeng Zhang, Rui Pan, Zhaozhuo Xu, Shanshan Han, Han Jin, Alay Dilipbhai Shah, Dimitris Stripelis, Yuhang Yao, Salman Avestimehr, Tong Zhang, Chaoyang He

专题命中 效率与部署 ：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Base model is available at https://huggingface.co/tensoropera/Fox-1-1.6B and the instruction-tuned version is available at https://huggingface.co/tensoropera/Fox-1-1.6B-Instruct-v0.1

Window Token Concatenation for Efficient Visual Large Language Models

Yifan Li, Wentao Bao, Botao Ye, Zhen Tan, Tianlong Chen, Huan Liu, Yu Kong

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

ReaLM: Reliable and Efficient Large Language Model Inference with Statistical Algorithm-Based Fault Tolerance

Tong Xie, Jiawang Zhao, Zishen Wan, Zuodong Zhang, Yuan Wang, Runsheng Wang, Ru Huang, Meng Li

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 6 pages, 10 figures. Accepted by Design Automation Conference (DAC) 2025

EE-MLLM: A Data-Efficient and Compute-Efficient Multimodal Large Language Model

Feipeng Ma, Yizhou Zhou, Zheyu Zhang, Shilin Yan, Hebei Li, Zilong He, Siying Wu, Fengyun Rao, Yueyi Zhang, Xiaoyan Sun

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Slow-Fast Architecture for Video Multi-Modal Large Language Models

Min Shi, Shihao Wang, Chieh-Yun Chen, Jitesh Jain, Kai Wang, Junjun Xiong, Guilin Liu, Zhiding Yu, Humphrey Shi

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Technical report

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models

Wanhua Li, Renping Zhou, Jiawei Zhou, Yingwei Song, Johannes Herter, Minghan Qin, Gao Huang, Hanspeter Pfister

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)

Comments CVPR 2025. Project Page: https://4d-langsplat.github.io

Understanding the Effectiveness of Coverage Criteria for Large Language Models: A Special Angle from Jailbreak Attacks

Shide Zhou, Tianlin Li, Kailong Wang, Yihao Huang, Ling Shi, Yang Liu, Haoyu Wang

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

LLMigrate: Transforming "Lazy" Large Language Models into Efficient Source Code Migrators

Yuchen Liu, Junhao Hu, Yingdi Shan, Ge Li, Yanzhen Zou, Yihong Dong, Tao Xie

专题命中 效率与部署 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)