Sentinel: Decoding Context Utilization via Attention Probing for Efficient LLM Context Compression
Sentinel: 通过注意力探测解码上下文利用以实现高效LLM上下文压缩
Yong Zhang, Heng Li, Yanwen Huang, Ning Cheng, Yang Guo, Yun Zhu, Yanmeng Wang, Shaojun Wang, Jing Xiao
机构
*
Ping An Technology (Shenzhen) Co., Ltd., China(平安科技(深圳)有限公司,中国)
;
University of Science and Technology of China(中国科学技术大学)
;
University of Electronic Science and Technology of China(电子科技大学)