SimLens for Early Exit in Large Language Models: Eliciting Accurate Latent Predictions with One More Token
SimLens用于大型语言模型中的早期退出:通过一个额外的标记获取准确的潜在预测
Ming Ma, Bowen Zheng, Zhongqiao Lin, Tianming Yang
机构
*
Institute of Neuroscience, State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences(中国科学院脑科学与智能技术卓越创新中心神经科学研究所,脑认知与脑启发智能技术国家重点实验室,脑科学与智能技术卓越创新中心)
;
School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院)
专题命中
其他LLM
:large language model(title,abstract);language model(title,abstract);分类 cs.CL
机构
*
The Hong Kong University of Science and Technology(香港科学与技术大学)
;
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
;
New York University(纽约大学)
;
National University of Singapore(新加坡国立大学)
专题命中
其他LLM
:LLM(title,abstract);large language model(abstract);language model(abstract);分类 cs.AI
Phase retrieval technique from regions of unresolvable fringe density using Phase Shifting Interferometry and Liquid Crystal on Silicon (LCOS) Spatial Light Modulator (SLM)
机构
*
School of Computer Science(计算机科学学院)
;
Wuhan University(武汉大学)
;
Zhongguancun Academy(中关村学院)
;
Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan)(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心(济南国家超级计算机中心))
;
Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东科学院))
;
Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing(山东省计算能力互联网与服务计算重点实验室)
;
Shandong Fundamental Research Center for Computer Science(山东省计算机科学基础研究中心)
Shu Liu, Shubham Agarwal, Monishwaran Maheswaran, Mert Cemri, Zhifei Li, Qiuyang Mang, Ashwin Naren, Ethan Boneh, Audrey Cheng, Melissa Z. Pan, Alexander Du, Kurt Keutzer, Alvin Cheung, Alexandros G. Dimakis, Koushik Sen, Matei Zaharia, Ion Stoica