CRISP: Compressing Redundancy in Chain-of-Thought via Intrinsic Saliency Pruning
通过内在显著性剪枝压缩链式推理中的冗余
Yangsong Lan, Hongliang Dai, Piji Li
机构
*
College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics(南京航空航天大学人工智能学院)
;
The Key Laboratory of Brain-Machine Intelligence Technology, Ministry of Education(教育部脑机智能技术重点实验室)
LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning
揭开真相的面纱:秩减少后主权重的浮现使以推理为导向的监督微调得以提升
Zihang Liu, Tianyu Pang, Oleg Balabanov, Chaoqun Yang, Tianjin Huang, Lu Yin, Yaoqing Yang, Shiwei Liu
机构
*
University of California, Berkeley, CA, USA(加州大学伯克利分校)
;
International Computer Science Institute, CA, USA(国际计算机科学研究所)
;
Lawrence Berkeley National Laboratory, CA, USA(伯克利国家实验室)
;
Dartmouth College, NH, USA(达特茅斯学院)
;
University of Exeter, Exeter, UK(埃克塞特大学)
;
University of Oxford, Oxford, UK(牛津大学)
;
University of Surrey, Guildford, UK(萨里大学)
;
Tsinghua University, China(清华大学)
;
Eindhoven University of Technology, the Netherlands(埃因霍温理工大学)
机构
*
Harbin Institute of Technology(哈尔滨工业大学)
;
Peng Cheng Laboratory(鹏城实验室)
;
The University of Hong Kong(香港大学)
;
Huawei Technologies Co., Ltd(华为技术有限公司)
CommentsWe argue that when the goal is to intervene on model behavior, skill characterization should be *model-native*: grounded in the model's own representations rather than imposed through external ontologies
MoE-nD: Per-Layer Mixture-of-Experts Routing for Multi-Axis KV Cache Compression
MoE-nD:多轴KV缓存压缩的分层专家路由
Libo Sun, Peixiong He, Po-Wei Harn, Xiao Qin
机构
*
Department of Computer Science and Software Engineering, Auburn University, Auburn, AL, USA(计算机科学与软件工程系,阿伯拉罕大学,阿伯丁,阿拉巴马州,美国)
;
Department of Information Management, National Central University, Taoyuan, Taiwan(信息管理系,国立中央大学,桃园,台湾)
From $\log π$ to $π$: Taming Divergence in Soft Clipping via Bilateral Decoupled Decay of Probability Gradient Weight
从log π到π:通过双侧解耦衰减概率梯度权重来驯服发散
Xiaoliang Fu, Jiaye Lin, Yangyi Fang, Chaowen Hu, Cong Qin, Zekai Shao, Binbin Zheng, Lu Pan, Ke Zeng
机构
*
Meituan(美团)
;
Fudan University(复旦大学)
;
Tsinghua University(清华大学)
;
Peking University(北京大学)
;
University of Science and Technology of China(中国科学技术大学)
Stability-Weighted Decoding for Diffusion Language Models
扩散语言模型的稳定性加权解码
Yue Wu, Jian Huang
机构
*
Department of XXX, University of YYY, Location, Country(XXX系,YYY大学,Location,Country)
;
School of ZZZ, Institute of WWW, Location, Country(ZZZ学院,WWW研究所,Location,Country)
;
Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong, China(数据科学与人工智能系,香港理工大学,香港,中国)
LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallacies
LLMs只能通过信任AI和情感诉求说服心理上易受影响的人群在社会问题上的观点,尽管存在逻辑谬误
Alexis Carrillo, Salvatore Citraro, Ali Aghazhadeh Ardebili, Enrique Taietta, Giulio Rossetti, Emilio Ferrara, Giuseppe Alessandro Veltri, Massimo Stella
机构
*
organization= CogNosco Lab, Department of Psychology
;
Cognitive Science, University of Trento , city= Rovereto , country= Italy
;
organization= Institute of Information Science
;
Technologies ``Alessandro Faedo", National Research Council , country= Italy
;
organization= Thomas Lord Department of Computer Science, University of Southern California , city= Los Angeles , state= California , country= USA
;
organization= Department of Sociology
;
Social Research, University of Trento , city= Trento , country= Italy
;
organization= Centre for Behavioural
;
Implementation Sciences in Medicine (BISI), National University of Singapore , city= Singapore , country= Singapore
Bridging the Culture Gap: A Framework for LLM-Driven Socio-Cultural Localization of Math Word Problems in Low-Resource Languages
弥合文化鸿沟:一种基于LLM的数学应用题社会文化本地化的框架
Israel Abebe Azime, Tadesse Destaw Belay, Dietrich Klakow, Philipp Slusallek, Anshuman Chhabra
机构
*
Saarland University(萨尔兰大学)
;
Saarland Informatics Campus(萨尔兰信息技术校园)
;
Instituto Politécnico Nacional(墨西哥理工学院)
;
University of South Florida(佛罗里达州立大学)
机构
*
School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院)
;
Beijing Key Laboratory of Artificial Intelligence for Education Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education(北京市教育厅人工智能教育工程研究中心智能技术与教育应用联合实验室)