arXivDaily arXiv每日学术速递 周一至周五更新

高校专区

University of Chinese Academy of Sciences(中国科学院大学)

2026-04-23 至 2026-04-23 共收录 8
2604.20368 2026-04-23 cs.CV cs.AI

LaplacianFormer:Rethinking Linear Attention with Laplacian Kernel

LaplacianFormer:重新思考线性注意力与拉普拉斯核

Zhe Feng, Sen Lian, Changwei Wang, Muyang Zhang, Tianlong Tan, Rongtao Xu, Weiliang Meng, Xiaopeng Zhang

机构 * School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学) China Electronics Data Corporation(中国电子数据公司) Institute of Computing Technology, Chinese Academy of Sciences(计算技术研究所,中国科学院) The Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心,齐鲁大学) Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science(山东省计算能力互联网与服务计算重点实验室,山东省计算机科学基础研究中心) Spatialtemporal AI(时空人工智能)

AI总结 LaplacianFormer通过引入拉普拉斯核替代softmax,解决高分辨率视觉任务中注意力机制的二次复杂度问题,提升表达能力并优化计算效率。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.20199 2026-04-23 cs.CL

All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG

所有语言都重要:理解并缓解多语言RAG中的语言偏差

Dan Wang, Guozhao Mo, Yafei Shi, Cheng Zhang, Bo Zheng, Boxi Cao, Xuanang Chen, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun

机构 * Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所信息处理实验室) University of Chinese Academy of Sciences(中国科学院大学) MYbank, AntGroup(蚂蚁集团MYbank)

AI总结 本文研究多语言RAG中的语言偏差问题,提出LAURA方法,通过多语言证据排名与生成效用对齐,有效缓解语言偏差并提升性能。

Comments ACL 2026 main conference

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.19884 2026-04-23 cs.CL cs.AI cs.LG

From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization

从信号退化到计算崩溃:揭示大语言模型量化中的两种失败模式

Chenxi Zhou, Pengfei Cao, Jiang Li, Bohan Yu, Jinyu Ye, Jun Zhao, Kang Liu

机构 * School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉学科学院) The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所认知与决策智能复杂系统重点实验室) School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院) College of Computer Science, Inner Mongolia University(内蒙古大学计算机学院)

AI总结 研究揭示大语言模型量化中两种不同失败模式:信号退化和计算崩溃,并提出针对性修复方法,表明结构重建比单纯补偿更有效。

Comments Accepted to Findings of ACL 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.10647 2026-04-23 cs.RO

OmniUMI: Towards Physically Grounded Robot Learning via Human-Aligned Multimodal Interaction

OmniUMI: 通过人对齐的多模态交互实现物理基础的机器人学习

Shaqi Luo, Yuanyuan Li, Youhao Hu, Chenhao Yu, Chaoran Xu, Jiachen Zhang, Guocai Yao, Tiejun Huang, Ran He, Zhongyuan Wang

机构 * Beijing Academy of Artificial Intelligence(北京人工智能研究院) MAIS & NLPR, Institute of Automation, Chinese Academy of Sciences(自动化研究所,中国科学院) School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院) Beijing Institute of Technology(北京理工大学) Beijing University of Posts and Telecommunications(北京邮电大学) Peking University(北京大学)

AI总结 OmniUMI通过人对齐的多模态交互实现物理基础的机器人学习,整合视觉、触觉和力觉数据,提升接触密集操作的性能。

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.18609 2026-04-23 cs.CL cs.AI cs.LG

Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models

任务分层的知识扩展规律用于训练后量化的大语言模型

Chenxi Zhou, Pengfei Cao, Jiang Li, Bohan Yu, Jinyu Ye, Jun Zhao, Kang Liu

机构 * School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉学科学院) The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所认知与决策智能复杂系统重点实验室) School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院) College of Computer Science, Inner Mongolia University(内蒙古大学计算机学院)

AI总结 本文提出任务分层的知识扩展规律,通过统一模型大小、位宽和细粒度因素,验证了293种不同的训练后量化配置,揭示了不同知识能力对精度、规模和校准的敏感性。

Comments Accepted to Findings of ACL 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.20733 2026-04-23 cs.LG

Near-Future Policy Optimization

近未来策略优化

Chuanyu Qin, Chenxu Yang, Qingyi Si, Naibin Gu, Dingyu Yao, Zheng Lin, Peng Fu, Nan Duan, Jiaqi Wang

机构 * Institute of Information Engineering, CAS(中国科学院信息工程研究所) School of Cyber Security, UCAS(中国科学院大学网络安全学院)

AI总结 本文提出NPO方法,通过策略自身近未来状态作为辅助轨迹,平衡轨迹质量和方差成本,提升学习信号。AutoNPO自动触发干预,提升性能至63.15。

Comments Work in progress

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.16676 2026-04-23 cs.LG cs.CL

WISCA: A Lightweight Model Transition Method to Improve LLM Training via Weight Scaling

WISCA:一种轻量级模型转换方法,通过权重缩放提高LLM训练

Jiacheng Li, Jianchao Tan, Zhidong Yang, Pingwei Sun, Feiye Huo, Jiayu Qin, Xiangyu Zhang, Maoxin He, Yerui Sun, Yuchen Xie, Guangming Tan, Weile Jia, Xunliang Cai, Tong Zhao

机构 * Meituan, Beijing, China(美团,北京,中国) University of Chinese Academy of Sciences, Beijing, China(中国科学院大学,北京,中国) Hong Kong University of Science and Technology, Hong Kong SAR, China(香港科技大学,香港特别行政区,中国) Xiamen University, Xiamen, China(厦门大学,厦门,中国)

AI总结 WISCA通过优化神经网络权重模式提升LLM训练效率和模型质量,实验显示在GQA架构和LoRA微调任务中显著提升收敛质量。

Comments Findings of the Association for Computational Linguistics: ACL 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.01621 2026-04-23 cs.LG q-bio.QM stat.ME stat.ML

Deciphering interventional dynamical causality from non-intervention complex systems

从非干预复杂系统中解码干预性动力学因果性

Jifan Shi, Yang Li, Juan Zhao, Siyang Leng, Rui Bao, Kazuyuki Aihara, Luonan Chen, Wei Lin

机构 * Research Institute of Intelligent Complex Systems & CISOR, Fudan University(智能复杂系统研究所及CISOR,复旦大学) International Research Center for Neurointelligence, The University of Tokyo Institutes for Advanced Study, The University of Tokyo(神经智能国际研究中心,东京大学先进研究所,东京大学) School of Pharmacy, Shanghai University of Traditional Chinese Medicine(上海中医药大学药学院) Institute of AI and Robotics, College of Intelligent Robotics and Advanced Manufacturing, Fudan University(人工智能与机器人研究所,智能机器人与先进制造学院,复旦大学) Frontiers Science Center for Deep Ocean Multispheres and Earth System, Key Laboratory of Marine Chemistry Theory and Technology, Ministry of Education, Ocean University of China(深海多球体与地球系统前沿科学中心,海洋化学理论与技术重点实验室,教育部,中国海洋大学) School of Mathematical Sciences and School of AI, Shanghai Jiao Tong University(数学科学学院和人工智能学院,上海交通大学) Key Laboratory of Systems Health Science of Zhejiang Province, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Chinese Academy of Sciences(浙江省系统健康科学重点实验室,杭州高级研究所,中国科学院大学,中国科学院)

AI总结 本文提出IntDC框架和IEE算法,通过延迟嵌入空间在不需干预或动力学模型的情况下,从观测数据中解码因果性,验证了其在因果分析中的有效性。

详情

展开后加载摘要…

URL PDF HTML 收藏