DECA: Decentralizing Block-Wise Adam for Efficient LLM Full-Parameter Fine-Tuning on Non-IID Data
DECA: 去中心化逐块Adam优化器用于非独立同分布数据上的高效大语言模型全参数微调
Yunsheng Yuan, Shaowei Li, Kai Wang, Zhongyuan Sun, Zheng Zhang, Kai Han, Jun Luo, Feng Li
机构
*
School of Computer Science and Technology, Shandong University, Qingdao China(山东大学计算机科学与技术学院,青岛中国)
;
School of Mathematical Science, Peking University, China(北京大学数学科学学院,中国)
;
IEIT SYSTEM, China(IEIT SYSTEM,中国)
;
School of Computer Science and Artificial Intelligence, Shanghai University of Finance and Economics, Shanghai, China(上海财经大学计算机科学与人工智能学院,上海中国)
;
College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算与数据科学学院,新加坡)
PhotoCraft: Agentic Reasoning with Hierarchical Self-Evolving Memory for Deep Image Search
PhotoCraft: 具有层次自进化记忆的深度图像搜索代理推理
Kailin Lyu, Zhiqiang Yuan, Jianwei He, Qiwei Yan, Xuanbo Su, Nanxing Hu, Yang Liu, Ce Hao, Shengqian Qin, Lianyu Hu, Jinchao Zhang, Jie Zhou
机构
*
Pattern Recognition Center, WeChat AI, Tencent Inc.(微信AI模式识别中心,腾讯公司)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
Zhongguancun Academy(中关村学院)
;
Nanyang Technological University(南洋理工大学)
;
Shanghai Jiao Tong University(上海交通大学)
FGRPO: Federated GRPO with Adaptive Aggregation on Non-IID Data
FGRPO:非独立同分布数据上具有自适应聚合的联邦GRPO
Pengyu Chen, Shaowei Li, Kai Wang, Yunsheng Yuan, Kai Han, Jun Luo, Feng Li
机构
*
School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院)
;
School of Mathematical Science, Peking University(北京大学数学科学学院)
;
School of Computer Science and Artificial Intelligence, Shanghai University of Finance and Economics(上海财经大学计算机科学与人工智能学院)
;
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
R2IF: Aligning Reasoning with Decisions via Composite Rewards for Interpretable LLM Function Calling
R2IF: 通过复合奖励对齐推理与决策以实现可解释的LLM函数调用
Aijia Cheng, Kailong Wang, Ling Shi, Yongxin Zhao
机构
*
Shanghai Key Laboratory of Trustworthy Computing, East China Normal University, Shanghai, China(上海可信计算实验室,华东师范大学,上海,中国)
;
Huazhong University of Science and Technology(华中科技大学)
;
Nanyang Technological University(南洋理工大学)
Total Variation, Adaptive Total Variation and Nonconvex Smoothly Clipped Absolute Deviation Penalty for Denoising Blocky Images
全变分、自适应全变分和非凸平滑剪切绝对偏差惩罚用于块状图像去噪
Aditya Chopra, Heng Lian
机构
*
School of Computing Sciences, VIT University, Vellore, TN, India(计算机科学学院,VIT大学,Vellore,印度)
;
Division of Mathematical Sciences, School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore, 637371(数学科学系,南洋理工大学,新加坡)
机构
*
Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
;
Nanyang Technological University(南洋理工大学)
;
Singapore University of Technology and Design(新加坡科技设计大学)
机构
*
Shanghai AI Laboratory(上海人工智能实验室)
;
SUSTech(南方科技大学)
;
CUHK(香港中文大学)
;
Harbin Institute of Technology(哈尔滨工业大学)
;
University of Oxford(牛津大学)
;
Beihang University(北京航空航天大学)
;
Nanyang Technological University(南洋理工大学)
;
University of Science and Technology of China(中国科学技术大学)
Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation
层级语义增强导航:面向视觉语言导航的最优传输与图驱动推理
Xiang Fang, Wanlong Fang, Changshuo Wang
机构
*
School of Software Engineering, Huazhong University of Science and Technology(华中科技大学软件学院)
;
Interdisciplinary Graduate Programme, Nanyang Technological University, Singapore(新加坡南洋理工大学交叉学科研究生项目)
;
University College London(伦敦大学学院)
PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion
PAI-Studio: 具有相机感知运动的电影级视频背景替换
Heyuan Gao, Bangxun Tang, Yiren Song, Guian Fang, Zijian He, Jie Yang, Mike Zheng Shou
机构
*
Utopai Studios(Utopai工作室)
;
Nanyang Technological University(南洋理工大学)
;
University of California, Irvine(加州大学尔湾分校)
;
Show Lab, National University of Singapore(新加坡国立大学Show实验室)
Thinking Economically: A Hierarchical Framework for Adaptive-Complexity Reasoning in LLMs
经济思维:面向LLM自适应复杂度推理的分层框架
Yubo Gao, Haotian Wu, Hong Chen, Junquan Huang, Yibo Yan, Jungang Li, Zihao Dongfang, Sicheng Tao, Puay Siew Tan, Jie Zhang, Xuming Hu
机构
*
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
;
The Hong Kong University of Science and Technology(香港科学与技术大学)
;
Nanyang Technological University(南洋理工大学)
;
Singapore Institute of Manufacturing Technology, A*STAR(新加坡制造技术研究所,A*STAR)
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Tsinghua University(清华大学)
;
Nanyang Technological University(南洋理工大学)
;
University of California, Berkeley(加州大学伯克利分校)
;
University of Washington(华盛顿大学)
Behavior Cloning of MPC for 3-DOF Robotic Manipulators
三自由度机械臂MPC的行为克隆
Theo Guegan, Dexter Wen Jie Teo
机构
*
University of Waterloo(多伦多大学)
;
Universite de Technologie de Compiègne(技术与科学大学)
;
Nanyang Technological University(南洋理工大学)
;
Polytechnique Montréal(蒙特利尔理工学院)
Fangyuan Wang, Ziyuan Wang, Guorui Pei, Mengshi Zhang, Canxi Liang, Jun Hu, Zhongxuan Li, Jinsong Wu, Ning Han, Zeqing Zhang, Jiaming Qi, Hongmin Wu, Shiyao Zhang, Pai Zheng, Jia Pan, David Navarro-Alarcon, Sichao Liu, Peng Zhou
机构
*
Department of Mechanical Engineering, The Hong Kong Polytechnic University(香港理工大学机械工程系)
;
Department of Mechanical Engineering and Automation, Harbin Institute of Technology(哈尔滨工业大学机械工程与自动化系)
;
School of Advanced Engineering, Great Bay University(大湾大学先进工程学院)
;
College of Robotics Science and Engineering, Taiyuan University of Technology(太原科技大学机器人科学与工程学院)
;
School of Data Science, City University of Hong Kong (Dongguan)(香港城市大学(东莞)数据科学学院)
;
Department of Mechatronic Engineering, Guangdong Polytechnic Normal University(广东 polytechnic 正常大学机电工程系)
;
School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院)
;
School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院)
;
College of Mechanical and Electrical Engineering, Northeast Forestry University(东北林业大学机械与电气工程学院)
;
Greater Bay Area National Center of Technology Innovation(粤港澳大湾区国家技术创新中心)
;
Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University(香港理工大学工业与系统工程系)
BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization
BitsMoE: 面向MoE大语言模型量化的频谱能量引导比特分配
Jiayu Zhao, Zihan Teng, Minhao Fan, Tianrui Ma, Wentao Ren, Song Chen, Weichen Liu
机构
*
School of Microelectronics, University of Science and Technology of China(中国科学技术大学微电子学院)
;
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
;
School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院)
VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
VLAMotor: 通过基于智能体的数据合成实现视觉-语言-动作模型的测试引导增强
Zeqin Liao, Peifan Ren, Zixu Gao, Hongyu Gong, Lianyu Hu, Wenbing Tang, Yuhong Nan, Zibin Zheng, Yang Liu
机构
*
School of computing and data science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
;
School of Software Engineering, Sun Yat-sen University(软件工程学院,中山大学)
;
GuangDong Engineering Technology Research Center of Blockchain, China(区块链工程技术研发中心,中国)
;
Northwest A&F University(西北农林科技大学)
WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization
WINDQuant: 权重感知的全局混合精度大语言模型量化神经决策
Phong Nam Huu Nguyen, Khoi M. Le, Cong-Duy T Nguyen, Anh Tuan Luu, Thong Thanh Nguyen, Tho Quan
机构
*
CAIR, VinUniversity, Vietnam(越南 VinUniversity 的 CAIR)
;
Ho Chi Minh City University of Technology (HCMUT), VNU-HCM, Ho Chi Minh City, Vietnam(越南胡志明市技术大学 (HCMUT))
;
CCDS, Nanyang Technological University, Singapore(新加坡南洋理工大学的 CCDS)
;
School of Computing, National University of Singapore, Singapore(新加坡国立大学计算机学院)
CommentsThe manuscript is being withdrawn at the request of the first author for the purpose of revising content and re-uploading a revised version with updated data/figures/text . The revised manuscript will be resubmitted to arXiv promptly with the same author list and research theme
机构
*
The University of Manchester, UK(英国曼彻斯特大学)
;
University of Pisa, Italy(意大利比萨大学)
;
Nanyang Technological University, Singapore(新加坡南洋理工大学)
;
Max Planck Institute for Mathematics in the Sciences, Germany(德国马克斯·普朗克数学研究所)