SOS-LoRA: Static Orthogonal-Subspace Low-Rank Adaptation with Fixed Multi-Scale Scaling
SOS-LoRA:具有固定多尺度缩放的静态正交子空间低秩自适应
Yupeng Chang, Yuan Wu, Yi Chang
机构
*
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院)
;
Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China(教育部知识驱动的人机智能工程研究中心)
;
International Center of Future Science, Jilin University(吉林大学未来科学国际合作中心)
Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective
重新思考异构语言模型合并:加权模型平均视角
Jiahe Fan, Yinghao Hou, Si Chen, Aiyuan Zhang, Hong Xie, Defu Lian
机构
*
University of Science and Technology of China(中国科学技术大学)
;
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院)
From Intent to Infrastructure: LLM-Driven Agent Compilers for ISAC Networks
从意图到基础设施:用于ISAC网络的基于大语言模型的智能体编译器
Lijie Zheng, Xudong Zhong, Baoquan Ren, Xiangwu Gong, Xinghui Zhu, Ji He
机构
*
School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院)
;
Institute of Systems General, Academy of Systems Engineering, Academy of Military Sciences(系统工程院系统一般研究所)
机构
*
School of Software Engineering, Huazhong University of Science and Technology(华中科技大学软件学院)
;
School of Electronic Information Engineering, South China University of Technology(华南理工大学电子信息学院)
;
Key Laboratory of Oracle Bone Inscriptions Information Processing, Anyang Normal University(安阳师范学院甲骨文信息处理重点实验室)