Retraction-Free Optimization over the Stiefel Manifold for the LoRA Fine-Tuning
用于LoRA微调的Stiefel流形上无回缩优化
Yuan Zhang, Jiang Hu, Zhijian Lai, Lin Lin, Zaiwen Wen
机构
*
Center for Data Science, Peking University(北京大学数据科学中心)
;
Yau Mathematical Sciences Center, Tsinghua University(清华大学丘成桐数学科学中心)
;
Beijing International Center for Mathematical Research, Peking University(北京大学北京国际数学研究中心)
;
Department of Mathematics, University of California, Berkeley(美国加州大学伯克利分校数学系)
;
Center for Machine Learning Research and Changsha Institute for Computing and Digital Economy, Peking University(北京大学机器学习研究中心和长沙计算与数字经济研究院)
专题命中
指令微调
:large language model(abstract);language model(abstract);分类 cs.AI、cs.LG
Generalization from Low- to Moderate-Resolution Spectra with Neural Networks for Stellar Parameter Estimation: A Case Study with DESI
利用神经网络从低分辨率到中等分辨率光谱进行泛化:恒星参数估计的案例研究
Xiaosheng Zhao, Yuan-Sen Ting, Rosemary F. G. Wyse, Alexander S. Szalay, Yang Huang, László Dobos, Tamás Budavári, Viska Wei
机构
*
Department of Physics \& Astronomy, The Johns Hopkins University, Baltimore, MD 21218, USA
;
Department of Astronomy, The Ohio State University, 140 West 18th Avenue, Columbus, OH 43210, USA
;
Center for Cosmology
;
AstroParticle Physics (CCAPP), The Ohio State University, Columbus, OH 43210, USA
;
Department of Computer Science, The Johns Hopkins University, Baltimore, MD 21218, USA
;
School of Astronomy
;
Space Science, University of Chinese Academy of Sciences, Beijing 100049, People's Republic of China
;
National Astronomical Observatories, Chinese Academy of Sciences, Beijing 100012, People's Republic of China
;
Department of Information Systems, E\"otv\"os Lor\'
;
University, Budapest 1117, Hungary
;
Department of Applied Mathematics \& Statistics, Johns Hopkins University, Baltimore, MD 21218, USA
机构
*
University of Southern California(南加州大学)
;
New York University(纽约大学)
;
Columbia University(哥伦比亚大学)
;
University of California, Berkeley(加利福尼亚大学伯克利分校)
;
City College of New York, CUNY(纽约市立大学城市学院)
;
Stevens Institute of Technology(史蒂文斯理工学院)
;
Nanyang Technological University(南洋理工大学)
VisRAG2.0: Mitigating Visual Hallucinations via Evidence-Guided Multi-Image Reasoning in Visual Retrieval-Augmented Generation
VisRAG2.0:通过视觉检索增强生成中的证据引导多图像推理减轻视觉幻觉
Yubo Sun, Chunyi Peng, Yukun Yan, Shi Yu, Zhenghao Liu, Sen Mei, Chi Chen, Maosong Sun
机构
*
School of Software and Microelectronics, Peking University, China(北京大学软件与微电子学院)
;
School of Computer Science and Engineering, Northeastern University, China(东北大学计算机科学与工程学院)
;
Department of Computer Science and Technology, Institute for AI, Tsinghua University, China(清华大学人工智能研究院计算机科学与技术系)
Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding
利用记忆进行推理:一种用于免训练长视频理解的时间粒度自适应框架
Linghao Meng, Qiankun Li, Junyuan Mao, Pujin Liao, Zhicheng He, Enbo Zhang, Kun Wang, Yang Liu, Huazhu Fu, Yueming Jin
机构
*
National University of Singapore(新加坡国立大学)
;
Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR)(高性能计算研究所,科学、技术与研究机构(A*STAR))
;
Nanyang Technological University(南洋理工大学)
;
University of Science and Technology of China(中国科学技术大学)
;
Jilin University(吉林大学)
专题命中
长上下文与记忆
:LLM(abstract);large language model(abstract);language model(abstract);分类 cs.AI
PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environments
PatchWorld:可执行世界模型的免梯度优化
Jiaxin Bai, Yue Guo, Yifei Dong, Jiaxuan Xiong, Tianshi Zheng, Yixia Li, Tianqing Fang, Yufei Li, Yisen Gao, Haoyu Huang, Zhongwei Xie, Hong Ting Tsang, Zihao Wang, Lihui Liu, Jeff Z. Pan, Yangqiu Song
机构
*
Hong Kong Baptist University(香港 Baptist 大学)
;
Independent Researcher(独立研究员)
;
HKUST(香港科技大学)
;
Beijing Institute of Technology(北京理工大学)
;
Southern University of Science and Technology(南方科技大学)
;
Wayne State University(韦恩州立大学)
;
University of Edinburgh(爱丁堡大学)