Lotus: Efficient LLM Training by Randomized Low-Rank Gradient Projection with Adaptive Subspace Switching
Lotus: 通过随机低秩梯度投影与自适应子空间切换实现高效的LLM训练
Tianhao Miao, Zhongyuan Bao, Lejun Zhang
机构
*
Hong Kong Baptist University, School of Science, Hong Kong, China(香港 Baptist 大学,科学学院,香港,中国)
;
Fudan University, School of Data Science, Shanghai, China(复旦大学,数据科学学院,上海,中国)
;
New York University, Tandon School of Engineering, New York, USA(纽约大学,Tandon 工程学院,纽约,美国)
Toward Universal and Transferable Jailbreak Attacks on Vision-Language Models
迈向通用且可迁移的视觉-语言模型劫持攻击
Kaiyuan Cui, Yige Li, Yutao Wu, Xingjun Ma, Sarah Erfani, Christopher Leckie, Hanxun Huang
机构
*
School of Computing and Information Systems, The University of Melbourne, Australia(墨尔本大学计算机与信息系)
;
School of Computing and Information Systems, Singapore Management University, Singapore(新加坡管理大学计算机与信息系)
;
School of Information Technology, Deakin University, Australia(德肯大学信息科技系)
;
Institute of Trustworthy Embodied AI, Fudan University, China(复旦大学可信具身人工智能研究所)
GPCR-Filter: a deep learning framework for efficient and precise GPCR modulator discovery
GPCR-Filter: 一种用于高效且精确发现GPCR调节剂的深度学习框架
Jingjie Ning, Xiangzhen Shen, Li Hou, Shiyi Shen, Jiahao Yang, Junrui Li, Hong Shan, Sanan Wu, Sihan Gao, H. Eric Xu, Xinheng He
机构
*
The State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, Shanghai, China(中国科学院上海药物研究所国家药物研究重点实验室)
;
School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA(卡内基梅隆大学计算机科学学院)
;
College of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan(湖南大学计算机科学与电子工程学院)
;
Lingang Laboratory, Shanghai, China(上海灵冈实验室)
;
Research Center for Medicinal Structural Biology, National Research Center for Translational Medicine at Shanghai, State Key Laboratory of Medical Genomics, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China(上海 translational 医学研究中心,国家医学基因组学重点实验室,瑞金医院,上海交通大学医学院,上海,中国)
;
School of Pharmacy, Fudan University, Shanghai 201203, China(复旦大学药学院)
Global Feature Enhancing and Fusion Framework for Strain Gauge Time Series Classification
基于应变计时间序列分类的全局特征增强与融合框架
Xu Zhang, Peng Wang, Chen Wang, Zhe Xu, Xiaohua Nie, Wei Wang
机构
*
Shanghai Key Laboratory of Data Science, School of Computer Science Fudan University(上海数据科学关键实验室,计算机科学学院,复旦大学)
;
National Engineering Research Center for Big Data Software Tsinghua University(大数据软件国家工程研究中心,清华大学)
;
School of Software Tsinghua University(软件学院,清华大学)
;
National Key Laboratory of Strength and Structural Integrity, Aircraft Strength Research Institute of China(强度与结构完整性国家重点实验室,中国航空强度研究室)
CommentsThe paper is published in the ACM Web Conference 2025, WWW 2025 Industry Track. The code is available at the link https://github.com/Meteor-Stars/GFEF
CommentsThe codes are available at https://github.com/Meteor-Stars/MLF. The paper is published in the ACM SIGKDD Conference on Knowledge Discovery and Data Mining, SIGKDD 2025
机构
*
School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院)
;
Shanghai Key Lab of Intell. Info. Processing, School of CS, Fudan University(复旦大学计算机学院智能信息处理重点实验室)
;
Department of Mathematics and Applications, University of Naples Federico II(那不勒斯费德里克二世大学应用数学系)
;
State Key Laboratory of Advanced Rail Autonomous Operation, Beijing Jiaotong University(北京交通大学先进轨道交通自主运行国家重点实验室)
IRPM: Intergroup Relative Preference Modeling for Pointwise Generative Reward Models
IRPM:基于组间相对偏好的点wise生成奖励模型
Haonan Song, Qingchen Xie, Huan Zhu, Feng Xiao, Luxi Xing, Liu Kang, Fuzhen Li, Zhiyong Zheng, Feng Jiang, Ziheng Li, Kun Yan, Qingyi Si, Yanghua Xiao, Hongcheng Guo, Fan Yang
机构
*
HUJING Digital Media \& Entertainment Group (XingYun Lab), Beijing, China
;
Department of Automation, Tsinghua University, Beijing, China
;
Fudan University, Shanghai, China
;
Beihang University, Beijing, China
;
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
CommentsComments: Updated title for clarity; improved theoretical derivations; added experiments at additional parameter scales and more ablations; added experimental details in the appendix; updated author list (added five co-authors) to reflect contributions to experiments and writing
SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysis
SLIM-Brain: 一种数据和训练高效的人脑fMRI数据分析基础模型
Mo Wang, Junfeng Xia, Wenhao Ye, Enyu Liu, Kaining Peng, Jianfeng Feng, Quanying Liu, Hongkai Wen
机构
*
Department of Biomedical Engineering, Southern University of Science and Technology, China(南方科技大学生物医学工程系)
;
Department of Computer Science, University of Warwick, The UK(沃里克大学计算机科学系)
;
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, China(复旦大学脑启发式智能科学技术研究所)
A Unified Study of LoRA Variants: Taxonomy, Review, Codebase, and Empirical Evaluation
LoRA变体的统一研究:分类、综述、代码库和实证评估
Haonan He, Jingqi Ye, Minglei Li, Zhengbo Wang, Tao Chen, Lei Bai, Peng Ye
机构
*
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
University of Science and Technology of China(中国科学技术大学)
;
Fudan University(复旦大学)
;
The Chinese University of Hong Kong(香港中文大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolution
达尔文记忆:一种无训练的自调节记忆系统用于GUI代理进化
Hongze Mi, Yibo Feng, WenJie Lu, Song Cao, Jinyuan Li, Yanming Li, Xuelin Zhang, Haotian Luo, Songyang Peng, He Cui, Tengfei Tian, Jun Fang, Hua Chai, Naiqiang Tan
机构
*
Didichuxing Co. Ltd(滴滴出行有限公司)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Tianjin University(天津大学)
;
Sun Yat-sen University(中山大学)
;
Fudan University(复旦大学)
机构
*
HKUST (GZ)(香港科技大学)
;
Tongji University(同济大学)
;
University of Rochester(罗切斯特大学)
;
Meta
;
Fudan University(复旦大学)
;
The University of British Columbia(不列颠哥伦比亚大学)
;
University of California, Davis(加州大学戴维斯分校)
CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translation
CycleDiff: 基于循环扩散模型的无配对图像到图像翻译
Shilong Zou, Yuhang Huang, Renjiao Yi, Chenyang Zhu, Kai Xu
机构
*
College of Computer Science and Technology, National University of Defense Technology(计算机科学与技术学院,国防科技大学)
;
College of Future Information Technology, Fudan University(未来信息技术学院,复旦大学)
;
School of Computer, National University of Defense Technology(计算机学院,国防科技大学)
;
Xiangjiang Laboratory(湘江实验室)
;
Institute of AI for Industries, Chinese Academy of Sciences(产业人工智能研究院,中国科学院)
机构
*
Shanghai University of Finance and Economics(上海财经大学)
;
University of Edinburgh(爱丁堡大学)
;
Southern University of Science and Technology(南方科技大学)
;
Fudan University(复旦大学)
ProFlow: Zero-Shot Physics-Consistent Sampling via Proximal Flow Guidance
ProFlow:通过近端流引导实现零样本物理一致采样
Zichao Yu, Ming Li, Wenyi Zhang, Difan Zou, Weiguo Gao
机构
*
University of Science
;
School of Mathematical Sciences, Fudan University, Shanghai 200433, China
;
Department of Electronic Engineering
;
Information Science, University of Science
;
School of Computing
;
Data Science, The University of Hong Kong
;
School of Mathematical Sciences, Fudan University, Shanghai 200433, China \& Shanghai Key Laboratory of Contemporary Applied Mathematics, Shanghai 200433, China
机构
*
Fudan University(复旦大学)
;
Tongji University(同济大学)
;
National University of Singapore(新加坡国立大学)
;
University of Washington(华盛顿大学)
;
University of Electronic Science and Technology of China(电子科技大学)
;
The Chinese University of Hong Kong(香港中文大学)