Cost-Efficient LLM Training with Lifetime-Aware Tensor Offloading via GPUDirect Storage
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; IBM Research(IBM研究院)
高校专区
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; IBM Research(IBM研究院)
机构 * University of California, San Diego(加州大学圣地亚哥分校) ; Johns Hopkins University(约翰霍普金斯大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Massachusetts Institute of Technology(麻省理工学院)
机构 * Department of Computer Science(计算机科学系) ; Illinois Mathematics and Science Academy(伊利诺伊数学与科学学院) ; Siebel School of Computing and Data Science(Siebel计算与数据科学学院) ; University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * University of Notre Dame(诺丁汉大学) ; Tencent AI Seattle Lab(腾讯AI西雅图实验室) ; UIUC(伊利诺伊大学香槟分校)
Comments Our code is available at https://github.com/tencent-ailab/Leopard
机构 * Adobe Research(Adobe研究院) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * Google Research(谷歌研究) ; Google DeepMind(谷歌DeepMind) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; University of Washington(华盛顿大学)
Comments Xu and Narayanswamy are co-first authors. McDuff and Liu are co-last authors
机构 * College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院) ; ZJU-UIUC Institute, Zhejiang University(浙江大学-伊利诺伊大学联合研究所)
机构 * Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院,清华大学) ; The Chinese University of Hong Kong(香港中文大学) ; The Chinese University of Hong Kong, Shenzhen(香港中文大学深圳分校) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Georgia Institute of Technology(佐治亚理工学院) ; The Hong Kong University of Science and Technology(香港科技大学)
Comments Accepted by ACL 2025 Findings
机构 * Arizona State University(亚利桑那州立大学) ; University of Chicago(芝加哥大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * POSTECH ; Seoul National University(首尔国立大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Kyungpook National University(庆北国立大学) ; LG AI Research(LG AI研究院)
Comments ACL 2025 FINDINGS
机构 * Georgia Institute of Technology(佐治亚理工学院) ; Sungkyunkwan University(全南大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Comments CVPR 2025 Highlight
机构 * Microsoft(微软公司) ; Nanjing University(南京大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * Department of Electrical and Computer Engineering and Coordinated Science Laboratory, University of Illinois at Urbana-Champaign(电气与计算机工程系和协调科学实验室,伊利诺伊大学厄巴纳-香槟分校) ; Department of Aerospace Engineering and Coordinated Science Laboratory, University of Illinois at Urbana-Champaign(航空航天工程系和协调科学实验室,伊利诺伊大学厄巴纳-香槟分校)
Comments 3 pages, 3 figures, presented at the 3rd Workshop on Representing and Manipulating Deformable Objects at the IEEE International Conference on Robotics and Automation. Video presentation [https://youtu.be/hfiqwMxitqA]. 3rd Workshop on Representing and Manipulating Deformable Objects [https://deformable-workshop.github.io/icra2023/]
机构 * National Institutes of Health(美国国立卫生研究院) ; University of Virginia(弗吉尼亚大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Comments 28 pages; 16 tables; 7 figures; Code: https://github.com/ncbi-nlp/cell-o1
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Comments 10 pages, 6 figures. ArgMining 2025 Workshop (Non-archival) @ ACL 2025
机构 * Carnegie Mellon University(卡内基梅隆大学) ; Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Meta AI
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Illinois Fire Service Institute(伊利诺伊州消防服务研究所)
Comments 20 pages, 9 figures, 6 tables
机构 * UIUC(伊利诺伊大学) ; Emergence AI
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * Siebel School of Computing and Data Science, University of Illinois at Urbana-Champaign(计算机与数据科学学院,伊利诺伊大学厄巴纳-香槟分校)
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
机构 * The Chinese University of Hong Kong(香港中文大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴娜-香槟分校) ; Princeton University(普林斯顿大学) ; Sun Yat-sen University(中山大学) ; Hong Kong University of Science and Technology(香港科学理工大学)
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Meta AI
Comments ACL 2025 Main Conference, 27 pages
机构 * Graduate School of Artificial Intelligence, POSTECH(POSTECH人工智能研究生院) ; Department of Computer Science and Engineering, POSTECH(POSTECH计算机科学与工程系) ; Artificial Intelligence Graduate School, UNIST(UNIST人工智能研究生院) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Comments ACL 2025 (32 pages); Project website: https://m3c-dataset.github.io/
机构 * University of Technology Sydney(技术科技大学) ; University of Washington(华盛顿大学) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Zhejiang University(浙江大学)
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Comments ACL 2025; NeurIPS Math-AI 2024; Code and Data: https://github.com/jiaruzouu/STEM-PoM
机构 * The University of Hong Kong(香港大学) ; University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; Apple(苹果公司) ; Tencent AI Lab(腾讯AI实验室)
Comments ICLR 2025. (minor updates) Code: https://github.com/HKUNLP/DiffuLLaMA
机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) ; UC Berkeley(伯克利加州大学)
机构 * School of Information Sciences University of Illinois at Urbana-Champaign(信息科学学院伊利诺伊大学厄巴纳-香槟分校) ; Computer Science and Engineering HKUST(计算机科学与工程香港科技大学) ; Computer Science Department University of California, Los Angeles(计算机科学系加州大学洛杉矶分校) ; Research Scientist, Intel Labs(英特尔实验室研究员) ; School of Information Sciences University of Illinois Urbana-Champaign(信息科学学院伊利诺伊大学厄巴纳-香槟分校)