Optimizing LLM Inference: Fluid-Guided Online Scheduling with Memory Constraints
优化大语言模型推理:带有内存约束的流引导在线调度
Ruicheng Ao, Gan Luo, David Simchi-Levi, Xinshang Wang
机构
*
Institute for Data, Systems, and Society, Massachusetts Institute of Technology(数据、系统与社会研究所,麻省理工学院)
;
School of Mathematical Sciences, Peking University(北京大学数学科学学院)
;
Alibaba Group(阿里巴巴集团)
Daehan Lee, Hyungtae Lim, Seongjun Kim, Soonbin Rho, Changhyeon Lee, Sanghyun Park, Junwoo Hong, Eunseon Choi, Hyunyoung Jo, Soohee Han
机构
*
Computational Control Engineering Laboratory (CoCEL), Department of Convergence IT Engineering and Electrical Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, South Korea(convergence 信息技术工程与电气工程系 计算控制工程实验室,POSTECH 首尔大学(Pohang University of Science and Technology), Pohang 37673, South Korea)
;
Laboratory for Information & Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA 02139, USA(信息与决策系统实验室,麻省理工学院(Massachusetts Institute of Technology), Cambridge, MA 02139, USA)
Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs
图学习应超越对谱图神经网络和消息传递图神经网络的狭隘观点
Antonis Vasileiou, Juan Cervino, Pascal Frossard, Charilaos I. Kanatsoulis, Christopher Morris, Michael T. Schaub, Pierre Vandergheynst, Zhiyang Wang, Guy Wolf, Ron Levie
机构
*
RWTH Aachen University(亚琛工业大学)
;
Massachusetts Institute of Technology(麻省理工学院)
;
École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院)
;
Stanford University(斯坦福大学)
;
University of California San Diego(加州大学圣地亚哥分校)
;
Univ. de Montréal(蒙特利尔大学)
;
Mila(Mila人工智能研究所)
;
Technion – Israel Institute of Technology(技术学院–以色列理工学院)
Explainable deep learning improves human mental models of self-driving cars
可解释深度学习提升人类对自动驾驶汽车的心理模型
Eoin M. Kenny, Akshay Dharmavaram, Sang Uk Lee, Tung Phan-Minh, Shreyas Rajesh, Yunqing Hu, Laura Major, Momchil S. Tomov, Julie A. Shah
机构
*
Computer Science & Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology(计算机科学与人工智能实验室(CSAIL),麻省理工学院)
;
Motional AD Inc.(Motional AD公司)
;
Department of Psychology and Center for Brain Science, Harvard University(心理学系和大脑科学中心,哈佛大学)
;
Department of Aeronautics and Astronautics, Massachusetts Institute of Technology(航空与宇航系,麻省理工学院)