PreDiff-LM: Pretrained Discrete Masked Diffusion Language Modeling with Hybrid Attention
PreDiff-LM:具有混合注意力的预训练离散掩码扩散语言模型
Zhengtao Yao, Runhao Li, Xupeng Chen, Jiayi Cheng, Chenqian Le, Michael Yue, Jesson Wang, Siheng Wang, Guang Yang, Haoyan Xu, Chenhao Wei, Zhengqing Yuan, Youran Shen, Yanfang Ye, Junhao Dong
机构
*
University of Southern California(南加州大学)
;
New York University(纽约大学)
;
Columbia University(哥伦比亚大学)
;
University of California, Berkeley(加州大学伯克利分校)
;
Stevens Institute of Technology(史蒂文斯理工学院)
;
University of Notre Dame(圣母大学)
;
Nanyang Technological University(南洋理工大学)
Atmospheric Diffusion-Guided Spatio-Temporal Transformer for Nuclear Radiation Forecasting
用于核辐射预测的大气扩散引导时空变换器
Tengfei Lyu, Jindong Han, Hao Liu
机构
*
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
;
The Hong Kong University of Science and Technology(香港科技大学)
;
Shandong University(山东大学)
Mohammad Hasan Yeganegi, Dian Yu, Andrea Del Prete, Majid Khadiv, Matteo Saveriano
机构
*
University of Trento(特伦托大学)
;
Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich (TUM)(慕尼黑工业大学慕尼黑机器人与机器智能研究所)
机构
*
School of Computing and Augmented Intelligence, Arizona State University(亚利桑那州立大学计算与增强智能学院)
;
Toyota Motor North America, Research & Development(丰田汽车北美研发公司)