ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks
ViroBench:病毒基因组学任务中的核苷酸基础模型基准测试
发表机构 * Shanghai Innovation Institute Shanghai China ; University of Electronic Science ; Fudan University Shanghai China ; Shanghai Artificial Intelligence Laboratory Shanghai China ; Institute of Infection ; Health Fudan University Shanghai China ; Shanghai Sci-Tech Inno Center for Infection \& Immunity Shanghai China ; Shanghai Jiao Tong University Shanghai China ; Shenzhen Loop Area Institute Shenzhen China ; Chinese University of Hong Kong Hong Kong China ; Westlake University Hangzhou China ; Shanghai Innovation Institute ; Fudan University ; Shanghai Artificial Intelligence Laboratory ; Shanghai Sci-Tech Inno Center for Infection \& Immunity ; Shanghai Jiao Tong University ; Shenzhen Loop Area Institute ; Chinese University of Hong Kong ; Westlake University
AI总结 提出首个针对病毒基因组学的综合基准ViroBench,评估66个核苷酸基础模型在生物学理解和潜在生物安全风险上的表现,发现模型在系统发育和时间偏移下性能下降,生成任务中统计似然与生物功能有效性脱钩,且预训练数据的分类多样性比参数规模更重要。
Comments 42 pages,15 figures