On Solomonoff Induction in Large Language Models and the Limits of Self-Improving: The Singularity Is Not Near Without Symbolic Model Synthesis
在大型语言模型中自我改进的极限:没有符号模型合成,奇点并不临近
机构 * Algorithmic Dynamics Lab(算法动力实验室) ; Department of Biomedical Computing(生物医学计算系) ; School of Biomedical Engineering and Imaging Sciences(生物医学工程与成像科学学院) ; King’s Institute for AI(国王人工智能研究所) ; King’s College London(伦敦国王学院) ; Oxford Immune Algorithmics(牛津免疫算法公司) ; Oxford University Innovation(牛津大学创新中心) ; London Institute for Healthcare Engineering(伦敦医疗工程研究所)
专题命中 知识编辑与模型理解 :large language model(title,abstract);language model(title,abstract);分类 cs.AI、cs.LG
AI总结 研究指出大型语言模型在缺乏外部信号时自我改进会退化,提出神经符号整合方法以突破这一限制。
Comments 31 pages. Update: DPI and Levin's non-growth is not violated explanation when it comes to finite learners