Better Accuracies, Worse Reasoning: A Step-Level Audit of Medical Chain-of-Thought Distillation
更高的准确率,更差的推理:医学思维链蒸馏的步骤级审计
机构 * School of Health & Wellbeing, University of Glasgow(健康与福祉学院,格拉斯哥大学) ; Department of Respiratory and Critical Care Medicine, Shanghai Sixth People’s Hospital, Shanghai Jiao Tong University School of Medicine(呼吸与危重医学科,上海第六人民医院,上海交通大学医学院) ; School of Life Science and Technology, University of Electronic Science and Technology of China(生命科学与技术学院,电子科技大学) ; Institute of Health Informatics, University College London(健康信息学研究所,伦敦大学学院)
专题命中 其他推理 :reasoning(title,abstract);chain-of-thought(title,abstract);CoT(abstract,abstract_cn);分类 cs.AI
AI总结 通过蒸馏大模型思维链训练小模型,发现医学问答中答案准确率提升但推理步骤的事实错误率上升,表明答案质量与推理真实性可能背道而驰。