AI中文摘要
人工智能(AI)系统越来越多地协助人类专家,但AI辅助对生产力的影响可能具有异质性。Caplin、Deming、S. Li、Martin、Marx、Weidmann和Ye(2025b)提供的证据表明,两个特征——能力和信念校准——有助于确定AI辅助的回报。本文表明,他们的结果在专业放射科医生利用最先进的机器学习预测分析胸部X光片的场景中得到了复制。我利用了Moehring、Kutwal、Huang、Banerjee、Jacobi、Eber、Mendoza、Chung、Dayan、Gupta、Bui、Truong、Pareek、Langlotz、Lungren、Agarwal、Rajpurkar和Salz(2025)描述的公共Collab-CXR数据存储库,该数据首先由Agarwal、Moehring、Rajpurkar和Salz(2023)用于人机协作分析。为了忠实再现Caplin、Deming、S. Li、Martin、Marx、Weidmann和Ye(2025b)的分析,我使用了重复病例设计中的放射科医生评估,包括68名放射科医生和11,420个配对的放射科医生-患者-病理观察结果。本复制结果支持其核心发现的外部有效性:较低的基础能力和较高的校准预测了AI带来的更大增量价值。
英文摘要
Artificial intelligence (AI) systems increasingly assist human experts, but the consequences of AI assistance on productivity can be heterogeneous. Caplin, Deming, S. Li, Martin, Marx, Weidmann, and Ye (2025b) provide evidence that two characteristics, ability and belief calibration, help to determine the returns to AI assistance. This note shows that their results replicate to a setting where professional radiologists analyze chest X-rays with access to state-of-the-art machine learning predictions. I leverage the public Collab-CXR data repository described by Moehring, Kutwal, Huang, Banerjee, Jacobi, Eber, Mendoza, Chung, Dayan, Gupta, Bui, Truong, Pareek, Langlotz, Lungren, Agarwal, Rajpurkar, and Salz (2025) and first analyzed for human-AI collaboration by Agarwal, Moehring, Rajpurkar, and Salz (2023). To faithfully reproduce the analysis in Caplin, Deming, S. Li, Martin, Marx, Weidmann, and Ye (2025b), I use the radiologist assessments from the repeated-case designs, which include 68 radiologists and 11,420 paired radiologist-patient-pathology observations. The results of this replication support the external validity of their core findings: lower baseline ability and higher calibration predict larger incremental value from AI.