Auditing demographic bias in AI-based emergency police dispatch: a cross-lingual evaluation of eleven large language models
对基于AI的紧急警务调度中的种族偏见进行审计:对十一种大型语言模型的跨语言评估
机构 * Department of Industrial Engineering, Tsinghua University(清华大学工业工程系) ; School of Social Sciences, Tsinghua University(清华大学社会科学部) ; Department of Industrial Engineering, Federal University of Rio de Janeiro(里约热内卢联邦大学工业工程系)
AI总结 本文通过跨语言框架评估11种模型,在19800个输出中发现当事件严重性模糊时种族偏见系统性出现,但当操作优先级由通话内容确定时偏见消失。偏见程度因种族轴而异,宗教外观影响最大,性别次之,种族最小。语言间偏见转移不一致,性别偏见在中文中放大,种族偏见在英文中更明显。
Comments 26 pages, 7 figures. Submitted to Humanities and Social Sciences Communications (Nature) collection on Artificial Intelligence and Emerging Technologies in Public Safety. Code and data: https://github.com/williamguey/llmdispatchbias