大模型对齐与安全

A Criminology of Machines

Gian Maria Campedelli

机构 * Fondazione Bruno Kessler（布鲁诺·科斯勒基金会） 纠错

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.CY

Comments This pre-print is also available at CrimRxiv with DOI: https://doi.org/10.21428/cb6ab371.e3354ce1

Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions

Mohamad Abou Ali, Fadi Dornaika

机构 * University of the Basque Country（巴斯克大学） ； Lebanese International University (LIU)（黎巴嫩国际大学） ； The International University of Beirut（贝鲁特国际大学） ； IKERBASQUE 纠错

专题命中 AI治理与伦理 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Plural Voices, Single Agent: Towards Inclusive AI in Multi-User Domestic Spaces

Joydeep Chandra, Satyam Kumar Navneet

机构 * BNRIST, Tsinghua University（北京理工大学、清华大学） ； Independent Researcher（独立研究者） 纠错

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.AI、cs.LG

Urban-R1: Reinforced MLLMs Mitigate Geospatial Biases for Urban General Intelligence

Qiongyan Wang, Xingchen Zou, Yutian Jiang, Haomin Wen, Jiaheng Wei, Qingsong Wen, Yuxuan Liang

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； Carnegie Mellon University（卡内基梅隆大学） ； Squirrel Ai Learning 纠错

专题命中 AI治理与伦理 ：alignment(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Benchmarking Adversarial Robustness to Bias Elicitation in Large Language Models: Scalable Automated Assessment with LLM-as-a-Judge

Riccardo Cantini, Alessio Orsino, Massimo Ruggiero, Domenico Talia

机构 * University of Calabria（卡利博利亚大学） 纠错

专题命中 AI治理与伦理 ：safety(abstract)；jailbreak(abstract)；分类 cs.CL、cs.AI

Journal ref Cantini, R., Orsino, A., Ruggiero, M., Talia, D. Benchmarking adversarial robustness to bias elicitation in large language models: scalable automated assessment with LLM-as-a-judge. Mach Learn 114, 249 (2025)

Generative Psycho-Lexical Approach for Constructing Value Systems in Large Language Models

Haoran Ye, Tianze Zhang, Yuhang Xie, Liyuan Zhang, Yuanyi Ren, Xin Zhang, Guojie Song

机构 * State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University（人工智能通用基础理论国家重点实验室，智能科学与技术学院，北京大学） ； Yuanpei College, Peking University（元培学院，北京大学） ； School of Psychological and Cognitive Sciences, Peking University（心理学与认知科学学院，北京大学） ； Key Laboratory of Machine Perception (Ministry of Education), Peking University（机器感知重点实验室（教育部），北京大学） ； PKU-Wuhan Institute for Artificial Intelligence（北京大学-武汉人工智能研究院） 纠错

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

Comments ACL 2025 Main

A Survey on Human-AI Collaboration with Large Foundation Models

Vanshika Vats, Marzia Binta Nizam, Minghao Liu, Ziyuan Wang, Richard Ho, Mohnish Sai Prasad, Vincent Titterton, Sai Venkat Malreddy, Riya Aggarwal, Yanwen Xu, Lei Ding, Jay Mehta, Nathan Grinnell, Li Liu, Sijia Zhong, Devanathan Nallur Gandamani, Xinyi Tang, Rohan Ghosalkar, Celeste Shen, Rachel Shen, Nafisa Hussain, Kesav Ravichandran, James Davis

机构 * University of California, Santa Cruz（加州大学圣克鲁兹分校） 纠错

专题命中 AI治理与伦理 ：safety(abstract)；trustworthy(abstract)；分类 cs.CL、cs.AI

Comments Topic and scope refinement

Private, Verifiable, and Auditable AI Systems

Tobin South

机构 * MIT Media Lab（麻省理工学院媒体实验室） 纠错

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.CY

Comments PhD thesis

Towards Experience-Centered AI: A Framework for Integrating Lived Experience in Design and Development

Sanjana Gautam, Mohit Chandra, Ankolika De, Tatiana Chakravorti, Girik Malik, Munmun De Choudhury

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.AI、cs.CY

HKGAI-V1: Towards Regional Sovereign Large Language Model for Hong Kong

Sirui Han, Junqi Zhu, Ruiyuan Zhang, Yike Guo

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.LG

From Turing to Tomorrow: The UK's Approach to AI Regulation

Oliver Ritchie, Markus Anderljung, Tom Rachman

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.CY

Comments This is a chapter intended for publication in a forthcoming edited volume. It is the version of the author's manuscript prior to acceptance for publication and has not undergone editorial and/or peer review on behalf of the Publisher

Revealing the Intrinsic Ethical Vulnerability of Aligned Large Language Models

Jiawei Lian, Jianhong Pan, Lefan Wang, Yi Wang, Shaohui Mei, Lap-Pui Chau

机构 * Department of Electrical and Electronic Engineering（电子与电气工程系） ； The Hong Kong Polytechnic University（香港理工大学） ； School of Electronics and Information（电子与信息学院） ； Northwestern Polytechnical University（西北工业大学） 纠错

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

DeepSeek in Healthcare: A Survey of Capabilities, Risks, and Clinical Applications of Open-Source Large Language Models

Jiancheng Ye, Sophie Bronstein, Jiarui Hai, Malak Abu Hashish

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

Relative Bias: A Comparative Framework for Quantifying Bias in LLMs

Alireza Arbabi, Florian Kerschbaum

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

Red-Teaming for Inducing Societal Bias in Large Language Models

Chu Fei Luo, Ahmad Ghawanmeh, Bharat Bhimshetty, Kashyap Murali, Murli Jadhav, Xiaodan Zhu, Faiza Khan Khattak

机构 * Queen’s University Vector Institute（女王大学向量研究所） ； SigmaRed Tech.（SigmaRed科技公司） ； Ernst & Young（埃森哲） ； Monark Health（Monark健康） 纠错

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.LG

Governance Challenges in Reinforcement Learning from Human Feedback: Evaluator Rationality and Reinforcement Stability

Dana Alsagheer, Abdulrahman Kamal, Mohammad Kamal, Weidong Shi

专题命中 AI治理与伦理 ：alignment(abstract)；RLHF(abstract)；分类 cs.AI、cs.CY

Recent advancements in LLM Red-Teaming: Techniques, Defenses, and Ethical Considerations

Tarun Raheja, Nilay Pochhi, F. D. C. M. Curie

专题命中 AI治理与伦理 ：safety(abstract)；jailbreak(abstract)；分类 cs.CL、cs.AI

Comments 16 pages, 2 figures

Speciesism in Natural Language Processing Research

Masashi Takeshita, Rafal Rzepka

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI

Comments This article is a preprint and has not been peer-reviewed. The postprint has been accepted for publication in AI and Ethics. Please cite the final version of the article once it is published

Mapping the Ethics of Generative AI: A Comprehensive Scoping Review

Thilo Hagendorff

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.AI、cs.CY

Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracity

Wrick Talukdar, Anjanava Biswas

专题命中 AI治理与伦理 ：alignment(abstract)；trustworthy(abstract)；分类 cs.CL、cs.AI

Comments 14 pages

Journal ref World Journal of Advanced Engineering Technology and Sciences, 2023, 10(2), 283-296

False Sense of Security in Explainable Artificial Intelligence (XAI)

Neo Christopher Chung, Hongkyou Chung, Hearim Lee, Lennart Brocki, Hongbeom Chung, George Dyer

专题命中 AI治理与伦理 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.CY

Comments AI Governance Workshop at the 2024 International Joint Conference on Artificial Intelligence (IJCAI)

Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches

Pablo Biedma, Xiaoyuan Yi, Linus Huang, Maosong Sun, Xing Xie

专题命中 AI治理与伦理 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

Comments 16 pages, work in progress

Aloe: A Family of Fine-tuned Open Healthcare LLMs

Ashwin Kumar Gururajan, Enrique Lopez-Cuena, Jordi Bayarri-Planas, Adrian Tormos, Daniel Hinjos, Pablo Bernabeu-Perez, Anna Arias-Duart, Pablo Agustin Martin-Torres, Lucia Urcelay-Ganzabal, Marta Gonzalez-Mallo, Sergio Alvarez-Napagao, Eduard Ayguadé-Parra, Ulises Cortés Dario Garcia-Gasulla

专题命中 AI治理与伦理 ：alignment(abstract)；red teaming(abstract)；分类 cs.CL、cs.AI

Comments Five appendix

Who Followed the Blueprint? Analyzing the Responses of U.S. Federal Agencies to the Blueprint for an AI Bill of Rights

Darren Lage, Riley Pruitt, Jason Ross Arnold

专题命中 AI治理与伦理 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.CY

Comments 8 pages

No Trust without regulation!

François Terrier

专题命中 AI治理与伦理 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.CY

A Principles-based Ethics Assurance Argument Pattern for AI and Autonomous Systems

Zoe Porter, Ibrahim Habli, John McDermid, Marten Kaas

专题命中 AI治理与伦理 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.CY

Journal ref AI and Ethics 2023

ChatGPT, Large Language Technologies, and the Bumpy Road of Benefiting Humanity

Atoosa Kasirzadeh

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.CY

Comments As part of a series on Dailynous : "Philosophers on next-generation large language models"

What should AI see? Using the Public's Opinion to Determine the Perception of an AI

Robin Chan, Radin Dardashti, Meike Osinski, Matthias Rottmann, Dominik Brüggemann, Cilia Rücker, Peter Schlicht, Fabian Hüger, Nikol Rummel, Hanno Gottschalk

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.LG

Comments 26 pages, 12 figures

Journal ref AI and Ethics (2023)

Obtaining Dyadic Fairness by Optimal Transport

Moyi Yang, Junjie Sheng, Xiangfeng Wang, Wenyan Liu, Bo Jin, Jun Wang, Hongyuan Zha

专题命中 AI治理与伦理 ：alignment(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Ed Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving

专题命中 AI治理与伦理 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI

Comments 120 pages