大模型对齐与安全

The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignment

Lenart Motnikar, Katharina Baum, Alexander Kagan, Sarah Spiekermann-Hoff

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.AI、cs.CY

Comments Thirty-Third European Conference on Information Systems (ECIS 2025), Amman, Jordan

Mapping Industry Practices to the EU AI Act's GPAI Code of Practice Safety and Security Measures

Lily Stelling, Mick Yang, Rokas Gipiškis, Leon Staufer, Ze Shen Chin, Siméon Campos, Ariel Gil, Michael Chen

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.AI、cs.CY

Comments 166 pages, the Oxford Martin AI Governance Initiative

From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Models

Yihong Tang, Ao Qu, Xujing Yu, Weipeng Deng, Jun Ma, Jinhua Zhao, Lijun Sun

机构 * McGill University（麦吉尔大学） ； Massachusetts Institute of Technology（麻省理工学院） ； The University of Hong Kong（香港大学） 纠错

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.CY、cs.LG

Alignment Revisited: Are Large Language Models Consistent in Stated and Revealed Preferences?

Zhuojun Gu, Quan Wang, Shuchu Han

机构 * Department of Information Systems and Business Analytics（信息系统与商业分析系） ； University at Albany - State University of New York（阿尔巴尼大学 - 新 york 状态大学） ； Santa Clara, CA（圣克拉拉，加州） ； Princeton Junction, NJ（普林斯顿 junction，新泽西） 纠错

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.AI、cs.LG

A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment

Edward Y. Chang

机构 * stan（斯坦福大学） ； Computer Science, Stanford University（斯坦福大学计算机科学） 纠错

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments 20 pages, 7 tables, 6 figures. arXiv admin note: substantial text overlap with arXiv:2405.07076

TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation

Wiebke Hutiri, Mircea Cimpoi, Morgan Scheuerman, Victoria Matthews, Alice Xiang

专题命中 AI治理与伦理 ：trustworthy(title,abstract)；分类 cs.AI、cs.CY

On the Interplay of Human-AI Alignment,Fairness, and Performance Trade-offs in Medical Imaging

Haozhe Luo, Ziyu Zhou, Zixin Shu, Aurélie Pahud de Mortanges, Robert Berke, Mauricio Reyes

机构 * University of Bern（伯恩大学） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

ValuesRAG: Enhancing Cultural Alignment Through Retrieval-Augmented Contextual Learning

Wonduk Seo, Zonghao Yuan, Yi Bu

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments preprint

Correcting Negative Bias in Large Language Models through Negative Attention Score Alignment

Sangwon Yu, Jongyoon Song, Bongkyu Hwang, Hoyoung Kang, Sooah Cho, Junhwa Choi, Seongho Joe, Taehee Lee, Youngjune L. Gwon, Sungroh Yoon

机构 * Department of Electrical and Computer Engineering, Seoul National University（电子与计算机工程系，首尔国立大学） ； Samsung SDS, Korea（三星SDS，韩国） ； AIIS, ASRI, INMC, ISRC, and IPAI, Seoul National University（人工智能研究所、人工智能研究机构、智能网络中心、智能系统研究室和人工智能政策研究所，首尔国立大学） 纠错

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL 2025 Oral

LOKA Protocol: A Decentralized Framework for Trustworthy and Ethical AI Agent Ecosystems

Rajesh Ranjan, Shailja Gupta, Surya Narayan Singh

专题命中 AI治理与伦理 ：trustworthy(title)；alignment(abstract)；分类 cs.AI、cs.CY

Comments 4 Figures, 1 Table

Benchmarking Multi-National Value Alignment for Large Language Models

Weijie Shi, Chengyi Ju, Chengzhong Liu, Jiaming Ji, Jipeng Zhang, Ruiyuan Zhang, Jia Zhu, Jiajie Xu, Yaodong Yang, Sirui Han, Yike Guo

机构 * The Hong Kong University of Science and Technology（香港科技大学） ； Peking University（北京大学） ； Zhejiang Normal University（浙江师范大学） ； Soochow University（苏州大学） 纠错

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Tuning-Free Personalized Alignment via Trial-Error-Explain In-Context Learning

Hyundong Cho, Karishma Sharma, Nicolaas Jedema, Leonardo F. R. Ribeiro, Alessandro Moschitti, Ravi Krishnan, Jonathan May

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL 2025 Findings

Analyzing the Safety of Japanese Large Language Models in Stereotype-Triggering Prompts

Akito Nakanishi, Yukie Sano, Geng Liu, Francesco Pierri

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.CL、cs.CY

Comments This paper has been submitted to IEEE Transactions on Artificial Intelligence for possible publication

CERN for AI: A Theoretical Framework for Autonomous Simulation-Based Artificial Intelligence Testing and Alignment

Ljubisa Bojic, Matteo Cinelli, Dubravko Culibrk, Boris Delibasic

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.AI、cs.CY

Comments 32 pages, 4 figures, 2 tables

Large Language Model Safety: A Holistic Survey

Dan Shi, Tianhao Shen, Yufei Huang, Zhigen Li, Yongqi Leng, Renren Jin, Chuang Liu, Xinwei Wu, Zishan Guo, Linhao Yu, Ling Shi, Bojian Jiang, Deyi Xiong

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.CL、cs.AI

Comments 158 pages, 18 figures

A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias

Yuemei Xu, Ling Hu, Jiayi Zhao, Zihan Qiu, Kexin XU, Yuqi Ye, Hanwen Gu

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments The article has been accepted by Frontiers of Computer Science (FCS), with the DOI: {10.1007/s11704-024-40579-4}

Using AI Alignment Theory to understand the potential pitfalls of regulatory frameworks

Alejandro Tlaie

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.AI、cs.CY

Cultural Bias and Cultural Alignment of Large Language Models

Yan Tao, Olga Viberg, Ryan S. Baker, Rene F. Kizilcec

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Journal ref PNAS Nexus, Volume 3, Issue 9, September 2024, pgae346

Building an Ethical and Trustworthy Biomedical AI Ecosystem for the Translational and Clinical Integration of Foundational Models

Simha Sankar Baradwaj, Destiny Gilliland, Jack Rincon, Henning Hermjakob, Yu Yan, Irsyad Adam, Gwyneth Lemaster, Dean Wang, Karol Watson, Alex Bui, Wei Wang, Peipei Ping

专题命中 AI治理与伦理 ：trustworthy(title,abstract)；分类 cs.AI、cs.CY

Comments 3 figures, 3 tables

InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?

Yogesh Tripathi, Raghav Donakanti, Sahil Girhepuje, Ishan Kavathekar, Bhaskara Hanuma Vedula, Gokul S Krishnan, Shreya Goyal, Anmol Goel, Balaraman Ravindran, Ponnurangam Kumaraguru

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.CL、cs.AI

Antisocial Analagous Behavior, Alignment and Human Impact of Google AI Systems: Evaluating through the lens of modified Antisocial Behavior Criteria by Human Interaction, Independent LLM Analysis, and AI Self-Reflection

Alan D. Ogilvie

专题命中 AI治理与伦理 ：alignment(title)；safety(abstract)；分类 cs.AI、cs.CY

Comments 48 pages including addendum of transcripts

Case Repositories: Towards Case-Based Reasoning for AI Alignment

K. J. Kevin Feng, Quan Ze Chen, Inyoung Cheong, King Xia, Amy X. Zhang

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.AI、cs.CY

Comments MP2 workshop @ NeurIPS 2023

Safety, Trust, and Ethics Considerations for Human-AI Teaming in Aerospace Control

Kerianne L. Hobbs, Bernard Li

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.AI、cs.CY

Alignment is not sufficient to prevent large language models from generating harmful information: A psychoanalytic perspective

Zi Yin, Wei Ding, Jia Liu

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Frontier AI Regulation: Managing Emerging Risks to Public Safety

Markus Anderljung, Joslyn Barnhart, Anton Korinek, Jade Leung, Cullen O'Keefe, Jess Whittlestone, Shahar Avin, Miles Brundage, Justin Bullock, Duncan Cass-Beggs, Ben Chang, Tantum Collins, Tim Fist, Gillian Hadfield, Alan Hayes, Lewis Ho, Sara Hooker, Eric Horvitz, Noam Kolt, Jonas Schuett, Yonadav Shavit, Divya Siddarth, Robert Trager, Kevin Wolf

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.AI、cs.CY

Comments Update July 11th: - Added missing footnote back in. - Adjusted author order (mistakenly non-alphabetical among the first 6 authors) and adjusted affiliations (Jess Whittlestone's affiliation was mistagged and Gillian Hadfield had SRI added to her affiliations) Updated September 4th: Various typos

It's an Alignment, Not a Trade-off: Revisiting Bias and Variance in Deep Models

Lin Chen, Michal Lukasik, Wittawat Jitkrittum, Chong You, Sanjiv Kumar

专题命中 AI治理与伦理 ：alignment(title,abstract)；分类 cs.AI、cs.LG

Artificial Intelligence Ethics and Safety: practical tools for creating "good" models

Nicholas Kluge Corrêa

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.AI、cs.CY

Comments I would like to withdraw this preprint because it has incorrect and outdated information

Scalable Safety-Critical Policy Evaluation with Accelerated Rare Event Sampling

Mengdi Xu, Peide Huang, Fengpei Li, Jiacheng Zhu, Xuewei Qi, Kentaro Oguchi, Zhiyuan Huang, Henry Lam, Ding Zhao

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments 8 pages, 6 figures

The missing link: Developing a safety case for perception components in automated driving

Rick Salay, Krzysztof Czarnecki, Hiroshi Kuwajima, Hirotoshi Yasuoka, Toshihiro Nakae, Vahdat Abdelzad, Chengjie Huang, Maximilian Kahn, Van Duong Nguyen

专题命中 AI治理与伦理 ：safety(title,abstract)；分类 cs.AI、cs.LG

Ethics-Based Auditing to Develop Trustworthy AI

Jakob Mokander, Luciano Floridi

专题命中 AI治理与伦理 ：trustworthy(title)；alignment(abstract)；分类 cs.AI、cs.CY

Comments Minds & Machines (2021)