大模型对齐与安全

Following the Whispers of Values: Unraveling Neural Mechanisms Behind Value-Oriented Behaviors in LLMs

Ling Hu, Yuemei Xu, Xiaoyang Gu, Letao Han

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI

Meta-Thinking in LLMs via Multi-Agent Reinforcement Learning: A Survey

Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer, Muhammad Awais Khan Bangash, Muhammad Ali Jamshed

机构 * University of Oklahoma（俄克拉荷马大学） ； Stanford University（斯坦福大学） ； School of Electrical and Computer Engineering, Oklahoma State University（电气与计算机工程学院，俄克拉荷马州立大学） ； University of Glasgow（格拉斯哥大学） 纠错

专题命中 安全评测 ：RLHF(abstract)；trustworthy(abstract)；分类 cs.CL、cs.AI

Comments Submitted to IEEE Transactions on Artificial Intelligence

Seeing Through Risk: A Symbolic Approximation of Prospect Theory

Ali Arslan Yousaf, Umair Rehman, Muhammad Umair Danish

机构 * Tradeweb Markets ； Western University（西方大学） 纠错

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.LG

Transforming disaster risk reduction with AI and big data: Legal and interdisciplinary perspectives

Kwok P Chun, Thanti Octavianti, Nilay Dogulu, Hristos Tyralis, Georgia Papacharalampous, Ryan Rowberry, Pingyu Fan, Mark Everard, Maria Francesch-Huidobro, Wellington Migliari, David M. Hannah, John Travis Marshall, Rafael Tolosana Calasanz, Chad Staddon, Ida Ansharyani, Bastien Dieppois, Todd R Lewis, Juli Ponce, Silvia Ibrean, Tiago Miguel Ferreira, Chinkie Peliño-Golle, Ye Mu, Manuel Delgado, Elizabeth Silvestre Espinoza, Martin Keulertz, Deepak Gopinath, Cheng Li

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.CY、cs.LG

Comments 20 pages, 2 figures

Journal ref Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 15 (2025) e70011

AI in radiological imaging of soft-tissue and bone tumours: a systematic review evaluating against CLAIM and FUTURE-AI guidelines

Douwe J. Spaanderman, Matthew Marzetti, Xinyi Wan, Andrew F. Scarsbrook, Philip Robinson, Edwin H. G. Oei, Jacob J. Visser, Robert Hemke, Kirsten van Langevelde, David F. Hanff, Geert J. L. H. van Leenders, Cornelis Verhoef, Dirk J. Gruühagen, Wiro J. Niessen, Stefan Klein, Martijn P. A. Starmans

专题命中 安全评测 ：alignment(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Comments 25 pages, 6 figures, 8 supplementary figures

Journal ref eBioMedicine(2025), Volume 114, 105642

JailBench: A Comprehensive Chinese Security Assessment Benchmark for Large Language Models

Shuyi Liu, Simiao Cui, Haoran Bu, Yuming Shang, Xi Zhang

专题命中 安全评测 ：safety(abstract)；jailbreak(abstract)；分类 cs.CL、cs.AI

Comments 12 pages, 5 figures, accepted at PAKDD 2025

Forbidden Science: Dual-Use AI Challenge Benchmark and Scientific Refusal Tests

David Noever, Forrest McKee

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI

Whether to trust: the ML leap of faith

Tory Frame, Julian Padget, George Stothart, Elizabeth Coulthard

专题命中 安全评测 ：alignment(abstract)；trustworthy(abstract)；分类 cs.AI、cs.CY

Comments 12 pages, 12 figures

Personality testing of Large Language Models: Limited temporal stability, but highlighted prosociality

Bojana Bodroza, Bojana M. Dinic, Ljubisa Bojic

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI

Comments 21 pages, 1 table

Aligning LLMs with Individual Preferences via Interaction

Shujin Wu, May Fung, Cheng Qian, Jeonghwan Kim, Dilek Hakkani-Tur, Heng Ji

专题命中 安全评测 ：alignment(abstract)；harmlessness(abstract)；分类 cs.CL、cs.AI

Comments Accepted to COLING 2025. The code and dataset are made public at https://github.com/ShujinWu-0814/ALOE

Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries

Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Praveen Subramanian, Paul Vozila, Tristan Naumann, Jianfeng Gao, Hoifung Poon

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.CL、cs.AI

Comments Published in ML4H Findings 2024, 4 pages

Pre-Deployment Information Sharing: A Zoning Taxonomy for Precursory Capabilities

Matteo Pistillo, Charlotte Stix

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.CY

Effective Mitigations for Systemic Risks from General-Purpose AI

Risto Uuk, Annemieke Brouwer, Tim Schreier, Noemi Dreksler, Valeria Pulignano, Rishi Bommasani

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.CY

Comments 78 pages, 7 figures, 2 tables

Explainability of Point Cloud Neural Networks Using SMILE: Statistical Model-Agnostic Interpretability with Local Explanations

Seyed Mohammad Ahmadi, Koorosh Aslansefat, Ruben Valcarce-Dineiro, Joshua Barnfather

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Comments 17 pages, 9 figures

Uncertainties of Latent Representations in Computer Vision

Michael Kirchhof

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Comments Doctoral thesis

Fostering Trust and Quantifying Value of AI and ML

Dalmo Cirne, Veena Calambur

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.CY、cs.LG

AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies

Yi Zeng, Kevin Klyman, Andy Zhou, Yu Yang, Minzhou Pan, Ruoxi Jia, Dawn Song, Percy Liang, Bo Li

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.AI、cs.CY

Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections

Yuanpu Cao, Bochuan Cao, Jinghui Chen

专题命中 安全评测 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

Prototypical Self-Explainable Models Without Re-training

Srishti Gautam, Ahcene Boubekki, Marina M. C. Höhne, Michael C. Kampffmeyer

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain

Dimitrios P. Panagoulias, Persephone Papatheodosiou, Anastasios P. Palamidas, Mattheos Sanoudos, Evridiki Tsoureli-Nikita, Maria Virvou, George A. Tsihrintzis

专题命中 安全评测 ：alignment(abstract)；safety(abstract)；分类 cs.CL、cs.AI

Comments Technical Paper

SUKHSANDESH: An Avatar Therapeutic Question Answering Platform for Sexual Education in Rural India

Salam Michael Singh, Shubhmoy Kumar Garg, Amitesh Misra, Aaditeshwar Seth, Tanmoy Chakraborty

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.CL、cs.CY

Can I trust my fake data -- A comprehensive quality assessment framework for synthetic tabular data in healthcare

Vibeke Binz Vallevik, Aleksandar Babic, Serena Elizabeth Marshall, Severin Elvatun, Helga Brøgger, Sharmini Alagaratnam, Bjørn Edwin, Narasimha Raghavan Veeraragavan, Anne Kjersti Befring, Jan Franz Nygård

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Journal ref Int. J. Med. Inform.185 (2024)

Trust in AI: Progress, Challenges, and Future Directions

Saleh Afroogh, Ali Akbari, Evan Malone, Mohammadali Kargar, Hananeh Alambeigi

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.CY

An Interpretable Client Decision Tree Aggregation process for Federated Learning

Alberto Argente-Garrido, Cristina Zuheros, M. Victoria Luzón, Francisco Herrera

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Comments Submitted to Information Science Journal

Optimal Transport Perturbations for Safe Reinforcement Learning with Robustness Guarantees

James Queeney, Erhan Can Ozcan, Ioannis Ch. Paschalidis, Christos G. Cassandras

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.AI、cs.LG

Comments Transactions on Machine Learning Research (TMLR), 2024

"Model Cards for Model Reporting" in 2024: Reclassifying Category of Ethical Considerations in Terms of Trustworthiness and Risk Management

DeBrae Kennedy-Mayo, Jake Gord

专题命中 安全评测 ：safety(abstract)；trustworthy(abstract)；分类 cs.CY、cs.LG

Comments 14 pages, 2 figures, submitted to ACM Conference on Fairness, Accountability, and Transparency 2024 (ACM FAccT '24)

Unmasking the Shadows of AI: Investigating Deceptive Capabilities in Large Language Models

Linge Guo

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI

Comments AI deception, Large Language Models, ChatGPT

Unsupervised Pretraining for Fact Verification by Language Model Distillation

Adrián Bazaga, Pietro Liò, Gos Micklem

专题命中 安全评测 ：alignment(abstract)；trustworthy(abstract)；分类 cs.CL、cs.LG

Comments ICLR 2024 Camera Ready

LLaMA Beyond English: An Empirical Study on Language Capability Transfer

Jun Zhao, Zhihao Zhang, Luhui Gao, Qi Zhang, Tao Gui, Xuanjing Huang

专题命中 安全评测 ：alignment(abstract)；harmlessness(abstract)；分类 cs.CL、cs.AI

Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations

Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Michael Tontchev, Qing Hu, Brian Fuller, Davide Testuggine, Madian Khabsa

专题命中 安全评测 ：safety(abstract)；AI safety(abstract)；分类 cs.CL、cs.AI