Alignment Risks from Capability-Seeking RL Training
从能力寻求强化学习训练中产生的对齐风险
Yujun Zhou, Yue Huang, Han Bao, Kehan Guo, Zhenwen Liang, Pin-Yu Chen, Tian Gao, Werner Geyer, Nuno Moniz, Nitesh V Chawla, Xiangliang Zhang
机构
*
University of California, Berkeley(加州大学伯克利分校)
;
Stanford University(斯坦福大学)
;
University of Washington(华盛顿大学)
;
University of Texas at Austin(德克萨斯大学奥斯汀分校)
;
University of Toronto(多伦多大学)
;
University of Cambridge(剑桥大学)
Rajeev Yasarla, Shizhong Han, Hsin-Pai Cheng, Apratim Bhattacharyya, Shweta Mahajan, Litian Liu, Yunxiao Shi, Risheek Garrepalli, Hong Cai, Fatih Porikli
机构
*
University of California, Berkeley(加州大学伯克利分校)
;
University of Texas at Austin(德克萨斯大学奥斯汀分校)
;
University of California, San Diego(加州大学圣地亚哥分校)
;
University of California, Los Angeles(加州大学洛杉矶分校)
;
University of California, Davis(加州大学戴维斯分校)
Ousiometrics: The essence of meaning aligns with a power-danger-structure framework instead of valence-arousal-dominance
Ousiometrics: 本质的意义与权力-危险-结构框架相一致,而非价值-唤醒-主导框架
P. S. Dodds, T. Alshaabi, M. I. Fudolig, J. W. Zimmerman, J. Lovato, S. Beaulieu, J. R. Minot, M. V. Arnold, A. J. Reagan, C. M. Danforth
机构
*
Computational Story Lab, Vermont Advanced Computing Center, University of Vermont, Burlington, VT 05405, United States(计算故事实验室、佛蒙特高级计算中心、佛蒙特大学、伯灵顿,VT 05405,美国)
;
Vermont Complex Systems Institute, MassMutual Center of Excellence for Complex Systems and Data Science, University of Vermont, Burlington, VT 05405, United States(佛蒙特复杂系统研究所、马斯穆特复杂系统和数据科学卓越中心、佛蒙特大学、伯灵顿,VT 05405,美国)
;
Department of Computer Science, University of Vermont, Burlington, VT 05405, United States(计算机科学系、佛蒙特大学、伯灵顿,VT 05405,美国)
;
Santa Fe Institute, 1399 Hyde Park Rd, Santa Fe, NM 87501, United States(圣达菲研究所、1399号海德公园路,圣达菲,NM 87501,美国)
;
Howard Hughes Medical Institute, Janelia Research Campus, Ashburn, VA 20147, United States(霍华德·休斯医学研究所、贾能利亚研究校区、阿什伯恩,VA 20147,美国)
;
Advanced Bioimaging Center, University of California Berkeley, Berkeley, CA 94720, United States(先进生物成像中心、加州大学伯克利分校、伯克利,CA 94720,美国)
;
School of Computer and Mathematical Sciences, University of Adelaide, Adelaide, SA 5005, Australia(计算机与数学科学学院、阿德莱德大学、阿德莱德,SA 5005,澳大利亚)
;
Computational Ethics Lab, University of Vermont, Burlington, VT 05405, United States(计算伦理实验室、佛蒙特大学、伯灵顿,VT 05405,美国)