Rating the Pitch, Not the Product: User Evaluations of LLMs Reflect Expectations More Than Performance
评价的是宣传话术,而非产品本身:用户对大语言模型的评估更多反映期望而非性能
Robert Morabito, Tyler McDonald, Charitra Viswanath, Angel Hsing-Chi Hwang, Susanne Gaube, Jad Kabbara, Ali Emami
机构
*
Brock University(布鲁克大学)
;
Emory University(埃默里大学)
;
University of Southern California(南加州大学)
;
University College London(伦敦大学学院)
;
Massachusetts Institute of Technology(麻省理工学院)
机构
*
Thomas Lord Department of Computer Science, University of Southern California, USA(汤姆斯·劳德计算机科学系,南加州大学,美国)
;
Signal Analysis and Interpretation Laboratory (SAIL), University of Southern California, USA(信号分析与解释实验室(SAIL),南加州大学,美国)
机构
*
University of California, Los Angeles(加州大学洛杉矶分校)
;
University of Southern California(南加州大学)
;
DeerLab LLC(DeerLab有限责任公司)
;
Carnegie Mellon University(卡内基梅隆大学)
;
Clemson University(克莱姆森大学)
;
Google(谷歌)
;
San Jose State University(圣何塞州立大学)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Staleness-Learning Rate Scaling Laws for Asynchronous RLHF
异步RLHF的陈旧度-学习率缩放定律
Jingwei Song, Haofeng Xu, Jie Xiao, Chengke Bao, Jingwei Shi, Pengbin Feng, Weixun Wang, Yuhang Han, Chuan Wu, Linfeng Zhang, Bill Shi
机构
*
The University of Hong Kong(香港大学)
;
Shanghai Jiao Tong University(上海交通大学)
;
Gradient
;
University of Southern California(南加州大学)
;
The Hong Kong Polytechnic University(香港理工大学)
机构
*
Department of Electrical Engineering and Computer Sciences University of California Berkeley(加州大学伯克利分校电气工程与计算机科学系)
;
University of Southern California(南加州大学)
OpenThoughts-Agent: Data Recipes for Agentic Models
OpenThoughts-Agent: 智能体模型的数据配方
Negin Raoof, Richard Zhuang, Marianna Nezhurina, Etash Guha, Atula Tejaswi, Ryan Marten, Charlie F. Ruan, Tyler Griggs, Alexander Glenn Shaw, Hritik Bansal, E. Kelly Buchanan, Artem Gazizov, Reinhard Heckel, Chinmay Hegde, Sankalp Jajee, Daanish Khazi, Emmanouil Koukoumidis, Xiangyi Li, Hange Liu, Shlok Natarajan, Harsh Raj, Nicholas Roberts, Ethan Shen, Nishad Singhi, Michael Siu, Ashima Suvarna, Hanwen Xing, Patrick Yubeaton, Robert Zhang, Leon Liangyu Chen, Xiaokun Chen, Steven Dillmann, Saadia Gabriel, Xunyi Jiang, Anurag Kashyap, Boxuan Li, Yein Park, Minh Pham, Sujay Sanghavi, Lin Shi, Ke Sun, Yixin Wang, Zhiwei Xu, Erica Zhang, Siyan Zhao, Wanjia Zhao, Jenia Jitsev, Alex Dimakis, Benjamin Feuer, Ludwig Schmidt
机构
*
UC Berkeley(加州大学伯克利分校)
;
Stanford University(斯坦福大学)
;
JSC(于利希超级计算中心)
;
LAION
;
University of Texas at Austin(德克萨斯大学奥斯汀分校)
;
Bespoke Labs
;
Laude Institute
;
UCLA(加州大学洛杉矶分校)
;
Harvard University & Harvard Medical School(哈佛大学与哈佛医学院)
;
TU Munich & Munich Center for Machine Learning(慕尼黑工业大学与慕尼黑机器学习中心)
;
New York University(纽约大学)
;
Medical University of South Carolina(南卡罗来纳医科大学)
;
The LLM Data Company
;
BenchFlow
;
Independent Researcher(独立研究员)
;
Northeastern University(东北大学)
;
University of Wisconsin–Madison(威斯康星大学麦迪逊分校)
;
University of Washington(华盛顿大学)
;
TU Darmstadt(达姆施塔特工业大学)
;
University of Southern California(南加州大学)
;
UC San Diego(加州大学圣地亚哥分校)
;
Amazon(亚马逊)
;
Microsoft(微软)
;
Korea University(高丽大学)
;
Cornell Tech(康奈尔科技)
;
University of Michigan(密歇根大学)
机构
*
Department of Electronics and Communication Engineering, National Institute of Technology Sikkim, India(印度西西姆国立技术学院电子与通信工程系)
;
Signal Analysis and Interpretation Laboratory, University of Southern California, Los Angeles, USA(美国南加州大学洛杉矶分校信号分析与解释实验室)
机构
*
Department of Computer Science and Engineering, Sikkim Manipal Institute of Technology, India(计算机科学与工程系,西基姆曼普尔理工学院,印度)
;
Department of Electronics and Communication Engineering, National Institute of Technology Sikkim, India(电子与通信工程系,西基姆国家理工学院,印度)
;
Signal Analysis and Interpretation Laboratory (SAIL), University of Southern California, Los Angeles, USA(信号分析与解释实验室(SAIL),南加州大学,美国洛杉矶)
机构
*
National Institute of Technology Sikkim(锡金国立技术学院)
;
Signal Analysis and Interpretation Lab (SAIL), University of Southern California(信号分析与解读实验室(SAIL),南加州大学)
机构
*
University of Michigan(密歇根大学)
;
National Taiwan University(国立台湾大学)
;
Signal Analysis and Interpretation Laboratory (SAIL)(信号分析与解释实验室)
;
University of Southern California(南加州大学)
;
National Taiwan University Artificial Intelligence Center of Research Excellence(国立台湾大学人工智能研究中心)
机构
*
University of Georgia(佐治亚大学)
;
University of South Florida(南佛罗里达大学)
;
Rutgers University(罗格斯大学)
;
University of Southern California(南加州大学)
;
Johns Hopkins University(约翰霍普金斯大学)
机构
*
Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo(宁波数字孪生研究院,东方理工高等研究院,宁波)
;
Viterbi School of Engineering, University of Southern California(南加州大学维特比工程学院)
;
The Hong Kong Polytechnic University(香港理工大学)
;
LMU Munich(慕尼黑大学)
;
Saarland University(萨尔大学)