Beyond Perfect APIs: A Comprehensive Evaluation of LLM Agents Under Real-World API Complexity
超越完美API:对LLM代理在现实API复杂性下的全面评估
Doyoung Kim, Zhiwei Ren, Jie Hao, Zhongkai Sun, Lichao Wang, Xiyao Ma, Zack Ye, Xu Han, Jun Yin, Heng Ji, Wei Shen, Xing Fan, Benjamin Yao, Chenlei Guo
机构
*
Amazon(亚马逊公司)
;
KAIST(韩国科学技术院)
;
University of Pittsburgh(匹兹堡大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Combinatorial Creativity: A New Frontier in Generalization Abilities
组合创造力:一般化能力的新前沿
Samuel Schapiro, Sumuk Shashidhar, Alexi Gladstone, Jonah Black, Royce Moon, Dilek Hakkani-Tur, Lav R. Varshney
机构
*
University of Illinois, Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
Siebel School of Computing and Data Science(计算与数据科学学院)
;
Spiral Works
;
AI Innovation Institute(人工智能创新研究所)
;
Stony Brook University(石溪大学)
;
Simons Institute for the Theory of Computing, Berkeley(伯克利理论计算研究所)
SoundnessBench: A Soundness Benchmark for Neural Network Verifiers
SoundnessBench: 一种用于神经网络验证器的声学基准
Xingjian Zhou, Keyi Shen, Andy Xu, Hongji Xu, Cho-Jui Hsieh, Huan Zhang, Zhouxing Shi
机构
*
University of California, Los Angeles(加州大学洛杉矶分校)
;
Georgia Institute of Technology(佐治亚理工学院)
;
Duke University(杜克大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
University of California, Riverside(加州大学河滨分校)
MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs
MM-SpuBench:迈向更好地理解多模态大语言模型中伪偏差的深入研究
Wenqian Ye, Bohan Liu, Guangtao Zheng, Di Wang, Yunsheng Ma, Xu Cao, Bolin Lai, James M. Rehg, Aidong Zhang
机构
*
University of Virginia(弗吉尼亚大学)
;
Purdue University(普渡大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
Georgia Institute of Technology(佐治亚理工学院)
ClinDEF: A Dynamic Evaluation Framework for Large Language Models in Clinical Reasoning
ClinDEF: 一种用于大语言模型临床推理的动态评估框架
Yuqi Tang, Jing Yu, Zichang Su, Kehua Feng, Zhihui Zhu, Libin Wang, Lei Liang, Qiang Zhang, Keyan Ding, Huajun Chen
机构
*
ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University(浙江大学杭州全球科技创新中心)
;
ZJU-UIUC Institute, Zhejiang University(浙江大学UIUC研究院)
;
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
;
The Polytechnic Institute, Zhejiang University(浙江大学 polytechnic 院)
;
AntGroup(蚂蚁集团)
S$^2$Edit: Text-Guided Image Editing with Precise Semantic and Spatial Control
S$^2$Edit: 基于文本引导的图像编辑与精确语义和空间控制
Xudong Liu, Zikun Chen, Ruowei Jiang, Ziyi Wu, Kejia Yin, Han Zhao, Parham Aarabi, Igor Gilitschenski
机构
*
Department of Computer Science, University of Toronto(多伦多大学计算机科学系)
;
ModiFace Inc.(ModiFace公司)
;
Department of Computer Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学系)
机构
*
Department of Computer Science & Engineering, University of Minnesota Twin Cities(计算机科学与工程系,明尼苏达大学双城分校)
;
Department of Bioengineering, University of Illinois at Urbana-Champaign(生物工程系,伊利诺伊大学厄巴纳-香槟分校)
;
Department of Neurology, Mayo Clinic(神经病学系,梅奥诊所)
;
Department of Neurology, University of Minnesota Twin Cities(神经病学系,明尼苏达大学双城分校)
Attention Distance: A Novel Metric for Directed Fuzzing with Large Language Models
注意力距离:一种用于大型语言模型定向模糊测试的新度量
Wang Bin, Ao Yang, Kedan Li, Aofan Liu, Hui Li, Guibo Luo, Weixiang Huang, Yan Zhuang
机构
*
Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, Shenzhen Graduate School, Peking University(广东超高清沉浸媒体技术省重点实验室,北京大学深圳研究生院)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
China Mobile Internet CO(中国移动互联网公司)
机构
*
Boston University(波士顿大学)
;
University of Pennsylvania(宾夕法尼亚大学)
;
Northwestern University(西北大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
A Decision-Theoretic Approach for Managing Misalignment
一种用于管理偏差的决策理论方法
Daniel A. Herrmann, Abinav Chari, Isabelle Qian, Sree Sharvesh, B. A. Levinstein
机构
*
University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
;
Georgia Institute of Technology(佐治亚理工学院)
;
University of California, Berkeley(加州大学伯克利分校)
;
Amrita Vishwa Vidyapeetham(阿米特拉维瓦大学)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Junyu Zhang, Yifan Sun, Tianang Leng, Jingyan Shen, Liu Ziyin, Paul Pu Liang, Huan Zhang
机构
*
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
;
Massachusetts Institute of Technology(麻省理工学院)
;
University of Pennsylvania(宾夕法尼亚大学)
;
New York University(纽约大学)
Distributionally Robust Imitation Learning: Layered Control Architecture for Certifiable Autonomy
分布鲁棒模仿学习:用于可验证自主性的分层控制架构
Aditya Gahlawat, Ahmed Aboudonia, Sandeep Banik, Naira Hovakimyan, Nikolai Matni, Aaron D. Ames, Gioele Zardini, Alberto Speranzon
机构
*
Department of Mechanical Science and Engineering, University of Illinois Urbana-Champaign(机械科学与工程系,伊利诺伊大学厄巴纳-香槟分校)
;
Department of Electrical and Systems Engineering, University of Pennsylvania(电气与系统工程系,宾夕法尼亚大学)
;
Mechanical and Civil Engineering, Control and Dynamical Systems, California Institute of Technology(机械与土木工程、控制与动态系统,加州理工学院)
;
Massachusetts Institute of Technology(麻省理工学院)
;
Advanced Technology Labs, Lockheed Martin(洛克希德·马丁高级技术实验室)
Non-Linear Strong Data-Processing for Quantum Hockey-Stick Divergences
非线性强数据处理用于量子曲棍球发散度
Theshani Nuradha, Ian George, Christoph Hirche
机构
*
Department of Mathematics and Illinois Quantum Information Science and Technology (IQUIST) Center, University of Illinois Urbana-Champaign(数学系和伊利诺伊大学量子信息科学与技术中心,伊利诺伊大学厄巴纳-香槟分校)
;
Centre for Quantum Technologies, National University of Singapore(新加坡国立大学量子技术中心)
;
Institute for Information Processing (tnt/L3S), Leibniz Universität Hannover(汉诺威莱布尼茨信息处理研究所(tnt/L3S))