Behavioral Consistency and Transparency Analysis on Large Language Model API Gateways
大型语言模型API网关的行为一致性与透明度分析
机构 * University of Massachusetts Boston(马萨诸塞大学波士顿分校) ; Arizona State University(亚利桑那州立大学)
专题命中 长上下文与记忆 :LLM(summary_cn,abstract);large language model(title,abstract);language model(title,abstract);分类 cs.AI
AI总结 本文提出GateScope框架,用于评估LLM网关的行为一致性和操作透明度,发现多个网关存在模型降级、响应不一致、计费不准确等问题。
Comments 11 pages. Initially submitted to IMC 2026 Cycle 1 on November 20, 2025; accepted on March 13, 2026. To appear in Proceedings of the 2026 ACM Internet Measurement Conference (IMC '26)