When Do LLMs Apply the Wrong Law? Diagnosing LLM Failures in Temporal Legal Reasoning
大型语言模型何时适用错误法律?诊断大型语言模型在时间法律推理中的失败
Yiqian Huang, Shuyuan Zheng, Qianying Liu, Shaowen Peng, Yuntao Kong, Kotaro Funakoshi, Chuan Xiao, Manabu Okumura, Yang Cao
机构
*
Institute of Science Tokyo(东京科学大学)
;
Osaka University(大阪大学)
;
NII LLMC(日本信息学研究所语言、语言学与媒体中心)
;
Nara Institute of Science and Technology(奈良科学技术研究所)
;
Center of Juris-Informatics, ROIS-DS(日本学术研究推进机构跨学科科学研究中心法学信息学中心)
AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning
AeroGround:用于空-地协同推理的综合基准
Shenghong Yi, Lin Zhang, Muzian Li, Jiakang Yuan, Haoyu Zhang, Peng Ye, Jiayuan Fan, Huafeng Qin, Tao Chen
机构
*
Shanghai Innovation Institute(上海创新研究院)
;
College of Future Information Technology, Fudan University(复旦大学未来信息技术学院)
;
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院)
;
Chongqing Technology and Business University(重庆工商大学)
;
The Chinese University of Hong Kong(香港中文大学)
机构
*
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院 aerospace information research institute)
;
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Key Laboratory of Target Cognition and Application Technology (TCAT)(目标认知与应用技术重点实验室)
Interpretable Cross-Lingual Alignment in Small Language Models: Probing Cultural and Pragmatic Reasoning in Japanese-English Bilingual LLMs
小语言模型中的可解释跨语言对齐:探究日英双语大语言模型的文化与语用推理
Florian Braun
机构
*
Sakaguchi–Inui Laboratory (Tohoku University)(东北大学坂口–乾实验室)
;
Natural Language Understanding Team at RIKEN AIP(理化学研究所先进智能项目中心自然语言理解团队)
;
Swallow Project at the Institute of Science Tokyo(东京科学大学Swallow项目)
;
Sakana AI
;
Tohoku University(东北大学)
;
RIKEN AIP(理化学研究所先进智能项目中心)
;
Institute of Science Tokyo(东京科学大学)
AMPLIFAI: A Multiphase CT Dataset for Benchmarking Clinical Reasoning in LI-RADS Assessment of Liver Lesions
AMPLIFAI:用于基准测试LI-RADS肝脏病变评估临床推理的多期CT数据集
Pranav Kulkarni, Nikhil Shah, Amritansh Suryavanshi, Jana Delfino, James Tonascia, Jade Wong-You-Cheong, Barton Lane, Joseph Chirico, Jeffrey D. Hirsch, Ang Li, Heng Huang, Florence X. Doo
机构
*
University of Maryland, College Park(马里兰大学帕克分校)
;
University of Maryland School of Medicine(马里兰大学医学院)
;
University of Maryland Institute for Health Computing(马里兰大学健康计算研究所)
;
University of Maryland Medical System(马里兰大学医学系统)
Multimodal Language Models Benchmarked Against the NRC Reactor Operator Licensing Examination: Fine-Tuning and Retrieval Strategies
基于美国核管理委员会反应堆操作员执照考试的多模态语言模型微调与检索策略基准测试
Isak Hwang, Yoon Pyo Lee, Syed Bahauddin Alam
机构
*
organization= Department of Nuclear Engineering, Hanyang University , addressline= 222 Wangsimni-ro , postcode= 04763 , state= Seongdong-gu , city= Seoul , country= South Korea
;
organization= The Grainger College of Engineering, Nuclear, Plasma \& Radiological Engineering, University of Illinois Urbana-Champaign , city= Urbana , state= IL , country= USA
机构
*
McCormick School of Engineering, Northwestern University(西北大学工程学院)
;
Wenzhou Buyi Pharmacy Chain Co., Ltd.(温州-buyi药链有限公司)
;
College of Computer Science and Artificial Intelligence, Wenzhou University(温州大学计算机科学与人工智能学院)
;
Department of Decision Analytics and Operations, City University of Hong Kong(香港城市大学决策分析与运营部门)
;
Institute of Operations Research and Analytics, National University of Singapore(新加坡国立大学运筹学与分析研究所)
Commentsv2: Major correction. Three v1 claims withdrawn (U-shaped detection curve, recalibration remedy, one reliability figure); the central 29% result survives. Adds a four-judge panel over a stratified 1,200-response sample, 10,792 votes with written reasoning. Data unchanged from v1. 21 pages, 8 figures, 18 tables. Itemized changelog and code: https://github.com/pskeough/The-Granularity-Gap
机构
*
University of California San Diego(加州大学圣地亚哥分校)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Peking University(北京大学)
;
University of California, Los Angeles(加州大学洛杉矶分校)
;
California Institute of Technology(加州理工学院)
;
ETH Zurich(苏黎世联邦理工学院)
Commentspost conference revision version at ICML; update: removed CGYRO due to bug in cases search. Will add back soon; Make the title consistent w/ pdf
机构
*
Nanjing University of Science and Techonolgy(南京理工大学)
;
Beijing Academy of Artificial Intelligence(北京人工智能研究院)
;
University of Science and Technology Beijing(北京科技大学)
;
Hefei University of Technology(合肥工业大学)
;
Beijing University of Chemical Technology(北京化工大学)
;
Renmin University of China(中国人民大学)
;
Beihang University(北航)
;
Beijing University of Posts and Telecommunications(北京邮电大学)
;
Griffith University, Australia(澳大利亚格里菲斯大学)