Journal ref"On the Limits of LLM Reasoning: Evidence From Contamination, Translation, and Answer Modification in Multiple-Choice Benchmarks," in IEEE Access, vol. 14, pp. 9384-9393, 2026
CommentsThelwall, M. & Mohammadi, E. (2026). Can small and reasoning Large Language Models score journal articles for research quality and do averaging and few-shot help? Scientometrics
CommentsSubmitted to CVPR 2026. Introduces the QVLM architecture and the SQuID dataset for quantitative geospatial reasoning. Dataset DOI: 10.57967/hf/7565
Large Language Models' Reasoning Stalls: An Investigation into the Capabilities of Frontier Models
Lachlan McGinness, Peter Baumgartner
机构
*
School of Computer Science, Australian National University and CSIRO(计算机科学学院,澳大利亚国立大学和CSIRO)
专题命中
推理评测
:reasoning(title,abstract);分类 cs.AI
CommentsThe original version of this article was withdrawn because there were errors in the evaluation of model faithfulness to reasoning strategies and completeness of reasoning. The analysis was re-conducted correctly and version two contains the corrections
机构
*
Tsinghua University(清华大学)
;
OpenDataLab, Shanghai Artificial Intelligence Laboratory(开放数据实验室、上海人工智能实验室)
;
Renmin University of China(中国人民大学)
专题命中
推理评测
:reasoning(title,abstract);分类 cs.CL
CommentsREST (Reasoning Evaluation through Simultaneous Testing), a stress-testing framework that concurrently exposes LRMs to multiple problems simultaneously
CommentsThe paper is withdrawn for further clarification of the alignment between the proposed knowledge transfer framework and its implementation, and for refinement of the transfer span definition and experimental evaluation design
The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic Reasoning
IOL-AI挑战赛:一项旨在推进语言推理的开放挑战赛
Eduardo Sánchez, Rita Berrada, Dan-Mircea Mirea, Sara Rajaee, Alexander Piperski, Ana Meta Dolinar, Boris Iomdin, Andrey Nikulin, Mariya Shmatova, Marzieh Fadaee, Julia Kreutzer
机构
*
University College London(伦敦大学学院)
;
Meta
;
CentraleSupélec(中央高等电力学院)
;
McGill University(麦吉尔大学)
;
Cohere Labs(Cohere实验室)
;
Princeton University(普林斯顿大学)
;
University of Amsterdam(阿姆斯特丹大学)
;
Stockholm University(斯德哥尔摩大学)
;
Faculty of Liberal Arts and Sciences(文理学院)
;
Universidade Federal de Goiás(戈亚斯联邦大学)
机构
*
Department of Computer Science and Engineering, Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系)
;
Department of Pathology, Nanfang Hospital, Southern Medical University(南方医科大学南芳医院病理科)
;
Department of Pathology, School of Basic Medical Sciences, Southern Medical University(南方医科大学基础医学学院病理科)
;
Department of Anatomical and Cellular Pathology, Chinese University of Hong Kong(香港中文大学解剖与细胞病理学系)
;
Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室)
;
Jinfeng Laboratory(锦风实验室)
;
Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology(香港科技大学化学与生物工程系)
;
Division of Life Science, Hong Kong University of Science and Technology(香港科技大学生命科学系)
;
State Key Laboratory of Nervous System Disorders, The Hong Kong University of Science and Technology(香港科技大学神经系统疾病国家重点实验室)
;
HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, The Hong Kong University of Science and Technology(香港科技大学深圳-香港协同创新研究院)