A Benchmark for Omni-Modal Reasoning in Long Videos
长视频全模态推理基准
Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Jinxing Zhou, Sahal Shaji Mullappilly, Mohammad Almansoori, Noor Ahsan, Beknur Kalmakhanbet, Sambal Shikhar, Rishabh Lalla, Jean Lahoud, Mariette Awad, Fahad Shahbaz Khan, Salman Khan, Rao Muhammad Anwer, Hisham Cholakkal
机构
*
Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
;
American University of Beirut(贝鲁特美国大学)
;
Linköping University(利尔贝里大学)
Comments17 pages, 5 figures, 9 tables. v2 corrects scorer and taxonomy defects, adds no-model baselines showing label leakage, re-runs the Lithuanian cells on de-leaked text, and withdraws the claim that few-shot helps on judgment-form classification everywhere; all tables and figures regenerated. Dataset: https://huggingface.co/datasets/overthelex/multi-legal-bench
AMPLIFAI: A Multiphase CT Dataset for Benchmarking Clinical Reasoning in LI-RADS Assessment of Liver Lesions
AMPLIFAI:用于基准测试LI-RADS肝脏病变评估临床推理的多期CT数据集
Pranav Kulkarni, Nikhil Shah, Amritansh Suryavanshi, Jana G. Delfino, James Tonascia, Jade Wong-You-Cheong, Barton Lane, Joseph Chirico, Jeffrey D. Hirsch, Ang Li, Heng Huang, Florence X. Doo
机构
*
University of Maryland, College Park(马里兰大学帕克分校)
;
University of Maryland School of Medicine(马里兰大学医学院)
;
University of Maryland Institute for Health Computing(马里兰大学健康计算研究所)
;
University of Maryland Medical System(马里兰大学医学系统)
SP-Mind: An Autonomous Reasoning Agent for Spatial Proteomics Analysis
SP-Mind: 用于空间蛋白质组学分析的自主推理智能体
Yucheng Yuan, Yuanfeng Ji, Zhongxiao Li, Ruijiang Li
机构
*
Department of Computer Science, Stanford University, Stanford, USA(计算机科学系,斯坦福大学,斯坦福,美国)
;
Department of Radiation Oncology, Stanford University, Stanford, USA(放射肿瘤学系,斯坦福大学,斯坦福,美国)
Multimodal Language Models Benchmarked Against the NRC Reactor Operator Licensing Examination: Fine-Tuning and Retrieval Strategies
基于美国核管理委员会反应堆操作员执照考试的多模态语言模型微调与检索策略基准测试
Isak Hwang, Yoon Pyo Lee, Syed Bahauddin Alam
机构
*
organization= Department of Nuclear Engineering, Hanyang University , addressline= 222 Wangsimni-ro , postcode= 04763 , state= Seongdong-gu , city= Seoul , country= South Korea
;
organization= The Grainger College of Engineering, Nuclear, Plasma \& Radiological Engineering, University of Illinois Urbana-Champaign , city= Urbana , state= IL , country= USA
机构
*
McCormick School of Engineering, Northwestern University(西北大学工程学院)
;
Wenzhou Buyi Pharmacy Chain Co., Ltd.(温州-buyi药链有限公司)
;
College of Computer Science and Artificial Intelligence, Wenzhou University(温州大学计算机科学与人工智能学院)
;
Department of Decision Analytics and Operations, City University of Hong Kong(香港城市大学决策分析与运营部门)
;
Institute of Operations Research and Analytics, National University of Singapore(新加坡国立大学运筹学与分析研究所)
BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali
BenHalluEval:孟加拉语大语言模型的多任务幻觉评估框架
Shefayat E Shams Adib, Ahmed Alfey Sani, Ekramul Alam Esham, Ajwad Abrar, Ishmam Tashdeed, Md Taukir Azam Chowdhury
机构
*
Department of Computer Science and Engineering, Islamic University of Technology(伊斯兰科技大学计算机科学与工程系)
;
Department of Computer Science and Engineering, University of California(加州大学计算机科学与工程系)
机构
*
Northeastern University(东北大学)
;
University of Notre Dame(Notre Dame 大学)
;
University of Waterloo(滑铁卢大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
Adobe(Adobe公司)
;
Microsoft Research Asia(微软亚洲研究院)