语言大模型 / LLM

Automated Interpretation of Non-Destructive Evaluation Contour Maps Using Large Language Models for Bridge Condition Assessment

Viraj Nishesh Darji, Callie C. Liao, Duoduo Liao

机构 * School of Computing（计算学院） ； George Mason University（乔治·玛莎大学） ； College of Science（科学学院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Journal ref IEEE BigData, Year: 2024; Page: 3258-3263

On the Limitations of Large Language Models (LLMs): False Attribution

Tosin Adewumi, Nudrat Habib, Lama Alkhaled, Elisa Barney

机构 * Machine Learning Group, EISLAB, Luleå University of Technology（机器学习组、EISLAB、卢勒奥技术大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments This paper was accepted for presentation by Recent Advances in NLP (RANLP) 2025 conference

DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil Engineering

Yinsheng Li, Zhen Dong, Yi Shao

机构 * McGill University（麦吉尔大学） ； UC Santa Barbara（圣巴巴拉大学） ； NVIDIA（英伟达） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Project page: https://github.com/Eason-Li-AIS/DrafterBench

Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models

Yuewen Mei, Tong Nie, Jian Sun, Ye Tian

机构 * Dept. of Traf. Eng. Tongji University Shanghai, China ； Dept. of Civ. \& Envir. Eng. The Hong Kong Polytechnic University Hong Kong SAR, China 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted at IEEE ITSC 2025

Journal ref IEEE International Conference on Intelligent Transportation Systems, 2025

Personalization of Large Language Models: A Survey

Zhehao Zhang, Ryan A. Rossi, Branislav Kveton, Yijia Shao, Diyi Yang, Hamed Zamani, Franck Dernoncourt, Joe Barrow, Tong Yu, Sungchul Kim, Ruiyi Zhang, Jiuxiang Gu, Tyler Derr, Hongjie Chen, Junda Wu, Xiang Chen, Zichao Wang, Subrata Mitra, Nedim Lipka, Nesreen Ahmed, Yu Wang

机构 * Dartmouth College（达特茅斯学院） ； Adobe Research（Adobe研究） ； Stanford University（斯坦福大学） ； University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） ； Pattern Data ； Vanderbilt University（范德比尔特大学） ； Dolby Research（Dolby研究） ； University of California San Diego（加州大学圣地亚哥分校） ； Cisco Research（思科研究） ； University of Oregon（俄勒冈大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at the Transactions on Machine Learning Research (TMLR) journal

Evaluation of Attribution Bias in Generator-Aware Retrieval-Augmented Large Language Models

Amin Abolghasemi, Leif Azzopardi, Seyyed Hadi Hashemi, Maarten de Rijke, Suzan Verberne

机构 * Leiden University（莱顿大学） ； University of Strathclyde（斯特拉思克莱德大学） ； eBay Inc.（eBay公司） ； University of Amsterdam（阿姆斯特丹大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at ACL 2025 (Findings)

Diagnosing Failures in Large Language Models' Answers: Integrating Error Attribution into Evaluation Framework

Zishan Xu, Shuyi Xie, Qingsong Lv, Shupei Xiao, Linlin Song, Sui Wenjuan, Fan Lin

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Signal or Noise? Evaluating Large Language Models in Resume Screening Across Contextual Variations and Human Expert Benchmarks

Aryan Varshney, Venkat Ram Reddy Ganuthula

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Enabling Inclusive Systematic Reviews: Incorporating Preprint Articles with Large Language Model-Driven Evaluations

Rui Yang, Jiayi Tong, Haoyuan Wang, Hui Huang, Ziyang Hu, Peiyu Li, Nan Liu, Christopher J. Lindsell, Michael J. Pencina, Yong Chen, Chuan Hong

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 30 pages, 6 figures

Automating Expert-Level Medical Reasoning Evaluation of Large Language Models

Shuang Zhou, Wenya Xie, Jiaxi Li, Zaifu Zhan, Meijia Song, Han Yang, Cheyenna Espinoza, Lindsay Welton, Xinnie Mai, Yanwei Jin, Zidu Xu, Yuen-Hei Chung, Yiyun Xing, Meng-Han Tsai, Emma Schaffer, Yucheng Shi, Ninghao Liu, Zirui Liu, Rui Zhang

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 22 pages,6 figures

A Comprehensive Survey of Contamination Detection Methods in Large Language Models

Mathieu Ravaut, Bosheng Ding, Fangkai Jiao, Hailin Chen, Xingxuan Li, Ruochen Zhao, Chengwei Qin, Caiming Xiong, Shafiq Joty

机构 * Nanyang Technological University（南洋理工大学） ； Institute of Infocomm Research (I2R), A*STAR（信息通信研究所（I2R），A*STAR） ； Salesforce Research（Salesforce研究） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by TMLR in July 2025. 18 pages, 1 figure, 3 tables

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models

Sangwon Hyun, Shaukat Ali, M. Ali Babar

机构 * The University of Adelaide（阿德莱德大学） ； Simula Research Laboratory（Simula研究实验室） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Application and Evaluation of Large Language Models for Forecasting the Impact of Traffic Incidents

George Jagadeesh, Srikrishna Iyer, Michal Polanowski, Kai Xin Thia

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments This paper has been accepted for publication at the 2025 IEEE 28th International Conference on Intelligent Transportation Systems (ITSC), Gold Coast, Australia, 2025. Copyright IEEE

Performance Evaluation of General Purpose Large Language Models for Basic Linear Algebra Subprograms Code Generation

Daichi Mukunoki, Shun-ichiro Hayashi, Tetsuya Hoshino, Takahiro Katagiri

机构 * Information Technology Center\ University Nagoya, Aichi 466-8601 Email ； Graduate School of Informatics\ University Nagoya, Aichi 466-8601 Email 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 8 pages, 6 tables

PHEONA: An Evaluation Framework for Large Language Model-based Approaches to Computational Phenotyping

Sarah Pungitore, Shashank Yadav, Vignesh Subbian

机构 * Program in Applied Mathematics, The University of Arizona（应用数学项目，亚利桑那大学） ； College of Engineering, The University of Arizona（工程学院，亚利桑那大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 2 figures, 5 tables, accepted at 2025 AMIA Annual Symposium

ChatGPT is not A Man but Das Man: Representativeness and Structural Consistency of Silicon Samples Generated by Large Language Models

Dai Li, Linzhuo Li, Huilian Sophie Qiu

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Autoformalization in the Era of Large Language Models: A Survey

Ke Weng, Lun Du, Sirui Li, Wangyue Lu, Haozhe Sun, Hengyu Liu, Tiancheng Zhang

机构 * Northeastern University（东北大学） ； Ant Research Institute, Ant Group（蚂蚁集团研究院） ； Department of Computer Science, Aalborg University（奥尔堡大学计算机科学系） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

VERBA: Verbalizing Model Differences Using Large Language Models

Shravan Doda, Shashidhar Reddy Javaji, Zining Zhu

机构 * Stevens Institute of Technology（史蒂文斯理工学院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Leveraging Large Language Models for Spontaneous Speech-Based Suicide Risk Detection

Yifan Gao, Jiao Fu, Long Guo, Hong Liu

机构 * College of Computer Science（计算机科学学院） ； National Key Laboratory of Fundamental Science on Synthetic Vision（合成视觉基础科学国家重点实验室） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to Interspeech 2025

How large language models judge and influence human cooperation

Alexandre S. Pires, Laurens Samson, Sennay Ghebreab, Fernando P. Santos

机构 * Institute of Informatics（信息学院） ； University of Amsterdam（阿姆斯特丹大学） ； City of Amsterdam（阿姆斯特丹市） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Software Engineering for Large Language Models: Research Status, Challenges and the Road Ahead

Hongzhou Rao, Yanjie Zhao, Xinyi Hou, Shenao Wang, Haoyu Wang

机构 * Huazhong University of Science and Technology（华中科技大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

On Recipe Memorization and Creativity in Large Language Models: Is Your Model a Creative Cook, a Bad Cook, or Merely a Plagiator?

Jan Kvapil, Martin Fajcik

机构 * Brno University of Technology（布拉格技术大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 13 pages, 5 figures

A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions

Hongbin Na, Yining Hua, Zimu Wang, Tao Shen, Beibei Yu, Lilin Wang, Wei Wang, John Torous, Ling Chen

机构 * Australian Artificial Intelligence Institute（澳大利亚人工智能研究所） ； University of Technology Sydney（悉尼科技大学） ； Harvard University（哈佛大学） ； Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学） ； University of Pennsylvania（宾夕法尼亚大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ACL 2025 Findings

Structuralist Approach to AI Literary Criticism: Leveraging Greimas Semiotic Square for Large Language Models

Fangzhou Dong, Yifan Zeng, Yingpeng Sang, Hong Shen

机构 * School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院） ； School of Engineering and Technology, Central Queensland University（中央昆士兰大学工程与技术学院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted in CogSci 2025

Enterprise Large Language Model Evaluation Benchmark

Liya Wang, David Yi, Damien Jose, John Passarelli, James Gao, Jordan Leventis, Kang Li

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Submitted to MLNLP 2025 at https://csity2025.org/mlnlp/index

Large Language Model Interface for Home Energy Management Systems

François Michelon, Yihong Zhou, Thomas Morstyn

机构 * University of Edinburgh（爱丁堡大学） ； Oxford University（牛津大学） 纠错

专题命中 评测与基准 ：language model(title,abstract)；large language model(title)；LLM(abstract)；prompting(abstract)

Comments 13 pages conference paper

Journal ref Proc. 16th ACM Int. Conf. on Future and Sustainable Energy Systems, e-Energy 2025, pages 590-602, 2025

Self-Critique-Guided Curiosity Refinement: Enhancing Honesty and Helpfulness in Large Language Models via In-Context Learning

Duc Hieu Ho, Chenglin Fan

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text

Arturs Kanepajs, Aditi Basu, Sankalpa Ghose, Constance Li, Akshat Mehta, Ronak Mehta, Samuel David Tucker-Davis, Eric Zhou, Bob Fischer, Jacy Reese Anthis

机构 * Alethic Research ； Texas State University（德克萨斯州立大学） ； Sentience Institute（意识研究所） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

ETM: Modern Insights into Perspective on Text-to-SQL Evaluation in the Age of Large Language Models

Benjamin G. Ascoli, Yasoda Sai Ram Kandikonda, Jinho D. Choi

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Yuhe Liu, Changhua Pei, Longlong Xu, Bohan Chen, Mingze Sun, Zhirui Zhang, Yongqian Sun, Shenglin Zhang, Kun Wang, Haiming Zhang, Jianhui Li, Gaogang Xie, Xidao Wen, Xiaohui Nie, Minghua Ma, Dan Pei

机构 * Tsinghua University \& BNRist Beijing China ； Beijing University of Posts ； Nankai University \& TKL-SEHCI Tianjin China ； Nankai University \& HL-IT Tianjin China ； Microsoft Redmond USA ； Tsinghua University \& BNRist ； Nankai University \& TKL-SEHCI ； Nankai University \& HL-IT ； Microsoft 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI