语言大模型 / LLM - arXivDaily 专题

2406.08434 2024-06-13 cs.CL cs.AI 90%

TasTe: Teaching Large Language Models to Translate through Self-Reflection

Yutong Wang, Jiali Zeng, Xuebo Liu, Fandong Meng, Jie Zhou, Min Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted to the ACL 2024 main conference

2406.06562 2024-06-12 cs.CL cs.AI 90%

Achieving Sparse Activation in Small Language Models

Jifeng Song, Kai Huang, Xiangyu Yin, Boyuan Yang, Wei Gao

专题命中评测与基准：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments 15 pages

2406.04379 2024-06-10 cs.SE cs.AI cs.CL 90%

VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation

Prashanth Vijayaraghavan, Luyao Shi, Stefano Ambrogio, Charles Mackin, Apoorva Nitsure, David Beymer, Ehsan Degan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 3 Figures, LAD'24

2406.04151 2024-06-07 cs.AI cs.CL 90%

AgentGym: Evolving Large Language Model-based Agents across Diverse Environments

Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Dingwen Yang, Chenyang Liao, Xin Guo, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Project site: https://agentgym.github.io

2405.00899 2024-06-07 cs.HC cs.AI cs.CL q-bio.NC 90%

Characterising the Creative Process in Humans and Large Language Models

Surabhi S. Nath, Peter Dayan, Claire Stevenson

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2401.04621 2024-06-07 cs.SE cs.AI cs.CL 90%

DebugBench: Evaluating Debugging Capability of Large Language Models

Runchu Tian, Yining Ye, Yujia Qin, Xin Cong, Yankai Lin, Yinxu Pan, Yesai Wu, Haotian Hui, Weichuan Liu, Zhiyuan Liu, Maosong Sun

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted as Findings of ACL 2024

2406.00975 2024-06-06 cs.CL cs.AI 90%

Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost

Masha Belyi, Robert Friel, Shuai Shao, Atindriyo Sanyal

专题命中评测与基准：language model(title,abstract)；foundation model(title)；LLM(abstract)；large language model(abstract)

2402.16786 2024-06-06 cs.CL cs.AI 90%

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Rose Kirk, Hinrich Schütze, Dirk Hovy

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted at ACL 2024 (Main Conference)

2406.02110 2024-06-05 cs.CL cs.AI 90%

UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models

Zhuoyang Li, Liran Deng, Hui Liu, Qiaoqiao Liu, Junzhao Du

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 5 figures

2406.00050 2024-06-05 cs.CL cs.AI 90%

An Empirical Analysis on Large Language Models in Debate Evaluation

Xinyi Liu, Pinxin Liu, Hangfeng He

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACL 2024 main

2403.00862 2024-06-05 cs.CL cs.AI 90%

NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism

Miao Li, Ming-Bin Chen, Bo Tang, Shengbin Hou, Pengyu Wang, Haiying Deng, Zhiyu Li, Feiyu Xiong, Keming Mao, Peng Cheng, Yi Luo

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Long paper, ACL 2024 Main

2402.13109 2024-06-05 cs.CL cs.AI 90%

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models

Yizhi LI, Ge Zhang, Xingwei Qu, Jiali Li, Zhaoqun Li, Zekun Wang, Hao Li, Ruibin Yuan, Yinghao Ma, Kai Zhang, Wangchunshu Zhou, Yiming Liang, Lei Zhang, Lei Ma, Jiajun Zhang, Zuowen Li, Stephen W. Huang, Chenghua Lin, Jie Fu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Camera-ready version for ACL 2024. Project page at https://yizhilll.github.io/CIF-Bench/

2406.01382 2024-06-04 cs.CL cs.AI 90%

Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Function

Keyon Vafa, Ashesh Rambachan, Sendhil Mullainathan

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments To appear in ICML 2024

2406.01126 2024-06-04 cs.CL cs.AI 90%

TCMBench: A Comprehensive Benchmark for Evaluating Large Language Models in Traditional Chinese Medicine

Wenjing Yue, Xiaoling Wang, Wei Zhu, Ming Guan, Huanran Zheng, Pengfei Wang, Changzhi Sun, Xin Ma

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 20 pages, 15 figures

2404.14387 2024-06-04 cs.CL cs.AI 90%

A Survey on Self-Evolution of Large Language Models

Zhengwei Tao, Ting-En Lin, Xiancai Chen, Hangyu Li, Yuchuan Wu, Yongbin Li, Zhi Jin, Fei Huang, Dacheng Tao, Jingren Zhou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2401.04514 2024-06-04 cs.SE cs.CL cs.IR cs.LG 90%

Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search

Haochen Li, Xin Zhou, Zhiqi Shen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2024

2405.20315 2024-05-31 cs.CL cs.AI 90%

ANAH: Analytical Annotation of Hallucinations in Large Language Models

Ziwei Ji, Yuzhe Gu, Wenwei Zhang, Chengqi Lyu, Dahua Lin, Kai Chen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL 2024

2405.16402 2024-05-28 cs.CL cs.AI 90%

Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactions

Man Luo, Christopher J. Warren, Lu Cheng, Haidar M. Abdul-Muhsin, Imon Banerjee

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2405.14383 2024-05-24 cs.CL cs.AI 90%

Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answering

Zhihua Wen, Zhiliang Tian, Zexin Jian, Zhen Huang, Pei Ke, Yifu Gao, Minlie Huang, Dongsheng Li

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2405.13055 2024-05-24 cs.CL cs.AI cs.CY 90%

Large Language Models for Medicine: A Survey

Yanxin Zheng, Wensheng Gan, Zefeng Chen, Zhenlian Qi, Qian Liang, Philip S. Yu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Preprint. 5 figures,5 tables

2405.13028 2024-05-24 cs.CL cs.AI 90%

DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues

Xiang Luo, Zhiwen Tang, Jin Wang, Xuejie Zhang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by COLING 2024

2405.13010 2024-05-24 cs.CL cs.AI 90%

UCCIX: Irish-eXcellence Large Language Model

Khanh-Tung Tran, Barry O'Sullivan, Hoang D. Nguyen

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2405.10893 2024-05-20 cs.CL cs.AI 90%

COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain

Dimitrios P. Panagoulias, Persephone Papatheodosiou, Anastasios P. Palamidas, Mattheos Sanoudos, Evridiki Tsoureli-Nikita, Maria Virvou, George A. Tsihrintzis

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Technical Paper

2305.10847 2024-05-16 cs.CL cs.AI 90%

Large Language Models can be Guided to Evade AI-Generated Text Detection

Ning Lu, Shengcai Liu, Rui He, Qi Wang, Yew-Soon Ong, Ke Tang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments TMLR camera ready

2401.14589 2024-05-14 cs.CL cs.AI 90%

Enhancing Diagnostic Accuracy through Multi-Agent Conversations: Using Large Language Models to Mitigate Cognitive Bias

Yu He Ke, Rui Yang, Sui An Lie, Taylor Xin Yi Lim, Hairil Rizal Abdullah, Daniel Shu Wei Ting, Nan Liu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 21 pages, 3 figures

2405.05741 2024-05-10 cs.CL cs.AI 90%

Can large language models understand uncommon meanings of common words?

Jinyang Wu, Feihu Che, Xinxin Zheng, Shuai Zhang, Ruihan Jin, Shuai Nie, Pengpeng Shao, Jianhua Tao

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

2310.10690 2024-05-07 cs.CL cs.AI 90%

Large Language Models for In-Context Student Modeling: Synthesizing Student's Behavior in Visual Programming

Manh Hung Nguyen, Sebastian Tschiatschek, Adish Singla

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Published in International Conference on Educational Data Mining (EDM) 2024

2405.01724 2024-05-06 cs.CL cs.AI 90%

Large Language Models are Inconsistent and Biased Evaluators

Rickard Stureborg, Dimitris Alikaniotis, Yoshi Suhara

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 7 figures

2401.10314 2024-05-06 cs.SE cs.AI cs.LG cs.RO 90%

LangProp: A code optimization framework using Large Language Models applied to driving

Shu Ishida, Gianluca Corrado, George Fedoseev, Hudson Yeo, Lloyd Russell, Jamie Shotton, João F. Henriques, Anthony Hu

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2405.00988 2024-05-03 cs.CL cs.LG 90%

Context-Aware Clustering using Large Language Models

Sindhu Tipirneni, Ravinarayana Adkathimar, Nurendra Choudhary, Gaurush Hiranandani, Rana Ali Amjad, Vassilis N. Ioannidis, Changhe Yuan, Chandan K. Reddy

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 16 pages

1. 评测与基准 31957 篇

TasTe: Teaching Large Language Models to Translate through Self-Reflection

Achieving Sparse Activation in Small Language Models

VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation

AgentGym: Evolving Large Language Model-based Agents across Diverse Environments

Characterising the Creative Process in Humans and Large Language Models

DebugBench: Evaluating Debugging Capability of Large Language Models

Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models

An Empirical Analysis on Large Language Models in Debate Evaluation

NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models

Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Function

TCMBench: A Comprehensive Benchmark for Evaluating Large Language Models in Traditional Chinese Medicine

A Survey on Self-Evolution of Large Language Models

Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search

ANAH: Analytical Annotation of Hallucinations in Large Language Models

Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactions

Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answering

Large Language Models for Medicine: A Survey

DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues

UCCIX: Irish-eXcellence Large Language Model

COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain

Large Language Models can be Guided to Evade AI-Generated Text Detection

Enhancing Diagnostic Accuracy through Multi-Agent Conversations: Using Large Language Models to Mitigate Cognitive Bias

Can large language models understand uncommon meanings of common words?

Large Language Models for In-Context Student Modeling: Synthesizing Student's Behavior in Visual Programming

Large Language Models are Inconsistent and Biased Evaluators

LangProp: A code optimization framework using Large Language Models applied to driving

Context-Aware Clustering using Large Language Models