语言大模型 / LLM - arXivDaily 专题

2403.05152 2025-11-25 cs.CL cs.AI 90%

Towards a Psychology of Machines: Large Language Models Predict Human Memory

迈向机器的心理学：大型语言模型预测人类记忆

Markus Huff, Elanur Ulakçı

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

AI总结本研究发现大型语言模型能有效预测人类记忆表现，揭示了LLMs在模拟人类认知方面的潜力，提出机器心理学作为新研究领域。

Comments 34 pages, 3 figures, 2 tables

Journal ref PeerJ Comput.Sci. 11 (2025) e3324

2511.03214 2025-11-06 cs.CL cs.AI 90%

LGM: Enhancing Large Language Models with Conceptual Meta-Relations and Iterative Retrieval

Wenchang Lei, Ping Zou, Yue Wang, Feng Sun, Lei Zhao

机构 * Philisense（哲思科技）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 30 pages, 5 figures

2508.09874 2025-10-24 cs.CL cs.AI 90%

Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models

Jiaqi Cao, Jiarui Wang, Rubin Wei, Qipeng Guo, Kai Chen, Bowen Zhou, Zhouhan Lin

机构 * LUMIA Lab（LUMIA实验室）； School of Artificial Intelligence（人工智能学院）； Shanghai Jiao Tong University（上海交通大学）； Shanghai AI Laboratory（上海人工智能实验室）； Tsinghua University（清华大学）； SJTU Paris Elite Institute of Technology（上海交通大学巴黎精英技术学院）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI

2507.04607 2025-09-30 cs.CL cs.AI 90%

PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Process

Xinliang Frederick Zhang, Nick Beauchamp, Lu Wang

机构 * Computer Science and Engineering, University of Michigan, Ann Arbor, MI（计算机科学与工程系，密歇根大学，安娜堡分校）； Department of Political Science, Northeastern University, Boston, MA（政治学系，东北大学，波士顿分校）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments EMNLP'25 Main

2308.15022 2025-08-26 cs.CL cs.AI 90%

Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models

Qingyue Wang, Yanhe Fu, Yanan Cao, Shuai Wang, Zhiliang Tian, Liang Ding

机构 * the Department of Computer Science and Engineering, Hong Kong University of Science and Technology（香港科技大学计算机科学与工程系）； the institute of information engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）； the College of Computer, National University of Defense Technology（国防科技大学计算机学院）； the University of Sydney（悉尼大学）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted by Neurocomputing

2507.03120 2025-07-08 cs.LG cs.AI 90%

How Overconfidence in Initial Choices and Underconfidence Under Criticism Modulate Change of Mind in Large Language Models

Dharshan Kumaran, Stephen M Fleming, Larisa Markeeva, Joe Heyward, Andrea Banino, Mrinal Mathur, Razvan Pascanu, Simon Osindero, Benedetto de Martino, Petar Velickovic, Viorica Patraucean

机构 * Google DeepMind（谷歌DeepMind）； Google Research（谷歌研究）； University College London（伦敦大学学院）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 41 pages

2310.02003 2025-06-30 cs.SE cs.AI cs.LG cs.PL 90%

L2MAC: Large Language Model Automatic Computer for Extensive Code Generation

Samuel Holt, Max Ruiz Luyten, Mihaela van der Schaar

机构 * University of Cambridge（剑桥大学）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2502.14802 2025-06-23 cs.CL cs.AI 90%

From RAG to Memory: Non-Parametric Continual Learning for Large Language Models

Bernal Jiménez Gutiérrez, Yiheng Shu, Weijian Qi, Sizhe Zhou, Yu Su

机构 * The Ohio State University, Columbus, OH, USA（俄亥俄州立大学）； University of Illinois Urbana-Champaign, IL, USA（伊利诺伊大学厄巴纳-香槟分校）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments ICML 2025. Code and data are available at: https://github.com/OSU-NLP-Group/HippoRAG

2505.00019 2025-05-02 cs.CL cs.AI 90%

An Empirical Study on Prompt Compression for Large Language Models

Zheng Zhang, Jinyi Li, Yihuai Lan, Xiang Wang, Hao Wang

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））； South China University of Technology（华南理工大学）； University of Science and Technology of China（中国科学技术大学）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by Building Trust Workshop at ICLR 2025

2504.02441 2025-04-25 cs.CL cs.AI 90%

Cognitive Memory in Large Language Models

Lianlei Shan, Shixian Luo, Zezhou Zhu, Yu Yuan, Yong Wu

机构 * Li Auto（利亚 Auto）

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 37 pages, 9 figures

2404.01663 2025-04-16 cs.CL cs.AI cs.CC 90%

CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models

Xuechen Liang, Yangfan He, Meiling Tao, Yinghui Xia, Jianhui Wang, Tianyu Shi, Jun Wang, JingSong Yang

专题命中长上下文与记忆：language model(title,abstract)；small language model(title)；large language model(abstract)；language agent(abstract)

2502.15470 2025-02-28 cs.AR cs.AI cs.DC cs.LG 90%

PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System

Yintao He, Haiyu Mao, Christina Giannoula, Mohammad Sadrosadati, Juan Gómez-Luna, Huawei Li, Xiaowei Li, Ying Wang, Onur Mutlu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments To appear in ASPLOS 2025

2502.16971 2025-02-25 cs.CL cs.AI 90%

LongSafety: Evaluating Long-Context Safety of Large Language Models

Yida Lu, Jiale Cheng, Zhexin Zhang, Shiyao Cui, Cunxiang Wang, Xiaotao Gu, Yuxiao Dong, Jie Tang, Hongning Wang, Minlie Huang

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2409.18028 2025-02-03 cs.AI cs.CL 90%

Compositional Hardness of Code in Large Language Models -- A Probabilistic Perspective

Yotam Wolf, Binyamin Rothberg, Dorin Shteyman, Amnon Shashua

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2411.08147 2024-11-14 cs.CL cs.AI 90%

Large Language Models Can Self-Improve in Long-context Reasoning

Siheng Li, Cheng Yang, Zesen Cheng, Lemao Liu, Mo Yu, Yujiu Yang, Wai Lam

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI

Comments Project Page: https://github.com/SihengLi99/SEALONG

2410.17397 2024-10-24 quant-ph cs.AI cs.LG 90%

Quantum Large Language Models via Tensor Network Disentanglers

Borja Aizpurua, Saeed S. Jahromi, Sukhbinder Singh, Roman Orus

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 4 pages, 2 figures

2409.08281 2024-09-16 q-fin.ST cs.AI cs.CE cs.LG 90%

StockTime: A Time Series Specialized Large Language Model Architecture for Stock Price Prediction

Shengkun Wang, Taoran Ji, Linhan Wang, Yanshen Sun, Shang-Ching Liu, Amit Kumar, Chang-Tien Lu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2403.00071 2024-09-05 cs.CL cs.AI 90%

Resonance RoPE: Improving Context Length Generalization of Large Language Models

Suyuchen Wang, Ivan Kobyzev, Peng Lu, Mehdi Rezagholizadeh, Bang Liu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 13 pages, 4 figures, accepted at ACL 2024 Findings

Journal ref https://aclanthology.org/2024.findings-acl.32

2403.11901 2024-08-23 cs.LG cs.AI 90%

Larimar: Large Language Models with Episodic Memory Control

Payel Das, Subhajit Chaudhury, Elliot Nelson, Igor Melnyk, Sarath Swaminathan, Sihui Dai, Aurélie Lozano, Georgios Kollias, Vijil Chenthamarakshan, Jiří, Navrátil, Soham Dan, Pin-Yu Chen

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments ICML 2024

2408.09559 2024-08-20 cs.CL cs.AI cs.RO 90%

HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model

Mengkang Hu, Tianxing Chen, Qiguang Chen, Yao Mu, Wenqi Shao, Ping Luo

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Project Page: https://github.com/HiAgent2024/HiAgent

2408.04681 2024-08-12 cs.CL cs.AI cs.CY cs.HC 90%

Conversational AI Powered by Large Language Models Amplifies False Memories in Witness Interviews

Samantha Chan, Pat Pataranutaporn, Aditya Suri, Wazeer Zulfikar, Pattie Maes, Elizabeth F. Loftus

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2309.08112 2024-08-06 cs.HC cs.AI cs.CL 90%

Empowering Private Tutoring by Chaining Large Language Models

Yulin Chen, Ning Ding, Hai-Tao Zheng, Zhiyuan Liu, Maosong Sun, Bowen Zhou

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.18158 2024-06-07 cs.CL cs.AI 90%

Evaluating Quantized Large Language Models

Shiyao Li, Xuefei Ning, Luning Wang, Tengxuan Liu, Xiangsheng Shi, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI

2405.19010 2024-05-30 cs.CL cs.AI cs.IR 90%

Evaluating the External and Parametric Knowledge Fusion of Large Language Models

Hao Zhang, Yuyang Zhang, Xiaoguang Li, Wenxuan Shi, Haonan Xu, Huanshuo Liu, Yasheng Wang, Lifeng Shang, Qun Liu, Yong Liu, Ruiming Tang

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 3 figures, 3 tables

2312.17259 2024-05-29 cs.CL cs.AI 90%

Empowering Working Memory for Large Language Model Agents

Jing Guo, Nan Li, Jianchuan Qi, Hang Yang, Ruiqiao Li, Yuzhen Feng, Si Zhang, Ming Xu

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2403.15638 2024-04-30 cs.CR cs.CL cs.LG 90%

Differentially Private Next-Token Prediction of Large Language Models

James Flemings, Meisam Razaviyayn, Murali Annavaram

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2403.09747 2024-03-18 cs.CL cs.AI 90%

Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectors

Guanghua Li, Wensheng Lu, Wei Zhang, Defu Lian, Kezhong Lu, Rui Mao, Kai Shu, Hao Liao

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2305.13300 2024-02-28 cs.CL cs.AI 90%

Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts

Jian Xie, Kai Zhang, Jiangjie Chen, Renze Lou, Yu Su

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments ICLR 2024 (Spotlight)

2402.11353 2024-02-20 cs.HC cs.AI cs.CL 90%

Understanding the Impact of Long-Term Memory on Self-Disclosure with Large Language Model-Driven Chatbots for Public Health Intervention

Eunkyung Jo, Yuin Jeong, SoHyun Park, Daniel A. Epstein, Young-Ho Kim

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACM CHI 2024 as a full paper

Journal ref In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA. ACM, New York, NY, USA

2401.11459 2024-01-23 cs.AR cs.AI cs.LG 90%

AttentionLego: An Open-Source Building Block For Spatially-Scalable Large Language Model Accelerator With Processing-In-Memory Technology

Rongqing Cong, Wenyang He, Mingxuan Li, Bangning Luo, Zebin Yang, Yuchao Yang, Ru Huang, Bonan Yan

专题命中长上下文与记忆：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments for associated source codes, see https://bonany.cc/attentionleg

1. 长上下文与记忆 4738 篇

Towards a Psychology of Machines: Large Language Models Predict Human Memory

LGM: Enhancing Large Language Models with Conceptual Meta-Relations and Iterative Retrieval

Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models

PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Process

Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models

How Overconfidence in Initial Choices and Underconfidence Under Criticism Modulate Change of Mind in Large Language Models

L2MAC: Large Language Model Automatic Computer for Extensive Code Generation

From RAG to Memory: Non-Parametric Continual Learning for Large Language Models

An Empirical Study on Prompt Compression for Large Language Models

Cognitive Memory in Large Language Models

CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models

PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System

LongSafety: Evaluating Long-Context Safety of Large Language Models

Compositional Hardness of Code in Large Language Models -- A Probabilistic Perspective

Large Language Models Can Self-Improve in Long-context Reasoning

Quantum Large Language Models via Tensor Network Disentanglers

StockTime: A Time Series Specialized Large Language Model Architecture for Stock Price Prediction

Resonance RoPE: Improving Context Length Generalization of Large Language Models

Larimar: Large Language Models with Episodic Memory Control

HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model

Conversational AI Powered by Large Language Models Amplifies False Memories in Witness Interviews

Empowering Private Tutoring by Chaining Large Language Models

Evaluating Quantized Large Language Models

Evaluating the External and Parametric Knowledge Fusion of Large Language Models

Empowering Working Memory for Large Language Model Agents

Differentially Private Next-Token Prediction of Large Language Models

Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectors

Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts

Understanding the Impact of Long-Term Memory on Self-Disclosure with Large Language Model-Driven Chatbots for Public Health Intervention

AttentionLego: An Open-Source Building Block For Spatially-Scalable Large Language Model Accelerator With Processing-In-Memory Technology