语言大模型 / LLM - arXivDaily 专题

2601.22361 2026-04-14 cs.CL cs.AI cs.LG 80%

MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment

MERMAID：基于多智能体迭代知识接地的记忆增强检索与推理用于真实性评估

Yupeng Cao, Chengyang He, Yangyang Yu, Ping Wang, K. P. Subbalakshmi

机构 * Stevens Institute of Technology（史蒂文斯理工学院）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

AI总结 MERMAID通过整合智能体驱动搜索、结构化知识表示和持久记忆模块，提升事实核查和主张验证的效率与一致性，实现检索、推理与记忆的协同优化。

2602.14457 2026-02-17 cs.AI cs.CL cs.CV cs.CY cs.LG 80%

Frontier AI Risk Management Framework in Practice: A Risk Analysis Technical Report v1.5

实践中的前沿AI风险管理框架：一项风险分析技术报告v1.5

Dongrui Liu, Yi Yu, Jie Zhang, Guanxu Chen, Qihao Lin, Hanxi Zhu, Lige Huang, Yijin Zhou, Peng Wang, Shuai Shao, Boxuan Zhang, Zicheng Liu, Jingwei Sun, Yu Li, Yuejin Xie, Jiaxuan Guo, Jia Xu, Chaochao Lu, Bowen Zhou, Xia Hu, Jing Shao

机构 * Shanghai AI Laboratory（上海人工智能实验室）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

AI总结本文提出实践中的前沿AI风险管理框架，评估五个关键风险维度并提出缓解策略，为安全部署前沿AI提供技术路径。

Comments 49 pages, 17 figures, 12 tables

2505.18148 2025-12-18 cs.CL cs.AI cs.LG 80%

Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find

haystack中隐藏的针：更小的针对LLM来说更难找到

Owen Bianchi, Mathew J. Koretsky, Maya Willey, Chelsea X. Alvarado, Tanay Nayak, Adi Asija, Nicole Kuznetsov, Mike A. Nalls, Faraz Faghri, Daniel Khashabi

机构 * Center for Alzheimer’s Disease and Related Dementias, NIA, NIH（阿尔茨海默病及相关痴呆症研究中心，国家老龄化研究所，国家卫生研究院）； DataTecnica LLC（DataTecnica公司）； Johns Hopkins University（约翰霍普金斯大学）； Laboratory of Neurogenetics, NIA, NIH（神经遗传学实验室，国家老龄化研究所，国家卫生研究院）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

AI总结本文研究了黄金上下文大小对LLM长上下文问答性能的影响，发现较短的黄金上下文会显著降低模型性能，揭示了上下文长度对模型表现的关键作用。

Comments Under Review

2511.15163 2025-11-20 cs.CL cs.AI cs.HC cs.LG 80%

Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMs

Yang Wu, Rujing Yao, Tong Zhang, Yufei Shi, Zhuoren Jiang, Zhushan Li, Xiaozhong Liu

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments AAAI 2026 Workshop

2511.04686 2025-11-10 cs.LG cs.AI cs.CL 80%

Stateful KV Cache Management for LLMs: Balancing Space, Time, Accuracy, and Positional Fidelity

Pratik Poudel

机构 * Florida International University（佛罗里达国际大学）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 14 pages, 2 figures

2505.21097 2025-10-17 cs.CL cs.AI cs.LG 80%

Thinker: Learning to Think Fast and Slow

Stephen Chung, Wenyu Du, Jie Fu

机构 * University of Cambridge（剑桥大学）； The University of Hong Kong（香港大学）； Shanghai AI Lab（上海人工智能实验室）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 23 pages

2407.09450 2025-10-14 cs.AI cs.CL cs.LG q-bio.NC 80%

Human-inspired Episodic Memory for Infinite Context LLMs

Zafeirios Fountas, Martin A Benfeghoul, Adnan Oomerjee, Fenia Christopoulou, Gerasimos Lampouras, Haitham Bou-Ammar, Jun Wang

机构 * Huawei Noah’s Ark Lab（华为诺亚实验室）； University College London（伦敦大学学院）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Journal ref Proc. International Conference on Learning Representations (ICLR), 2025

2410.11001 2025-05-30 cs.CL cs.AI cs.LG 80%

Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs

Haozhen Zhang, Tao Feng, Jiaxuan You

机构 * University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ACL 2025 Main. The code is available at https://github.com/ulab-uiuc/GoR

2502.16747 2025-05-21 cs.CL cs.AI cs.LG cs.SE 80%

SQLong: Enhanced NL2SQL for Longer Contexts with LLMs

Dai Quoc Nguyen, Cong Duy Vu Hoang, Duy Vu, Gioacchino Tangari, Thanh Tien Vu, Don Dharmasiri, Yuan-Fang Li, Long Duong

机构 * Oracle Corporation（Oracle公司）

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to Table Representation Learning Workshop at ACL 2025

2505.13941 2025-05-21 cs.MA cs.AI cs.CL cs.LG 80%

MLZero: A Multi-Agent System for End-to-end Machine Learning Automation

Haoyang Fang, Boran Han, Nick Erickson, Xiyuan Zhang, Su Zhou, Anirudh Dagar, Jiani Zhang, Ali Caner Turkmen, Cuixiong Hu, Huzefa Rangwala, Ying Nian Wu, Bernie Wang, George Karypis

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2503.20589 2025-03-27 cs.SE 80%

What to Retrieve for Effective Retrieval-Augmented Code Generation? An Empirical Study and Beyond

Wenchao Gu, Juntao Chen, Yanlin Wang, Tianyue Jiang, Xingzhe Li, Mingwei Liu, Xilin Liu, Yuchi Ma, Zibin Zheng

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

2502.13870 2025-02-20 cs.LG cs.AI cs.CL cs.IT math.IT 80%

SPEX: Scaling Feature Interaction Explanations for LLMs

Justin Singh Kang, Landon Butler, Abhineet Agarwal, Yigit Efe Erginbas, Ramtin Pedarsani, Kannan Ramchandran, Bin Yu

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2409.02976 2024-12-09 cs.LG cs.AI cs.CL 80%

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models

Gabriel Y. Arteaga, Thomas B. Schön, Nicolas Pielawski

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 6 pages, 3 figures

2410.19318 2024-10-28 cs.CL cs.AI cs.LG 80%

Two are better than one: Context window extension with multi-grained self-injection

Wei Han, Pan Zhou, Soujanya Poria, Shuicheng Yan

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The code is available at https://github.com/Clement25/SharedLLM

2410.02024 2024-10-24 cs.CE cs.AI cs.CL cs.LG 80%

FLAG: Financial Long Document Classification via AMR-based GNN

Bolun "Namir" Xia, Aparna Gupta, Mohammed J. Zaki

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages, 3 figures, to be published in CIFEr Conference 2024 as "Semantic Graph Learning for Trend Prediction from Long Financial Documents"

2404.07979 2024-10-18 cs.CL cs.AI cs.LG 80%

LLoCO: Learning Long Contexts Offline

Sijun Tan, Xiuyu Li, Shishir Patil, Ziyang Wu, Tianjun Zhang, Kurt Keutzer, Joseph E. Gonzalez, Raluca Ada Popa

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024. The first two authors contributed equally to this work

2410.05983 2024-10-10 cs.CL cs.AI cs.LG 80%

Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG

Bowen Jin, Jinsung Yoon, Jiawei Han, Sercan O. Arik

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 34 pages

2409.17422 2024-09-27 cs.CL cs.AI cs.LG 80%

Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction

Zhenmei Shi, Yifei Ming, Xuan-Phi Nguyen, Yingyu Liang, Shafiq Joty

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.16008 2024-07-04 cs.CL cs.AI cs.LG 80%

Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization

Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long T. Le, Abhishek Kumar, James Glass, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, Tomas Pfister

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL Findings 2024

2406.05688 2024-06-11 cs.CL cs.AI cs.LG 80%

Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions

Cheng Tan, Dongxin Lyu, Siyuan Li, Zhangyang Gao, Jingxuan Wei, Siqi Ma, Zicheng Liu, Stan Z. Li

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Under review

2402.04617 2024-05-29 cs.CL cs.AI cs.LG 80%

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory

Chaojun Xiao, Pengle Zhang, Xu Han, Guangxuan Xiao, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Maosong Sun

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2404.05726 2024-04-25 cs.CV 80%

MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

Bo He, Hengduo Li, Young Kyun Jang, Menglin Jia, Xuefei Cao, Ashish Shah, Abhinav Shrivastava, Ser-Nam Lim

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments Accepted at CVPR 2024. Project Page https://boheumd.github.io/MA-LMM/

2404.09339 2024-04-16 cs.CL cs.AI cs.LG 80%

Towards Practical Tool Usage for Continually Learning LLMs

Jerry Huang, Prasanna Parthasarathi, Mehdi Rezagholizadeh, Sarath Chandar

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 20 pages, 11 tables, 7 figures

2403.05004 2024-03-11 cs.CL cs.AI cs.IR cs.LG 80%

Can't Remember Details in Long Documents? You Need Some R&R

Devanshu Agrawal, Shang Gao, Martin Gajek

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 13 pages, 1 figure, 9 tables. For associated code repository see https://github.com/casetext/r-and-r

2307.12856 2024-02-27 cs.LG cs.AI cs.CL 80%

A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis

Izzeddin Gur, Hiroki Furuta, Austin Huang, Mustafa Safdari, Yutaka Matsuo, Douglas Eck, Aleksandra Faust

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ICLR 2024 (Oral)

2306.03901 2023-06-08 cs.AI cs.CL cs.DB cs.LG 80%

ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory

Chenxu Hu, Jie Fu, Chenzhuang Du, Simian Luo, Junbo Zhao, Hang Zhao

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2506.08184 2025-08-01 cs.CL cs.AI q-bio.NC 80%

Unable to Forget: Proactive Interference Reveals Working Memory Limits in LLMs Beyond Context Length

Chupei Wang, Jiaqiu Vince Sun

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at ICML 2025 Workshop on Long Context Foundation Models (ICFM). Code: https://github.com/zhuangziGiantfish/Unable-to-Forget

2608.13921 2026-08-17 cs.AI 新提交 79%

When Personal Memory Has No Single Answer: Evaluating LLM Agents under Irreducible Conflict

当个人记忆没有唯一答案时：评估大语言模型智能体在不可约冲突下的表现

Lu Yang, Shusheng Xu, Zhuoran Li, Tongkai Yang, Longbo Huang

机构 * Ant Group（蚂蚁集团）

专题命中长上下文与记忆：LLM(title,abstract)；分类 cs.AI

AI总结该研究针对大语言模型智能体的记忆冲突问题，提出了基准TANGLE并评估其表现，发现现有方法存在缺陷，进而提出冲突感知行动策略CAAP。

2608.11248 2026-08-13 cs.AI cs.MA 新提交 79%

EvoGraph-Mem: Failure-Aware Editable Graph Memory for Long-Term Language Agents

EvoGraph-Mem：面向长期语言智能体的故障感知可编辑图记忆

Yuxi Qian, Yuxiang Ren

专题命中长上下文与记忆：language agent(title,abstract)；分类 cs.AI

AI总结本文针对长期语言智能体的记忆污染问题，提出故障感知可编辑图记忆框架，通过见解节点跟踪与图级编辑优化记忆，实验显示其性能优于现有记忆增强智能体基线。

Comments 10 pages, 3 figures

2509.18751 2026-08-13 cs.LG 版本更新 79%

Patch-based Memory Gate Model in Time Series Foundation Model

MOMEMTO：基于补丁的记忆门模型在时间序列基础模型中的应用

Samuel Yoon, Jongwon Kim, Juyoung Ha, Young Myoung Ko

机构 * Pohang University of Science and Technology（浦项科学技术大学）

专题命中长上下文与记忆：foundation model(title,abstract)；分类 cs.LG

AI总结 MOMEMTO通过基于补丁的记忆模块改进时间序列基础模型，有效缓解过度泛化问题，提升异常检测性能，尤其在少样本学习中表现突出。

Comments Published in Transactions on Machine Learning Research (TMLR), 2026

Journal ref Transactions on Machine Learning Research (TMLR), 2026

1. 长上下文与记忆 4771 篇

MERMAID: Memory-Enhanced Retrieval and Reasoning with Multi-Agent Iterative Knowledge Grounding for Veracity Assessment

Frontier AI Risk Management Framework in Practice: A Risk Analysis Technical Report v1.5

Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find

Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMs

Stateful KV Cache Management for LLMs: Balancing Space, Time, Accuracy, and Positional Fidelity

Thinker: Learning to Think Fast and Slow

Human-inspired Episodic Memory for Infinite Context LLMs

Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs

SQLong: Enhanced NL2SQL for Longer Contexts with LLMs

MLZero: A Multi-Agent System for End-to-end Machine Learning Automation

What to Retrieve for Effective Retrieval-Augmented Code Generation? An Empirical Study and Beyond

SPEX: Scaling Feature Interaction Explanations for LLMs

Hallucination Detection in LLMs: Fast and Memory-Efficient Fine-Tuned Models

Two are better than one: Context window extension with multi-grained self-injection

FLAG: Financial Long Document Classification via AMR-based GNN

LLoCO: Learning Long Contexts Offline

Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG

Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction

Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization

Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactions

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory

MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

Towards Practical Tool Usage for Continually Learning LLMs

Can't Remember Details in Long Documents? You Need Some R&R

A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis

ChatDB: Augmenting LLMs with Databases as Their Symbolic Memory

Unable to Forget: Proactive Interference Reveals Working Memory Limits in LLMs Beyond Context Length

When Personal Memory Has No Single Answer: Evaluating LLM Agents under Irreducible Conflict

EvoGraph-Mem: Failure-Aware Editable Graph Memory for Long-Term Language Agents

Patch-based Memory Gate Model in Time Series Foundation Model