语言大模型 / LLM

Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation

Huifeng Lin, Gang Su, Jintao Liang, You Wu, Rui Zhao, Ziyue Li

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments under Review of EMNLP 2025

Towards Compute-Optimal Many-Shot In-Context Learning

Shahriar Golchin, Yanfei Chen, Rujun Han, Manan Gandhi, Tianli Yu, Swaroop Mishra, Mihai Surdeanu, Rishabh Agarwal, Chen-Yu Lee, Tomas Pfister

机构 * University of Arizona（亚利桑那大学） ； Google Cloud AI Research（谷歌云人工智能研究） ； Google DeepMind（谷歌DeepMind） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Final version; accepted at COLM 2025

UniAPO: Unified Multimodal Automated Prompt Optimization

Qipeng Zhu, Yanzhe Chen, Huasong Zhong, Yan Li, Jie Chen, Zhixin Zhang, Junping Zhang, Zhenheng Yang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；prompting(abstract)

Comments 23 pages, 5 figures

Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs

Hao Wang, Pinzhi Huang, Jihan Yang, Saining Xie, Daisuke Kawahara

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The first version of this paper mistakenly included a prompt injection phrase, which was inappropriate and unprofessional. Although we corrected the version on arXiv and withdrew from the conference, my co-authors and university strongly request a full withdrawal. Given the situation, I no longer have the authority to manage this paper, and withdrawing it from arXiv is the most responsible action

CXLAimPod: CXL Memory is all you need in AI era

Yiwei Yang, Yusheng Zheng, Yiqi Chen, Zheng Liang, Kexin Chu, Zhe Zhou, Andi Quinn, Wei Zhang

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Mitigating the Carbon Footprint of Chatbots as Consumers

Boris Ruf, Marcin Detyniecki

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Published in Lanka, S., Cabezuelo, A.S., Vuppalapati, C. (2025). Trends in Sustainable Computing and Machine Intelligence. Proceedings of ICTSM: International Conference on Trends in Sustainable Computing and Machine Intelligence 2024. Springer, Singapore

LagKV: Lag-Relative Information of the KV Cache Tells Which Tokens Are Important

Manlai Liang, JiaMing Zhang, Xiong Li, Jinlong Li

机构 * AI Lab, China Merchants Bank（中国商人银行人工智能实验室） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Explicit Vulnerability Generation with LLMs: An Investigation Beyond Adversarial Attacks

Emir Bosnak, Sahand Moslemi, Mayasah Lami, Anil Koyuncu

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；prompting(abstract)

Comments Accepted to ICSME 2025

Hypertokens: Holographic Associative Memory in Tokenized LLMs

Christopher James Augeri

机构 * Sloop FX, Inc.（Sloop FX 公司） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments preprint as accepted to https://qnlp.ai/ - Quantum AI and NLP Conference 2025

SEAL: Scaling to Emphasize Attention for Long-Context Retrieval

Changhun Lee, Minsang Seok, Jun-gyu Jin, Younghyun Cho, Eunhyeok Park

机构 * Department of Convergence IT Engineering（融合IT工程系） ； Department of Computer Science and Engineering（计算机科学与工程系） ； Graduate School of Artificial Intelligence（人工智能研究生院） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at ACL 2025 Main

Tracing Errors, Constructing Fixes: Repository-Level Memory Error Repair via Typestate-Guided Context Retrieval

Xiao Cheng, Zhihao Guo, Huan Huo, Yulei Sui

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Cartridges: Lightweight and general-purpose long context representations via self-study

Sabri Eyuboglu, Ryan Ehrlich, Simran Arora, Neel Guha, Dylan Zinsley, Emily Liu, Will Tennien, Atri Rudra, James Zou, Azalia Mirhoseini, Christopher Re

机构 * Department of XXX, University of YYY, Location, Country（XXX系，YYY大学，地点，国家） ； School of ZZZ, Institute of WWW, Location, Country（ZZZ学院，WWW研究所，地点，国家） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

CoMemo: LVLMs Need Image Context with Image Memory

Shi Liu, Weijie Su, Xizhou Zhu, Wenhai Wang, Jifeng Dai

机构 * Shi Liu ； Weijie Su ； Xizhou Zhu ； Wenhai Wang ； Jifeng Dai 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments ICML 2025

HashEvict: A Pre-Attention KV Cache Eviction Strategy using Locality-Sensitive Hashing

Minghui Liu, Tahseen Rabbani, Tony O'Halloran, Ananth Sankaralingam, Mary-Anne Hartley, Furong Huang, Cornelia Fermüller, Yiannis Aloimonos

机构 * University of Maryland（马里兰大学） ； Yale University（耶鲁大学） ； University of Galway（Galway大学） ； University of Maryland Capital One（马里兰大学Capital One） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 6 figures, 2 tables

GET: Goal-directed Exploration and Targeting for Large-Scale Unknown Environments

Lanxiang Zheng, Ruidong Mei, Mingxin Wei, Hao Ren, Hui Cheng

机构 * School of Computer Science and Engineering（计算机科学与工程学院） ； School of Systems Science and Engineering（系统科学与工程学院） ； School of Artificial Intelligence（人工智能学院） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

MacRAG: Compress, Slice, and Scale-up for Multi-Scale Adaptive Context RAG

Woosang Lim, Zekun Li, Gyuwan Kim, Sungyoung Ji, HyeonJung Kim, Kyuri Choi, Jin Hyuk Lim, Kyungpyo Park, William Yang Wang

机构 * POSCO HOLDINGS（POSCO控股公司） ； University of California, Santa Barbara（加州大学圣巴巴拉分校） ； Google Cloud（谷歌云） 纠错

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

LongFuncEval: Measuring the effectiveness of long context models for function calling

Kiran Kate, Tejaswini Pedapati, Kinjal Basu, Yara Rizk, Vijil Chenthamarakshan, Subhajit Chaudhury, Mayank Agarwal, Ibrahim Abdelaziz

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Instantiating Standards: Enabling Standard-Driven Text TTP Extraction with Evolvable Memory

Cheng Meng, ZhengWei Jiang, QiuYun Wang, XinYi Li, ChunYan Ma, FangMing Dong, FangLi Ren, BaoXu Liu

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Codetations: Intelligent, Persistent Notes and UIs for Programs and Other Documents

Edward Misback, Erik Vank, Zachary Tatlock, Steven Tanimoto

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 24 pages, 5 figures, 2 tables

HierarQ: Task-Aware Hierarchical Q-Former for Enhanced Video Understanding

Shehreen Azad, Vibhav Vineet, Yogesh Singh Rawat

机构 * Center for Research in Computer Vision, University of Central Florida（计算机视觉研究中心，中央佛罗里达大学） ； Microsoft Research（微软研究院） 纠错

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Accepted in CVPR 2025

From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs

Yaxiong Wu, Sheng Liang, Chen Zhang, Yichao Wang, Yongyue Zhang, Huifeng Guo, Ruiming Tang, Yong Liu

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 26 pages, 1 figure, 3 tables

Wormhole Memory: A Rubik's Cube for Cross-Dialogue Retrieval

Libo Wang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The experimental process and code have been uploaded to the Github repository, the link is: https://github.com/brucewang123456789/GeniusTrail/tree/main/Wormhole%20Memory%20Module

The Method for Storing Patterns in Neural Networks-Memorization and Recall of QR code Patterns-

Hiroshi Inazawa

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 14 pages, 6 figures

Training-Free Exponential Context Extension via Cascading KV Cache

Jeffrey Willette, Heejun Lee, Youngwan Lee, Myeongjae Jeon, Sung Ju Hwang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Robot Character Generation and Adaptive Human-Robot Interaction with Personality Shaping

Cheng Tang, Chao Tang, Steven Gong, Thomas M. Kwok, Yue Hu

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMs

Alireza Rezazadeh, Zichao Li, Wei Wei, Yujia Bao

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

COLA: A Scalable Multi-Agent Framework For Windows UI Task Automation

Di Zhao, Longhui Ma, Siwei Wang, Miao Wang, Zhao Lv

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

LLMs Know What to Drop: Self-Attention Guided KV Cache Eviction for Efficient Long-Context Inference

Guangtao Wang, Shubhangi Upasani, Chen Wu, Darshan Gandhi, Jonathan Li, Changran Hu, Bo Li, Urmish Thakker

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Towards Reliable Vector Database Management Systems: A Software Testing Roadmap for 2030

Shenao Wang, Yanjie Zhao, Yinglin Xie, Zhao Liu, Xinyi Hou, Quanchen Zou, Haoyu Wang

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)

LongSafety: Enhance Safety for Long-Context LLMs

Mianqiu Huang, Xiaoran Liu, Shaojun Zhou, Mozhi Zhang, Qipeng Guo, Linyang Li, Chenkun Tan, Yang Gao, Pengyu Wang, Linlin Li, Qun Liu, Yaqian Zhou, Xipeng Qiu, Xuanjing Huang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG