语言大模型 / LLM

Improving LLM-Based Fault Localization with External Memory and Project Context

Inseok Yeo, Duksan Ryu, Jongmoon Baik

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 12 Pages, 7 figures

RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditing

Jinyao Guo, Chengpeng Wang, Xiangzhe Xu, Zian Su, Xiangyu Zhang

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 18 pages, 11 tables, 6 figures, 3 listings

Mini-batch Coresets for Memory-efficient Language Model Training on Data Mixtures

Dang Nguyen, Wenhan Yang, Rathul Anand, Yu Yang, Baharan Mirzasoleiman

机构 * Computer Science Department, UCLA（计算机科学系，加州大学洛杉矶分校） 纠错

专题命中 长上下文与记忆 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 21 pages, 6 figures, 9 tables, link: https://github.com/BigML-CS-UCLA/CoLM

Too Long, Didn't Model: Decomposing LLM Long-Context Understanding With Novels

Sil Hamilton, Rebecca M. M. Hicke, Matthew Wilkens, David Mimno

机构 * Department of Information Science（信息科学系） ； Department of Computer Science（计算机科学系） ； Cornell University（康奈尔大学） 纠错

专题命中 长上下文与记忆 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Augmented Body Communicator: Enhancing daily body expression for people with upper limb limitations through LLM and a robotic arm

Songchen Zhou, Mark Armstrong, Giulia Barbareschi, Toshihiro Ajioka, Zheng Hu, Ryoichi Ando, Kentaro Yoshifuji, Masatane Muto, Kouta Minamizawa

机构 * Keio University Graduate School of Media Design（庆应大学媒体设计研究生院） 纠错

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

LAMeD: LLM-generated Annotations for Memory Leak Detection

Ekaterina Shemetova, Ilya Shenbin, Ivan Smirnov, Anton Alekseev, Alexey Rukhovich, Sergey Nikolenko, Vadim Lomshakov, Irina Piontkovskaya

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Customizing Emotional Support: How Do Individuals Construct and Interact With LLM-Powered Chatbots

Xi Zheng, Zhuoyang Li, Xinning Gui, Yuhan Luo

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 20 pages, 3 figures, 3 tables. Accepted to CHI 2025, ACM Conference on Human Factors in Computing Systems

Journal ref Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25), Article 376, 20 pages. ACM, New York, NY, USA.

Gene42: Long-Range Genomic Foundation Model With Dense Attention

Kirill Vishniakov, Boulbaba Ben Amor, Engin Tekin, Nancy A. ElNaker, Karthik Viswanathan, Aleksandr Medvedev, Aahan Singh, Maryam Nadeem, Mohammad Amaan Sayeed, Praveenkumar Kanithi, Tiago Magalhaes, Natalia Vassilieva, Dwarikanath Mahapatra, Marco Pimentel, and Shadab Khan

专题命中 长上下文与记忆 ：foundation model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

RustMap: Towards Project-Scale C-to-Rust Migration via Program Analysis and LLM

Xuemeng Cai, Jiakun Liu, Xiping Huang, Yijun Yu, Haitao Wu, Chunmiao Li, Bo Wang, Imam Nur Bani Yusuf, Lingxiao Jiang

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Agent-S: LLM Agentic workflow to automate Standard Operating Procedures

Mandar Kulkarni

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

LogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-Agents

Ke Zhang, Chenxi Zhang, Chong Wang, Chi Zhang, YaChen Wu, Zhenchang Xing, Yang Liu, Qingshan Li, Xin Peng

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Towards More Economical Context-Augmented LLM Generation by Reusing Stored KV Cache

Hanchen Li, Yuhan Liu, Yihua Cheng, Kuntai Du, Junchen Jiang

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models

Yanming Liu, Xinyue Peng, Yuwei Zhang, Xiaolan Ke, Songhang Deng, Jiannan Cao, Chen Ma, Mengchen Fu, Tianyu Du, Sheng Cheng, Xun Wang, Jianwei Yin, Xuhong Zhang

专题命中 长上下文与记忆 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Fix metadata error

CoS: Chain-of-Shot Prompting for Long Video Understanding

Jian Hu, Zixu Cheng, Chenyang Si, Wei Li, Shaogang Gong

专题命中 长上下文与记忆 ：prompting(title,abstract)；large language model(abstract)；language model(abstract)

Comments A training-free test-time optimisation approach for long video understanding

ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models

Thibaut Thonet, Jos Rozen, Laurent Besacier

专题命中 长上下文与记忆 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published in COLING 2025

AdaptiveCoPilot: Design and Testing of a NeuroAdaptive LLM Cockpit Guidance System in both Novice and Expert Pilots

Shaoyue Wen, Michael Middleton, Songming Ping, Nayan N Chawla, Guande Wu, Bradley S Feest, Chihab Nadri, Yunmei Liu, David Kaber, Maryam Zahabi, Ryan P. McMahan, Sonia Castelo, Ryan Mckendrick, Jing Qian, Claudio Silva

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Differentiable Prompt Learning for Vision Language Models

Zhenhan Huang, Tejaswini Pedapati, Pin-Yu Chen, Jianxi Gao

专题命中 长上下文与记忆 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool

Cunchen Hu, Heyang Huang, Junhao Hu, Jiang Xu, Xusheng Chen, Tao Xie, Chenxi Wang, Sa Wang, Yungang Bao, Ninghui Sun, Yizhou Shan

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Hiding Communication Cost in Distributed LLM Training via Micro-batch Co-execution

Haiquan Wang, Chaoyi Ruan, Jia He, Jiaqi Ruan, Chengjie Tang, Xiaosong Ma, Cheng Li

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Securing Multi-turn Conversational Language Models From Distributed Backdoor Triggers

Terry Tong, Jiashu Xu, Qin Liu, Muhao Chen

专题命中 长上下文与记忆 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Findings of EMNLP 2024

Semantic Communications using Foundation Models: Design Approaches and Open Issues

Peiwen Jiang, Chao-Kai Wen, Xinping Yi, Xiao Li, Shi Jin, Jun Zhang

专题命中 长上下文与记忆 ：foundation model(title,abstract)；large language model(abstract)；language model(abstract)

Comments This work has been submitted to the IEEE for possible publication

Memory-Efficient LLM Training with Online Subspace Descent

Kaizhao Liang, Bo Liu, Lizhang Chen, Qiang Liu

专题命中 长上下文与记忆 ：LLM(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Code is available at https://github.com/kyleliang919/Online-Subspace-Descent

Lifelong Robot Library Learning: Bootstrapping Composable and Generalizable Skills for Embodied Control with Language Models

Georgios Tziafas, Hamidreza Kasaei

专题命中 长上下文与记忆 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)

Comments ICRA 2024

Feedback Loops With Language Models Drive In-Context Reward Hacking

Alexander Pan, Erik Jones, Meena Jagadeesan, Jacob Steinhardt

专题命中 长上下文与记忆 ：language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2024 camera-ready

PM4Py.LLM: a Comprehensive Module for Implementing PM on LLMs

Alessandro Berti

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering

Wenhu Chen, Pat Verga, Michiel de Jong, John Wieting, William Cohen

专题命中 长上下文与记忆 ：language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by EACL 2023

Kodezi Chronos: A Debugging-First Language Model for Repository-Scale Code Understanding

Kodezi Chronos：面向仓库级代码理解的调试优先语言模型

Ishraq Khan, Assad Chowdary, Sharoz Haseeb, Urvish Patel, Yousuf Zaii

专题命中 长上下文与记忆 ：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

AI总结 Kodezi Chronos-1是一种专为调试设计的语言模型，通过自适应图引导检索、持久调试内存和七层架构，在多文件调试任务中达到67.3%的修复准确率，超越现有模型并实现仓库特定的高解决率。

Comments 24 figures, 43 tables, 2 algorithms. Extended technical report introducing Chronos-1, a debugging-specific language model. Information available at https://github.com/Kodezi/chronos

Beyond LLMs, Sparse Distributed Memory, and Neuromorphics <A Hyper-Dimensional SRAM-CAM "VaCoAl" for Ultra-High Speed, Ultra-Low Power, and Low Cost>

超越LLM、稀疏分布式记忆和神经形态计算：一种用于超高速、超低功耗和低成本的超维SRAM-CAM“VaCoAl”

Hiroyuki Chuma, Kanji Otsuka, Yoichi Sato

机构 * Hitotsubashi University（立命馆大学） ； Meisei University（立命馆大学） ； Shuhari System（Shuhari系统） 纠错

专题命中 长上下文与记忆 ：LLM(title_cn,abstract_cn)；large language model(abstract)；language model(abstract)；分类 cs.AI

AI总结 本文提出VaCoAl算法，通过超维计算和伽罗瓦域扩散，在SRAM/DRAM-CAM上实现可逆、可审计的多跳推理，解决灾难性遗忘和绑定问题，并在维基数据上验证了其路径依赖的STDP式选择机制。

Comments 58 pages, 4 figure, 19 tables

Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach

使用工具的智能体群体中自适应隐式合谋的隐写分析：一种黑盒跨主体方法

Mohamed Chahine Ghanem

专题命中 长上下文与记忆 ：LLM(summary_cn,abstract_cn)；large language model(abstract)；language model(abstract)；分类 cs.AI

AI总结 本研究针对使用工具的LLM智能体群体的自适应隐式合谋，构建结合多类方法的黑盒隐写分析检测器，开展红蓝对抗实验，绘制检测容量边界并发现新的规避手段。

Comments 10 pages

Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory

理解在早期完成：大语言模型的深度分工及其在无界上下文记忆中的应用

Hanzuo Liu, Xuan Qi, Chunyu Liu, Haotian Zhong, Yulong Wang, Rayying, Key, Alex Lamb, Mingyu Gao

机构 * Tsinghua University（清华大学） ； Tencent（腾讯） 纠错

专题命中 长上下文与记忆 ：large language model(title)；language model(title)；分类 cs.CL

AI总结 该研究提出CoMem方法，利用大语言模型的深度分工构建无界上下文记忆，在RULER、LoCoMo等基准上性能优于全上下文KV-Direct，内存占用低、预填充速度快，证明长上下文记忆可沿层轴组织。

Comments 19 pages, 4 figures, 27 tables. Submitted to ACL Rolling Review