语言大模型 / LLM

ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities

Peng Xu, Wei Ping, Xianchao Wu, Chejian Xu, Zihan Liu, Mohammad Shoeybi, Bryan Catanzaro

专题命中 长上下文与记忆 ：instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at ICLR 2025

Open-Source AI-Powered Optimization in Scalene: Advancing Python Performance Profiling with DeepSeek-R1 and LLaMA 3.2

Saem Hasan, Sanju Basak

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

An Evolved Universal Transformer Memory

Edoardo Cetin, Qi Sun, Tianyu Zhao, Yujin Tang

专题命中 长上下文与记忆 ：foundation model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published at ICLR 2025. Source code available at https://github.com/SakanaAI/evo-memory

Distributed Approach to Haskell Based Applications Refactoring with LLMs Based Multi-Agent Systems

Shahbaz Siddeeq, Zeeshan Rasheed, Malik Abdul Sami, Mahade Hasan, Muhammad Waseem, Jussi Rasku, Mika Saari, Kai-Kristian Kemell, Pekka Abrahamsson

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

DINT Transformer

Yueyang Cang, Yuhang Liu, Xiaoteng Zhang, Erlu Zhao, Li Shi

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments arXiv admin note: text overlap with arXiv:2410.05258 by other authors

MicroPython Testbed for Federated Learning Algorithms

Miroslav Popovic, Marko Popovic, Ivan Kastelan, Miodrag Djukic, Ilija Basicevic

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 20 pages, 6 figures, 12 tables, the extended paper preprint

LongKey: Keyphrase Extraction for Long Documents

Jeovane Honorio Alves, Radu State, Cinthia Obladen de Almendra Freitas, Jean Paul Barddal

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted for presentation at the 2024 IEEE International Conference on Big Data (IEEE BigData 2024). Code available at https://github.com/jeohalves/longkey

Titans: Learning to Memorize at Test Time

Ali Behrouz, Peilin Zhong, Vahab Mirrokni

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

HiCM$^2$: Hierarchical Compact Memory Modeling for Dense Video Captioning

Minkuk Kim, Hyeon Bae Kim, Jinyoung Moon, Jinwoo Choi, Seong Tae Kim

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments AAAI2025

MarketGPT: Developing a Pre-trained transformer (GPT) for Modeling Financial Time Series

Aaron Wheeler, Jeffrey D. Varner

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 13 pages, 8 figures

Empowering Agile-Based Generative Software Development through Human-AI Teamwork

Sai Zhang, Zhenchang Xing, Ronghui Guo, Fangzhou Xu, Lei Chen, Zhaoyuan Zhang, Xiaowang Zhang, Zhiyong Feng, Zhiqiang Zhuang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments This paper is accepted by ACM TOSEM

Assessing Episodic Memory in LLMs with Sequence Order Recall Tasks

Mathis Pink, Vy A. Vo, Qinyuan Wu, Jianing Mu, Javier S. Turek, Uri Hasson, Kenneth A. Norman, Sebastian Michelmann, Alexander Huth, Mariya Toneva

专题命中 长上下文与记忆 ：LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Visual Context Window Extension: A New Perspective for Long Video Understanding

Hongchen Wei, Zhenzhong Chen

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 14 pages, 4 figures

Benchmarking ChatGPT, Codeium, and GitHub Copilot: A Comparative Study of AI-Driven Programming and Debugging Assistants

Md Sultanul Islam Ovi, Nafisa Anjum, Tasmina Haque Bithe, Md. Mahabubur Rahman, Mst. Shahnaj Akter Smrity

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position

Kechi Zhang, Ge Li, Huangzhao Zhang, Zhi Jin

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments Camera Ready version for ACL 2024 (main)

MEIA: Multimodal Embodied Perception and Interaction in Unknown Environments

Yang Liu, Xinshuai Song, Kaixuan Jiang, Weixing Chen, Jingzhou Luo, Guanbin Li, Liang Lin

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments Codes will be available at https://github.com/HCPLab-SYSU/Embodied_AI_Paper_List

Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams

Haoji Zhang, Yiqin Wang, Yansong Tang, Yong Liu, Jiashi Feng, Jifeng Dai, Xiaojie Jin

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization

Shida Wang, Qianxiao Li

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 28 pages, 7 figures, ICML 2024

Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

Alex Jinpeng Wang, Linjie Li, Yiqi Lin, Min Li, Lijuan Wang, Mike Zheng Shou

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 12 pages. The website is \url{https://fingerrec.github.io/visincontext}

PostDoc: Generating Poster from a Long Multimodal Document Using Deep Submodular Optimization

Vijay Jaisankar, Sambaran Bandyopadhyay, Kalp Vyas, Varre Chaitanya, Shwetha Somasundaram

专题命中 长上下文与记忆 ：LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation

Jennifer A Bishop, Qianqian Xie, Sophia Ananiadou

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments This paper has been published in LREC-COLING 2024, Pages 10777-10789 and was presented as an oral presentation during the conference held in Turin, Italy. The published version is available at https://aclanthology.org/2024.lrec-main.941. 13 pages, 5 figures

Journal ref Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

A Framework for Inference Inspired by Human Memory Mechanisms

Xiangyu Zeng, Jie Lin, Piao Hu, Ruizheng Huang, Zhicheng Zhang

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

FETILDA: An Effective Framework For Fin-tuned Embeddings For Long Financial Text Documents

Bolun "Namir" Xia, Vipula D. Rawte, Mohammed J. Zaki, Aparna Gupta

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 9 figures, 7 tables

EVCap: Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension

Jiaxuan Li, Duc Minh Vo, Akihiro Sugimoto, Hideki Nakayama

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments CVPR 2024

TrICy: Trigger-guided Data-to-text Generation with Intent aware Attention-Copy

Vibhav Agarwal, Sourav Ghosh, Harichandana BSS, Himanshu Arora, Barath Raj Kandur Raja

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published in the IEEE/ACM Transactions on Audio, Speech, and Language Processing. (Sourav Ghosh and Vibhav Agarwal contributed equally to this work.)

Journal ref IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 32, pp. 1173-1184, 2024

Scaling Transformer to 1M tokens and beyond with RMT

Aydar Bulatov, Yuri Kuratov, Yermek Kapushev, Mikhail S. Burtsev

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Program Decomposition and Translation with Static Analysis

Ali Reza Ibrahimzada

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments Published in ICSE SRC 2024

COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training

Alex Jinpeng Wang, Linjie Li, Kevin Qinghong Lin, Jianfeng Wang, Kevin Lin, Zhengyuan Yang, Lijuan Wang, Mike Zheng Shou

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)

Comments 16 pages; Website: http://fingerrec.github.io/cosmo

HistAlign: Improving Context Dependency in Language Generation by Aligning with History

David Wan, Shiyue Zhang, Mohit Bansal

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2023 (20 pages)

Semantic HELM: A Human-Readable Memory for Reinforcement Learning

Fabian Paischer, Thomas Adler, Markus Hofmarcher, Sepp Hochreiter

专题命中 长上下文与记忆 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments To appear at NeurIPS 2023, 10 pages (+ references and appendix), Code: https://github.com/ml-jku/helm