语言大模型 / LLM - arXivDaily 专题

2405.06067 2025-02-07 cs.CL cs.LG 79%

HMT: Hierarchical Memory Transformer for Efficient Long Context Language Processing

Zifan He, Yingqi Cao, Zongyue Qin, Neha Prakriya, Yizhou Sun, Jason Cong

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments NAACL 2025 Main Conference

2501.13956 2025-01-27 cs.CL cs.AI cs.IR 79%

Zep: A Temporal Knowledge Graph Architecture for Agent Memory

Preston Rasmussen, Pavlo Paliychuk, Travis Beauvais, Jack Ryan, Daniel Chalef

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 12 pages, 3 tables

2403.09498 2024-12-24 cs.SI cs.AI cs.CL 79%

From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News

Yuhan Liu, Xiuying Chen, Xiaoqing Zhang, Xing Gao, Ji Zhang, Rui Yan

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments IJCAI 2024 Oral

2412.13626 2024-12-19 cs.CL cs.AI 79%

LIFT: Improving Long Context Understanding Through Long Input Fine-Tuning

Yansheng Mao, Jiaqi Li, Fanxu Meng, Jing Xiong, Zilong Zheng, Muhan Zhang

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2412.09596 2024-12-13 cs.CV cs.AI cs.CL 79%

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

Pan Zhang, Xiaoyi Dong, Yuhang Cao, Yuhang Zang, Rui Qian, Xilin Wei, Lin Chen, Yifei Li, Junbo Niu, Shuangrui Ding, Qipeng Guo, Haodong Duan, Xin Chen, Han Lv, Zheng Nie, Min Zhang, Bin Wang, Wenwei Zhang, Xinyue Zhang, Jiaye Ge, Wei Li, Jingwen Li, Zhongying Tu, Conghui He, Xingcheng Zhang, Kai Chen, Yu Qiao, Dahua Lin, Jiaqi Wang

专题命中长上下文与记忆：large language model(abstract)；language model(abstract)；foundation model(abstract)；分类 cs.CL、cs.AI

Comments Github Repo: https://github.com/InternLM/InternLM-XComposer/tree/main/InternLM-XComposer-2.5-OmniLive

2411.01643 2024-11-05 cs.AI cs.CL 79%

EcoAct: Economic Agent Determines When to Register What Action

Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Rühle, Qingyun Wu, Chi Wang

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 16 pages, 10 figures

2410.12859 2024-10-18 cs.CL cs.AI cs.IR 79%

Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism

Yimin Tang, Yurong Xu, Ning Yan, Masood Mortazavi

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2406.14928 2024-10-18 cs.AI cs.CL cs.HC cs.MA cs.SI 79%

Autonomous Agents for Collaborative Task under Information Asymmetry

Wei Liu, Chenxi Wang, Yifei Wang, Zihao Xie, Rennai Qiu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Chen Qian

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 32 pages, 12 figures, 6 tables, accepted by NeurIPS 2024, see detail at https://thinkwee.top/iagents

2308.04215 2024-10-15 cs.CL cs.AI cs.DC 79%

Hybrid-RACA: Hybrid Retrieval-Augmented Composition Assistance for Real-time Text Prediction

Menglin Xia, Xuchao Zhang, Camille Couturier, Guoqing Zheng, Saravan Rajmohan, Victor Ruhle

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at EMNLP 2024 Industry Track

2402.03483 2024-10-10 cs.CL cs.AI 79%

SWAG: Storytelling With Action Guidance

Zeeshan Patel, Karim El-Refai, Jonathan Pei, Tianle Li

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments EMNLP Findings 2024

2409.16120 2024-09-25 cs.SE cs.AI cs.CL 79%

MOSS: Enabling Code-Driven Evolution and Context Management for AI Agents

Ming Zhu, Yi Zhou

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2409.13695 2024-09-24 cs.CL cs.AI cs.IR 79%

You Only Use Reactive Attention Slice For Long Context Retrieval

Yun Joon Soh, Hanxian Huang, Yuandong Tian, Jishen Zhao

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2408.16586 2024-09-05 cs.CL cs.AI 79%

Enhancing Dialogue Generation in Werewolf Game Through Situation Analysis and Persuasion Strategies

Zhiyang Qi, Michimasa Inaba

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to the AIWolfDial2024 workshop at INLG 2024

2408.11939 2024-08-30 cs.AI cs.LG 79%

Matmul or No Matmul in the Era of 1-bit LLMs

Jinendra Malekar, Mohammed E. Elbtity, Ramtin Zand

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Fixed Typo in title, Fixed typo in author name, fixed typo in amdhal's law para

2406.18312 2024-08-29 cs.CL cs.AI 79%

AI-native Memory: A Pathway from LLMs Towards AGI

Jingbo Shang, Zai Zheng, Jiale Wei, Xiang Ying, Felix Tao, Mindverse Team

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2405.10620 2024-08-13 cs.AI cs.CL cs.CV 79%

MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains

Zhaohuan Zhan, Lisha Yu, Sijie Yu, Guang Tan

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2310.06839 2024-08-13 cs.CL cs.LG 79%

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at ACL 2024

2407.19089 2024-07-30 cs.CL cs.AI 79%

Many-Shot In-Context Learning for Molecular Inverse Design

Saeed Moayedpour, Alejandro Corrochano-Navarro, Faryad Sahneh, Shahriar Noroozizadeh, Alexander Koetter, Jiri Vymetal, Lorenzo Kogler-Anele, Pablo Mas, Yasser Jangjou, Sizhen Li, Michael Bailey, Marc Bianciotto, Hans Matter, Christoph Grebner, Gerhard Hessler, Ziv Bar-Joseph, Sven Jager

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2305.15233 2024-07-17 cs.CL cs.AI 79%

Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance

Sunkyoung Kim, Dayeon Ki, Yireun Kim, Jinsik Lee

专题命中长上下文与记忆：large language model(abstract)；language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ICML 2024 Workshop on In-Context Learning

2404.19721 2024-07-11 cs.AI cs.CL 79%

PANGeA: Procedural Artificial Narrative using Generative AI for Turn-Based Video Games

Steph Buongiorno, Lawrence Jake Klinkert, Tanishq Chawla, Zixin Zhuang, Corey Clark

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2406.10878 2024-06-18 cs.AI cs.CL 79%

Demonstration Notebook: Finding the Most Suited In-Context Learning Example from Interactions

Yiming Tang, Bin Dong

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2405.13386 2024-05-24 cs.CL cs.AI 79%

360Zhinao Technical Report

360Zhinao Team

专题命中长上下文与记忆：pretraining(abstract)；SFT(abstract)；RLHF(abstract)；分类 cs.CL、cs.AI

Comments 360Zhinao technical report. Github: https://github.com/Qihoo360/360zhinao

2405.06714 2024-05-15 cs.CL cs.AI 79%

Towards a Path Dependent Account of Category Fluency

David Heineman, Reba Koenen, Sashank Varma

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments To appear at CogSci 2024

2404.08692 2024-04-16 cs.IR cs.AI cs.CL 79%

Apollonion: Profile-centric Dialog Agent

Shangyu Chen, Zibo Zhao, Yuanyuan Zhao, Xiang Li

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2404.06480 2024-04-11 cs.CL cs.AI 79%

Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks

Chonghua Wang, Haodong Duan, Songyang Zhang, Dahua Lin, Kai Chen

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments NAACL 2024

2404.03865 2024-04-08 cs.CL cs.LG 79%

FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping

Ajay Jaiswal, Bodun Hu, Lu Yin, Yeonju Ro, Shiwei Liu, Tianlong Chen, Aditya Akella

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments arXiv admin note: text overlap with arXiv:2310.01382

2402.10685 2024-03-26 cs.CL cs.AI 79%

LongHeads: Multi-Head Attention is Secretly a Long Context Processor

Yi Lu, Xin Zhou, Wei He, Jun Zhao, Tao Ji, Tao Gui, Qi Zhang, Xuanjing Huang

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2402.06082 2024-02-12 cs.LG cs.AI cs.DS 79%

SubGen: Token Generation in Sublinear Time and Memory

Amir Zandieh, Insu Han, Vahab Mirrokni, Amin Karbasi

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2402.04232 2024-02-08 cs.AI cs.CL 79%

Can Generative Agents Predict Emotion?

Ciaran Regan, Nanami Iwahashi, Shogo Tanaka, Mizuki Oka

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 6 figures

2312.12383 2023-12-20 cs.AI cs.CL cs.CV 79%

Visual AI and Linguistic Intelligence Through Steerability and Composability

David Noever, Samantha Elizabeth Miller Noever

专题命中长上下文与记忆：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

1. 长上下文与记忆 4779 篇

HMT: Hierarchical Memory Transformer for Efficient Long Context Language Processing

Zep: A Temporal Knowledge Graph Architecture for Agent Memory

From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News

LIFT: Improving Long Context Understanding Through Long Input Fine-Tuning

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

EcoAct: Economic Agent Determines When to Register What Action

Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism

Autonomous Agents for Collaborative Task under Information Asymmetry

Hybrid-RACA: Hybrid Retrieval-Augmented Composition Assistance for Real-time Text Prediction

SWAG: Storytelling With Action Guidance

MOSS: Enabling Code-Driven Evolution and Context Management for AI Agents

You Only Use Reactive Attention Slice For Long Context Retrieval

Enhancing Dialogue Generation in Werewolf Game Through Situation Analysis and Persuasion Strategies

Matmul or No Matmul in the Era of 1-bit LLMs

AI-native Memory: A Pathway from LLMs Towards AGI

MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Many-Shot In-Context Learning for Molecular Inverse Design

Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance

PANGeA: Procedural Artificial Narrative using Generative AI for Turn-Based Video Games

Demonstration Notebook: Finding the Most Suited In-Context Learning Example from Interactions

360Zhinao Technical Report

Towards a Path Dependent Account of Category Fluency

Apollonion: Profile-centric Dialog Agent

Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks

FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping

LongHeads: Multi-Head Attention is Secretly a Long Context Processor

SubGen: Token Generation in Sublinear Time and Memory

Can Generative Agents Predict Emotion?

Visual AI and Linguistic Intelligence Through Steerability and Composability