语言大模型 / LLM - arXivDaily 专题

2402.16482 2024-02-27 cs.AI cs.CE cs.CL 62%

On Languaging a Simulation Engine

Han Liu, Liantang Li

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2401.11626 2024-02-27 cs.LG cs.CL 62%

Freely Long-Thinking Transformer (FraiLT)

Akbay Tabak

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2402.13208 2024-02-21 cs.CL cs.AI 62%

How do Hyenas deal with Human Speech? Speech Recognition and Translation with ConfHyena

Marco Gaido, Sara Papi, Matteo Negri, Luisa Bentivogli

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at LREC-COLING 2024

2305.02437 2023-12-27 cs.CL cs.AI 62%

Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory

Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, Rui Yan

专题命中长上下文与记忆：LLM(abstract)；分类 cs.CL、cs.AI

Comments Neurips 2023

2305.05091 2023-12-19 cs.CL cs.AI cs.HC 62%

Knowledge-enhanced Agents for Interactive Text Games

Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Published at K-CAP '23

2306.09364 2023-12-12 cs.LG cs.AI 62%

TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting

Vijay Ekambaram, Arindam Jati, Nam Nguyen, Phanwadee Sinthong, Jayant Kalagnanam

专题命中长上下文与记忆：foundation model(abstract)；分类 cs.AI、cs.LG

Comments Accepted in the Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 23), Research Track. Delayed release in arXiv to comply with the conference policies on the double-blind review process. This paper has been submitted to the KDD peer-review process on Feb 02, 2023

2305.13877 2023-12-11 cs.CL cs.AI 62%

NarrativeXL: A Large-scale Dataset For Long-Term Memory Models

Arseny Moskvichev, Ky-Vinh Mai

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2311.18194 2023-12-01 cs.LG cs.CL 62%

Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes

Yongqiang Chen, Binghui Xie, Kaiwen Zhou, Bo Han, Yatao Bian, James Cheng

专题命中长上下文与记忆：LLM(abstract)；分类 cs.CL、cs.LG

Comments Ongoing work; preliminary version

2305.04859 2023-11-21 cs.CL cs.AI 62%

A Frustratingly Easy Improvement for Position Embeddings via Random Padding

Mingxu Tao, Yansong Feng, Dongyan Zhao

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2311.08123 2023-11-15 cs.LG cs.CL 62%

Memory-efficient Stochastic methods for Memory-based Transformers

Vishwajit Kumar Vishnu, C. Chandra Sekhar

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2309.13543 2023-09-26 cs.CL cs.LG 62%

Substituting Data Annotation with Balanced Updates and Collective Loss in Multi-label Text Classification

Muberra Ozmen, Joseph Cotnareanu, Mark Coates

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments Proc. Conf. Lifelong Learning Agents (CoLLAs), 2023

2309.08868 2023-09-19 cs.CL cs.AI 62%

MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Coding

Junwen Duan, Han Jiang, Ying Yu

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments 5 pages, 1 figure, accepted in ICASSP 2023

2304.11461 2023-04-25 cs.LG cs.CL cs.NE cs.SD eess.AS 62%

Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments To appear as a part of an upcoming textbook on deep learning

2302.00003 2023-02-02 cs.LG cs.CL 62%

The Power of External Memory in Increasing Predictive Model Capacity

Cenk Baykal, Dylan J Cutler, Nishanth Dikkala, Nikhil Ghosh, Rina Panigrahy, Xin Wang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments arXiv admin note: substantial text overlap with arXiv:2301.13310

2207.06881 2022-12-09 cs.CL cs.LG 62%

Recurrent Memory Transformer

Aydar Bulatov, Yuri Kuratov, Mikhail S. Burtsev

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

2204.13074 2022-10-25 cs.CL cs.AI 62%

Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement

Bhavana Dalvi Mishra, Oyvind Tafjord, Peter Clark

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments accepted at EMNLP 2022

2210.02928 2022-10-21 cs.CL cs.AI cs.CV 62%

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text

Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2022 main conference

2203.12644 2022-10-14 cs.CL cs.LG 62%

Linearizing Transformer with Key-Value Memory

Yizhe Zhang, Deng Cai

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

Comments EMNLP2022. The two authors contributed equally

2209.15189 2022-10-03 cs.CL cs.AI 62%

Learning by Distilling Context

Charlie Snell, Dan Klein, Ruiqi Zhong

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

2209.06505 2022-09-16 cs.CL cs.LG 62%

BERT-based Ensemble Approaches for Hate Speech Detection

Khouloud Mnassri, Praboda Rajapaksha, Reza Farahbakhsh, Noel Crespi

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2106.04560 2022-06-22 cs.CV cs.AI cs.LG 62%

Scaling Vision Transformers

Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, Lucas Beyer

专题命中长上下文与记忆：language model(abstract)；分类 cs.AI、cs.LG

Comments Xiaohua, Alex, and Lucas contributed equally; CVPR 2022

2206.06520 2022-06-15 cs.AI cs.CL 62%

Memory-Based Model Editing at Scale

Eric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning, Chelsea Finn

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments ICML 2022. Project site at https://sites.google.com/view/serac-editing

2206.03428 2022-06-08 cs.CV cs.AI cs.CL 62%

Revealing Single Frame Bias for Video-and-Language Learning

Jie Lei, Tamara L. Berg, Mohit Bansal

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments 19 pages, 8 figures

2205.13730 2022-05-30 cs.CL cs.AI 62%

Understanding Long Programming Languages with Structure-Aware Sparse Attention

Tingting Liu, Chengyu Wang, Cen Chen, Ming Gao, Aoying Zhou

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments sigir 2022 accepted, code will be available at https://github.com/alibaba/EasyNLP

2205.05198 2022-05-12 cs.LG cs.CL 62%

Reducing Activation Recomputation in Large Transformer Models

Vijay Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2104.09962 2022-05-11 cs.AI cs.LG 62%

Text-Aware Predictive Monitoring of Business Processes

Marco Pegoraro, Merih Seran Uysal, David Benedikt Georgi, Wil M. P. van der Aalst

专题命中长上下文与记忆：language model(abstract)；分类 cs.AI、cs.LG

Comments 14 pages, 4 figures, 5 tables, 16 references

Journal ref BIS (2021) 221-232

2108.11626 2022-04-22 cs.CL cs.AI 62%

CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation

Joosung Lee, Wooin Lee

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments NAACL 2022 main conference

2202.01709 2022-02-04 cs.CL cs.LG 62%

Towards Coherent and Consistent Use of Entities in Narrative Generation

Pinelopi Papalampidi, Kris Cao, Tomas Kocisky

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.LG

2012.15197 2021-11-25 cs.CL cs.AI 62%

SemGloVe: Semantic Co-occurrences for GloVe from BERT

Leilei Gan, Zhiyang Teng, Yue Zhang, Linchao Zhu, Fei Wu, Yi Yang

专题命中长上下文与记忆：language model(abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 3 figures, 5 tables

2111.03612 2021-11-08 cs.CL cs.LG 62%

Sexism Identification in Tweets and Gabs using Deep Neural Networks

Amikul Kalra, Arkaitz Zubiaga

专题命中长上下文与记忆：prompting(abstract)；分类 cs.CL、cs.LG

Comments 8 pages

1. 长上下文与记忆 4789 篇

On Languaging a Simulation Engine

Freely Long-Thinking Transformer (FraiLT)

How do Hyenas deal with Human Speech? Speech Recognition and Translation with ConfHyena

Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory

Knowledge-enhanced Agents for Interactive Text Games

TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting

NarrativeXL: A Large-scale Dataset For Long-Term Memory Models

Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes

A Frustratingly Easy Improvement for Position Embeddings via Random Padding

Memory-efficient Stochastic methods for Memory-based Transformers

Substituting Data Annotation with Balanced Updates and Collective Loss in Multi-label Text Classification

MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Coding

Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey

The Power of External Memory in Increasing Predictive Model Capacity

Recurrent Memory Transformer

Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvement

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text

Linearizing Transformer with Key-Value Memory

Learning by Distilling Context

BERT-based Ensemble Approaches for Hate Speech Detection

Scaling Vision Transformers

Memory-Based Model Editing at Scale

Revealing Single Frame Bias for Video-and-Language Learning

Understanding Long Programming Languages with Structure-Aware Sparse Attention

Reducing Activation Recomputation in Large Transformer Models

Text-Aware Predictive Monitoring of Business Processes

CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation

Towards Coherent and Consistent Use of Entities in Narrative Generation

SemGloVe: Semantic Co-occurrences for GloVe from BERT

Sexism Identification in Tweets and Gabs using Deep Neural Networks