Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
-
Updated
Mar 30, 2024 - Python
#
long-context-modeling
Here are 20 public repositories matching this topic...
-
Updated
Jul 10, 2025 - Python
[EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
question-answering rag large-language-models long-context retrieval-augmented-generation long-context-modeling multi-document-rag
-
Updated
Dec 22, 2025 - Python
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
-
Updated
Oct 16, 2024 - Python
[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
-
Updated
Mar 12, 2024 - Python
🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
visual-question-answering vision-language-model large-multimodal-models long-context-modeling multi-image-understanding
-
Updated
Nov 21, 2025 - Python
This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
benchmark machine-learning natural-language-processing deep-neural-networks computer-vision deep-learning evaluation multimodality visual-question-answering multimodal foundation-models large-language-models llm llms long-context-transformers multimodal-large-language-models large-multimodal-models long-context-modeling
-
Updated
Jul 11, 2024 - Python
[ICLR 2025] Official code repository for "TULIP: Token-length Upgraded CLIP"
retrieval image-generation multimodal vision-and-language cross-modal-retrieval contrastive-learning clip-model vision-language-model context-window long-context-modeling iclr-2025
-
Updated
Jan 26, 2026 - Python
[NeurIPS 2025] HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models
-
Updated
Feb 19, 2026 - Python
🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
visual-question-answering vision-language-model retrieval-augmented-generation large-multimodal-models long-context-modeling
-
Updated
Feb 9, 2025 - Python
Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers
-
Updated
May 26, 2026 - Python
context denoising training for long-context modeling
-
Updated
Oct 10, 2025 - Python
🫧 Code for Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data (Maekawa*, Iso* et al.; ICLR 2025)
-
Updated
Feb 25, 2025 - Python
CoPE: Clipped RoPE as A Scalable Free Lunch for Long Context LLMs
-
Updated
May 2, 2026 - Python
HiCI: Hierarchical Construction-Integration for Long-Context Attention
memory transformers attention-mechanism hierarchical-attention efficient-attention llm long-context-modeling hici
-
Updated
May 9, 2026 - Python
Pure PyTorch + 🤗 Transformers reimplementation of Megalodon (CEMA + chunked attention) - readable, hackable, no CUDA kernels required
pytorch rope ema pytorch-implementation linear-attention efficient-transformers llm sub-quadratic-attention long-context-modeling streaming-inference complex-ema
-
Updated
Jan 12, 2026 - Python
Minimal implementation of Samba by Microsoft in PyTorch
language-model ssm pytorch-implementation efficient-attention llm long-context-modeling mamba-state-space-models
-
Updated
Nov 24, 2024 - Python
This is the official implementations for SustainableKV
-
Updated
Jun 30, 2025 - Python
jax rewrite for CEMA support + other training speedups.
-
Updated
Jul 29, 2026 - Python
Add this topic to your repo
To associate your repository with the long-context-modeling topic, visit your repo's landing page and select "manage topics."