Paper archive

All AI memory papers

Browse 314 explainers on agent memory, RAG, long-term context, personalization, benchmarks, and memory architectures.

Page 4 of 14

Agent Memory

LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory

Jing Yu, Yibo Zhao et al.

arXiv 2026 · 2026

LazyMem stores raw histories and at query time runs Hybrid Retrieval, History Windowing, and a trained Memory-Processing Model to build compact, query-conditioned memory for an answer LLM. On LongMemEval, LazyMem-4B achieves 0.85 LLM-judge accuracy with 213 answer-context memory tokens, a 0.03 gain over StructMem while using 21.0× fewer tokens.

BenchmarkBenchmarkCognitive Architecture

Learning to Forget: Sleep-Inspired Memory Consolidation for Resolving Proactive Interference in Large Language Models

Ying Xie

· 2026

SleepGate augments transformers with a Conflict-Aware Temporal Tagger, Forgetting Gate, Consolidation Module, and Sleep Trigger that periodically rewrite the KV cache during sleep micro-cycles. On the PI-LLM benchmark, SleepGate achieves 99.5% retrieval accuracy at PI depth 5 and 97.0% at depth 10, while full KV cache, sliding window, H2O, StreamingLLM, and a decay-only ablation all stay below 18% across all depths.

BenchmarkAgent MemoryLong-Term MemoryMemory Architecture

Lightweight LLM Agent Memory with Small Language Models

Jiaquan Zhang, Chaoning Zhang et al.

· 2026

LightMem orchestrates SLM-1 Controller, SLM-2 Selector, SLM-3 Writer, and STM MTM LTM stores to modularize retrieval, writing, and offline consolidation. On LoCoMo, LightMem reaches 34.50 F1 for GPT-4o multi hop questions, +1.64 over A-MEM, while keeping median retrieval latency at 83 ms.

Benchmark

Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents

Yifei Li, Weidong Guo et al.

· 2026

LoCoMo-Plus evaluates cognitive memory using an implicit Cue–Trigger Query Construction pipeline plus Semantic Filtering, Cue Memory Elicitation Validation, and insertion into LoCoMo dialogues. On LoCoMo-Plus, even strong systems like gemini-2.5-pro reach only 26.06% cognitive accuracy versus 71.78% factual accuracy on LoCoMo, exposing a large unresolved gap.

RAG

LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleagues

Di Wu, Zixiang Ji et al.

arXiv 2026 · 2026

LongMemEval-V2 evaluates long-term agent memory via context gathering over massive web-agent haystacks, using components like AgentRunbook-R, AgentRunbook-C, raw state slice pools, state transition event pools, and procedure and hint note pools. On LME-V2-Medium, AgentRunbook-C achieves 70.1% overall accuracy, a +24.2 point gain over the strongest RAG baseline with trajectory notes (45.9%).

Long-Term Memory

LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling

Keqin Xie

· 2026

LPC-SM combines local attention, dual-timescale memory, predictive correction, Orthogonal Novelty Transport, and multi-head-coupled residual routing (mHC) inside a single autoregressive block. On OpenWebMath-10k continuation, LPC-SM with adaptive sparse control reaches final LM loss 10.787 versus 12.137 for a fixed sparse controller, a 12.517% improvement.

Agent Memory

LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation

Dongfang Li, Zixuan Liu et al.

arXiv 2026 · 2026

LycheeMemory V2 combines Online Semantic Segmentation, Segment-Level Memory Encoding, Structured Evidence Organization, and Plan-Guided Multi-Route Retrieval to batch coherent dialogue segments into typed, indexed records. On LoCoMo, LycheeMemory V2 achieves 89.22% overall accuracy versus 68.83% for A-Mem, and on LongMemEval-S it reaches 92.20% versus 71.60% for A-Mem, with up to 7.2× fewer construction tokens.

Agent Memory

MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agents

Dongming Jiang, Yi Li et al.

· 2026

MAGMA organizes agent memory with an Intent-Aware Router, Adaptive Topological Retrieval, a Data Structure Layer of Relation Graphs and Vector Database, plus dual-stream Synaptic Ingestion and Asynchronous Consolidation. On LoCoMo, MAGMA achieves a 0.700 overall LLM-as-a-Judge score versus 0.590 for Nemori, and reaches 61.2% average accuracy on LongMemEval versus 56.2% for Nemori.

Benchmark

MELD: A Protocol for Merging Knowledge Across Distributed Agentic Memories

Lauri Lovén, Jaakko Sauvola et al.

arXiv 2026 · 2026

MELD merges distributed wiki brains using a merge decision procedure, Patch, status CRDT, and semantic publish subscribe over a typed-link memory substrate. On HotpotQA distractor, MELD’s decentralized merge achieves recall@5 = 0.630 vs 0.619 for a centralized store and 0.595 for naive union, with about 11% less live storage than union.

Agent Memory

Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents

Yiting Shen, Kun Li et al.

· 2026

Mem2ActBench integrates Heterogeneous Data Integration, Fact Extraction and Grouping, Memory Evolution Chain Construction, and Memory-anchored Q&A Construction to create long, interruption-heavy sessions with grounded tool calls. On Mem2ActBench, oracle retrieval reaches F1 53.8 while the best passive hybrid retriever at k=5 reaches only 30.7, revealing a 23.1 F1 gap in memory utilization.

Agent Memory

MemAdapter: Fast Alignment across Agent Memory Paradigms via Generative Subgraph Retrieval

Xin Zhang, Kailai Yang et al.

· 2026

MemAdapter combines a Generative Subgraph Retriever, Anchored Alignment Module, Target Alignment Module, Unified Memory Space, and Agent Model to turn diverse memory states into explicit evidence subgraphs. On NarrativeQA with Qwen2.5-7B, MemAdapter achieves F1 61.59 compared to 56.91 for MemoryLLM and 50.01 for Mem0, while completing cross-paradigm alignment in about 13 minutes with less than 5% of training compute.

Agent Memory

MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection

Zhewen Tan, Yilun Yao et al.

arXiv 2026 · 2026

MemAudit combines Counterfactual Memory Influence Score, Memory Consistency Graph, and a fused Detoxification Score to rank and remove suspicious memories in MINJA-poisoned agents. On MINJA QA with GPT-4o, MemAudit reduces attack success rate from 70.0% to 0.0%, beating random deletion, retrieval-frequency deletion, and nearest-neighbor contradiction filtering.

Long-Term Memory

MemConflict: Evaluating Long-Term Memory Systems Under Memory Conflicts

Zhen Tao, Jinxiang Zhao et al.

arXiv 2026 · 2026

MemConflict builds structured user profiles, simulates long-horizon timelines, injects conflicts, and evaluates systems via black-box Answer Accuracy and white-box Support Evidence Hit and Support Rank Score. On the MemConflict benchmark, MemOS attains 0.5539 average Answer Accuracy, 0.6710 SEH@3, and 0.5879 SRS, revealing large gaps versus systems like LangMem at 0.2822 AA.

BenchmarkBenchmarkBenchmarkAgent MemoryLong-Term Memory

MemEvoBench: Benchmarking Memory MisEvolution in LLM Agents

Weiwei Xie, Shaoxiong Guo et al.

· 2026

MemEvoBench combines Misleading Memory Injection, Noisy Tool Returns, Biased User Feedback, and a Memory Modification Tool (+ModTool) to stress-test long-term memory safety in LLM agents across 7 domains and 36 risk types. On the QA Style benchmark, MemEvoBench shows Gemini-2.5-Pro’s ASR drops from 67.0% (Vanilla) to 19.0% with +ModTool in Round 1, while biased feedback can push GPT-5’s QA ASR from 59.0% to 78.0% by Round 3.

Agent Memory

Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memory

Zhenting Wang, Huancheng Chen et al.

· 2026

Memex(RL) optimizes Indexed Experience Memory, CompressExperience, ReadExperience, and ContextStatus so Memex keeps only an indexed summary in-context while archiving full artifacts externally. On modified ALFWorld, Memex(RL) lifts task success from 24.22% to 85.61% over the Memex agent without RL while reducing peak working context from 16,934.46 to 9,634.47 tokens.

Agent Memory

MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing

Han Chen, Zining Zhang et al.

arXiv 2026 · 2026

MemForest combines parallel extraction, a shared memory substrate of canonical facts, scoped MemTrees, and forest recall plus tree browse to maintain temporal agent memory efficiently. On LongMemEval-S, MemForest with Qwen3-30B-A3B-Instruct-2507 achieves 81.8% pass@1 overall, 14.8 points above EverMemOS, while its input-normalized build rate is 6.0× higher.

Long-Term Memory

Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents

Yuanchen Bei, Tianxin Wei et al.

· 2026

Mem-Gallery organizes multi-session, multimodal conversations and tasks via Benchmark Construction, a unified Conversational Environment for Memory, and an Evaluation Framework spanning extraction, reasoning, and knowledge management. On Mem-Gallery, MuRAG reaches 0.6966 overall F1 and 0.8856 LLM-Judge on visual-centric search, surpassing NaiveRAG by 0.0992 overall F1.

Long-Term Memory

MemGround: Long-Term Memory Evaluation Kit for Large Language Models in Gamified Scenarios

Yihang Ding, Wanke Xia et al.

· 2026

MemGround evaluates long-term memory via Surface State Memory, Temporal Associative Memory, and Reasoning-Based Memory in TRPG, No Case Should Remain Unsolved, and Type Help scenarios. MemGround’s main result shows frontier GPT-5.2 reaches 51.51% QA Overall in TRPG but only 23.61% QA Overall in Type Help, revealing severe reasoning degradation versus closed-source baselines like Gemini-3-Pro-Preview.

Long-Term Memory

MemGuard: Preventing Memory Contamination in Long-Term Memory-Augmented Large Language Models

Hyeonjeong Ha, Jeonghwan Kim et al.

arXiv 2026 · 2026

MEMGUARD decomposes conversations into type-specific memory atoms via Type-Aware Knowledge Decomposition, Self-Verified Extraction, Relational Knowledge Graph, and Query-Adaptive Type Routing stored in type-isolated memory. On HaluMem, MEMGUARD attains 89.53% anti-hallucination accuracy and 94.15 F1, improving anti-hallucination by 28.27 percentage points over MemOS.