All AI memory papers

HGMEM represents working memory as a hypergraph with Hypergraph-based Memory Storage, Adaptive Memory-based Evidence Retrieval, and Dynamic Memory Evolving to build high-order correlations across entities and facts. On Prelude long narrative understanding, HGMEM with GPT-4o achieves 73.81% accuracy compared to 72.22% for HippoRAG v2, while also reaching 69.74 comprehensiveness on Longbench generative sense-making QA.

Reflective Memory Management (RMM) uses a memory bank, retriever, reranker, and LLM to implement Prospective Reflection and Retrospective Reflection for topic-based storage and RL-based retrieval refinement. On LongMemEval, RMM with GTE achieves 69.8% Recall@5 and 70.4% accuracy, compared to 62.4% Recall@5 and 63.6% accuracy for GTE RAG.

KV-DISTILL combines a learnable state selection scorer, a LoRA-based adapted LMθ, and a KL-type objective function to compress KV caches into shorter, reusable representations. On SQuAD, KV-DISTILL with 25% KV retention achieves 86.6% accuracy on LLAMA-3 versus 87.6% for the uncompressed baseline, while H2I drops to 56.6%.

Latent learning uses oracle episodic retrieval, within-experience in-context learning, parametric learning, and latent learning benchmarks to study how reinstating full past episodes into context changes generalization. Latent learning shows that oracle retrieval solves latent tests like reversals and codebooks where parametric-only transformers stay near 0% despite strong performance on forward and in-context variants.

Learning from Supervision with Semantic and Episodic Memory combines a performance agent, critic agent, semantic memory, episodic memory, and memory retriever to turn label-grounded critiques into reusable supervision without parameter updates. On the Multi-Condition Ranking dataset with Mixtral 8x22B and o4-mini as critic, Learning from Supervision with Semantic and Episodic Memory reaches 85.6% accuracy, a 24.8% gain over the EP_LABEL baseline at 60.8%.

LEGOMem builds a procedural memory bank, full task memories, subtask memories, LEGOMem-Dynamic, and LEGOMem-QueryRewrite to store successful trajectories and allocate them to orchestrators and task agents. On OfficeBench, LEGOMem reaches 58.44% overall success for the LLM team versus 45.83% with no memory, and lifts the SLM team from 24.78% to 38.16%.

LiCoMemory organizes long term dialogue with CogniGraph, Query Processing and Integrated Rerank, and Real Time Interactions to keep session summaries, triples, and chunks linked. On LongMemEval with GPT-4o-mini, LiCoMemory reaches 73.80% accuracy and 76.63% recall, beating Mem0g by 9.0 and 7.1 points.

LightMem pipelines a Cognitive-Inspired Sensory Memory, Topic Segmentation Submodule, Topic-Aware Short-Term Memory, and Long-Term Memory with Sleep-Time Update to filter, group, summarize, and asynchronously consolidate dialogue history. On LongMemEval-S with Qwen3-30B-A3B-Instruct-2507, LightMem reaches 70.20% ACC vs 65.20% for A-MEM (+5.00 points) while reducing total token usage by up to 21.8× and API calls by up to 17.1×.

LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics coordinates a routing agent, task planning agent, and knowledge base agent over RAG and ChromaDB to translate household commands into grounded robot actions. In three tabletop scenarios, Qwen2.5-32B in LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics achieves 84.3% total lenient task planning accuracy versus 68.7% for Gemma2-27B and 61.1% for LLaMa3.1-8B.

MEM1 trains an RL agent that updates a compact Internal State (IS) using Masked Trajectory for Policy Optimization, 2D Attention Mask, and Multi-Objective Task Design to jointly consolidate memory and reason. On 16-objective multi-hop QA, MEM1-7B reaches EM 1.97 vs 0.567 for Qwen2.5-14B-Instruct while using 10.4×10² peak tokens vs 38.4×10².

MemBench evaluates LLM-based agents with multi-scenario datasets, multi-level memory content, and a time-aware benchmark using components like Multi-scenario Dataset, Multi-level Memory Content, and Multi-metric Evaluation. MemBench shows that mechanisms such as GenerativeAgent, MemGPT, MemoryBank, and SCMemory can drop from accuracies around 0.7 on 10k-token settings to roughly 0.3–0.4 at 100k tokens, exposing clear capacity limits.

Memento combines a Planner, Executor, Case Memory, Subtask Memory, and Tool Memory inside a memory-based MDP, learning a neural case-selection policy over a growing Case Bank instead of updating LLM weights. On GAIA, Memento achieves 87.88% Pass@3 on validation and 79.40% on the test set, surpassing DeepResearcher’s 51.8% F1 and 60.5% PM on DeepResearcher benchmarks by +14.8 F1 and +19.9 PM.

MemEvolve decomposes agent memory into Encode, Store, Retrieve, and Manage modules and meta evolves these components via a dual evolution process over candidate architectures. On xBench DeepSearch, MemEvolve with GPT 5 mini raises Flash Searcher pass@1 from 69.0 to 74.0 and WebWalkerQA accuracy from 58.82 to 61.18 while keeping API cost near 0.141 per query.

MemGuide combines Intent-Aligned Retrieval, Missing-Slot Guided Filtering, a CoT Slot Reasoner, a LLaMA-8B filter, and an LLM Reader over QA-style memory banks to select goal-consistent memories. On the MS-TOD benchmark, MemGuide reaches a 0.70 Joint Goal Accuracy and 0.99 Success Rate with GPT-4o-mini, improving Success Rate by 0.15 over AutoTOD and reducing Dialogue Turn Efficiency from 7.80 to 3.19.

MemInsight augments agent memory using Attribute Mining, Annotation and Attribute Prioritization, and Memory Retrieval modules that generate and exploit structured attributes over past interactions. On the LoCoMo question answering benchmark, MemInsight with Claude-3-Sonnet priority augmentation achieves 60.5% Recall@5 versus 26.5% for DPR, a 34.0-point improvement.

Memoria augments LLM chats with structured conversation logging, dynamic user persona via KG, session level memory for real time context, and seamless retrieval for context aware responses to provide persistent, interpretable memory. On LongMemEvals single-session-user and knowledge-update subsets, Memoria reaches 87.1% and 80.8% accuracy respectively, surpassing A-Mem (OpenAI) while using much shorter prompts.

MemoriesDB stores each Memory Record, Edges and Relations, and the Temporal Semantic Stack inside PostgreSQL with pgvector, exposing unified temporal–semantic–relational queries. MemoriesDB’s main result is a working implementation that demonstrates scalable time-bounded recall and hybrid semantic–structural queries on commodity SQL infrastructure without specialized vector or graph engines.

Memorization to Generalization recasts diffusion training and sampling as Dense Associative Memory dynamics, analyzing memorized, spurious, and generalized states via energy basins and curvature. Memorization to Generalization shows that as training size grows on MNIST, CIFAR10, FASHION-MNIST, LSUN-CHURCH, and Stable Diffusion, spurious states peak at the memorization–generalization boundary and have distinct basin volume and curvature signatures.

Phonetic Trajectory Memory (PTM) combines the Acoustic Injection, Entropy Filter, Neuro-Symbolic Relay, and Resonance Engine to encode text as a continuous trajectory on an ergodic Hyper-Torus Memory instead of a growing KV cache. PTM delivers >3,000× signal-to-KV compression while maintaining ≈92% factual accuracy and sub-50 ms retrieval latency on long narrative and scientific corpora compared to dense KV baselines.

DM-RAG augments Phi-4-mini with a Short-Term Memory (STM) buffer, Long-Term Memory (LTM) FAISS store, Bayesian fusion, and a logistic regression confidence model for structured log analysis. On UNSW-NB15, DM-RAG reaches 98.70% recall and 69.59% F1, beating the Phi-4 + RAG (MITRE) baseline in F1 by 17.89 points.

Memory-Augmented Transformers organizes functional objectives, memory types, and integration techniques into a unified taxonomy that connects biological memory principles with concrete architectures like Memformer, Titans, ATLAS, and EMAT. Memory-Augmented Transformers’ main result is a systematic three-dimensional classification that links dynamic multi-timescale memory, selective attention, and consolidation to specific Transformer designs and emerging lifelong-learning paradigms.

MemoryBench orchestrates Task Provider, User Simulator, and Performance Monitor to feed heterogeneous tasks, simulate explicit and implicit feedback, and score LLM systems across declarative and procedural memory. MemoryBench’s main finding is that state-of-the-art memory systems like A-Mem, Mem0, and MemoryOS often fail to beat naive BM25 or embedding-based RAG on partitions such as SiLo and LiLo.

Memory Decoder combines a Pre-training stage that aligns with kNN-LM distributions and an Inference interpolation mechanism that mixes Memory Decoder and base LLM outputs without changing base parameters. On Wikitext-103, Memory Decoder with 124M parameters reaches 13.36 perplexity on GPT2-small versus 14.76 for DAPT, and on specialized domains a single 0.5B Memory Decoder reduces average perplexity from 14.88 to 4.05 on Qwen2-0.5B.