TRUSTMEM: Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory

AuthorsTianyu Yang, Sudipta Paul, Vijay Srinivasan et al.

arXiv 20262026

TL;DR

TRUSTMEM uses a Memory Transition Verifier plus Transition-Ranked GRPO to train memory updates, reaching 65.7 average on MemoryAgentBench (+6.5 over Mem-α).

SharePost on XLinkedIn

Read our summary here, or open the publisher PDF on the next tab.

THE PROBLEM

Persistent memory errors in LLM agents cause long-term failures (omission 8.08%, corruption 0.14%, hallucination 0.01%)

LLM memory agents can omit key facts, corrupt prior knowledge, or hallucinate unsupported content during consolidation, which then persists across interactions.

These persistent errors contaminate long-term memory, degrading downstream reasoning and question answering even when terminal task performance looks acceptable.

HOW IT WORKS

TRUSTMEM and Transition-Ranked GRPO for trustworthy memory consolidation

TRUSTMEM centers on a Memory Transition Verifier, Memory Executor, Policy Model, Reference Model, and Retriever to score and update memory transitions step by step.

Think of TRUSTMEM like a CPU with a safety coprocessor: the Policy Model proposes edits, the Memory Executor applies them, and the Memory Transition Verifier checks each change before it becomes disk.

This verifier plus Transition-Ranked GRPO lets TRUSTMEM learn memory updates that avoid omission, corruption, and hallucination, something a plain context window or trajectory-only reward cannot guarantee.

DIAGRAM

Chunk-by-chunk memory update and verification flow in TRUSTMEM

This diagram shows how TRUSTMEM processes each input chunk, executes WRITE REVISE PRUNE actions, and verifies the resulting memory transition before downstream use.

DIAGRAM

Training pipeline of Transition-Ranked GRPO in TRUSTMEM

This diagram shows how TRUSTMEM uses multi-granularity rewards and verifier-guided ranking to optimize the memory-update policy.

PROCESS

How TRUSTMEM Handles a Continual Memory Consolidation Stream

  1. 01

    Continual memory update problem

    TRUSTMEM receives chunk ct and previous memory Mt−1, then the Policy Model proposes structured WRITE REVISE PRUNE actions for this step.

  2. 02

    Memory Executor applies actions

    The Memory Executor deterministically applies actions to the Memory Store, producing an updated memory state Mt and defining the transition zt.

  3. 03

    Memory Transition Verifier scoring

    The Memory Transition Verifier inspects zt for coverage, preservation, and faithfulness, returning a trustworthiness score used as Rver in training.

  4. 04

    Transition-Ranked GRPO optimization

    TRUSTMEM runs multiple rollouts, uses verifier scores to rank transitions, and updates the Policy Model with GRPO plus a DPO-style ranking loss.

KEY CONTRIBUTIONS

Key Contributions

  • 01

    Memory Transition Verifier

    TRUSTMEM introduces a Memory Transition Verifier that scores each update for coverage, preservation, and faithfulness, cutting omission by 40.1% and corruption by 79.1% versus baselines.

  • 02

    Transition-Ranked GRPO

    TRUSTMEM proposes Transition-Ranked GRPO, using verifier-guided preference pairs to optimize memory-editing actions beyond scalar rewards, boosting TTL scores from 57.6 to 70.1.

  • 03

    Reliable long-term memory benchmarks

    TRUSTMEM is evaluated on MemoryAgentBench, HaluMem, and Mem-α, achieving 65.7 average on MemoryAgentBench and +12.14 F1 on HaluMem memory extraction over the strongest prior method.

RESULTS

By the Numbers

MemoryAgentBench Avg.

65.7 score

+6.5 over Mem-α

Mem-α Avg.

66.3 score

+4.4 over Mem-α baseline

HaluMem Extraction F1

69.45 F1

+12.14 over strongest prior F1

Omission Rate

8.08 %

lowest omission vs MemAgent, MEM1, Mem-T, AtomMem

On MemoryAgentBench, which tests accurate retrieval, test-time learning, and long-range understanding, TRUSTMEM’s 65.7 average score shows robust memory utility. On HaluMem, TRUSTMEM’s 69.45 F1 for memory extraction and 8.08% omission rate demonstrate safer, higher-quality memory operations than prior memory agents.

BENCHMARK

By the Numbers

On MemoryAgentBench, which tests accurate retrieval, test-time learning, and long-range understanding, TRUSTMEM’s 65.7 average score shows robust memory utility. On HaluMem, TRUSTMEM’s 69.45 F1 for memory extraction and 8.08% omission rate demonstrate safer, higher-quality memory operations than prior memory agents.

BENCHMARK

Experiment results on MemoryAgentBench

Average task score across Accurate Retrieval, Test-Time Learning, and Long-Range Understanding on MemoryAgentBench.

BENCHMARK

Experiment results on the Mem-α validation set

Average score on the Mem-α validation set across SQuAD, HotpotQA, PerLTQA, TREC-C, NLU, PubMed, and BookSum.

KEY INSIGHT

The Counterintuitive Finding

TRUSTMEM’s Transition-Ranked GRPO boosts Test-Time Learning from 57.6 to 70.1, even though both variants share the same reward components.

This is surprising because many assume scalar rewards alone suffice; TRUSTMEM shows that explicit transition ranking adds crucial supervision for safe memory updates.

WHY IT MATTERS

What this unlocks for the field

TRUSTMEM unlocks trustworthy, step-level memory consolidation, letting agents audit each WRITE REVISE PRUNE transition instead of only checking final answers.

Builders can now deploy long-lived LLM agents whose memories evolve safely over thousands of interactions, without accumulating silent omissions, corruptions, or hallucinations.

~14 min read← Back to papers

Related papers

BenchmarkAgent Memory

Active Context Compression: Autonomous Memory Management in LLM Agents

Nikhil Verma

· 2026

Focus Agent adds start_focus, complete_focus, a persistent Knowledge block, and an optimized Persistent Bash plus String-Replace Editor scaffold to actively compress context during long software-engineering tasks. On five hard SWE-bench Lite instances against a Baseline ReAct agent, Focus Agent achieves 22.7% token reduction (14.9M → 11.5M) while matching 3/5 = 60% task success.

Questions about this paper?

Paper: TRUSTMEM: Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory

Answers use this explainer on Memory Papers.

Checking…