Beyond Memory Majority: Latent-Source Reasoning for Multi-Agent Memory Arbitration

AuthorsChenchen Lin, Wenhao Yuan, Xuehe Wang, Edith Cheuk Han Ngai

arXiv 20262026

TL;DR

CAMA uses neuro symbolic latent evidence slots plus active independent evidence recovery to reach 87.9 EM on LongMemEval vs 86.8 for MADAM RAG.

SharePost on XLinkedIn

Read our summary here, or open the publisher PDF on the next tab.

THE PROBLEM

False majorities from Memory Correlation Bias inflate evidence

CAMA identifies Memory Correlation Bias, where correlated memories are repeatedly counted and form a false majority, inflating support for a hypothesis.

In long term multi agent systems, this bias corrupts arbitration, writes wrong conclusions back into shared memory, and causes persistent, self reinforcing reasoning errors.

HOW IT WORKS

Correlation-Aware Memory Arbitration with latent evidence slots

CAMA’s core mechanism chains Neuro-Symbolic Evidence Assignment, Effective Independent Evidence Estimation, Factor-Level Conflict Arbitration, and Active Independent-Evidence Recovery to reason over latent evidence slots instead of raw memories.

You can think of CAMA like a librarian clustering many copies of the same book into one catalog card, then deliberately searching for missing, independent books before deciding.

This design lets CAMA discount duplicated evidence that a plain context window would over count and actively pull in new, independent memories when support is too narrow.

DIAGRAM

Query-Conditioned Arbitration and Recovery Flow

This diagram shows how CAMA runs query-conditioned evidence decoupling, arbitration, and sequential recovery actions over time for a single query.

DIAGRAM

Evaluation and Ablation Pipeline for CAMA

This diagram shows how CAMA is evaluated across benchmarks, baselines, and ablations with DeepSeek V4 Flash and Qwen3.6 27B.

PROCESS

How CAMA Handles a Memory Arbitration Query

  1. 01

    Query-Conditioned Evidence Decoupling

    CAMA runs Neuro-Symbolic Evidence Assignment over the retrieved slice and provenance graph to produce soft assignments Z(t) and overlap scores r(t)_ij.

  2. 02

    Effective Independent Evidence Estimation

    CAMA computes slot presence e(t)_j, normalizes to p(t)_j, and derives the Hill diversity based N(t)_eff as the effective independent evidence count.

  3. 03

    Factor-Level Conflict Arbitration

    CAMA scores memories s(t)_i(h), aggregates slot support β(t)_j(h), applies reliability weights ρ(t)_j, and forms arbitration logits ℓ(t)(h) and posterior P(t)(h|q,C(t)_q).

  4. 04

    Active Independent-Evidence Recovery

    CAMA’s recovery policy observes state S_t and chooses Expand(q′), Trace(m_i), or Stop, updating C(t)_q and Z(t) until evidence sufficiency or budget B is reached.

KEY CONTRIBUTIONS

Key Contributions

  • 01

    Identification of Memory Correlation Bias

    CAMA formalizes Memory Correlation Bias in long term multi agent memory, showing how correlated memories create false majorities that corrupt arbitration and propagate errors.

  • 02

    Correlation-Aware Memory Arbitration

    CAMA introduces Neuro-Symbolic Evidence Assignment, Effective Independent Evidence Estimation, and Factor-Level Conflict Arbitration to aggregate at latent evidence slot level instead of raw entries.

  • 03

    Active Independent-Evidence Recovery

    CAMA adds Active Independent-Evidence Recovery with Expand and Trace actions, achieving CMR 71.2 and RS 7.8 on MemoryAgentBench under DeepSeek V4 Flash.

RESULTS

By the Numbers

EM

87.9

+1.1 over MADAM-RAG on LongMemEval with DeepSeek-V4-Flash

BERT

69.2

vs MADAM-RAG’s 62.4 on LoCoMo with DeepSeek-V4-Flash

CMR

71.2

+10.5 over MADAM-RAG on MemoryAgentBench correlation metrics

RS

7.8

down from MADAM-RAG’s 15.3 on MemoryAgentBench, halving replication sensitivity

On MemoryAgentBench, LongMemEval, and LoCoMo, which test long term memory reasoning and correlation robustness, CAMA consistently raises task scores and boosts Correct Minority Recovery while sharply lowering Replication Sensitivity.

BENCHMARK

By the Numbers

On MemoryAgentBench, LongMemEval, and LoCoMo, which test long term memory reasoning and correlation robustness, CAMA consistently raises task scores and boosts Correct Minority Recovery while sharply lowering Replication Sensitivity.

BENCHMARK

Overall performance comparison on three benchmark datasets

Overall score on MemoryAgentBench with DeepSeek-V4-Flash.

BENCHMARK

Evaluation of memory correlation bias mitigation under DeepSeek-V4-Flash

Replication Sensitivity (RS) on MemoryAgentBench.

KEY INSIGHT

The Counterintuitive Finding

CAMA cuts Replication Sensitivity on MemoryAgentBench from MADAM-RAG’s 15.3 down to 7.8 while simultaneously increasing Correct Minority Recovery from 60.7 to 71.2.

This is surprising because adding a recovery policy and extra retrieval usually increases sensitivity to redundant evidence, yet CAMA’s latent slot reasoning makes more retrieval actually reduce bias.

WHY IT MATTERS

What this unlocks for the field

CAMA enables long term multi agent systems to arbitrate based on effective independent evidence rather than raw memory counts, even under heavy correlation.

Builders can now safely scale shared memories and multi agent pipelines without majority voting being hijacked by duplicated or biased sources, improving reliability for high stakes deployments.

~13 min read← Back to papers

Related papers

BenchmarkAgent Memory

Active Context Compression: Autonomous Memory Management in LLM Agents

Nikhil Verma

· 2026

Focus Agent adds start_focus, complete_focus, a persistent Knowledge block, and an optimized Persistent Bash plus String-Replace Editor scaffold to actively compress context during long software-engineering tasks. On five hard SWE-bench Lite instances against a Baseline ReAct agent, Focus Agent achieves 22.7% token reduction (14.9M → 11.5M) while matching 3/5 = 60% task success.

Agent Memory

ActMem: Bridging the Gap Between Memory Retrieval and Reasoning in LLM Agents

Xiaohui Zhang, Zequn Sun et al.

· 2026

ActMem transforms dialogue history into atomic facts via Memory Fact Extraction, groups them with Fact Clustering, links them through a Memory KG Construction module, and uses Counterfactual-based Retrieval and Reasoning for action-aware answers. On ActMemEval, ActMem reaches 76.52% QA accuracy with DeepSeek-V3, beating LightMem’s 63.97% by 12.55 points and NaiveRAG’s 61.54%.

Questions about this paper?

Paper: Beyond Memory Majority: Latent-Source Reasoning for Multi-Agent Memory Arbitration

Answers use this explainer on Memory Papers.

Checking…