Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses

AuthorsZhaochen Yu, Yingcheng Wu, Zhenfei Yin et al.

arXiv 20262026

TL;DR

Recuris couples verified working memory with experiential skills and a recursive Meta-Agent, adding up to +32.2 points on the longest long-horizon tasks.

SharePost on XLinkedIn

Read our summary here, or open the publisher PDF on the next tab.

THE PROBLEM

Long-horizon agents lose unresolved goals and omit required writes

As interaction histories grow, agents retrieve against noisy dialogue and lose track of unresolved goals, causing misaligned skill use and stalled execution.

On 𝜏2-Retail, the base agent omits all required database writes in 42% of episodes and achieves only 55.7% required-write recall, leaving tasks apparently complete but environments unchanged.

HOW IT WORKS

Recursive Experiential–Working Memory Coupling in Recuris

Recuris represents Skill Memory as Mπ‘˜ = (Eπ‘˜, Wπ‘˜, πœŒπ‘˜, Cπ‘˜), coupling Experiential Memory Eπ‘˜ with Working Memory specification Wπ‘˜, invocation policy πœŒπ‘˜, and checker set Cπ‘˜.

Think of Working Memory 𝑀𝑑 as RAM tracking current goals, while Experiential Memory Eπ‘˜ is a disk of reusable skills that Recuris selectively loads based on the verified task state.

This EM–WM coupling plus a fixed Meta-Agent turns execution into structured evidence, enabling component-level repairs to Mπ‘˜ that a plain context window or static skill library cannot provide.

DIAGRAM

Within-task EM–WM Execution Loop in Recuris

This diagram shows how Recuris uses verified working memory to drive state-grounded skill invocation and evidence-grounded state updates at each step.

DIAGRAM

Bounded Recursive Skill Memory Evolution Pipeline

This diagram shows how Recuris localizes failures from structured traces and applies validation-gated, component-specific patches to Skill Memory Mπ‘˜.

PROCESS

How Recuris Handles a Long-Horizon Task

  1. 01

    Structured Working State

    Recuris initializes working state w0 under Working Memory specification Wπ‘˜, creating goal entries with status, evidence, and blockers to expose pending and done goals.

  2. 02

    State-Grounded Skill Invocation

    At each execution event 𝑒𝑑, Recuris uses invocation policy πœŒπ‘˜ to select skills E𝑑 from Experiential Memory Eπ‘˜ based on the current verified state 𝑀𝑑.

  3. 03

    Evidence-Grounded State Update

    After the LLM acts and Env returns π‘œπ‘‘, Recuris proposes e𝑀𝑑+1 via Wπ‘˜, evaluates it with checker set Cπ‘˜, and commits only supported changes through kernel K.

  4. 04

    Bounded Recursive Evolution

    Across tasks, a fixed Meta-Agent reads structured traces Ξ“π‘˜, runs trace-based failure localization, applies component-specific patching to Mπ‘˜, and admits updates via a validation gate.

KEY CONTRIBUTIONS

Key Contributions

  • 01

    Experiential–Working Memory Coupling

    Recuris couples Experiential Memory Eπ‘˜ with verified Working Memory Wπ‘˜, enabling state-grounded skill invocation that raises required-write recall on 𝜏2-Retail from 55.7% to 82.4%.

  • 02

    Structured Evidence for Failure Localization

    Recuris records structured traces Ξ“π‘˜ linking states, skills, actions, and observations, boosting component fault recall from 13.0% with outcomes to 64.8% with Ξ“π‘˜.

  • 03

    Bounded Recursive Skill Memory Evolution

    Recuris evolves Skill Memory Mπ‘˜ via a fixed Meta-Agent and validation gate, yielding held-out gains up to +17.44 points over M0 and transferring +17.8 points to GPT-5.6 Sol on 𝜏2-Retail.

RESULTS

By the Numbers

Task success on Ο„2-Retail (doubao-2.0-pro)

81.4%

+23.3 points over base agent 58.1%

Task success on SkillFlow (Qwen3.6-27B)

58.7%

+16.6 points over base agent 42.2%

Task success on Ο„2-Retail (Claude Opus 5)

87.9%

+15.6 points over base agent 72.4%

Failure-mode reduction (hallucination completion)

14%

↓86% failure rate relative to agent alone = 100

Recuris is evaluated on 𝜏2-Retail, 𝜏2-Airline, SkillFlow, and Terminal-Bench 2.1, covering tool-use dialogue, lifelong skill reuse, and terminal work. The gains up to +32.2 points on the longest tasks and up to 86% reduction in common long-horizon failures show that Recuris turns accumulated experience into reliably improved long-horizon behavior.

BENCHMARK

By the Numbers

Recuris is evaluated on 𝜏2-Retail, 𝜏2-Airline, SkillFlow, and Terminal-Bench 2.1, covering tool-use dialogue, lifelong skill reuse, and terminal work. The gains up to +32.2 points on the longest tasks and up to 86% reduction in common long-horizon failures show that Recuris turns accumulated experience into reliably improved long-horizon behavior.

BENCHMARK

Task success on Ο„2-Retail with and without Recuris

Task success (%) on Ο„2-Retail for the base agent and Recuris across several models.

KEY INSIGHT

The Counterintuitive Finding

On 𝜏2-Retail, adding experiential skills alone yields only +2.0 points, while adding a verified working state yields +23.9 points and coupling both reaches +25.4.

This is counterintuitive because many systems focus on richer skill libraries, but Recuris shows that when and why skills are invoked, via working memory, matters far more than skill content alone.

WHY IT MATTERS

What this unlocks for the field

Recuris unlocks long-horizon agents whose memory-control layer can recursively evolve while the base LLM and outer harness remain frozen, enabling safe, interpretable RSI.

Builders can now ship agents that continuously convert structured execution traces into targeted Skill Memory updates, improving tool use, goal tracking, and failure recovery across tasks and even across models.

Related papers

BenchmarkAgent Memory

Active Context Compression: Autonomous Memory Management in LLM Agents

Nikhil Verma

Β· 2026

Focus Agent adds start_focus, complete_focus, a persistent Knowledge block, and an optimized Persistent Bash plus String-Replace Editor scaffold to actively compress context during long software-engineering tasks. On five hard SWE-bench Lite instances against a Baseline ReAct agent, Focus Agent achieves 22.7% token reduction (14.9M β†’ 11.5M) while matching 3/5 = 60% task success.

RAGBenchmarkAgent MemoryMemory Architecture

ADAM: A Systematic Data Extraction Attack on Agent Memory via Adaptive Querying

Xingyu Lyu, Jianfeng He et al.

Β· 2026

ADAM combines Anchor extraction, Distribution estimation, Anchor selection, and Query generation to adaptively probe agent memory via an auxiliary generator and entropy based selection. On the EHRAgent benchmark with Llama2-7b-chat, ADAM reaches EQ=77 and ASR=1.00, compared to MEXTRA’s EQ=44 and ASR=0.89.

Questions about this paper?

Paper: Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnesses

Answers use this explainer on Memory Papers.

Checking…