Semantic Memory

AgentSM builds a planner agent, schema linking agent, trajectory store, and composite tools that turn past execution traces into reusable, structured semantic memory. On Spider 2.0 Lite, AgentSM with Claude 4 Sonnet achieves 44.8% execution accuracy versus 28.7% for SpiderAgent, while shortening trajectories and latency.

SYNAPSE combines a Unified Episodic Semantic Graph, Cognitive Dynamics with Uncertainty Gating, and Triple Hybrid Retrieval to turn long-term agent memory into a dynamic associative graph. On the LoCoMo benchmark, SYNAPSE achieves 40.5 weighted F1 versus 33.3 for A-Mem, with 95% token reduction compared to full-context methods.

Evaluating Long-Term Memory for Long-Context Question Answering compares Full Context, RAG, A-Mem, RAG+PromptOpt, and RAG+EpMem memory components across semantic, episodic, and procedural memory for long conversational QA. On LoCoMo, RAG+EpMem reaches an average F1 ranking of 1.83 for Llama 3.2-3B Instruct and 1.80 for GPT-4o mini while using around 1,000 tokens per query versus over 23,000 for Full Context.

Learning from Supervision with Semantic and Episodic Memory combines a performance agent, critic agent, semantic memory, episodic memory, and memory retriever to turn label-grounded critiques into reusable supervision without parameter updates. On the Multi-Condition Ranking dataset with Mixtral 8x22B and o4-mini as critic, Learning from Supervision with Semantic and Episodic Memory reaches 85.6% accuracy, a 24.8% gain over the EP_LABEL baseline at 60.8%.

Semantic Anchoring enriches conversational memory by combining a hybrid memory store with dense and symbolic indexes, structured memory representation tuples, hybrid storage and indexing, and a retrieval scoring method. On MultiWOZ-Long, Semantic Anchoring reaches 83.5% Factual Recall and 80.8% Discourse Coherence, beating Entity-RAG by 7.6 and 8.6 points respectively.

WorldMM dynamically coordinates Episodic Memory, Semantic Memory, Visual Memory, an Adaptive Retrieval Agent, and a Response Agent to answer queries over hour- to week-long videos. On five long video QA benchmarks, WorldMM-GPT reaches 69.5% average accuracy, beating M3-Agent’s 55.1% by 14.4 points and the best prior memory baseline HippoRAG’s 57.0% by 12.5 points.

DynaMem maintains a Dynamic 3D Voxel Map, supports Embedded Vision Language Features and Multimodal Large Language Models querying, and exposes Exploration Primitives and an Obstacle map for navigation and manipulation. On real Stretch SE3 experiments, DynaMem achieves a 70% success rate on dynamic pick-and-drop tasks compared to 30% for the static OK-Robot baseline.

Variational Semantic Memory combines variational prototype inference, variational semantic memory, latent memory m, and an attention-based memory update to build probabilistic class prototypes from long-term semantic knowledge. On miniImageNet 5-way 1-shot with a deep backbone, Variational Semantic Memory reaches 65.72% accuracy versus 64.82% for Tian et al. 2020.