Agent Memory Architectures

Memory systems transform LLM-based agents from stateless text generators into genuinely adaptive systems that persist and recall information across interactions. Du formalizes agent memory as a write-manage-read loop tightly coupled with perception and action — a framework that organizes the full design space through a three-dimensional taxonomy spanning temporal scope, representational substrate, and control policy.

Five mechanism families implement this loop:

1. Context-resident compression — Summarizing and compressing interaction history to fit within context windows. Progressive distillation of episodic memories into compact representations, trading information fidelity against context budget.

2. Retrieval-augmented stores — External memory (vector databases, knowledge graphs) accessed via embedding-based similarity search. Hybrid retrieval combines semantic similarity with temporal recency and importance scoring.

3. Reflective self-improvement — Agents generating insights and lessons learned from past experiences. Self-critique mechanisms identify errors and update behavioral policies. Meta-cognitive processes distill episodic memories into strategic knowledge.

4. Hierarchical virtual context — Multi-level hierarchies mimicking human short-term and long-term memory. Working memory for active reasoning, episodic memory for experiences, semantic memory for facts, with attention-based access across levels.

5. Policy-learned management — Learned policies for deciding what to store, when to consolidate, and how to retrieve. Reinforcement learning optimizes memory management strategies that evolve with agent experience.

A-MEM (Xu et al., NeurIPS 2025) offers a concrete implementation of agentic memory inspired by the Zettelkasten method. When new information arrives, the agent constructs a structured note with core content, contextual description, keywords/tags, and metadata. It then performs retrospective analysis — scanning existing memories for semantic connections and establishing bidirectional links. The system actively evolves: new information can modify contextual representations of existing memories, contradictory information triggers reconciliation, and frequently accessed memories gain higher retrieval priority.

Key Claims

• Write-manage-read loop is the fundamental memory abstraction — All agent memory systems can be understood as implementations of this three-phase cycle coupled with perception and action. Evidence: strong (Memory for Autonomous LLM Agents)
• Five mechanism families cover the design space — Context-resident compression, retrieval-augmented stores, reflective self-improvement, hierarchical virtual context, and policy-learned management. Evidence: strong (Memory for Autonomous LLM Agents)
• Zettelkasten-inspired memory outperforms fixed-structure baselines — A-MEM with dynamic note construction and linking beats flat, hierarchical, and summary-based memory on multi-session tasks across six foundation models. Evidence: strong (A-MEM: Agentic Memory for LLM Agents)
• Evaluation is shifting from static recall to multi-session agentic tests — Memory benchmarks now measure knowledge integration, temporal reasoning, and inference chains across sessions, not just retrieval accuracy. Evidence: strong (Memory for Autonomous LLM Agents)

Open Questions

• How to achieve continual consolidation without catastrophic forgetting?
• Can causally grounded retrieval replace similarity-based retrieval for better relevance?
• How to ensure self-generated reflective insights are reliable and grounded?
• How to extend memory systems to multimodal embodied settings (visual, spatial, proprioceptive)?
• How to secure memory stores against manipulation attacks (a documented agentic threat vector)?

Related Concepts

• Agentic Reasoning — Memory is the infrastructure for self-evolving agents (layer 2 of the three-layer framework)
• Reinforcement Learning for Agents — RL optimizes memory management policies
• Agent Safety & Alignment — Memory manipulation is a documented attack surface

Backlinks

Pages that reference this concept:

• Agentic Reasoning
• Agent Safety & Alignment