memgpt

Definition

Treats the context window as virtual memory: the model itself issues function calls to page information between the limited in-context working set and an external store, deciding what to keep resident and what to evict. Borrowing the operating-system metaphor lets a fixed-window model sustain conversations and documents far longer than the window. Note the contrast with approaches that attack the same problem by enlarging the window itself.

Explainers using this term

• Designing Agent Memory — Short-Term, Long-Term, EpisodicMemGPT: Towards LLMs as Operating Systems