Light
Dark

MemGPT is now part of Letta

Sep 22, 2024

MemGPT started as a research project at UC Berkeley, inspired by an effort to improve the memory systems of Discord chatbots. As it turns out, many builders in the AI ecosystem were (and still are!) looking for a memory management solution, and the paper we wrote went viral. Since then, the scope of our research and open source development has grown significantly, and the MemGPT repository has rapidly evolved to support agents more generally, with support for features like custom tools, data sources, and even memory classes, as well as the ability to deploy and persist these agents as stateful services.

The rapid popularity of the research, the paper, and the context window management technique itself has resulted in some confusion about the MemGPT name. Some people use “MemGPT” to refer to the original “LLM OS” techniques in the paper, some use “MemGPT” to refer to an archetype of LLM-driven chatbots with self-editing memory, and others use “MemGPT” to refer to the open source agent framework. To clarify this, we’ve decided that MemGPT should refer to the original agent design pattern described in the research paper (empowering LLMs with self-editing memory tools), and use the name Letta to refer to the agent framework.

Introducing Letta, the company we’ve started to advance the frontier of AI systems with memory. We started Letta to continue research and development of the LLM OS: the orchestration layer that sits above the model layer. Letta the company will continue to maintain the open source repository, MemGPT. Our commercial offering will focus on making deployability easier, and improving performance, and offering UX tools for debugging and monitoring agents.

This means: 

  • The pypi package will be moved to letta
  • The Docker image will be moved to letta/letta-server

Thank you to our open source and Discord communities for using MemGPT and invaluable feedback over the course of the project. We hope to keep having you along for this ride, and promise to fix bugs faster now that we are not just two PhD students :)

- Charles and Sarah