Meet LiteLLM Agent Platform: A Kubernetes-Based, Self-Hosted Infrastructure Layer for Isolated Agent Sandboxes and Persistent Session Management in Production

BerriAI open-sourced LiteLLM Agent Platform, a self-hosted TypeScript stack for running AI agents in production.

The platform combines Kubernetes sandboxes, a web dashboard, a worker process, and Postgres to manage agent sessions and isolated execution environments.

It supports local development with kind and docker compose, making it easier to test and deploy the same setup.

The release tackles two key production pain points: preserving session state across restarts and separating tools and secrets into secure per-team environments.