Open-source AI infrastructure
Today we are launching Everstack in alpha - a self-hosted platform that unifies AI gateway routing, agent orchestration, workflow studios, sandboxed execution, and…
Building production AI applications today means stitching together a dozen services: an LLM proxy here, an agent framework there, a separate vector database, another observability pipeline, yet another sandbox runtime. Each one has its own deployment model, its own auth surface, and its own failure modes. Teams spend more time on infrastructure plumbing than on the AI product itself.
A unified proxy that routes requests across 200+ models from OpenAI, Anthropic, Google, Mistral, Cohere, and more. Built-in semantic caching, rate limiting, load balancing, and automatic failover - all configurable through YAML or the dashboard.
Everstack is designed to run on your infrastructure. Deploy with Docker Compose for development or Helm charts for production Kubernetes clusters. Your data, your models, your rules.
The alpha ships with official SDKs for TypeScript/Node.js, Python, and Go - covering gateway chat, embeddings, agents, sandboxes, memory, datasets, and evaluations. A full CLI is included for server management and sandbox operations.
This is an alpha release. We are shipping fast and iterating based on feedback. Here is what is on the immediate roadmap:
Everstack is built for teams that want a unified, self-hosted AI infrastructure platform. We welcome bug reports and feature requests.