LiteLLM
The most widely deployed self-hosted AI gateway, with the widest provider coverage anywhere.
- MIT except the enterprise/ directory, 57,637 GitHub stars (August 2026)
- Rust core with a Python SDK, describes itself as calling 100+ LLM APIs
- Enterprise pricing not published
- Free self-hosting of the core proxy
Best for: Teams whose priority is provider breadth and who can live inside the MIT core.
Watch out: Virtual keys, budgets, RPM and TPM limits, spend by team and SSO are enterprise features.
Full LiteLLM comparisonBifrost
A Go gateway from Maxim AI with a clean Apache-2.0 licence and a focus on low overhead.
- Apache-2.0 with no enterprise directory, 7,675 GitHub stars (August 2026)
- Docker, Kubernetes or a single Go binary
- OSS tier free forever, Enterprise custom
Best for: Teams who want a fast, simple, cleanly licensed proxy and do not need guardrails or clustering in the free build.
Watch out: Guardrails, Cluster Mode, adaptive load balancing, RBAC, audit logs and SSO are Enterprise.
Full Bifrost comparisonKong AI Gateway
Enterprise-grade API gateway with AI plugins, and the obvious answer if Kong is already in your path.
- Core is Apache-2.0, 44,059 GitHub stars (August 2026)
- Six AI plugins free, seventeen enterprise-only
- Konnect Plus includes five proxied models, then $100 per month each
Best for: Organisations that already run Kong and want AI traffic governed by the same system.
Watch out: Semantic caching, advanced rate limiting and all guardrails are enterprise. Packaging is changing in Gateway 3.18.
Full Kong AI Gateway comparisonHelicone
Apache-2.0 gateway and observability platform with the lowest-friction integration in this set.
- Apache-2.0, no enterprise directory, 6,116 GitHub stars (August 2026)
- Maintenance mode since Mintlify's acquisition announced 3 March 2026; security updates, bug fixes and new models still ship
- Hobby free with 10,000 requests, Pro $79/month, Team $799/month
Best for: Teams replacing Portkey's observability as much as its routing, who want published tier pricing.
Watch out: Both Helicone and Mintlify describe it as running in maintenance mode after the March 2026 acquisition, which constrains new feature work. Supported on-prem is Enterprise; SOC 2 and HIPAA sit on Team at $799 per month.
Full Helicone comparisonCloudflare AI Gateway
A hosted platform service with analytics, caching, rate limiting and fallback, free on every Cloudflare plan.
- Not open source, no self-hosting option
- Available on all plans including free
- Nothing to deploy, patch or scale
Best for: Teams leaving Portkey for cost reasons rather than deployment reasons, who already run on Cloudflare.
Watch out: If you are leaving Portkey because it is cloud-hosted, this does not solve that.
Full Cloudflare AI Gateway comparisonEverstack
OursA self-hosted-first control plane where the gateway ships with the agent runtime, sandboxes and evaluations.
- Apache-2.0 across the repository, no separately licensed directory
- Self-hosting is the default at any tier, not an enterprise plan
- Guardrails and per-tenant limits in the free build
- Starter $0, Build $20/month, Scale $100/month (August 2026)
Best for: Teams whose reason for leaving is deployment control, and who also need execution or evaluations in the same place.
Watch out: Portkey's operator UX is more mature than ours, and it now has a large vendor behind it. If continuity is your concern, an independent young company is not obviously the answer.
Full Everstack comparison