Open-source AI infrastructure
Compare Everstack and Cloudflare AI Gateway on deployment model, data residency, caching and rate limiting, and what happens to your traffic past the request.
Cloudflare AI Gateway is a platform service with no self-hosting option. Its documentation presents it exclusively as Cloudflare-hosted. If a data residency or deployment constraint is why you are evaluating gateways, that settles it immediately. If traffic traversing Cloudflare is fine, it is very hard to beat.
Cloudflare describes AI Gateway as available on all plans including the free tier, and it takes one line of code. If you already run on Cloudflare, standing up your own gateway instead is hard to justify on anything except the deployment question. There is also no infrastructure to operate, which is a real advantage rather than a footnote.
Analytics and logging, caching served from Cloudflare's edge rather than the model provider, rate limiting, and retry with model fallback. Agent execution, isolated sandboxes, memory, evaluations and human review are not part of it. Whether that matters depends entirely on whether you have those problems.