Gateways
Proxies in front of model APIs: keys, fallbacks, and logs.
-
Cloudflare AI Gateway
Cloudflare documents AI Gateway for analytics, logging, caching, rate limiting, retries, and model fallback. The overview says it is available on all plans.
-
LiteLLM
Proxy and SDK in front of many model APIs. The LICENSE file puts content outside the enterprise directory under MIT.
-
OpenRouter
Hosted router across model providers. The pricing page lists a free plan, a standard pay-as-you-go plan, and a business plan.
-
Portkey gateway
Open-source AI gateway. GitHub reports the gateway repository as MIT. Portkey also sells a hosted product.