Model layer
Gateways & routers
Proxies that sit in front of many models — one API, with failover and spend control.
LiteLLM
★Gateways & routers
An open-source proxy that gives 100+ model providers one OpenAI-compatible API.
Bifrost
Gateways & routers
A fast, open-source LLM gateway written in Go, with one API across providers.
Cloudflare AI Gateway
Gateways & routers
Cloudflare's proxy for model traffic, adding caching, rate limiting, and analytics at the edge.
OpenRouter
Gateways & routers
A hosted marketplace and router that exposes hundreds of models behind one API and one bill.
Portkey
Gateways & routers
An AI gateway pairing fast model routing with built-in observability, caching, and guardrails.
Requesty
Gateways & routers
A routing layer that unifies many models with spend controls and automatic failover.
Vercel AI Gateway
Gateways & routers
Vercel's gateway for routing to many model providers through one endpoint and one bill.