Bifrost
Gateways & routersA fast, open-source LLM gateway written in Go, with one API across providers.
Bifrost is an open-source AI gateway built for throughput — written in Go and benchmarked to add very little overhead at high request rates. It offers one unified API across providers, with fallbacks, load balancing, and MCP support.
It positions itself as the performance-first option for teams that want a self-hosted gateway that disappears under load.
Where it's ideally used
A fit when you self-host a gateway under heavy traffic and per-request overhead has to stay minimal.
Where it doesn't fit
A younger project than the established gateways — less of a fit when ecosystem depth outweighs raw speed.