maximhq / bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
8,769 stars
1,387 forks
Go
1,209 issues
agent-gatewayai-gatewayai-governanceapi-gatewayclaude-codecoding-agentsfailovergatewayguardrailsllm-costllm-gatewayllm-observabilityllm-proxyllm-routerload-balancingmcp-gatewaymodel-context-protocolmodel-routeropenai-compatiblesemantic-cache