[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-11697":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":9,"totalLinesOfCode":9,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":9,"subscribersCount":16,"size":16,"stars1d":17,"stars7d":18,"stars30d":19,"stars90d":16,"forks30d":16,"starsTrendScore":20,"compositeScore":21,"rankGlobal":9,"rankLanguage":9,"license":9,"archived":22,"fork":22,"defaultBranch":23,"hasWiki":22,"hasPages":22,"topics":24,"createdAt":9,"pushedAt":9,"updatedAt":41,"readmeContent":42,"aiSummary":43,"trendingCount":16,"starSnapshotCount":16,"syncStatus":44,"lastSyncTime":45,"discoverSource":46},11697,"bifrost","maximhq\u002Fbifrost","maximhq","Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & \u003C100 µs overhead at 5k RPS.",null,"https:\u002F\u002Fgithub.com\u002Fmaximhq\u002Fbifrost","Go",5651,734,26,237,0,114,271,806,342,111.6,false,"main",[25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40],"gateway","llm","llm-gateway","mcp-client","mcp-server","guardrails","mcp-gateway","ai-gateway","gateway-services","generative-ai","llm-cost","llm-observability","llmops","load-balancing","token-management","model-router","2026-06-12 04:00:55","# Bifrost AI Gateway\n\n[![Go Report Card](https:\u002F\u002Fgoreportcard.com\u002Fbadge\u002Fgithub.com\u002Fmaximhq\u002Fbifrost\u002Fcore)](https:\u002F\u002Fgoreportcard.com\u002Freport\u002Fgithub.com\u002Fmaximhq\u002Fbifrost\u002Fcore)\n[![Discord badge](https:\u002F\u002Fdcbadge.limes.pink\u002Fapi\u002Fserver\u002Fhttps:\u002F\u002Fdiscord.gg\u002FexN5KAydbU?style=flat)](https:\u002F\u002Fdiscord.gg\u002FexN5KAydbU)\n[![codecov](https:\u002F\u002Fcodecov.io\u002Fgh\u002Fmaximhq\u002Fbifrost\u002Fbranch\u002Fmain\u002Fgraph\u002Fbadge.svg)](https:\u002F\u002Fcodecov.io\u002Fgh\u002Fmaximhq\u002Fbifrost)\n![Docker Pulls](https:\u002F\u002Fimg.shields.io\u002Fdocker\u002Fpulls\u002Fmaximhq\u002Fbifrost)\n[\u003Cimg src=\"https:\u002F\u002Frun.pstmn.io\u002Fbutton.svg\" alt=\"Run In Postman\" style=\"width: 95px; height: 21px;\">](https:\u002F\u002Fapp.getpostman.com\u002Frun-collection\u002F31642484-2ba0e658-4dcd-49f4-845a-0c7ed745b916?action=collection%2Ffork&source=rip_markdown&collection-url=entityId%3D31642484-2ba0e658-4dcd-49f4-845a-0c7ed745b916%26entityType%3Dcollection%26workspaceId%3D63e853c8-9aec-477f-909c-7f02f543150e)\n[![Artifact Hub](https:\u002F\u002Fimg.shields.io\u002Fendpoint?url=https:\u002F\u002Fartifacthub.io\u002Fbadge\u002Frepository\u002Fbifrost)](https:\u002F\u002Fartifacthub.io\u002Fpackages\u002Fsearch?repo=bifrost)\n[![License](https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Flicense\u002Fmaximhq\u002Fbifrost)](LICENSE)\n\n## The fastest way to build AI applications that never go down\n\nBifrost is a high-performance AI gateway that unifies access to 23+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, and more) through a single OpenAI-compatible API. Deploy in seconds with zero configuration and get automatic failover, load balancing, semantic caching, and enterprise-grade features.\n\n## Quick Start\n\n![Get started](.\u002Fdocs\u002Fmedia\u002Fgetting-started.png)\n\n**Go from zero to production-ready AI gateway in under a minute.**\n\n**Step 1:** Start Bifrost Gateway\n\n```bash\n# Install and run locally\nnpx -y @maximhq\u002Fbifrost\n\n# Or use Docker\ndocker run -p 8080:8080 maximhq\u002Fbifrost\n```\n\n**Step 2:** Configure via Web UI\n\n```bash\n# Open the built-in web interface\nopen http:\u002F\u002Flocalhost:8080\n```\n\n**Step 3:** Make your first API call\n\n```bash\ncurl -X POST http:\u002F\u002Flocalhost:8080\u002Fv1\u002Fchat\u002Fcompletions \\\n  -H \"Content-Type: application\u002Fjson\" \\\n  -d '{\n    \"model\": \"openai\u002Fgpt-4o-mini\",\n    \"messages\": [{\"role\": \"user\", \"content\": \"Hello, Bifrost!\"}]\n  }'\n```\n\n**That's it!** Your AI gateway is running with a web interface for visual configuration, real-time monitoring, and analytics.\n\n**Complete Setup Guides:**\n\n- [Gateway Setup](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fsetting-up) - HTTP API deployment\n- [Go SDK Setup](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgo-sdk\u002Fsetting-up) - Direct integration\n\n---\n\n## Enterprise Deployments\n\nBifrost supports enterprise-grade, private deployments for teams running production AI systems at scale.\nIn addition to private networking, custom security controls, and governance, enterprise deployments unlock advanced capabilities including adaptive load balancing, clustering, guardrails, MCP gateway and and other features designed for enterprise-grade scale and reliability.\n\n\u003Cimg src=\".github\u002Fassets\u002Ffeatures.png\" alt=\"Book a Demo\" width=\"100%\" style=\"margin-top:5px;\"\u002F>\n\n\n\u003Cdiv align=\"center\" style=\"display: flex; flex-direction: column;\">\n  \u003Ca href=\"https:\u002F\u002Fcalendly.com\u002Fmaximai\u002Fbifrost-demo\">\n    \u003Cimg src=\".github\u002Fassets\u002Fbook-demo-button.png\" alt=\"Book a Demo\" width=\"170\" style=\"margin-top:5px;\"\u002F>\n  \u003C\u002Fa>\n  \u003Cdiv>\n  \u003Ca href=\"https:\u002F\u002Fwww.getmaxim.ai\u002Fbifrost\u002Fenterprise\" target=\"_blank\" rel=\"noopener noreferrer\">Explore enterprise capabilities\u003C\u002Fa>\n  \u003C\u002Fdiv>\n\u003C\u002Fdiv>\n\n---\n\n## Key Features\n\n### Core Infrastructure\n\n- **[Unified Interface](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Funified-interface)** - Single OpenAI-compatible API for all providers\n- **[Multi-Provider Support](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fprovider-configuration)** - OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cerebras, Cohere, Mistral, Ollama, Groq, and more\n- **[Automatic Fallbacks](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Ffallbacks)** - Seamless failover between providers and models with zero downtime\n- **[Load Balancing](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Ffallbacks)** - Intelligent request distribution across multiple API keys and providers\n\n### Advanced Features\n\n- **[Model Context Protocol (MCP)](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fmcp)** - Enable AI models to use external tools (filesystem, web search, databases)\n- **[Semantic Caching](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fsemantic-caching)** - Intelligent response caching based on semantic similarity to reduce costs and latency\n- **[Multimodal Support](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fstreaming)** - Support for text,images, audio, and streaming, all behind a common interface.\n- **[Custom Plugins](https:\u002F\u002Fdocs.getbifrost.ai\u002Fenterprise\u002Fcustom-plugins)** - Extensible middleware architecture for analytics, monitoring, and custom logic\n- **[Governance](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fgovernance)** - Usage tracking, rate limiting, and fine-grained access control\n\n### Enterprise & Security\n\n- **[Budget Management](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fgovernance)** - Hierarchical cost control with virtual keys, teams, and customer budgets\n- **[SSO Integration](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fsso-with-google-github)** - Google and GitHub authentication support\n- **[Observability](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fobservability)** - Native Prometheus metrics, distributed tracing, and comprehensive logging\n- **[Vault Support](https:\u002F\u002Fdocs.getbifrost.ai\u002Fenterprise\u002Fvault-support)** - Secure API key management with HashiCorp Vault integration\n\n### Developer Experience\n\n- **[Zero-Config Startup](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fsetting-up)** - Start immediately with dynamic provider configuration\n- **[Drop-in Replacement](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fdrop-in-replacement)** - Replace OpenAI\u002FAnthropic\u002FGenAI APIs with one line of code\n- **[SDK Integrations](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Fwhat-is-an-integration)** - Native support for popular AI SDKs with zero code changes\n- **[Configuration Flexibility](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fprovider-configuration)** - Web UI, API-driven, or file-based configuration options\n\n---\n\n## Repository Structure\n\nBifrost uses a modular architecture for maximum flexibility:\n\n```text\nbifrost\u002F\n├── npx\u002F                 # NPX script for easy installation\n├── core\u002F                # Core functionality and shared components\n│   ├── providers\u002F       # Provider-specific implementations (OpenAI, Anthropic, etc.)\n│   ├── schemas\u002F         # Interfaces and structs used throughout Bifrost\n│   └── bifrost.go       # Main Bifrost implementation\n├── framework\u002F           # Framework components for data persistence\n│   ├── configstore\u002F     # Configuration storages\n│   ├── logstore\u002F        # Request logging storages\n│   └── vectorstore\u002F     # Vector storages\n├── transports\u002F          # HTTP gateway and other interface layers\n│   └── bifrost-http\u002F    # HTTP transport implementation\n├── ui\u002F                  # Web interface for HTTP gateway\n├── plugins\u002F             # Extensible plugin system\n│   ├── governance\u002F      # Budget management and access control\n│   ├── jsonparser\u002F      # JSON parsing and manipulation utilities\n│   ├── logging\u002F         # Request logging and analytics\n│   ├── maxim\u002F           # Maxim's observability integration\n│   ├── mocker\u002F          # Mock responses for testing and development\n│   ├── semanticcache\u002F   # Intelligent response caching\n│   └── telemetry\u002F       # Monitoring and observability\n├── docs\u002F                # Documentation and guides\n└── tests\u002F               # Comprehensive test suites\n```\n\n---\n\n## Getting Started Options\n\nChoose the deployment method that fits your needs:\n\n### 1. Gateway (HTTP API)\n\n**Best for:** Language-agnostic integration, microservices, and production deployments\n\n```bash\n# NPX - Get started in 30 seconds\nnpx -y @maximhq\u002Fbifrost\n\n# Docker - Production ready\ndocker run -p 8080:8080 -v $(pwd)\u002Fdata:\u002Fapp\u002Fdata maximhq\u002Fbifrost\n```\n\n**Features:** Web UI, real-time monitoring, multi-provider management, zero-config startup\n\n**Learn More:** [Gateway Setup Guide](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fsetting-up)\n\n### 2. Go SDK\n\n**Best for:** Direct Go integration with maximum performance and control\n\n```bash\ngo get github.com\u002Fmaximhq\u002Fbifrost\u002Fcore\n```\n\n**Features:** Native Go APIs, embedded deployment, custom middleware integration\n\n**Learn More:** [Go SDK Guide](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgo-sdk\u002Fsetting-up)\n\n### 3. Drop-in Replacement\n\n**Best for:** Migrating existing applications with zero code changes\n\n```diff\n# OpenAI SDK\n- base_url = \"https:\u002F\u002Fapi.openai.com\"\n+ base_url = \"http:\u002F\u002Flocalhost:8080\u002Fopenai\"\n\n# Anthropic SDK  \n- base_url = \"https:\u002F\u002Fapi.anthropic.com\"\n+ base_url = \"http:\u002F\u002Flocalhost:8080\u002Fanthropic\"\n\n# Google GenAI SDK\n- api_endpoint = \"https:\u002F\u002Fgenerativelanguage.googleapis.com\"\n+ api_endpoint = \"http:\u002F\u002Flocalhost:8080\u002Fgenai\"\n```\n\n**Learn More:** [Integration Guides](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Fwhat-is-an-integration)\n\n---\n\n## Performance\n\nBifrost adds virtually zero overhead to your AI requests. In sustained 5,000 RPS benchmarks, the gateway added only **11 µs** of overhead per request.\n\n| Metric | t3.medium | t3.xlarge | Improvement |\n|--------|-----------|-----------|-------------|\n| Added latency (Bifrost overhead) | 59 µs | **11 µs** | **-81%** |\n| Success rate @ 5k RPS | 100% | 100% | No failed requests |\n| Avg. queue wait time | 47 µs | **1.67 µs** | **-96%** |\n| Avg. request latency (incl. provider) | 2.12 s | **1.61 s** | **-24%** |\n\n**Key Performance Highlights:**\n\n- **Perfect Success Rate** - 100% request success rate even at 5k RPS\n- **Minimal Overhead** - Less than 15 µs additional latency per request\n- **Efficient Queuing** - Sub-microsecond average wait times\n- **Fast Key Selection** - ~10 ns to pick weighted API keys\n\n**Complete Benchmarks:** [Performance Analysis](https:\u002F\u002Fdocs.getbifrost.ai\u002Fbenchmarking\u002Fgetting-started)\n\n---\n\n## Documentation\n\n**Complete Documentation:** [https:\u002F\u002Fdocs.getbifrost.ai](https:\u002F\u002Fdocs.getbifrost.ai)\n\n### Quick Start\n\n- [Gateway Setup](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fsetting-up) - HTTP API deployment in 30 seconds\n- [Go SDK Setup](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgo-sdk\u002Fsetting-up) - Direct Go integration\n- [Provider Configuration](https:\u002F\u002Fdocs.getbifrost.ai\u002Fquickstart\u002Fgateway\u002Fprovider-configuration) - Multi-provider setup\n\n### Features\n\n- [Multi-Provider Support](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Funified-interface) - Single API for all providers\n- [MCP Integration](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fmcp) - External tool calling\n- [Semantic Caching](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fsemantic-caching) - Intelligent response caching\n- [Fallbacks & Load Balancing](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Ffallbacks) - Reliability features\n- [Budget Management](https:\u002F\u002Fdocs.getbifrost.ai\u002Ffeatures\u002Fgovernance) - Cost control and governance\n\n### Integrations\n\n- [OpenAI SDK](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Fopenai-sdk) - Drop-in OpenAI replacement\n- [Anthropic SDK](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Fanthropic-sdk) - Drop-in Anthropic replacement\n- [AWS Bedrock SDK](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Fbedrock-sdk) - AWS Bedrock integration\n- [Google GenAI SDK](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Fgenai-sdk) - Drop-in GenAI replacement\n- [LiteLLM SDK](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Flitellm-sdk) - LiteLLM integration\n- [Langchain SDK](https:\u002F\u002Fdocs.getbifrost.ai\u002Fintegrations\u002Flangchain-sdk) - Langchain integration\n\n### Enterprise\n\n- [Custom Plugins](https:\u002F\u002Fdocs.getbifrost.ai\u002Fenterprise\u002Fcustom-plugins) - Extend functionality\n- [Clustering](https:\u002F\u002Fdocs.getbifrost.ai\u002Fenterprise\u002Fclustering) - Multi-node deployment\n- [Vault Support](https:\u002F\u002Fdocs.getbifrost.ai\u002Fenterprise\u002Fvault-support) - Secure key management\n- [Production Deployment](https:\u002F\u002Fdocs.getbifrost.ai\u002Fdeployment\u002Fdocker-setup) - Scaling and monitoring\n\n---\n\n## Need Help?\n\n**[Join our Discord](https:\u002F\u002Fdiscord.gg\u002FexN5KAydbU)** for community support and discussions.\n\nGet help with:\n\n- Quick setup assistance and troubleshooting\n- Best practices and configuration tips  \n- Community discussions and support\n- Real-time help with integrations\n\n---\n\n## Contributing\n\nWe welcome contributions of all kinds! See our [Contributing Guide](https:\u002F\u002Fdocs.getbifrost.ai\u002Fcontributing\u002Fsetting-up-repo) for:\n\n- Setting up the development environment\n- Code conventions and best practices\n- How to submit pull requests\n- Building and testing locally\n\nFor development requirements and build instructions, see our [Development Setup Guide](https:\u002F\u002Fdocs.getbifrost.ai\u002Fcontributing\u002Fsetting-up-repo#development-environment-setup).\n\n---\n\n## License\n\nThis project is licensed under the Apache 2.0 License - see the [LICENSE](LICENSE) file for details.\n\nBuilt with ❤️ by [Maxim](https:\u002F\u002Fgithub.com\u002Fmaximhq)\n","Bifrost 是一个高性能的企业级AI网关，能够统一访问23个以上的AI提供商（如OpenAI、Anthropic等）并通过单一的OpenAI兼容API进行管理。其核心功能包括自适应负载均衡、集群模式、安全防护措施以及对1000多种模型的支持，在5000 RPS下仅产生不到100微秒的额外延迟。该项目采用Go语言开发，具有极高的性能和稳定性，适合需要快速部署并保持高可用性的AI应用场景，如企业级AI服务、大规模生成式AI应用等。此外，Bifrost还提供了丰富的监控与分析工具，帮助用户更好地管理和优化AI资源使用。",2,"2026-06-11 03:32:21","trending"]