[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-901":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":10,"totalLinesOfCode":10,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":16,"subscribersCount":16,"size":16,"stars1d":17,"stars7d":18,"stars30d":19,"stars90d":16,"forks30d":16,"starsTrendScore":20,"compositeScore":21,"rankGlobal":10,"rankLanguage":10,"license":22,"archived":23,"fork":23,"defaultBranch":24,"hasWiki":25,"hasPages":25,"topics":26,"createdAt":10,"pushedAt":10,"updatedAt":40,"readmeContent":41,"aiSummary":42,"trendingCount":16,"starSnapshotCount":16,"syncStatus":43,"lastSyncTime":44,"discoverSource":45},901,"litellm","BerriAI\u002Flitellm","BerriAI","Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]","https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002F",null,"Python",50073,8795,209,1409,0,150,787,3487,705,45,"Other",false,"litellm_internal_staging",true,[27,28,29,30,31,32,5,33,34,35,36,37,38,39],"ai-gateway","anthropic","azure-openai","bedrock","gateway","langchain","llm","llm-gateway","llmops","mcp-gateway","openai","openai-proxy","vertex-ai","2026-06-12 02:00:20","\u003Ch1 align=\"center\">\n        🚅 LiteLLM\n    \u003C\u002Fh1>\n    \u003Cp align=\"center\">\n        \u003Cp align=\"center\">LiteLLM AI Gateway\n        \u003C\u002Fp>\n        \u003Cp align=\"center\">Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format.\u003C\u002Fp>\n        \u003Cp align=\"center\">\n        \u003Ca href=\"https:\u002F\u002Frender.com\u002Fdeploy?repo=https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm\" target=\"_blank\" rel=\"nofollow\">\u003Cimg src=\"https:\u002F\u002Frender.com\u002Fimages\u002Fdeploy-to-render-button.svg\" alt=\"Deploy to Render\">\u003C\u002Fa>\n        \u003Ca href=\"https:\u002F\u002Frailway.com\u002Fdeploy\u002FRhvhdC?referralCode=7mRv9K&utm_medium=integration&utm_source=template&utm_campaign=generic\">\n          \u003Cimg src=\"https:\u002F\u002Frailway.com\u002Fbutton.svg\" alt=\"Deploy on Railway\">\n        \u003C\u002Fa>\n        \u003C\u002Fp>\n    \u003C\u002Fp>\n\u003Ch4 align=\"center\">\u003Ca href=\"https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fsimple_proxy\" target=\"_blank\">LiteLLM Proxy Server (AI Gateway)\u003C\u002Fa> | \u003Ca href=\"https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fenterprise#hosted-litellm-proxy\" target=\"_blank\"> Hosted Proxy\u003C\u002Fa> | \u003Ca href=\"https:\u002F\u002Flitellm.ai\u002Fenterprise\"target=\"_blank\">Enterprise Tier\u003C\u002Fa> | \u003Ca href=\"https:\u002F\u002Fwww.litellm.ai\u002Fai-gateway\" target=\"_blank\">Website\u003C\u002Fa>\u003C\u002Fh4>\n\u003Ch4 align=\"center\">\n    \u003Ca href=\"https:\u002F\u002Fpypi.org\u002Fproject\u002Flitellm\u002F\" target=\"_blank\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fpypi\u002Fv\u002Flitellm.svg\" alt=\"PyPI Version\">\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm\" target=\"_blank\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fstars\u002FBerriAI\u002Flitellm.svg?style=social\" alt=\"GitHub Stars\">\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fwww.ycombinator.com\u002Fcompanies\u002Fberriai\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FY%20Combinator-W23-orange?style=flat-square\" alt=\"Y Combinator W23\">\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fwa.link\u002Fhuol9n\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fstatic\u002Fv1?label=Chat%20on&message=WhatsApp&color=success&logo=WhatsApp&style=flat-square\" alt=\"Whatsapp\">\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fdiscord.gg\u002FwuPM9dRgDw\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fstatic\u002Fv1?label=Chat%20on&message=Discord&color=blue&logo=Discord&style=flat-square\" alt=\"Discord\">\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fwww.litellm.ai\u002Fsupport\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fstatic\u002Fv1?label=Chat%20on&message=Slack&color=black&logo=Slack&style=flat-square\" alt=\"Slack\">\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fcodspeed.io\u002FBerriAI\u002Flitellm?utm_source=badge\">\n        \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fendpoint?url=https:\u002F\u002Fcodspeed.io\u002Fbadge.json\" alt=\"CodSpeed\"\u002F>\n    \u003C\u002Fa>\n\u003C\u002Fh4>\n\n\u003Cimg width=\"2688\" height=\"1600\" alt=\"Group 7154 (1)\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Fc5ee0412-6fb5-4fb6-ab5b-bafae4209ca6\" \u002F>\n\n---\n\n## What is LiteLLM\n\nLiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.\n\nUse it as a **Python SDK** for direct library integration, or deploy the **AI Gateway (Proxy Server)** as a centralized service for your team or organization.\n\n[**Jump to LiteLLM Proxy (LLM Gateway) Docs**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fsimple_proxy) \u003Cbr>\n[**Jump to Supported LLM Providers**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders)\n\n---\n\n## Why LiteLLM\n\nManaging LLM calls across providers gets complicated fast — different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction:\n\n- **Unified API** — one interface for 100+ LLMs, no provider-specific SDK juggling\n- **Drop-in OpenAI compatibility** — swap providers without rewriting your code\n- **Production-ready gateway** — virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box\n- **8ms P95 latency** at 1k RPS ([benchmarks](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fbenchmarks))\n\n### OSS Adopters\n\n\u003Ctable>\n  \u003Ctr>\n    \u003Ctd>\u003Cimg height=\"60\" alt=\"Stripe\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Ff7296d4f-9fbd-460d-9d05-e4df31697c4b\" \u002F>\u003C\u002Ftd>\n    \u003Ctd>\u003Cimg height=\"60\" alt=\"image\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F436fca71-988b-40bb-b5fe-8450c80fdbd0\" \u002F>\u003C\u002Ftd>\n    \u003Ctd>\u003Cimg height=\"60\" alt=\"Google ADK\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Fcaf270a2-5aee-45c4-8222-41a2070c4f19\" \u002F>\u003C\u002Ftd>\n    \u003Ctd>\u003Cimg height=\"60\" alt=\"Greptile\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F3db0ae72-0843-4005-a56d-bba1dde2193d\" \u002F>\u003C\u002Ftd>\n    \u003Ctd>\u003Cimg height=\"60\" alt=\"OpenHands\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Fa6150c4c-149e-4cae-888b-8b92be6e003f\" \u002F>\u003C\u002Ftd>\n    \u003Ctd>\u003Ch2>Netflix\u003C\u002Fh2>\u003C\u002Ftd>\n    \u003Ctd>\u003Cimg height=\"60\" alt=\"OpenAI Agents SDK\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Fc02f7be0-8c2e-4d27-aea7-7c024bfaebc0\" \u002F>\u003C\u002Ftd>\n  \u003C\u002Ftr>\n\u003C\u002Ftable>\n\n---\n\n## Features\n\n\u003Cdetails open>\n\u003Csummary>\u003Cb>LLMs\u003C\u002Fb> - Call 100+ LLMs (Python SDK + AI Gateway)\u003C\u002Fsummary>\n\n[**All Supported Endpoints**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fsupported_endpoints) - `\u002Fchat\u002Fcompletions`, `\u002Fresponses`, `\u002Fembeddings`, `\u002Fimages`, `\u002Faudio`, `\u002Fbatches`, `\u002Frerank`, `\u002Fa2a`, `\u002Fmessages` and more.\n\n### Python SDK\n\n```shell\nuv add litellm\n```\n\n```python\nfrom litellm import completion\nimport os\n\nos.environ[\"OPENAI_API_KEY\"] = \"your-openai-key\"\nos.environ[\"ANTHROPIC_API_KEY\"] = \"your-anthropic-key\"\n\n# OpenAI\nresponse = completion(model=\"openai\u002Fgpt-4o\", messages=[{\"role\": \"user\", \"content\": \"Hello!\"}])\n\n# Anthropic  \nresponse = completion(model=\"anthropic\u002Fclaude-sonnet-4-20250514\", messages=[{\"role\": \"user\", \"content\": \"Hello!\"}])\n```\n\n### AI Gateway (Proxy Server)\n\n[**Getting Started - E2E Tutorial**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproxy\u002Fdocker_quick_start) - Setup virtual keys, make your first request\n\n```shell\nuv tool install 'litellm[proxy]'\nlitellm --model gpt-4o\n```\n\n```python\nimport openai\n\nclient = openai.OpenAI(api_key=\"anything\", base_url=\"http:\u002F\u002F0.0.0.0:4000\")\nresponse = client.chat.completions.create(\n    model=\"gpt-4o\",\n    messages=[{\"role\": \"user\", \"content\": \"Hello!\"}]\n)\n```\n\n[**Docs: LLM Providers**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders)\n\n\u003C\u002Fdetails>\n\n\u003Cdetails>\n\u003Csummary>\u003Cb>Agents\u003C\u002Fb> - Invoke A2A Agents (Python SDK + AI Gateway)\u003C\u002Fsummary>\n\n[**Supported Providers**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fa2a#add-a2a-agents) - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI\n\n### Python SDK - A2A Protocol\n\n```python\nfrom litellm.a2a_protocol import A2AClient\nfrom a2a.types import SendMessageRequest, MessageSendParams\nfrom uuid import uuid4\n\nclient = A2AClient(base_url=\"http:\u002F\u002Flocalhost:10001\")\n\nrequest = SendMessageRequest(\n    id=str(uuid4()),\n    params=MessageSendParams(\n        message={\n            \"role\": \"user\",\n            \"parts\": [{\"kind\": \"text\", \"text\": \"Hello!\"}],\n            \"messageId\": uuid4().hex,\n        }\n    )\n)\nresponse = await client.send_message(request)\n```\n\n### AI Gateway (Proxy Server)\n\n**Step 1.** [Add your Agent to the AI Gateway](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fa2a#adding-your-agent)\n\n**Step 2.** Call Agent via A2A SDK\n\n```python\nfrom a2a.client import A2ACardResolver, A2AClient\nfrom a2a.types import MessageSendParams, SendMessageRequest\nfrom uuid import uuid4\nimport httpx\n\nbase_url = \"http:\u002F\u002Flocalhost:4000\u002Fa2a\u002Fmy-agent\"  # LiteLLM proxy + agent name\nheaders = {\"Authorization\": \"Bearer sk-1234\"}    # LiteLLM Virtual Key\n\nasync with httpx.AsyncClient(headers=headers) as httpx_client:\n    resolver = A2ACardResolver(httpx_client=httpx_client, base_url=base_url)\n    agent_card = await resolver.get_agent_card()\n    client = A2AClient(httpx_client=httpx_client, agent_card=agent_card)\n\n    request = SendMessageRequest(\n        id=str(uuid4()),\n        params=MessageSendParams(\n            message={\n                \"role\": \"user\",\n                \"parts\": [{\"kind\": \"text\", \"text\": \"Hello!\"}],\n                \"messageId\": uuid4().hex,\n            }\n        )\n    )\n    response = await client.send_message(request)\n```\n\n[**Docs: A2A Agent Gateway**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fa2a)\n\n\u003C\u002Fdetails>\n\n\u003Cdetails>\n\u003Csummary>\u003Cb>MCP Tools\u003C\u002Fb> - Connect MCP servers to any LLM (Python SDK + AI Gateway)\u003C\u002Fsummary>\n\n### Python SDK - MCP Bridge\n\n```python\nfrom mcp import ClientSession, StdioServerParameters\nfrom mcp.client.stdio import stdio_client\nfrom litellm import experimental_mcp_client\nimport litellm\n\nserver_params = StdioServerParameters(command=\"python\", args=[\"mcp_server.py\"])\n\nasync with stdio_client(server_params) as (read, write):\n    async with ClientSession(read, write) as session:\n        await session.initialize()\n\n        # Load MCP tools in OpenAI format\n        tools = await experimental_mcp_client.load_mcp_tools(session=session, format=\"openai\")\n\n        # Use with any LiteLLM model\n        response = await litellm.acompletion(\n            model=\"gpt-4o\",\n            messages=[{\"role\": \"user\", \"content\": \"What's 3 + 5?\"}],\n            tools=tools\n        )\n```\n\n### AI Gateway - MCP Gateway\n\n**Step 1.** [Add your MCP Server to the AI Gateway](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fmcp#adding-your-mcp)\n\n**Step 2.** Call MCP tools via `\u002Fchat\u002Fcompletions`\n\n```bash\ncurl -X POST 'http:\u002F\u002F0.0.0.0:4000\u002Fv1\u002Fchat\u002Fcompletions' \\\n  -H 'Authorization: Bearer sk-1234' \\\n  -H 'Content-Type: application\u002Fjson' \\\n  -d '{\n    \"model\": \"gpt-4o\",\n    \"messages\": [{\"role\": \"user\", \"content\": \"Summarize the latest open PR\"}],\n    \"tools\": [{\n      \"type\": \"mcp\",\n      \"server_url\": \"litellm_proxy\u002Fmcp\u002Fgithub\",\n      \"server_label\": \"github_mcp\",\n      \"require_approval\": \"never\"\n    }]\n  }'\n```\n\n### Use with Cursor IDE\n\n```json\n{\n  \"mcpServers\": {\n    \"LiteLLM\": {\n      \"url\": \"http:\u002F\u002Flocalhost:4000\u002Fmcp\u002F\",\n      \"headers\": {\n        \"x-litellm-api-key\": \"Bearer sk-1234\"\n      }\n    }\n  }\n}\n```\n\n[**Docs: MCP Gateway**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fmcp)\n\n\u003C\u002Fdetails>\n\n### Supported Providers ([Website Supported Models](https:\u002F\u002Fmodels.litellm.ai\u002F) | [Docs](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders))\n\n| Provider                                                                            | `\u002Fchat\u002Fcompletions` | `\u002Fmessages` | `\u002Fresponses` | `\u002Fembeddings` | `\u002Fimage\u002Fgenerations` | `\u002Faudio\u002Ftranscriptions` | `\u002Faudio\u002Fspeech` | `\u002Fmoderations` | `\u002Fbatches` | `\u002Frerank` |\n|-------------------------------------------------------------------------------------|---------------------|-------------|--------------|---------------|----------------------|-------------------------|-----------------|----------------|-----------|-----------|\n| [Abliteration (`abliteration`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fabliteration) | ✅ |  |  |  |  |  |  |  |  |  |\n| [AI\u002FML API (`aiml`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Faiml) | ✅ | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |\n| [AI21 (`ai21`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fai21) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [AI21 Chat (`ai21_chat`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fai21) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Aleph Alpha](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Faleph_alpha) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Amazon Nova](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Famazon_nova) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Anthropic (`anthropic`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fanthropic) | ✅ | ✅ | ✅ |  |  |  |  |  | ✅ |  |\n| [Anthropic Text (`anthropic_text`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fanthropic) | ✅ | ✅ | ✅ |  |  |  |  |  | ✅ |  |\n| [Anyscale](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fanyscale) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [AssemblyAI (`assemblyai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fpass_through\u002Fassembly_ai) | ✅ | ✅ | ✅ |  |  | ✅ |  |  |  |  |\n| [Auto Router (`auto_router`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproxy\u002Fauto_routing) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [AWS - Bedrock (`bedrock`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fbedrock) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  | ✅ |\n| [AWS - Sagemaker (`sagemaker`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Faws_sagemaker) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [Azure (`azure`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fazure) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |  |\n| [Azure AI (`azure_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fazure_ai) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |  |\n| [Azure Text (`azure_text`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fazure) | ✅ | ✅ | ✅ |  |  | ✅ | ✅ | ✅ | ✅ |  |\n| [Baseten (`baseten`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fbaseten) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Bytez (`bytez`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fbytez) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Cerebras (`cerebras`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcerebras) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Clarifai (`clarifai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fclarifai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Cloudflare AI Workers (`cloudflare`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcloudflare_workers) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Codestral (`codestral`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcodestral) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Cohere (`cohere`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcohere) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  | ✅ |\n| [Cohere Chat (`cohere_chat`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcohere) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [CometAPI (`cometapi`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcometapi) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [CompactifAI (`compactifai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcompactifai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Custom (`custom`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcustom_llm_server) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Custom OpenAI (`custom_openai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fopenai_compatible) | ✅ | ✅ | ✅ |  |  | ✅ | ✅ | ✅ | ✅ |  |\n| [Dashscope (`dashscope`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fdashscope) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Databricks (`databricks`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fdatabricks) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [DataRobot (`datarobot`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fdatarobot) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Deepgram (`deepgram`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fdeepgram) | ✅ | ✅ | ✅ |  |  | ✅ |  |  |  |  |\n| [DeepInfra (`deepinfra`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fdeepinfra) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Deepseek (`deepseek`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fdeepseek) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [ElevenLabs (`elevenlabs`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Felevenlabs) | ✅ | ✅ | ✅ |  |  | ✅ | ✅ |  |  |  |\n| [Empower (`empower`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fempower) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Fal AI (`fal_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ffal_ai) | ✅ | ✅ | ✅ |  | ✅ |  |  |  |  |  |\n| [Featherless AI (`featherless_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ffeatherless_ai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Fireworks AI (`fireworks_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ffireworks_ai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [FriendliAI (`friendliai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ffriendliai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Galadriel (`galadriel`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fgaladriel) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [GitHub Copilot (`github_copilot`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fgithub_copilot) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [GitHub Models (`github`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fgithub) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Google - PaLM](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fpalm) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Google - Vertex AI (`vertex_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fvertex) | ✅ | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |\n| [Google AI Studio - Gemini (`gemini`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fgemini) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [GradientAI (`gradient_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fgradient_ai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Groq AI (`groq`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fgroq) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Heroku (`heroku`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fheroku) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Hosted VLLM (`hosted_vllm`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fvllm) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Huggingface (`huggingface`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fhuggingface) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  | ✅ |\n| [Hyperbolic (`hyperbolic`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fhyperbolic) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [IBM - Watsonx.ai (`watsonx`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fwatsonx) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [Infinity (`infinity`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Finfinity) |  |  |  | ✅ |  |  |  |  |  |  |\n| [Jina AI (`jina_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fjina_ai) |  |  |  | ✅ |  |  |  |  |  |  |\n| [Lambda AI (`lambda_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Flambda_ai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Lemonade (`lemonade`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Flemonade) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [LiteLLM Proxy (`litellm_proxy`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Flitellm_proxy) | ✅ | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |\n| [Llamafile (`llamafile`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fllamafile) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [LM Studio (`lm_studio`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Flm_studio) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Maritalk (`maritalk`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fmaritalk) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Meta - Llama API (`meta_llama`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fmeta_llama) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Mistral AI API (`mistral`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fmistral) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [Moonshot (`moonshot`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fmoonshot) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Morph (`morph`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fmorph) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Nebius AI Studio (`nebius`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fnebius) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [NLP Cloud (`nlp_cloud`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fnlp_cloud) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Novita AI (`novita`)](https:\u002F\u002Fnovita.ai\u002Fmodels\u002Fllm?utm_source=github_litellm&utm_medium=github_readme&utm_campaign=github_link) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Nscale (`nscale`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fnscale) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Nvidia NIM (`nvidia_nim`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fnvidia_nim) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [OCI (`oci`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Foci) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Ollama (`ollama`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Follama) | ✅ | ✅ | ✅ | ✅ |  |  |  |  |  |  |\n| [Ollama Chat (`ollama_chat`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Follama) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Oobabooga (`oobabooga`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fopenai_compatible) | ✅ | ✅ | ✅ |  |  | ✅ | ✅ | ✅ | ✅ |  |\n| [OpenAI (`openai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fopenai) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |  |\n| [OpenAI-like (`openai_like`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fopenai_compatible) |  |  |  | ✅ |  |  |  |  |  |  |\n| [OpenRouter (`openrouter`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fopenrouter) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [OVHCloud AI Endpoints (`ovhcloud`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fovhcloud) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Perplexity AI (`perplexity`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fperplexity) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Petals (`petals`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fpetals) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Predibase (`predibase`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fpredibase) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Recraft (`recraft`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Frecraft) |  |  |  |  | ✅ |  |  |  |  |  |\n| [Replicate (`replicate`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Freplicate) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Sagemaker Chat (`sagemaker_chat`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Faws_sagemaker) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Sambanova (`sambanova`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fsambanova) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Snowflake (`snowflake`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fsnowflake) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Text Completion Codestral (`text-completion-codestral`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fcodestral) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Text Completion OpenAI (`text-completion-openai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ftext_completion_openai) | ✅ | ✅ | ✅ |  |  | ✅ | ✅ | ✅ | ✅ |  |\n| [Together AI (`together_ai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ftogetherai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Topaz (`topaz`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ftopaz) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Triton (`triton`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Ftriton-inference-server) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [V0 (`v0`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fv0) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Vercel AI Gateway (`vercel_ai_gateway`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fvercel_ai_gateway) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [VLLM (`vllm`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fvllm) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Volcengine (`volcengine`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fvolcano) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Voyage AI (`voyage`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fvoyage) |  |  |  | ✅ |  |  |  |  |  |  |\n| [WandB Inference (`wandb`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fwandb_inference) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Watsonx Text (`watsonx_text`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fwatsonx) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [xAI (`xai`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fxai) | ✅ | ✅ | ✅ |  |  |  |  |  |  |  |\n| [Xinference (`xinference`)](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproviders\u002Fxinference) |  |  |  | ✅ |  |  |  |  |  |  |\n\n[**Read the Docs**](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002F)\n\n---\n\n## Get Started\n\nYou can use LiteLLM through either the Proxy Server or Python SDK. Both give you a unified interface to access multiple LLMs (100+ LLMs). Choose the option that best fits your needs:\n\n\u003Ctable style={{width: '100%', tableLayout: 'fixed'}}>\n\u003Cthead>\n\u003Ctr>\n\u003Cth style={{width: '14%'}}>\u003C\u002Fth>\n\u003Cth style={{width: '43%'}}>\u003Cstrong>\u003Ca href=\"https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fsimple_proxy\">LiteLLM AI Gateway\u003C\u002Fa>\u003C\u002Fstrong>\u003C\u002Fth>\n\u003Cth style={{width: '43%'}}>\u003Cstrong>\u003Ca href=\"https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002F\">LiteLLM Python SDK\u003C\u002Fa>\u003C\u002Fstrong>\u003C\u002Fth>\n\u003C\u002Ftr>\n\u003C\u002Fthead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd style={{width: '14%'}}>\u003Cstrong>Use Case\u003C\u002Fstrong>\u003C\u002Ftd>\n\u003Ctd style={{width: '43%'}}>Central service (LLM Gateway) to access multiple LLMs\u003C\u002Ftd>\n\u003Ctd style={{width: '43%'}}>Use LiteLLM directly in your Python code\u003C\u002Ftd>\n\u003C\u002Ftr>\n\u003Ctr>\n\u003Ctd style={{width: '14%'}}>\u003Cstrong>Who Uses It?\u003C\u002Fstrong>\u003C\u002Ftd>\n\u003Ctd style={{width: '43%'}}>Gen AI Enablement \u002F ML Platform Teams\u003C\u002Ftd>\n\u003Ctd style={{width: '43%'}}>Developers building LLM projects\u003C\u002Ftd>\n\u003C\u002Ftr>\n\u003Ctr>\n\u003Ctd style={{width: '14%'}}>\u003Cstrong>Key Features\u003C\u002Fstrong>\u003C\u002Ftd>\n\u003Ctd style={{width: '43%'}}>Centralized API gateway with authentication and authorization, multi-tenant cost tracking and spend management per project\u002Fuser, per-project customization (logging, guardrails, caching), virtual keys for secure access control, admin dashboard UI for monitoring and management\u003C\u002Ftd>\n\u003Ctd style={{width: '43%'}}>Direct Python library integration in your codebase, Router with retry\u002Ffallback logic across multiple deployments (e.g. Azure\u002FOpenAI) - \u003Ca href=\"https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Frouting\">Router\u003C\u002Fa>, application-level load balancing and cost tracking, exception handling with OpenAI-compatible errors, observability callbacks (Lunary, MLflow, Langfuse, etc.)\u003C\u002Ftd>\n\u003C\u002Ftr>\n\u003C\u002Ftbody>\n\u003C\u002Ftable>\n\n**Stable Release:** Use docker images with the `-stable` tag. These have undergone 12 hour load tests, before being published. [More information about the release cycle here](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproxy\u002Frelease_cycle)\n\nSupport for more providers. Missing a provider or LLM Platform, raise a [feature request](https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm\u002Fissues\u002Fnew?assignees=&labels=enhancement&projects=&template=feature_request.yml&title=%5BFeature%5D%3A+).\n\n### Run in Developer Mode\n#### Services\n1. Setup .env file in root\n2. Run dependant services `docker-compose up db prometheus`\n\n#### Backend\n1. (In root) create virtual environment `python -m venv .venv`\n2. Activate virtual environment `source .venv\u002Fbin\u002Factivate`\n3. Install dependencies `uv sync --all-extras --group proxy-dev`\n4. `uv run prisma generate`\n5. `prisma generate`\n6. Start proxy backend `python litellm\u002Fproxy\u002Fproxy_cli.py`\n\n#### Frontend\n1. Navigate to `ui\u002Flitellm-dashboard`\n2. Install dependencies `npm install`\n3. Run `npm run dev` to start the dashboard\n\n### Verify Docker Image Signatures\n\nAll LiteLLM Docker images published to GHCR are signed with [cosign](https:\u002F\u002Fdocs.sigstore.dev\u002Fcosign\u002Foverview\u002F). Every release is signed with the same key introduced in [commit `0112e53`](https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm\u002Fcommit\u002F0112e53046018d726492c814b3644b7d376029d0).\n\n**Verify using the pinned commit hash (recommended):**\n\nA commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:\n\n```bash\ncosign verify \\\n  --key https:\u002F\u002Fraw.githubusercontent.com\u002FBerriAI\u002Flitellm\u002F0112e53046018d726492c814b3644b7d376029d0\u002Fcosign.pub \\\n  ghcr.io\u002Fberriai\u002Flitellm:\u003Crelease-tag>\n```\n\n**Verify using a release tag (convenience):**\n\nTags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:\n\n```bash\ncosign verify \\\n  --key https:\u002F\u002Fraw.githubusercontent.com\u002FBerriAI\u002Flitellm\u002F\u003Crelease-tag>\u002Fcosign.pub \\\n  ghcr.io\u002Fberriai\u002Flitellm:\u003Crelease-tag>\n```\n\nReplace `\u003Crelease-tag>` with the version you are deploying (e.g. `v1.83.0-stable`).\n\n---\n\n# Enterprise\nFor companies that need better security, user management and professional support\n\n[Get an Enterprise License](https:\u002F\u002Flitellm.ai\u002Fenterprise)\n[Talk to founders](https:\u002F\u002Fenterprise.litellm.ai\u002Fdemo)\n\nThis covers:\n- ✅ **Features under the [LiteLLM Commercial License](https:\u002F\u002Fdocs.litellm.ai\u002Fdocs\u002Fproxy\u002Fenterprise):**\n- ✅ **Feature Prioritization**\n- ✅ **Custom Integrations**\n- ✅ **Professional Support - Dedicated discord + slack**\n- ✅ **Custom SLAs**\n- ✅ **Secure access with Single Sign-On**\n\n# Contributing\n\nWe welcome contributions to LiteLLM! Whether you're fixing bugs, adding features, or improving documentation, we appreciate your help.\n\n## Quick Start for Contributors\n\nThis requires uv to be installed.\n\n```bash\ngit clone https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm.git\ncd litellm\nmake install-dev    # Install development dependencies\nmake format         # Format your code\nmake lint           # Run all linting checks\nmake test-unit      # Run unit tests\nmake format-check   # Check formatting only\n```\n\nFor detailed contributing guidelines, see [CONTRIBUTING.md](CONTRIBUTING.md).\n\n> **📖 Contributing to documentation?** The LiteLLM docs have moved to a separate repository: [BerriAI\u002Flitellm-docs](https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm-docs). Please open doc PRs there. Docs are served at [docs.litellm.ai](https:\u002F\u002Fdocs.litellm.ai).\n\n## Code Quality \u002F Linting\n\nLiteLLM follows the [Google Python Style Guide](https:\u002F\u002Fgoogle.github.io\u002Fstyleguide\u002Fpyguide.html).\n\nOur automated checks include:\n- **Black** for code formatting\n- **Ruff** for linting and code quality\n- **MyPy** for type checking\n- **Circular import detection**\n- **Import safety checks**\n\n\nAll these checks must pass before your PR can be merged.\n\n\n# Support \u002F talk with founders\n\n- [Schedule Demo 👋](https:\u002F\u002Fcalendly.com\u002Fd\u002F4mp-gd3-k5k\u002Fberriai-1-1-onboarding-litellm-hosted-version)\n- [Community Discord 💭](https:\u002F\u002Fdiscord.gg\u002FwuPM9dRgDw)\n- [Community Slack 💭](https:\u002F\u002Fwww.litellm.ai\u002Fsupport)\n- Our emails ✉️ ishaan@berri.ai \u002F krrish@berri.ai\n\n# Contributors\n\n\u003C!-- ALL-CONTRIBUTORS-LIST:START - Do not remove or modify this section -->\n\u003C!-- prettier-ignore-start -->\n\u003C!-- markdownlint-disable -->\n\n\u003C!-- markdownlint-restore -->\n\u003C!-- prettier-ignore-end -->\n\n\u003C!-- ALL-CONTRIBUTORS-LIST:END -->\n\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm\u002Fgraphs\u002Fcontributors\">\n  \u003Cimg src=\"https:\u002F\u002Fcontrib.rocks\u002Fimage?repo=BerriAI\u002Flitellm\" \u002F>\n\u003C\u002Fa>\n","LiteLLM 是一个开源的AI网关，提供了一个统一的接口来调用超过100种大语言模型（LLM）提供商的服务，包括OpenAI、Anthropic、Bedrock、Azure等，并支持使用OpenAI格式。其核心功能包括成本跟踪、安全防护、负载均衡和日志记录。技术上，它既可作为Python SDK直接集成到项目中，也可以部署为AI网关（代理服务器），以集中化的方式服务于团队或组织。适用于需要跨多个LLM提供商进行开发的企业级应用场景，特别是那些重视成本控制、性能优化以及安全合规性的企业。",2,"2026-06-11 02:40:06","top_all"]