[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-885":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":10,"totalLinesOfCode":10,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":16,"subscribersCount":16,"size":16,"stars1d":17,"stars7d":18,"stars30d":19,"stars90d":16,"forks30d":16,"starsTrendScore":20,"compositeScore":21,"rankGlobal":10,"rankLanguage":10,"license":22,"archived":23,"fork":23,"defaultBranch":24,"hasWiki":25,"hasPages":25,"topics":26,"createdAt":10,"pushedAt":10,"updatedAt":45,"readmeContent":46,"aiSummary":47,"trendingCount":16,"starSnapshotCount":16,"syncStatus":48,"lastSyncTime":49,"discoverSource":50},885,"LocalAI","mudler\u002FLocalAI","mudler","LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.","https:\u002F\u002Flocalai.io",null,"Go",46792,4130,287,151,0,18,123,589,83,45,"MIT License",false,"master",true,[27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44],"agents","ai","api","audio-generation","decentralized","distributed","image-generation","libp2p","llama","llm","mamba","mcp","musicgen","object-detection","rerank","stable-diffusion","text-generation","tts","2026-06-12 02:00:20","\u003Ch1 align=\"center\">\n  \u003Cbr>\n  \u003Cimg width=\"300\" src=\".\u002Fcore\u002Fhttp\u002Fstatic\u002Flogo.png\"> \u003Cbr>\n\u003Cbr>\n\u003C\u002Fh1>\n\n\u003Cp align=\"center\">\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fgo-skynet\u002FLocalAI\u002Fstargazers\" target=\"blank\">\n\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fstars\u002Fgo-skynet\u002FLocalAI?style=for-the-badge\" alt=\"LocalAI stars\"\u002F>\n\u003C\u002Fa>\n\u003Ca href='https:\u002F\u002Fgithub.com\u002Fgo-skynet\u002FLocalAI\u002Freleases'>\n\u003Cimg src='https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Frelease\u002Fgo-skynet\u002FLocalAI?&label=Latest&style=for-the-badge'>\n\u003C\u002Fa>\n\u003Ca href=\"LICENSE\" target=\"blank\">\n\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FLicense-MIT-yellow.svg?style=for-the-badge\" alt=\"LocalAI License\"\u002F>\n\u003C\u002Fa>\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n\u003Ca href=\"https:\u002F\u002Ftwitter.com\u002FLocalAI_API\" target=\"blank\">\n\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FX-%23000000.svg?style=for-the-badge&logo=X&logoColor=white&label=LocalAI_API\" alt=\"Follow LocalAI_API\"\u002F>\n\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fdiscord.gg\u002FuJAeKSAGDy\" target=\"blank\">\n\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002Fdynamic\u002Fjson?color=blue&label=Discord&style=for-the-badge&query=approximate_member_count&url=https%3A%2F%2Fdiscordapp.com%2Fapi%2Finvites%2FuJAeKSAGDy%3Fwith_counts%3Dtrue&logo=discord\" alt=\"Join LocalAI Discord Community\"\u002F>\n\u003C\u002Fa>\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n\u003Ca href=\"https:\u002F\u002Ftrendshift.io\u002Frepositories\u002F5539\" target=\"_blank\">\u003Cimg src=\"https:\u002F\u002Ftrendshift.io\u002Fapi\u002Fbadge\u002Frepositories\u002F5539\" alt=\"mudler%2FLocalAI | Trendshift\" style=\"width: 250px; height: 55px;\" width=\"250\" height=\"55\"\u002F>\u003C\u002Fa>\n\u003C\u002Fp>\n\n**LocalAI** is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.\n\n- **Drop-in API compatibility** — OpenAI, Anthropic, ElevenLabs APIs\n- **36+ backends** — llama.cpp, vLLM, transformers, whisper, diffusers, MLX...\n- **Any hardware** — NVIDIA, AMD, Intel, Apple Silicon, Vulkan, or CPU-only\n- **Multi-user ready** — API key auth, user quotas, role-based access\n- **Built-in AI agents** — autonomous agents with tool use, RAG, MCP, and skills\n- **Privacy-first** — your data never leaves your infrastructure\n\nCreated by [Ettore Di Giacinto](https:\u002F\u002Fgithub.com\u002Fmudler) and maintained by the [LocalAI team](#team).\n\n> [:book: Documentation](https:\u002F\u002Flocalai.io\u002F) | [:speech_balloon: Discord](https:\u002F\u002Fdiscord.gg\u002FuJAeKSAGDy) | [💻 Quickstart](https:\u002F\u002Flocalai.io\u002Fbasics\u002Fgetting_started\u002F) | [🖼️ Models](https:\u002F\u002Fmodels.localai.io\u002F) | [❓FAQ](https:\u002F\u002Flocalai.io\u002Ffaq\u002F)\n\n## Guided tour\n\nhttps:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F08cbb692-57da-48f7-963d-2e7b43883c18\n\n\u003Cdetails>\n\n\u003Csummary>\nClick to see more!\n\u003C\u002Fsummary>\n\n#### User and auth\n\nhttps:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F228fa9ad-81a3-4d43-bfb9-31557e14a36c\n\n#### Agents\n\nhttps:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F6270b331-e21d-4087-a540-6290006b381a\n\n#### Usage metrics per user\n\nhttps:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Fcbb03379-23b4-4e3d-bd26-d152f057007f\n\n#### Fine-tuning and Quantization\n\nhttps:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F5ba4ace9-d3df-4795-b7d4-b0b404ea71ee\n\n#### WebRTC\n\nhttps:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002Fed88e34c-fed3-4b83-8a67-4716a9feeb7b\n\n\u003C\u002Fdetails>\n\n## Quickstart\n\n### macOS\n\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Freleases\u002Flatest\u002Fdownload\u002FLocalAI.dmg\">\n  \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FDownload-macOS-blue?style=for-the-badge&logo=apple&logoColor=white\" alt=\"Download LocalAI for macOS\"\u002F>\n\u003C\u002Fa>\n\n> **Note:** The DMG is not signed by Apple. After installing, run: `sudo xattr -d com.apple.quarantine \u002FApplications\u002FLocalAI.app`. See [#6268](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fissues\u002F6268) for details.\n\n### Containers (Docker, podman, ...)\n\n> Already ran LocalAI before? Use `docker start -i local-ai` to restart an existing container.\n\n#### CPU only:\n\n```bash\ndocker run -ti --name local-ai -p 8080:8080 localai\u002Flocalai:latest\n```\n\n#### NVIDIA GPU:\n\n```bash\n# CUDA 13\ndocker run -ti --name local-ai -p 8080:8080 --gpus all localai\u002Flocalai:latest-gpu-nvidia-cuda-13\n\n# CUDA 12\ndocker run -ti --name local-ai -p 8080:8080 --gpus all localai\u002Flocalai:latest-gpu-nvidia-cuda-12\n\n# NVIDIA Jetson ARM64 (CUDA 12, for AGX Orin and similar)\ndocker run -ti --name local-ai -p 8080:8080 --gpus all localai\u002Flocalai:latest-nvidia-l4t-arm64\n\n# NVIDIA Jetson ARM64 (CUDA 13, for DGX Spark)\ndocker run -ti --name local-ai -p 8080:8080 --gpus all localai\u002Flocalai:latest-nvidia-l4t-arm64-cuda-13\n```\n\n#### AMD GPU (ROCm):\n\n```bash\ndocker run -ti --name local-ai -p 8080:8080 --device=\u002Fdev\u002Fkfd --device=\u002Fdev\u002Fdri --group-add=video localai\u002Flocalai:latest-gpu-hipblas\n```\n\n#### Intel GPU (oneAPI):\n\n```bash\ndocker run -ti --name local-ai -p 8080:8080 --device=\u002Fdev\u002Fdri\u002Fcard1 --device=\u002Fdev\u002Fdri\u002FrenderD128 localai\u002Flocalai:latest-gpu-intel\n```\n\n#### Vulkan GPU:\n\n```bash\ndocker run -ti --name local-ai -p 8080:8080 localai\u002Flocalai:latest-gpu-vulkan\n```\n\n### Loading models\n\n```bash\n# From the model gallery (see available models with `local-ai models list` or at https:\u002F\u002Fmodels.localai.io)\nlocal-ai run llama-3.2-1b-instruct:q4_k_m\n# From Huggingface\nlocal-ai run huggingface:\u002F\u002FTheBloke\u002Fphi-2-GGUF\u002Fphi-2.Q8_0.gguf\n# From the Ollama OCI registry\nlocal-ai run ollama:\u002F\u002Fgemma:2b\n# From a YAML config\nlocal-ai run https:\u002F\u002Fgist.githubusercontent.com\u002F...\u002Fphi-2.yaml\n# From a standard OCI registry (e.g., Docker Hub)\nlocal-ai run oci:\u002F\u002Flocalai\u002Fphi-2:latest\n```\n\n> **Automatic Backend Detection**: LocalAI automatically detects your GPU capabilities and downloads the appropriate backend. For advanced options, see [GPU Acceleration](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fgpu-acceleration\u002F).\n\nFor more details, see the [Getting Started guide](https:\u002F\u002Flocalai.io\u002Fbasics\u002Fgetting_started\u002F).\n\n## Latest News\n\n- **April 2026**: [Voice recognition](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9500), [Face recognition, identification & liveness detection](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9480), [Ollama API compatibility](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9284), [Video generation in stable-diffusion.ggml](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9420), [Backend versioning with auto-upgrade](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9315), [Pin models & load-on-demand toggle](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9309), [Universal model importer](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9466), new backends: [sglang](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9359), [ik-llama-cpp](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9326), [TurboQuant](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9355), [sam.cpp](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9288), [Kokoros](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9212), [qwen3tts.cpp](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9316), [tinygrad multimodal](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F9364)\n- **March 2026**: [Agent management](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F8820), [New React UI](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F8772), [WebRTC](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F8790), [MLX-distributed via P2P and RDMA](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F8801), [MCP Apps, MCP Client-side](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F8947)\n- **February 2026**: [Realtime API for audio-to-audio with tool calling](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F6245), [ACE-Step 1.5 support](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F8396)\n- **January 2026**: **LocalAI 3.10.0** — Anthropic API support, Open Responses API, video & image generation (LTX-2), unified GPU backends, tool streaming, Moonshine, Pocket-TTS. [Release notes](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Freleases\u002Ftag\u002Fv3.10.0)\n- **December 2025**: [Dynamic Memory Resource reclaimer](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F7583), [Automatic multi-GPU model fitting (llama.cpp)](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F7584), [Vibevoice backend](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F7494)\n- **November 2025**: [Import models via URL](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F7245), [Multiple chats and history](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fpull\u002F7325)\n- **October 2025**: [Model Context Protocol (MCP)](https:\u002F\u002Flocalai.io\u002Fdocs\u002Ffeatures\u002Fmcp\u002F) support for agentic capabilities\n- **September 2025**: New Launcher for macOS and Linux, extended backend support for Mac and Nvidia L4T, MLX-Audio, WAN 2.2\n- **August 2025**: MLX, MLX-VLM, Diffusers, llama.cpp now supported on Apple Silicon\n- **July 2025**: All backends migrated outside the main binary — [lightweight, modular architecture](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Freleases\u002Ftag\u002Fv3.2.0)\n\nFor older news and full release notes, see [GitHub Releases](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Freleases) and the [News page](https:\u002F\u002Flocalai.io\u002Fbasics\u002Fnews\u002F).\n\n## Features\n\n- [Text generation](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Ftext-generation\u002F) (`llama.cpp`, `transformers`, `vllm` ... [and more](https:\u002F\u002Flocalai.io\u002Fmodel-compatibility\u002F))\n- [Text to Audio](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Ftext-to-audio\u002F)\n- [Audio to Text](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Faudio-to-text\u002F)\n- [Image generation](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fimage-generation)\n- [OpenAI-compatible tools API](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fopenai-functions\u002F)\n- [Realtime API](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fopenai-realtime\u002F) (Speech-to-speech)\n- [Embeddings generation](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fembeddings\u002F)\n- [Constrained grammars](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fconstrained_grammars\u002F)\n- [Download models from Huggingface](https:\u002F\u002Flocalai.io\u002Fmodels\u002F)\n- [Vision API](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fgpt-vision\u002F)\n- [Object Detection](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fobject-detection\u002F)\n- [Reranker API](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Freranker\u002F)\n- [P2P Inferencing](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fdistribute\u002F)\n- [Distributed Mode](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fdistributed-mode\u002F) — Horizontal scaling with PostgreSQL + NATS\n- [Model Context Protocol (MCP)](https:\u002F\u002Flocalai.io\u002Fdocs\u002Ffeatures\u002Fmcp\u002F)\n- [Built-in Agents](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fagents\u002F) — Autonomous AI agents with tool use, RAG, skills, SSE streaming, and [Agent Hub](https:\u002F\u002Fagenthub.localai.io)\n- [Backend Gallery](https:\u002F\u002Flocalai.io\u002Fbackends\u002F) — Install\u002Fremove backends on the fly via OCI images\n- Voice Activity Detection (Silero-VAD)\n- Integrated WebUI\n\n## Supported Backends & Acceleration\n\nLocalAI supports **36+ backends** including llama.cpp, vLLM, transformers, whisper.cpp, diffusers, MLX, MLX-VLM, and many more. Hardware acceleration is available for **NVIDIA** (CUDA 12\u002F13), **AMD** (ROCm), **Intel** (oneAPI\u002FSYCL), **Apple Silicon** (Metal), **Vulkan**, and **NVIDIA Jetson** (L4T). All backends can be installed on-the-fly from the [Backend Gallery](https:\u002F\u002Flocalai.io\u002Fbackends\u002F).\n\nSee the full [Backend & Model Compatibility Table](https:\u002F\u002Flocalai.io\u002Fmodel-compatibility\u002F) and [GPU Acceleration guide](https:\u002F\u002Flocalai.io\u002Ffeatures\u002Fgpu-acceleration\u002F).\n\n## Resources\n\n- [Documentation](https:\u002F\u002Flocalai.io\u002F)\n- [LLM fine-tuning guide](https:\u002F\u002Flocalai.io\u002Fdocs\u002Fadvanced\u002Ffine-tuning\u002F)\n- [Build from source](https:\u002F\u002Flocalai.io\u002Fbasics\u002Fbuild\u002F)\n- [Kubernetes installation](https:\u002F\u002Flocalai.io\u002Fbasics\u002Fgetting_started\u002F#run-localai-in-kubernetes)\n- [Integrations & community projects](https:\u002F\u002Flocalai.io\u002Fdocs\u002Fintegrations\u002F)\n- [Installation video walkthrough](https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=cMVNnlqwfw4)\n- [Media & blog posts](https:\u002F\u002Flocalai.io\u002Fbasics\u002Fnews\u002F#media-blogs-social)\n- [Examples](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI-examples)\n\n## Team\n\nLocalAI is maintained by a small team of humans, together with the wider community of contributors.\n\n- **[Ettore Di Giacinto](https:\u002F\u002Fgithub.com\u002Fmudler)** — original author and project lead\n- **[Richard Palethorpe](https:\u002F\u002Fgithub.com\u002Frichiejp)** — maintainer\n\nA huge thank you to everyone who contributes code, reviews PRs, files issues, and helps users in [Discord](https:\u002F\u002Fdiscord.gg\u002FuJAeKSAGDy) — LocalAI is a community-driven project and wouldn't exist without you. See the full [contributors list](https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fgraphs\u002Fcontributors).\n\n## Citation\n\nIf you utilize this repository, data in a downstream project, please consider citing it with:\n\n```\n@misc{localai,\n  author = {Ettore Di Giacinto},\n  title = {LocalAI: The free, Open source OpenAI alternative},\n  year = {2023},\n  publisher = {GitHub},\n  journal = {GitHub repository},\n  howpublished = {\\url{https:\u002F\u002Fgithub.com\u002Fgo-skynet\u002FLocalAI}},\n```\n\n## Sponsors\n\n> Do you find LocalAI useful?\n\nSupport the project by becoming [a backer or sponsor](https:\u002F\u002Fgithub.com\u002Fsponsors\u002Fmudler). Your logo will show up here with a link to your website.\n\nA huge thank you to our generous sponsors who support this project covering CI expenses, and our [Sponsor list](https:\u002F\u002Fgithub.com\u002Fsponsors\u002Fmudler):\n\n\u003Cp align=\"center\">\n  \u003Ca href=\"https:\u002F\u002Fwww.spectrocloud.com\u002F\" target=\"blank\">\n    \u003Cimg height=\"200\" src=\"https:\u002F\u002Fgithub.com\u002Fuser-attachments\u002Fassets\u002F72eab1dd-8b93-4fc0-9ade-84db49f24962\">\n  \u003C\u002Fa>\n  \u003Ca href=\"https:\u002F\u002Fwww.premai.io\u002F\" target=\"blank\">\n    \u003Cimg height=\"200\" src=\"https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI\u002Fassets\u002F2420543\u002F42e4ca83-661e-4f79-8e46-ae43689683d6\"> \u003Cbr>\n  \u003C\u002Fa>\n\u003C\u002Fp>\n\n### Individual sponsors\n\nA special thanks to individual sponsors, a full list is on [GitHub](https:\u002F\u002Fgithub.com\u002Fsponsors\u002Fmudler) and [buymeacoffee](https:\u002F\u002Fbuymeacoffee.com\u002Fmudler). Special shout out to [drikster80](https:\u002F\u002Fgithub.com\u002Fdrikster80) for being generous. Thank you everyone!\n\n## Star history\n\n[![LocalAI Star history Chart](https:\u002F\u002Fapi.star-history.com\u002Fsvg?repos=go-skynet\u002FLocalAI&type=Date)](https:\u002F\u002Fstar-history.com\u002F#go-skynet\u002FLocalAI&Date)\n\n## License\n\nLocalAI is a community-driven project created by [Ettore Di Giacinto](https:\u002F\u002Fgithub.com\u002Fmudler\u002F) and maintained by the [LocalAI team](#team).\n\nMIT - Author Ettore Di Giacinto \u003Cmudler@localai.io>\n\n## Acknowledgements\n\nLocalAI couldn't have been built without the help of great software already available from the community. Thank you!\n\n- [llama.cpp](https:\u002F\u002Fgithub.com\u002Fggerganov\u002Fllama.cpp)\n- https:\u002F\u002Fgithub.com\u002Ftatsu-lab\u002Fstanford_alpaca\n- https:\u002F\u002Fgithub.com\u002Fcornelk\u002Fllama-go for the initial ideas\n- https:\u002F\u002Fgithub.com\u002Fantimatter15\u002Falpaca.cpp\n- https:\u002F\u002Fgithub.com\u002FEdVince\u002FStable-Diffusion-NCNN\n- https:\u002F\u002Fgithub.com\u002Fggerganov\u002Fwhisper.cpp\n- https:\u002F\u002Fgithub.com\u002Frhasspy\u002Fpiper\n- [exo](https:\u002F\u002Fgithub.com\u002Fexo-explore\u002Fexo) for the MLX distributed auto-parallel sharding implementation\n\n## Contributors\n\nThis is a community project, a special thanks to our contributors!\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fgo-skynet\u002FLocalAI\u002Fgraphs\u002Fcontributors\">\n  \u003Cimg src=\"https:\u002F\u002Fcontrib.rocks\u002Fimage?repo=go-skynet\u002FLocalAI\" \u002F>\n\u003C\u002Fa>\n","LocalAI是一个开源的人工智能引擎，支持在任何硬件上运行多种模型，包括大语言模型、视觉、语音、图像和视频处理等，无需GPU。其核心功能包括与OpenAI、Anthropic和ElevenLabs等主流API的兼容性，支持超过36种后端技术如llama.cpp、vLLM等，并具备多用户管理能力，确保数据隐私安全。该工具特别适合那些希望在本地环境中部署AI应用而无需依赖云端资源的企业或个人开发者使用，适用于边缘计算、私有云等多种场景。",2,"2026-06-11 02:40:02","top_all"]