[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-92352":3},{"id":4,"name":5,"fullName":6,"owner":5,"repo":5,"description":7,"homepage":8,"htmlUrl":9,"language":10,"languages":8,"totalLinesOfCode":8,"stars":11,"forks":12,"watchers":13,"openIssues":14,"contributorsCount":8,"subscribersCount":15,"size":15,"stars1d":15,"stars7d":15,"stars30d":16,"stars90d":15,"forks30d":15,"starsTrendScore":15,"compositeScore":17,"rankGlobal":8,"rankLanguage":8,"license":8,"archived":18,"fork":18,"defaultBranch":19,"hasWiki":18,"hasPages":18,"topics":20,"createdAt":8,"pushedAt":8,"updatedAt":26,"readmeContent":27,"aiSummary":28,"trendingCount":15,"starSnapshotCount":15,"syncStatus":16,"lastSyncTime":29,"discoverSource":30},92352,"FastFlowLM","FastFlowLM\u002FFastFlowLM","Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.",null,"https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM","C++",1560,117,23,74,0,2,51.42,false,"main",[21,22,23,24,25],"amd","deepseek","llama","llm","npu","2026-07-22 04:02:05","\u003Cp align=\"center\">\n  \u003Ca href=\"https:\u002F\u002Fwww.fastflowlm.com\" target=\"_blank\">\n    \u003Cimg src=\"assets\u002Flogo.png\" alt=\"FastFlowLM Logo\" width=\"200\"\u002F>\n  \u003C\u002Fa>\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n  \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FNPU-Optimized-red\" \u002F>\n\u003C\u002Fp>\n\n## ⚡ FastFlowLM (FLM) — Unlock Ryzen™ AI NPUs\n\nRun large language models — now with **Vision**, **Audio**, **Embedding** and **MoE** support — on **AMD Ryzen™ AI NPUs** in minutes.  \n**No GPU required. Faster and over 10× more power-efficient. Supports context lengths up to 256k tokens. Ultra-Lightweight (17 MB). Installs within 20 seconds.**\n\n📦 **The only out-of-box, NPU-first runtime built exclusively for Ryzen™ AI.**  \n🤝 **Think Ollama — but deeply optimized for NPUs.**  \n✨ **From Idle Silicon to Instant Power — FastFlowLM Makes Ryzen™ AI Shine.**\n\n> FastFlowLM (FLM) supports all Ryzen™ AI Series chips with XDNA2 NPUs (Strix, Strix Halo, Kraken, and Gorgon Point).\n\n---\n\n## 🔗 Quick Links\n\n  🔽 **[Download](https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM\u002Freleases\u002Flatest\u002Fdownload\u002Fflm-setup.exe)** | 📊 **[Benchmarks](https:\u002F\u002Ffastflowlm.com\u002Fdocs\u002Fbenchmarks\u002F)** | 📦 **[Model List](https:\u002F\u002Ffastflowlm.com\u002Fdocs\u002Fmodels\u002F)**  \n\n  🐧 **[Linux Getting Started Guide](.\u002Fdocs\u002Flinux-getting-started.md)**\n\n  📖 **[Docs](https:\u002F\u002Ffastflowlm.com\u002Fdocs)** | 📺 **[Demos](https:\u002F\u002Fwww.youtube.com\u002Fplaylist?list=PLf87s9UUZrJoDdz639Yc6w1UTyJ4cFHZ1)** | 🧪 **[Test Drive](https:\u002F\u002Ffastflowlm.com\u002Fdocs\u002F#-test-drive-remote-demo)** | 💬 **[Discord](https:\u002F\u002Fdiscord.gg\u002Fz24t23HsHF)** \n\n---\n\n## 🚀 Quick Start\n\nA packaged FLM Windows installer is available here: [**flm-setup.exe**](https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM\u002Freleases\u002Flatest\u002Fdownload\u002Fflm-setup.exe). For more details, see the [release notes](https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM\u002Freleases\u002F).\n\n📺 [**Watch the quick start video (Windows)**](https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=mYOfDNkyBII)\n\n> [!IMPORTANT]  \n> ⚠️ Ensure NPU driver version is **>= 32.0.203.304** (`.304` is the minimum requirement but `.311` is recommended; check via Task Manager→Performance→NPU or Device Manager).  \n> ⚙️ **Tip:**\n>   * **RECOMMENDED**: Try running **Windows Update** or **[Driver Download](https:\u002F\u002Fwww.amd.com\u002Fen\u002Fsupport)**.\n>   * **[Official AMD Install Doc](https:\u002F\u002Fryzenai.docs.amd.com\u002Fen\u002Flatest\u002Finst.html#install-npu-drivers)** *(AMD account required)*.\n>   * **[Unofficial forum downloads](https:\u002F\u002Fwww.elevenforum.com\u002Ft\u002Fdrivers-amd-npu-ryzen-8xxx-9xxx-apu.24220\u002F)** *(CAUTION, we do not hold responsible for what you download here)*.\n\nAfter installation, open **PowerShell** (`Win + X → I`). To run a model in terminal (**CLI Mode**):\n```powershell\nflm run llama3.2:1b\n```\n> **Notes:**\n> - Internet access to HuggingFace is required to download the optimized model kernels.\n> - Sometimes downloads from HuggingFace may get corrupted. If this happens, run `flm pull \u003Cmodel_tag> --force` (e.g. `flm pull llama3.2:1b --force`) to re-download and fix them.\n> - By default, models are stored in:\n>   - **Windows**: `C:\\Users\\\u003CUSER>\\Documents\\flm\\models\\`\n>   - **Linux**: `~\u002F.config\u002Fflm\u002F`\n> - During installation on Windows, you can select a different base folder (e.g., if you choose `C:\\Users\\\u003CUSER>\\flm`, models will be saved under `C:\\Users\\\u003CUSER>\\flm\\models\\`).\n> - On Linux, you can override the default location by setting the `FLM_MODEL_PATH` environment variable.\n> - To disable the startup version check, set `FLM_DISABLE_UPDATE_CHECK=1`.\n> - ⚠️ If HuggingFace is not accessible in your region, manually download the model ([check this issue](https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM\u002Fissues\u002F2)) and place it in the chosen directory.   \n\n🎉🚀 FastFlowLM (FLM) is ready — your NPU is unlocked and you can start chatting with models right away!\n\nOpen **Task Manager** (`Ctrl + Shift + Esc`). Go to the **Performance** tab → click **NPU** to monitor usage.  \n\n> **⚡ Quick Tips:**  \n> - Use `\u002Fverbose` during a session to turn on performance reporting (toggle off with `\u002Fverbose` again).   \n> - Type `\u002Fbye` to exit a conversation.  \n> - Run `flm list` in PowerShell to show all available models.  \n\nTo start the local server (**Server Mode**):\n```powershell\nflm serve llama3.2:1b\n```\n> The model tag (e.g., `llama3.2:1b`) sets the initial model, which is optional. If another model is requested, FastFlowLM will automatically switch to it. Local server is on port 52625 (default).  \n\n**[![FastFlowLM Docs](https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FFastFlowLM-Detailed%20Instructions-red?style=flat&logo=readthedocs)](https:\u002F\u002Ffastflowlm.com\u002Fdocs\u002Finstructions\u002F)**\n\n---\n\n## 📰 In the News\n\n- 03\u002F11\u002F2026 🎉 FLM now supports Linux 🐧 ! To get started, check out the **[quick start guide](https:\u002F\u002Ffastflowlm.com\u002Fdocs\u002Finstall_lin\u002F)** or the **[Lemonade Server docs](https:\u002F\u002Flemonade-server.ai\u002Fflm_npu_linux.html)**, and watch the **[short video](https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=tXRchP3sKA8)** for a quick walkthrough of FLM on Linux via Lemonade 🍋.\n\n- 10\u002F01\u002F2025 🎉 FLM was integrated into AMD's **[Lemonade Server](https:\u002F\u002Flemonade-server.ai\u002F)** 🍋. Watch this **[short demo](https:\u002F\u002Fwww.youtube.com\u002Fwatch?v=w0Tb3h4WUnE)** about using FLM in Lemonade.\n\n---\n\n## 🧠 Local AI on NPU\n\nFLM makes it easy to run cutting-edge **LLMs** (and now **VLMs**) locally with:\n- ⚡ Fast and low power\n- 🧰 Simple CLI and API (REST and OpenAI API)\n- 🔐 Fully private and offline\n\nNo model rewrites, no tuning — it just works.\n\n---\n\n## ✅ Highlights\n\n- **Runs fully on AMD Ryzen™ AI NPU** — no GPU or CPU load\n- **Lightweight runtime (17 MB)** — installs within **20 seconds**, easy to integrate    \n- **Developer-first flow** — like Ollama, but optimized for NPU  \n- **Support for long context windows** — up to 256k tokens (e.g., Qwen3-4B-Thinking-2507)  \n- **No low-level tuning required** — You focus on your app, we handle the rest\n\n---\n\n## 📄 License\n\n- All orchestration code and CLI tools are open-source under the [MIT License](.\u002FLICENSE_RUNTIME.txt).  \n- These NPU-accelerated binary kernels are completely free for any use, including commercial use.\n- Please acknowledge FastFlowLM in your README\u002Fproject page (or product) as follows:\n  ```\n  Powered by [FastFlowLM](https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM)\n  ```\n  \n---\n\n💬 Have **feedback\u002Fissues** or want **early access** to our new releases? [Open an issue](https:\u002F\u002Fgithub.com\u002Ffastflowlm\u002Ffastflowlm\u002Fissues\u002Fnew) or [Join our Discord community](https:\u002F\u002Fdiscord.gg\u002Fz24t23HsHF)\n\n---\n\n## 🙏 Acknowledgements\n\n- Powered by the advanced **AMD Ryzen™ AI NPU architecture**\n- Inspired by the widely adopted [llama.cpp](https:\u002F\u002Fgithub.com\u002Fggml-org\u002Fllama.cpp) and [Ollama](https:\u002F\u002Fgithub.com\u002Follama\u002Follama)\n- Tokenization accelerated with [MLC-ai\u002Ftokenizers-cpp](https:\u002F\u002Fgithub.com\u002Fmlc-ai\u002Ftokenizers-cpp)\n- Chat formatting via [Google\u002Fminja](https:\u002F\u002Fgithub.com\u002Fgoogle\u002Fminja)\n- Low-level kernels optimized using the powerful [IRON](https:\u002F\u002Fgithub.com\u002Famd\u002Firon)+[AIE-MLIR](https:\u002F\u002Fgithub.com\u002FXilinx\u002Fmlir-aie)\n\n---\n\n## 🛠️ Building from Source\n\nFor developers who want to build FastFlowLM from source, we provide CMake presets for a convenient and consistent build experience.\n\n### Prerequisites\n\n- Git\n- CMake (version 3.22 or higher)\n- A C++20 compatible compiler (e.g., GCC, Clang, MSVC)\n- Ninja (recommended)\n\n### Build Instructions\n\nMore details on the exact procedure, with dependencies to be installed, for linux can be found in [linux-getting-started.md](docs\u002Flinux-getting-started.md).\n\n1.  **Clone the repository:**\n\n    ```bash\n    git clone --recursive https:\u002F\u002Fgithub.com\u002FFastFlowLM\u002FFastFlowLM.git\n    cd FastFlowLM\u002Fsrc\n    ```\n\n2.  **Configure CMake using presets:**\n\n    -   **For Linux:**\n\n        ```bash\n        cmake --preset linux-default\n        ```\n\n        This will configure the build to install to `\u002Fopt\u002Ffastflowlm`.\n\n    -   **For Windows (in a developer command prompt):**\n\n        ```bash\n        cmake --preset windows-default\n        ```\n\n3.  **Build the project:**\n\n    ```bash\n    cmake --build build\n    ```\n\n4.  **Install the project (optional):**\n\n    -   **For Linux:**\n\n        ```bash\n        sudo cmake --install build\n        ```\n\n    -   **For Windows (with administrator privileges):**\n\n        ```bash\n        cmake --install build\n        ```\n","FastFlowLM 是一个专为 AMD Ryzen™ AI NPU（XDNA2 架构）优化的轻量级大语言模型（LLM）推理运行时。它支持文本、视觉、音频、嵌入及 MoE 模型，提供最高 256k 上下文长度，安装仅需 20 秒、体积仅 17 MB，无需 GPU 即可本地高效运行。基于 C++ 实现，深度适配 Strix\u002FHalo\u002FKraken\u002FGorgon Point 等 Ryzen AI 芯片，强调功耗效率（较 GPU 节能超 10 倍）与开箱即用体验。适用于边缘端、笔记本本地部署、低功耗 AI 应用开发及 NPU 硬件能力验证等场景。","2026-07-08 04:30:09","trending"]