[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-72519":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":10,"language":11,"languages":10,"totalLinesOfCode":10,"stars":12,"forks":13,"watchers":14,"openIssues":15,"contributorsCount":16,"subscribersCount":16,"size":16,"stars1d":17,"stars7d":18,"stars30d":19,"stars90d":16,"forks30d":16,"starsTrendScore":20,"compositeScore":21,"rankGlobal":10,"rankLanguage":10,"license":22,"archived":23,"fork":23,"defaultBranch":24,"hasWiki":25,"hasPages":23,"topics":26,"createdAt":10,"pushedAt":10,"updatedAt":27,"readmeContent":28,"aiSummary":29,"trendingCount":16,"starSnapshotCount":16,"syncStatus":30,"lastSyncTime":31,"discoverSource":32},72519,"NeMo-Agent-Toolkit","NVIDIA\u002FNeMo-Agent-Toolkit","NVIDIA","The NVIDIA NeMo Agent toolkit is an open-source library for efficiently connecting and optimizing teams of AI agents.","https:\u002F\u002Fdocs.nvidia.com\u002Fnemo\u002Fagent-toolkit\u002Flatest\u002F",null,"Python",2400,672,33,23,0,18,52,119,54,110.48,"Apache License 2.0",false,"develop",true,[],"2026-06-12 04:01:06","\u003C!--\nSPDX-FileCopyrightText: Copyright (c) 2024-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.\nSPDX-License-Identifier: Apache-2.0\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\nhttp:\u002F\u002Fwww.apache.org\u002Flicenses\u002FLICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n-->\n\n![NVIDIA NeMo Agent Toolkit](.\u002Fdocs\u002Fsource\u002F_static\u002Fbanner.png \"NeMo Agent Toolkit banner image\")\n\n# NVIDIA NeMo Agent Toolkit\n\n\u003C!-- vale off (due to hyperlinks) -->\n[![License: Apache 2.0](https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FLicense-Apache%202.0-green.svg)](https:\u002F\u002Fopensource.org\u002Flicenses\u002FApache-2.0)\n[![GitHub Release](https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fv\u002Frelease\u002FNVIDIA\u002FNeMo-Agent-Toolkit)](https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002Freleases)\n[![PyPI version](https:\u002F\u002Fimg.shields.io\u002Fpypi\u002Fv\u002Fnvidia-nat)](https:\u002F\u002Fpypi.org\u002Fproject\u002Fnvidia-nat\u002F)\n[![GitHub issues](https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fissues\u002FNVIDIA\u002FNeMo-Agent-Toolkit)](https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002Fissues)\n[![GitHub pull requests](https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fissues-pr\u002FNVIDIA\u002FNeMo-Agent-Toolkit)](https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002Fpulls)\n[![GitHub Repo stars](https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fstars\u002FNVIDIA\u002FNeMo-Agent-Toolkit)](https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit)\n[![GitHub forks](https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fforks\u002FNVIDIA\u002FNeMo-Agent-Toolkit)](https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002Fnetwork\u002Fmembers)\n[![Ask DeepWiki](https:\u002F\u002Fdeepwiki.com\u002Fbadge.svg)](https:\u002F\u002Fdeepwiki.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit)\n[![Open in Colab](https:\u002F\u002Fcolab.research.google.com\u002Fassets\u002Fcolab-badge.svg)](https:\u002F\u002Fcolab.research.google.com\u002Fgithub\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002F)\n\u003C!-- vale on -->\n\n\u003Cdiv align=\"center\">\n\n*NVIDIA NeMo Agent Toolkit adds intelligence to AI agents across any framework—enhancing speed, accuracy, and decision-making through enterprise-grade instrumentation, observability, and continuous learning.*\n\n\u003C\u002Fdiv>\n\n## 🔥 New Features\n\n- [**AI Coding Agent Skills:**](.\u002FAGENTS.md) Use focused NeMo Agent Toolkit skills to give coding agents task-specific guidance for building, evaluating, optimizing, and observing workflows.\n- [**Dynamo Runtime Intelligence:**](.\u002Fexamples\u002Fdynamo_integration\u002Flatency_sensitivity_demo\u002FREADME.md) Automatically infer per-request latency sensitivity from agent profiles and apply runtime hints for cache control, load-aware routing, and priority-aware serving.\n- [**Agent Performance Primitives (APP):**](https:\u002F\u002Fdocs.langchain.com\u002Foss\u002Fpython\u002Fintegrations\u002Fproviders\u002Fnvidia#install-2) Introduce framework-agnostic performance primitives that accelerate graph-based agent frameworks such as LangChain, CrewAI, and Agno with parallel execution, speculative branching, and node-level priority routing.\n- [**LangSmith Native Integration:**](.\u002Fdocs\u002Fsource\u002Frun-workflows\u002Fobserve\u002Fobserve-workflow-with-langsmith.md) Observe end-to-end agent execution with native LangSmith tracing, run evaluation experiments, compare outcomes, and manage prompt versions across development and production workflows.\n- [**FastMCP Workflow Publishing:**](.\u002Fdocs\u002Fsource\u002Frun-workflows\u002Ffastmcp-server.md) Publish NeMo Agent Toolkit workflows as MCP servers using the FastMCP server runtime to simplify MCP-native deployment and integration.\n- **Migration notice:** `1.5.0` simplifies package installation and dependency management. See the [Migration Guide](.\u002Fdocs\u002Fsource\u002Fresources\u002Fmigration-guide.md#v150).\n\n## ✨ Key Features\n\n- 🛠️ **Building Agents**: Accelerate your agent development with tools that make it easier to get your agent into production.\n  - 🧩 [**Framework Agnostic:**](.\u002Fdocs\u002Fsource\u002Fcomponents\u002Fintegrations\u002Fframeworks.md) Work side-by-side with agentic frameworks to add the instrumentation necessary for observing, profiling, and optimizing your agents. Use the toolkit with popular frameworks such as [LangChain](https:\u002F\u002Fwww.langchain.com\u002F), [LlamaIndex](https:\u002F\u002Fwww.llamaindex.ai\u002F), [CrewAI](https:\u002F\u002Fwww.crewai.com\u002F), [Microsoft Semantic Kernel](https:\u002F\u002Flearn.microsoft.com\u002Fen-us\u002Fsemantic-kernel\u002F), and [Google ADK](https:\u002F\u002Fgoogle.github.io\u002Fadk-docs\u002F), as well as custom enterprise agentic frameworks and simple Python agents.\n  - 🔁 [**Reusability:**](.\u002Fdocs\u002Fsource\u002Fcomponents\u002Fsharing-components.md) Build components once and use them multiple times to maximize the value from development effort.\n  - ⚡ [**Customization:**](docs\u002Fsource\u002Fget-started\u002Ftutorials\u002Fcustomize-a-workflow.md) Start with a pre-built agent, tool, or workflow, and customize it to your needs.\n  - 💬 [**Built-In User Interface:**](.\u002Fdocs\u002Fsource\u002Frun-workflows\u002Flaunching-ui.md) Use the NeMo Agent Toolkit UI chat interface to interact with your agents, visualize output, and debug workflows.\n- 📈 **Agent Insights:** Utilize NeMo Agent Toolkit instrumentation to better understand how your agents function at runtime.\n  - 📊 [**Profiling:**](.\u002Fdocs\u002Fsource\u002Fimprove-workflows\u002Fprofiler.md) Profile entire workflows from the agent level all the way down to individual tokens to identify bottlenecks, analyze token efficiency, and guide developers in optimizing their agents.\n  - 🔎 [**Observability:**](.\u002Fdocs\u002Fsource\u002Frun-workflows\u002Fobserve\u002Fobserve.md) Track performance, trace execution flows, and gain insights into your agent behaviors in production.\n- 🚀 **Agent Optimization:** Improve your agent's quality, accuracy, and performance with a suite of tools for all phases of the agent lifecycle.\n  - 🧪 [**Evaluation System:**](.\u002Fdocs\u002Fsource\u002Fimprove-workflows\u002Fevaluate.md) Validate and maintain accuracy of agentic workflows with a suite of tools for offline evaluation.\n  - 🎯 [**Hyper-Parameter and Prompt Optimizer:**](.\u002Fdocs\u002Fsource\u002Fimprove-workflows\u002Foptimizer.md) Automatically identify the best configuration and prompts to ensure you are getting the most out of your agent.\n  - 🧠 [**Fine-tuning with Reinforcement Learning:**](.\u002Fdocs\u002Fsource\u002Fimprove-workflows\u002Ffinetuning\u002Findex.md) Fine-tune LLMs specifically for your agent and train intrinsic information about your workflow directly into the model.\n  - ⚡ [**NVIDIA Dynamo Integration:**](.\u002Fexamples\u002Fdynamo_integration\u002FREADME.md) Use Dynamo and NeMo Agent Toolkit together to improve agent performance at scale.\n  - ⚙️ [**Agent Performance Primitives (APP):**](https:\u002F\u002Fdocs.langchain.com\u002Foss\u002Fpython\u002Fintegrations\u002Fproviders\u002Fnvidia#install-2) Accelerate graph-based agent frameworks such as LangChain, CrewAI, and Agno with parallel execution, speculative branching, and node-level priority routing.\n- 🔌 **Protocol Support:** Integrate with common protocols used to build agents.\n  - 🔗 [**Model Context Protocol (MCP):**](.\u002Fdocs\u002Fsource\u002Fbuild-workflows\u002Fmcp-client.md) Integrate [MCP tools](.\u002Fdocs\u002Fsource\u002Fbuild-workflows\u002Fmcp-client.md) into your agents or serve your tools and agents as an [MCP server](.\u002Fdocs\u002Fsource\u002Frun-workflows\u002Fmcp-server.md) for others to consume.\n  - 🤝 [**Agent-to-Agent (A2A) Protocol:**](.\u002Fdocs\u002Fsource\u002Fcomponents\u002Fintegrations\u002Fa2a.md) Build teams of distributed agents with full support for authentication.\n\nWith NeMo Agent Toolkit, you can move quickly, experiment freely, and ensure reliability across all your agent-driven projects.\n\n## 🚀 Installation\n\nBefore you begin using NeMo Agent Toolkit, ensure that you have Python 3.11, 3.12, or 3.13 installed on your system.\n\n> [!NOTE]\n> For users who want to run the examples, it's required to clone the repository and install from source to get the necessary files required to run the examples. Please refer to the [Examples](.\u002Fexamples\u002FREADME.md) documentation for more information.\n\nTo install the latest stable version of NeMo Agent Toolkit from PyPI, run the following command:\n\n```bash\npip install nvidia-nat\n```\n\nNeMo Agent Toolkit has many optional dependencies that can be installed with the core package. Optional dependencies are grouped by framework. For example, to install the LangChain\u002FLangGraph plugin, run the following:\n\n```bash\npip install \"nvidia-nat[langchain]\"\n```\n\nDetailed installation instructions, including the full list of optional dependencies and their conflicts, can be found in the [Installation Guide](.\u002Fdocs\u002Fsource\u002Fget-started\u002Finstallation.md).\n\n## 🌟 Hello World Example\n\nBefore getting started, it's possible to run this simple workflow and many other examples in Google Colab with no setup. Click here to open the introduction notebook: [![Open in Colab](https:\u002F\u002Fcolab.research.google.com\u002Fassets\u002Fcolab-badge.svg)](https:\u002F\u002Fcolab.research.google.com\u002Fgithub\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002F).\n\n1. Ensure you have set the `NVIDIA_API_KEY` environment variable to allow the example to use NVIDIA NIMs. An API key can be obtained by visiting [`build.nvidia.com`](https:\u002F\u002Fbuild.nvidia.com\u002F) and creating an account.\n\n   ```bash\n   export NVIDIA_API_KEY=\u003Cyour_api_key>\n   ```\n\n2. Create the NeMo Agent Toolkit workflow configuration file. This file will define the agents, tools, and workflows that will be used in the example. Save the following as `workflow.yml`:\n\n   ```yaml\n   functions:\n      # Add a tool to search wikipedia\n      wikipedia_search:\n         _type: wiki_search\n         max_results: 2\n\n   llms:\n      # Tell NeMo Agent Toolkit which LLM to use for the agent\n      nim_llm:\n         _type: nim\n         model_name: nvidia\u002Fnemotron-3-nano-30b-a3b\n         temperature: 0.0\n         chat_template_kwargs:\n            enable_thinking: false\n\n   workflow:\n      # Use an agent that 'reasons' and 'acts'\n      _type: react_agent\n      # Give it access to our wikipedia search tool\n      tool_names: [wikipedia_search]\n      # Tell it which LLM to use\n      llm_name: nim_llm\n      # Make it verbose\n      verbose: true\n      # Retry up to 3 times\n      parse_agent_response_max_retries: 3\n   ```\n\n3. Run the Hello World example using the `nat` CLI and the `workflow.yml` file.\n\n   ```bash\n   nat run --config_file workflow.yml --input \"List five subspecies of Aardvarks\"\n   ```\n\n   This will run the workflow and output the results to the console.\n\n   ```console\n   Workflow Result:\n   ['Here are five subspecies of Aardvarks:\\n\\n1. Orycteropus afer afer (Southern aardvark)\\n2. O. a. adametzi  Grote, 1921 (Western aardvark)\\n3. O. a. aethiopicus  Sundevall, 1843\\n4. O. a. angolensis  Zukowsky & Haltenorth, 1957\\n5. O. a. erikssoni  Lönnberg, 1906']\n   ```\n\n## 📚 Additional Resources\n\n* 📖 [Documentation](https:\u002F\u002Fdocs.nvidia.com\u002Fnemo\u002Fagent-toolkit\u002Flatest): Explore the full documentation for NeMo Agent Toolkit.\n* 🧭 [Get Started Guide](.\u002Fdocs\u002Fsource\u002Fget-started\u002Finstallation.md): Set up your environment and start building with NeMo Agent Toolkit.\n* 🤝 [Contributing](.\u002Fdocs\u002Fsource\u002Fresources\u002Fcontributing\u002Findex.md): Learn how to contribute to NeMo Agent Toolkit and set up your development environment.\n* 🧪 [Examples](.\u002Fexamples\u002FREADME.md): Explore examples of NeMo Agent Toolkit workflows located in the [`examples`](.\u002Fexamples) directory of the source repository.\n* 🛠️ [Create and Customize NeMo Agent Toolkit Workflows](docs\u002Fsource\u002Fget-started\u002Ftutorials\u002Fcustomize-a-workflow.md): Learn how to create and customize NeMo Agent Toolkit workflows.\n* 🤖 [AI Coding Agent Skill](.\u002Fdocs\u002Fsource\u002Fresources\u002Fcontributing\u002Fagent-skills.md): Install the NeMo Agent Toolkit skill and use example prompts for agent-assisted development.\n* 🎯 [Evaluate with NeMo Agent Toolkit](.\u002Fdocs\u002Fsource\u002Fimprove-workflows\u002Fevaluate.md): Learn how to evaluate your NeMo Agent Toolkit workflows.\n* 🆘 [Troubleshooting](.\u002Fdocs\u002Fsource\u002Fresources\u002Ftroubleshooting.md): Get help with common issues.\n\n\n## 🛣️ Roadmap\n\n- [x] Automatic Reinforcement Learning (RL) to fine-tune LLMs for a specific agent.\n- [x] Integration with [NVIDIA Dynamo](https:\u002F\u002Fgithub.com\u002Fai-dynamo\u002Fdynamo) to reduce LLM latency at scale.\n- [x] Improve agent throughput with KV-Cache optimization.\n- [ ] Improved, standalone evaluation harness and migration to [ATIF](https:\u002F\u002Fgithub.com\u002Fharbor-framework\u002Fharbor\u002Fblob\u002Fmain\u002Frfcs\u002F0001-trajectory-format.md) for trajectory format.\n- [ ] Support for additional programming languages (TypeScript, Rust, Go, WASM) with compiled libraries.\n- [ ] Phasing out wrapping architecture to ease onboarding for more agents.\n- [ ] Support for adding skills and sandboxes to existing agents.\n- [ ] MCP authentication improvements.\n- [ ] Improved memory interface to support self-improving agents.\n\n## 📊 Telemetry\n\nThe NeMo Agent Toolkit includes runtime telemetry hooks for the `nat` command-line tool to help guide improvements. Telemetry is best-effort and never blocks or fails a CLI invocation. Once you opt in (see below), events are sent to the shared NeMo Usage Telemetry ingest.\n\n### How consent works\n\nThe first time you run an interactive `nat` command, you'll see a one-time consent prompt explaining what is collected and asking whether to allow it. The prompt defaults to **yes** (pressing Enter accepts); type `n` to opt out. Your decision is persisted to `~\u002F.config\u002Fnat\u002Ftelemetry.toml` and respected on every subsequent invocation.\n\nIn **non-interactive contexts** (CI, cron, piped scripts, daemons), telemetry is **always off** unless you explicitly enable it via the environment variable below. We never send data when there's no opportunity to ask.\n\nYou can change your decision anytime:\n\n```bash\nnat configure telemetry --enable     # opt in\nnat configure telemetry --disable    # opt out\nnat configure telemetry --status     # show the current effective state\n```\n\nOr override the persisted decision (and skip the prompt) via environment variable:\n\n```bash\nexport NAT_TELEMETRY_ENABLED=false   # disable for this shell session\nexport NAT_TELEMETRY_ENABLED=true    # enable for this shell session\n```\n\nThe environment variable takes precedence over the persisted file. If both disagree, `nat configure telemetry --status` will tell you which one is winning.\n\n### What is collected\n\nFor each `nat` command invocation, a single event is sent at exit containing:\n\n- The top-level command name, such as `run`, `serve`, or `evaluate`.\n- The second-level command name when applicable, such as `list-components` for `nat info list-components`.\n- The outcome: `success`, `failure`, or `interrupted`.\n- The wall-clock duration in milliseconds.\n- The process exit code.\n- The Python class name of the raised exception on failure (the message is not collected).\n- The Python runtime version, such as `3.11.7`.\n\n### What is not collected\n\nThe following are never collected:\n\n- Command arguments or option values.\n- Workflow names, function names, model names, or any contents of configuration files.\n- File paths, hostnames, usernames, IP addresses, or any other identifying information.\n- The output of any command.\n\n## 💬 Feedback\n\nWe would love to hear from you! Please file an issue on [GitHub](https:\u002F\u002Fgithub.com\u002FNVIDIA\u002FNeMo-Agent-Toolkit\u002Fissues) if you have any feedback or feature requests.\n\n## 🤝 Acknowledgements\n\nWe would like to thank the following groups for their contribution to the toolkit:\n\n- [Synopsys](https:\u002F\u002Fwww.synopsys.com\u002F)\n  - Google ADK framework support.\n  - Microsoft AutoGen framework support.\n- [W&B Weave Team](https:\u002F\u002Fwandb.ai\u002Fsite\u002Fweave\u002F)\n  - Contributions to the evaluation and telemetry system.\n\nIn addition, we would like to thank the following open source projects that made NeMo Agent Toolkit possible:\n\n- [Agent2Agent (A2A) Protocol](https:\u002F\u002Fgithub.com\u002Fa2aproject\u002FA2A)\n- [CrewAI](https:\u002F\u002Fgithub.com\u002FcrewAIInc\u002FcrewAI)\n- [Dynamo](https:\u002F\u002Fgithub.com\u002Fai-dynamo\u002Fdynamo)\n- [FastAPI](https:\u002F\u002Fgithub.com\u002Ftiangolo\u002Ffastapi)\n- [Google Agent Development Kit (ADK)](https:\u002F\u002Fgithub.com\u002Fgoogle\u002Fadk-python)\n- [LangChain](https:\u002F\u002Fgithub.com\u002Flangchain-ai\u002Flangchain)\n- [Llama-Index](https:\u002F\u002Fgithub.com\u002Frun-llama\u002Fllama_index)\n- [Mem0ai](https:\u002F\u002Fgithub.com\u002Fmem0ai\u002Fmem0)\n- [Microsoft AutoGen](https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002Fautogen)\n- [MinIO](https:\u002F\u002Fgithub.com\u002Fminio\u002Fminio)\n- [Model Context Protocol (MCP)](https:\u002F\u002Fgithub.com\u002Fmodelcontextprotocol\u002Fmodelcontextprotocol)\n- [OpenTelemetry](https:\u002F\u002Fgithub.com\u002Fopen-telemetry\u002Fopentelemetry-python)\n- [Phoenix](https:\u002F\u002Fgithub.com\u002Farize-ai\u002Fphoenix)\n- [Ragas](https:\u002F\u002Fgithub.com\u002Fexplodinggradients\u002Fragas)\n- [Redis](https:\u002F\u002Fgithub.com\u002Fredis\u002Fredis-py)\n- [Semantic Kernel](https:\u002F\u002Fgithub.com\u002Fmicrosoft\u002Fsemantic-kernel)\n- [Strands](https:\u002F\u002Fgithub.com\u002Fstrands-agents\u002Fsdk-python)\n- [uv](https:\u002F\u002Fgithub.com\u002Fastral-sh\u002Fuv)\n- [Weave](https:\u002F\u002Fgithub.com\u002Fwandb\u002Fweave)\n","NVIDIA NeMo Agent Toolkit是一个开源库，用于高效连接和优化AI代理团队。它通过提供企业级的工具、可观测性和持续学习能力来增强AI代理的速度、准确性和决策能力。该工具包支持跨框架操作，并引入了AI编码代理技能、Dynamo运行时智能以及代理性能原语（APP）等特性，以提高开发效率和系统性能。适用于需要构建复杂AI代理网络并追求高性能表现的企业或研究机构，特别是在自然语言处理、自动编程助手等领域有广泛应用潜力。",2,"2026-06-11 03:42:24","high_star"]