NeMo GuardrailsNeMo Guardrails
核验标记表示资料完整度,不是产品评分。下列未确认项可能影响选型;请按对应来源逐项确认。The confidence mark describes evidence completeness, not a product score. Unconfirmed items below may affect your choice; check them against the relevant sources.
未确认的信息Information not confirmed
- MCP server 作为工具的接入方式:config.yml 顶层键未见对应配置项
- 跨会话记忆与 rail 状态的持久化策略
- 除配置目录外的本机文件读写面
- 合规认证与遥测/日志留存承诺
- 各 rail 在不同语言下的准确率(官方未公布,本站不测)
- How MCP servers are attached as tools: no corresponding top-level key in the config.yml schema
- Cross-session memory and rail-state persistence
- The local file surface beyond the configuration directory
- Compliance certifications and telemetry/log-retention commitments
- Per-language rail accuracy (not published officially; this site does not measure it)
它是本地跑的护栏库,不是托管的安全服务。
NVIDIA 把它写成「给 LLM 应用加可编程护栏的开源 Python 库」(About 页当日在册): rail 的类型、判定用的模型、数据往哪走,都由你 config.yml 里的选择决定。
它是本地跑的护栏库,不是托管的安全服务。
NVIDIA 把它写成「给 LLM 应用加可编程护栏的开源 Python 库」(About 页当日在册): rail 的类型、判定用的模型、数据往哪走,都由你 config.yml 里的选择决定。
适合与不适合When to use it, when not to
适合在自有进程或容器里加护栏的团队:话题控制、越狱检测、PII、工具调用管控都能写进 rail。 不适合想要托管控制台与审核工作流的人,也不适合把「护栏质量」当厂商承诺的团队—— 判定用的是你选的模型,模型换了结论就跟着换。
中文生态China availability 国产 / 国内可直接用 / 备案状态 · 快照domestic / direct access / CAC filing · snapshot 2026-11-06
- 出品属地Origin
- 国外出品foreign-made NVIDIA 主体(文档站与仓库页当日在册);未见面向中国大陆的本地化版本。NVIDIA entity (on the docs site and repository page same day); no mainland-localised edition found.
- 国内使用Direct access
- 大陆可直连direct OK 同日实测 docs.nvidia.com 与 pypi.org 返回 200,github.com 返回 000(本机网络受限);安装路由走 PyPI 可达,文档可达不等于任何合规承诺。Same-day probes: docs.nvidia.com and pypi.org returned 200, github.com returned 000 (local network restriction); the install route via PyPI is reachable. Page reachability is not a compliance claim.
- 备案状态CAC filing
- 备案未核验filing unknown:官方文档与仓库页当日在册内容未写中国大陆备案/登记信息;本次未检索监管公示名单,不做推断。Nothing on the mainland filing/registration appears in the official pages fetched same day; the regulator's public registry was not searched, so no inference is made.
备案信息以网信办《生成式人工智能服务已备案信息》公示名单为准(按批次滚动更新,本站只抄编号不解读);「大陆可直连」是本站从大陆网络直连实测的结果,不是厂商承诺。GitHub 类站点当日实测有波动,口径写在依据里。Filing status is quoted from the CAC public registry (updated batch by batch; this site copies the number and does not interpret it). "Direct access" is this site's own reachability measurement from a mainland network, not a vendor promise. GitHub-hosted sites fluctuated on the measurement day — the note says so.
固定坐标系Fixed coordinate system
8 个维度dimensions, 与同分区其他对象逐项可比each comparable item by item against others in the same section.
- 模型与开放条件Model & openness
守的是你应用里接的那个模型,模型本身不由它提供。官方 Supported LLMs 页在册:NVIDIA NIM、 OpenAI、Azure、Anthropic、Hugging Face、Ollama、LangChain,可同机服务也可远端端点。 护栏判定可用应用模型自检(LLM self-checking)、NemoGuard / Nemotron 专用安全模型, 也可挂第三方(目录在册 LlamaGuard、ActiveFence、Cisco AI Defense 等)。
It guards the model your app already calls; it does not supply one. The official Supported LLMs page records NVIDIA NIM, OpenAI, Azure, Anthropic, Hugging Face, Ollama and LangChain, served either on the same machine or at a remote endpoint. Rail decisions can use the application LLM for self-checking, dedicated NemoGuard / Nemotron safety models, or third parties (the catalog records LlamaGuard, ActiveFence, Cisco AI Defense).
- 运行位置Where it runs
开源 Python 库,官方 About 页在册两种交付:PyPI 包与容器镜像。装在你自己的进程或容器里跑, installation 页在册 pip 安装、Python 3.10–3.13、uv 起 server、Docker 可用。 检测逻辑在本地引擎执行,模型调用按你配置的端点出去。
An open-source Python library; the About page records two delivery forms: the PyPI package and a container image. It runs inside your own process or container. The installation page records pip install, Python 3.10-3.13, starting the server with uv, and Docker. Rail logic executes locally; model calls go wherever you configure them.
- 本地文件Local files
配置目录(config.yml + flows / actions)在你本机文件系统,CLI 与 server 直接读该目录。 官方页未声明它读写你的工作区业务文件;评测用公开数据集(evaluate 页在册 chit-chat、MSMARCO)。 更大范围的本地文件面本次未逐条核验,记为未知。
The config folder (config.yml plus flows and actions) lives on your own filesystem and is read directly by the CLI and the server. No official statement was found about reading your project's business files; evaluation uses public datasets (chit-chat, MSMARCO, on the evaluate page). The wider local file surface was not verified item by item and is recorded as unknown.
- 关机后的任务Tasks after shutdown
没有托管侧的「关机后续跑」任务面:它是随你的应用一起起来的库或服务进程。 官方 CLI 页在册 chat / server / convert / find_providers 等子命令, evaluate 页在册离线批跑评测;异步队列与断点续跑不在产品口径里。
There is no hosted 'keeps running after shutdown' task surface: it comes up with your application. The CLI page records chat / server / convert / find_providers, and the evaluate page records offline batch evaluation. Queues and resumption are not part of the product framing.
- 工具与扩展Tools & extensions
五类 rail 在册:input / dialog / retrieval / execution / output,execution rail 管工具调用, 自定义 action 可挂自己的校验函数。LangChain / LangGraph 走 passthrough mode 集成。 config.yml 顶层键(models / instructions / rails / prompts / knowledge_base / tracing) 未见 MCP server 配置项,MCP 接入方式记为未知。
Five rail types are on record: input / dialog / retrieval / execution / output, where execution rails govern tool calls and custom actions let you plug in your own checks. LangChain and LangGraph integrate through passthrough mode. The top-level config.yml keys (models / instructions / rails / prompts / knowledge_base / tracing) contain no MCP server entry, so MCP access is recorded as unknown.
- 上下文与记忆Context & memory
会话消息由调用方带入,rail 在处理 user / assistant 消息时逐条判定; retrieval rail 可读 knowledge_base 做检索过滤。跨会话记忆与持久化策略本次未核验到官方声明, 记为未知;上下文长度实际上限由你所选模型决定。
Conversation messages are passed in by the caller and rails judge user / assistant messages one by one; retrieval rails can read the knowledge_base. No official statement was verified on cross-session memory or rail-state persistence, recorded as unknown; effective context length is set by whichever model you choose.
- 权限与限制Permissions & limits
数据流向取决于你选的端点:本地 / 自托管端点内容不出你的环境; catalog 页在册第三方 guardrail 服务会把送检内容交给该方。许可证 Apache-2.0(当日在册)。 观测面有 logging / tracing 专页在册。合规认证(SOC 2 / ISO 等)与训练用途承诺本次未核验,记为未知。
Data flow depends on the endpoint you select: local or self-hosted endpoints keep content inside your environment, while the catalog page records that third-party guardrail services send submitted content to that party. Apache-2.0 is on the PyPI and repository pages the same day. Logging and tracing have dedicated pages. Compliance certifications and training-use commitments were not verified and are recorded as unknown.
- 适合什么任务Best for
适合:要在自己的进程或容器里加可编程护栏——话题控制、PII、越狱检测、工具调用管控, 并且要能换模型与端点。不适合:只想要一个托管控制台带审核工作流、要把评测平台当主轴、 或不能接受「护栏质量取决于所选模型」这件事。
Fits: teams adding programmable rails inside their own process or container - topic control, PII, jailbreak detection, tool-call governance - while keeping the freedom to swap models and endpoints. Not a fit: anyone wanting a hosted console with review workflows, or treating rail quality as a vendor guarantee, since the judgement inherits whichever model runs it.
头号误解Top misconception
- 把它当托管安全服务:本体是本地库 / 容器,数据流向由你配的端点决定
- 以为工具调用自动被拦:官方工具集成页写明 tool 消息绕过 input 校验,建议补 output rail
- 把 catalog 里的第三方 rail 当免费内置能力:接第三方即把送检内容送出你的环境
证据来源Evidence sources
最近核验记录Latest recorded check 2026-11-06,内容更新日content updated on 2026-11-06。单项复核范围见正文或来源说明,不代表所有字段在同一天重新核验。See the text or source notes for item-specific scope; this does not mean every field was rechecked on that date.
| 类型Type | 名称Name | 链接Link |
|---|---|---|
| docs | NeMo Guardrails · Docs Overview(开源 Python 库定位与导航,2026-11-06 直抓 200)NeMo Guardrails · Docs Overview (open-source Python library positioning and navigation, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/ |
| docs | NeMo Guardrails · About the library(两种交付形态与防护对象,2026-11-06 直抓 200)NeMo Guardrails · About the library (two delivery forms and what gets guarded, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/about-nemo-guardrails-library/overview.md |
| docs | NeMo Guardrails · Supported LLMs(provider 清单与本地/远端端点表述,2026-11-06 直抓 200)NeMo Guardrails · Supported LLMs (provider list and local/remote endpoint wording, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/about-nemo-guardrails-library/supported-llms.md |
| docs | NeMo Guardrails · Guardrail Types(五类 rail 各自职责,2026-11-06 直抓 200)NeMo Guardrails · Guardrail Types (responsibilities of the five rail types, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/about-nemo-guardrails-library/rail-types |
| docs | NeMo Guardrails · Installation guide(pip / Python 版本 / server / Docker,2026-11-06 直抓 200)NeMo Guardrails · Installation guide (pip / Python versions / server / Docker, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/get-started/installation-guide |
| docs | NeMo Guardrails · CLI(子命令清单,2026-11-06 直抓 200)NeMo Guardrails · CLI (subcommand list, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/guardrails-python-sdk/nemoguardrails/cli.md |
| docs | NeMo Guardrails · Guardrail catalog(内容安全 / 越狱 / PII / 工具调用等家族,2026-11-06 直抓 200)NeMo Guardrails · Guardrail catalog (content safety / jailbreak / PII / tool-calling families, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/configure-guardrails/guardrail-catalog.md |
| docs | NeMo Guardrails · Content safety rails(本地 Nemotron 与第三方 API 之分,2026-11-06 直抓 200)NeMo Guardrails · Content safety rails (local Nemotron versus third-party APIs, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/configure-guardrails/guardrail-catalog/content-safety.md |
| docs | NeMo Guardrails · Tools integration(passthrough mode 与 tool 消息校验边界,2026-11-06 直抓 200)NeMo Guardrails · Tools integration (passthrough mode and the tool-message validation boundary, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/integration-with-third-party-libraries/tools-integration |
| docs | NeMo Guardrails · config.yml schema(顶层键清单,2026-11-06 直抓 200)NeMo Guardrails · config.yml schema (top-level key list, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/configure-guardrails/yaml-schema.md |
| docs | NeMo Guardrails · Evaluate guardrails(可离线批跑的评测面,2026-11-06 直抓 200)NeMo Guardrails · Evaluate guardrails (the offline batch evaluation surface, direct-fetched 200 on 2026-11-06) | https://docs.nvidia.com/nemo/guardrails/latest/evaluation/evaluate-guardrails.md |
| changelog | NeMo Guardrails · Releases(变更记录;v0.24.1 及各版要点,2026-11-06 直抓 200)NeMo Guardrails · Releases (change record; v0.24.1 and per-release highlights, direct-fetched 200 on 2026-11-06) | https://github.com/NVIDIA/NeMo-Guardrails/releases |
| changelog | NeMo Guardrails · PyPI(版本 0.24.1 与 2026-09-16 发布日、Apache-2.0,2026-11-06 直抓 200)NeMo Guardrails · PyPI (version 0.24.1 dated 2026-09-16 with Apache-2.0, direct-fetched 200 on 2026-11-06) | https://pypi.org/project/nemoguardrails/ |
| repo | NeMo Guardrails · 仓库(Apache 2.0、最新 release 与未归档状态,2026-11-06 直抓 200)NeMo Guardrails · repository (Apache 2.0, latest release, not archived, direct-fetched 200 on 2026-11-06) | https://github.com/NVIDIA/NeMo-Guardrails |
官方口径与未核到项Official record and unverified items
本站尚未完成实测。本档只覆盖能力面与配置面,不含命中率、误拦率或延迟数字。
实测建议(三条):
- 同一套 rail 在不同 provider 上的判定差异(本地端点 vs 第三方 API)
- tool 消息绕过 input 校验的实际后果,与补 output rail 的成本差
- 接第三方 guardrail 服务时的数据外送范围与留存条款
This site has not completed measured runs; nothing here covers hit rates, false-block rates or latency.
Suggested measurements (three):
- How the same rail set behaves across providers (local endpoint versus third-party API)
- The real consequences of tool messages bypassing input validation, versus the cost of adding output rails
- What data actually leaves your environment when a third-party guardrail service is attached
能力边界Capability boundaries
官方 catalog 页在册的家族是:内容安全、越狱防护、话题控制、PII 检测、agentic 安全与工具调用、 幻觉与自检、第三方 rail API。它拦的是消息与动作;「人工审核外包」与跨厂商模型打分 都不在官方口径里(本站观点,按在册页面范围判断)。 评测面(evaluate)在开源包内,用公开数据集跑 dialog / fact-checking / moderation / hallucination 四类指标——这是「你自己的 rail 配置有多准」,不是跨厂商的跑分。
The catalog families on record are content safety, jailbreak protection, topic control, PII detection, agentic security and tool calling, hallucination and self-checks, plus third-party rail APIs. What it blocks are messages and actions; human-review outsourcing and cross-vendor model scoring are absent from the official framing (this site's view, judged from the scope of the pages on record). The evaluation surface ships in the open-source package and runs dialog, fact-checking, moderation and hallucination metrics over public datasets - that measures your own rail configuration, not a cross-vendor leaderboard.
变更记录说明Change record
变更记录走 GitHub releases(无独立 changelog 页)。当日直抓在册的版本线: v0.24.1(09-16)、v0.24.0(IORails 扩充内建 rail、F5 集成)、v0.23.0(Polygraf PII、HF 分类器)、 v0.22.0(与 LangChain 解耦、流式与 OpenTelemetry)、v0.21.0(IORails 并行引擎、OpenAI 兼容服务)。 最近一次官方发布距核验日约 51 天,故 lifecycle 记 maintenance,不记 active。
Change history lives in the GitHub releases page (there is no separate changelog page). Recorded release line on the verification day: v0.24.1 (09-16), v0.24.0 (IORails expands built-in rails, F5 integration), v0.23.0 (Polygraf PII, Hugging Face classifiers), v0.22.0 (LangChain decoupling, streaming and OpenTelemetry), v0.21.0 (IORails parallel engine, OpenAI-compatible server). The most recent official release is about 51 days before the verification date, so lifecycle is recorded as maintenance rather than active.
相关条目Related entries
- Azure AI Content SafetyAzure AI Content Safety同为护栏,运行位置相反:那边检测在厂商侧,这里在你进程里。Same line: Azure AI Content Safety (in guardrails and content filtering); this entry states only what its own official sources support.
- Amazon Bedrock GuardrailsAmazon Bedrock Guardrails策略面相似(内容/越狱/PII),差别在能不能换模型端点。Same line: Amazon Bedrock Guardrails (in guardrails and content filtering); this entry states only what its own official sources support.
- LiteLLMLiteLLM Proxy (AI Gateway)网关侧也能挂 rail;这里是应用内库,那里是入口治理。Same line: LiteLLM 网关(Proxy / AI Gateway) (in guardrails and content filtering); this entry states only what its own official sources support.
本页由This page is generated from the ai-handbook 数据层生成(CC BY 4.0)。data layer (CC BY 4.0).
方法论与坐标系定义见仓库内For the methodology and coordinate definitions, see METHODOLOGY.md.