Arize PhoenixArize Phoenix
核验标记表示资料完整度,不是产品评分。下列未确认项可能影响选型;请按对应来源逐项确认。The confidence mark describes evidence completeness, not a product score. Unconfirmed items below may affect your choice; check them against the relevant sources.
未确认的信息Information not confirmed
- 主体归属:按官方仓库自我归属记;注册地与主体细节未逐条核验
- judge 侧支持的模型厂商适配器全清单
- 数据集版本、split 与实验比对口径(文档正文未抓到)
- self-hosting 的外部数据库、对象存储与集群配置面(正文未抓到)
- 评估任务的调度、抽样与失败重试口径
- MCP 接入方式与对外 API 面
- 商业条款、数据用途与训练开关(产品页与文档站当日 403)
- 备案公示检索
- Full list of judge-side model vendor adapters
- Dataset versioning, splits and experiment-comparison semantics (doc bodies not fetched)
- External database, object-storage and cluster configuration in self-hosting (bodies not fetched)
- Scheduling, sampling and retry behaviour of evaluation jobs
- MCP support and the outward API surface
- Commercial terms, data usage and training opt-out (product and docs pages returned 403 today)
- Filing-registry search
English summaries and interface labels are available. Detailed source notes below are currently in Chinese.
Phoenix 是开源许可下的观测与评测平台,跑在你自己的机器或集群里。 它的评测面是「评估器挂在数据集上」,许可面是 Elastic License 2.0。
Phoenix 是开源许可下的观测与评测平台,跑在你自己的机器或集群里。 它的评测面是「评估器挂在数据集上」,许可面是 Elastic License 2.0。
适合与不适合When to use it, when not to
适合已经把 OpenTelemetry 当地图、要在 notebook 里跑批量对照实验的团队: trace 先进来,再沉淀成数据集,评估器随实验自动跑,分数与来源调用可回溯。 不适合两类需求——只要厂商托管控制台的,以及想把 Phoenix 包成服务对外卖的 (ELv2 明文禁止把软件作为托管或管理服务提供,当日 LICENSE 在册)。 本站只记它支持哪些评测类型,不记评测出来的分数。
中文生态China availability 国产 / 国内可直接用 / 备案状态 · 快照domestic / direct access / CAC filing · snapshot 2026-11-06
- 出品属地Origin
- 国外出品foreign-made 按官方仓库自我归属 Arize 记 foreign;公司主体、注册地与「Arize AX 才是托管线」的关系未逐条核验。recorded as foreign on the repository's own attribution to Arize; the legal entity, place of incorporation and the Phoenix-versus-Arize-AX relationship were not item-verified.
- 国内使用Direct access
- 直连未核验direct unknown arize.com 的产品页与文档站当日对本站抓取通道返回 403;github.com 与 pypi.org 当日直抓 200,可达性混合故标 unknown。arize.com's product and docs pages returned 403 to this site's fetch channel today, while github.com and pypi.org fetched 200 — mixed reachability, so marked unknown.
- 备案状态CAC filing
- 备案未核验filing unknown:本次未检索备案公示名单;自托管开源组件是否落入备案口径未核验,记入未知项清单。the filing registry was not searched today; whether a self-hosted open-source component falls under filing scope is unverified — listed under unknowns.
备案信息以网信办《生成式人工智能服务已备案信息》公示名单为准(按批次滚动更新,本站只抄编号不解读);「大陆可直连」是本站从大陆网络直连实测的结果,不是厂商承诺。GitHub 类站点当日实测有波动,口径写在依据里。Filing status is quoted from the CAC public registry (updated batch by batch; this site copies the number and does not interpret it). "Direct access" is this site's own reachability measurement from a mainland network, not a vendor promise. GitHub-hosted sites fluctuated on the measurement day — the note says so.
固定坐标系Fixed coordinate system
8 个维度dimensions, 与同分区其他对象逐项可比each comparable item by item against others in the same section.
- 模型与开放条件Model & openness
平台不绑模型厂商,评测面分三层:LLM-as-judge、自定义 Python 与 TypeScript 评估器、 确定性检查(server-evals 文档当日直抓在册)。内置确定性评估器 contains、exact_match、regex、 levenshtein_distance、json_distance 不需要 LLM 与 API key(同日直抓在册)。 judge 侧支持的厂商适配器全清单本次未逐条核验,记为未知。
The platform is not tied to model vendors; the evaluation surface has three layers — LLM-as-judge, custom Python and TypeScript evaluators, and deterministic checks (server-evals doc direct-fetched today). The built-in deterministic evaluators contains, exact_match, regex, levenshtein_distance and json_distance need no LLM and no API key (fetched the same day). The full list of judge-side vendor adapters supported was not verified item by item — recorded as unknown.
- 运行位置Where it runs
本机起服务是主路线:
pip install arize-phoenix或 Docker(仓库 README 与 PyPI 当日在册, requires-python ≥3.11),界面是本机起的 Web UI;仓库另有 helm 与 kustomize 目录供自有集群部署。 厂商侧托管线是 Arize AX,不是 Phoenix 本体(README 当日在册)。Running the service on your own machine is the main route:
pip install arize-phoenixor Docker (repo README and PyPI fetched today; requires-python ≥3.11), with a web UI served locally; the repository also ships helm and kustomize directories for your own clusters. The vendor-hosted line is Arize AX, not Phoenix itself (README fetched today).- 本地文件Local files
自托管时 trace 与评测数据留在自有环境,经 OpenTelemetry 上报;平台不读本机代码库或工作区文件。 self-hosting 文档分区存在 deployment-options 与 configuration 两个子目录(当日目录结构在册), 但正文本次未抓到,外部数据库与对象存储的配置面记为未知。
Self-hosted, traces and evaluation data stay in your environment and arrive over OpenTelemetry; the platform does not read your local codebase or workspace files. The self-hosting docs area contains deployment-options and configuration subfolders (directory structure fetched today), but their bodies were not fetched, so external database and object-storage configuration is recorded as unknown.
- 关机后的任务Tasks after shutdown
服务端评估器可挂在数据集上,随实验自动运行、无需本地代码(server-evals 文档当日在册); 批量对照靠 experiments 跑数据集。关机续跑不是这类平台的功能面。 评估任务的调度、抽样与重试口径未逐条在册,记为未知。
Server-side evaluators can be attached to datasets and run automatically with experiments, with no local code (server-evals doc fetched today); batch comparison runs on datasets through experiments. Resume-after-shutdown is not a feature surface for this kind of platform. Scheduling, sampling and retry semantics are not on record item by item — unknown.
- 工具与扩展Tools & extensions
OpenTelemetry 追踪 + Python/JS SDK(Releases 当日在册含 @arizeai/phoenix-cli); 仓库文档分区含 tracing、prompt-engineering、datasets-and-experiments、evaluation(当日结构在册)。 MCP 接入方式与 API 面本次未核验到官方声明,记为未知。
OpenTelemetry tracing plus Python/JS SDKs (Releases fetched today include @arizeai/phoenix-cli); the in-repo docs areas cover tracing, prompt-engineering, datasets-and-experiments and evaluation (structure fetched today). MCP support and the outward API surface were not verified in official statements — recorded as unknown.
- 上下文与记忆Context & memory
观测对象是 trace 与 span,评测对象是数据集与实验的对照(datasets-and-experiments 分区含 concepts、how-to、quickstart 文件,当日结构在册)。 数据集版本、split 与实验比对口径未读到正文,记为未知。
What is observed is traces and spans; what is evaluated is datasets against experiments (the datasets-and-experiments area holds concepts, how-to and quickstart files, structure fetched today). Dataset versioning, splits and experiment-comparison semantics were not read — recorded as unknown.
- 权限与限制Permissions & limits
许可边界最要紧:ELv2 禁止把软件作为托管或管理服务对外提供,企业功能靠 license key (LICENSE 当日直抓在册)。自托管本体无账号体系。 官方文档站与产品页当日对本站抓取通道返回 403,商业条款、数据用途与训练开关未读到,记为未知。
The license boundary matters most: ELv2 forbids providing the software to third parties as a hosted or managed service, and enterprise functionality is gated by a license key (LICENSE fetched today). Self-hosting has no account system. The official docs site and product page returned 403 to this site's fetch channel today, so commercial terms, data usage and training opt-out were not read — recorded as unknown.
- 适合什么任务Best for
适合已把 OpenTelemetry 当观测底座、要在 notebook 或自有集群里跑评测、需要「评估器挂数据集」 这种批量对照的团队。不适合只要托管控制台、打算把 Phoenix 包一层对外售卖(ELv2 限制这条), 或要现成红队与合规审计面的场景;本站不测分也不排名。
Fits teams already standardizing on OpenTelemetry who want batch comparisons in a notebook or on their own cluster: traces come in first, become datasets, evaluators run with the experiment, and each score links back to its source call. Not a fit for those who only want a hosted console, or who intend to resell Phoenix wrapped as a service (ELv2 forbids that explicitly), or who need a ready-made red-team or compliance-audit surface. This site does not measure scores and does not rank.
头号误解Top misconception
- 把 README 的 open source 当成 OSI 开源许可——本体是 ELv2,对外提供托管服务是条款明文限制项(LICENSE 当日在册)
- 把「内置评估器」当成一定要接模型——contains、exact_match、regex 等确定性评估器不接 LLM 也不要 API key(当日在册)
- 把 arize.com 文档站当成可核验入口——当日对本站返回 403,能力面只能以 GitHub 仓内文档与 PyPI 在册
证据来源Evidence sources
最近核验记录Latest recorded check 2026-11-06,内容更新日content updated on 2026-11-06。单项复核范围见正文或来源说明,不代表所有字段在同一天重新核验。See the text or source notes for item-specific scope; this does not mean every field was rechecked on that date.
| 类型Type | 名称Name | 链接Link |
|---|---|---|
| repo | Arize-ai/phoenix · 仓库 README(自称 open-source AI observability platform,pip 与 Docker、OpenTelemetry、evals library、Arize AX 托管线,2026-11-06 直抓 200)Arize-ai/phoenix · repository README (self-described open-source AI observability platform; pip and Docker, OpenTelemetry, the evals library, the Arize AX hosted line, direct-fetched 200 on 2026-11-06) | https://github.com/Arize-ai/phoenix |
| repo | Arize-ai/phoenix · LICENSE(Elastic License 2.0 与三条限制,2026-11-06 直抓 200)Arize-ai/phoenix · LICENSE (Elastic License 2.0 and its three limitations, direct-fetched 200 on 2026-11-06) | https://github.com/Arize-ai/phoenix/blob/main/LICENSE |
| docs | Phoenix · server-side evals 概览(评估器分 LLM-as-judge、自定义 Python 与 TypeScript、Exact Match 与 Regex 等确定性检查,可挂数据集随实验运行,2026-11-06 直抓 200)Phoenix · server-side evals overview (evaluators split into LLM-as-judge, custom Python and TypeScript, and deterministic checks such as Exact Match and Regex; attachable to datasets and run with experiments, direct-fetched 200 on 2026-11-06) | https://github.com/Arize-ai/phoenix/blob/main/docs/phoenix/evaluation/server-evals/overview.mdx |
| docs | Phoenix · 内置评估器清单(contains、exact_match、regex、levenshtein_distance、json_distance,不需 LLM 与 API key,2026-11-06 直抓 200)Phoenix · built-in evaluator list (contains, exact_match, regex, levenshtein_distance, json_distance — no LLM or API key needed, direct-fetched 200 on 2026-11-06) | https://github.com/Arize-ai/phoenix/blob/main/docs/phoenix/evaluation/server-evals/builtin-evaluators.mdx |
| docs | Phoenix · 仓内文档分区(evaluation 与 datasets-and-experiments 与 self-hosting 与 tracing 与 prompt-engineering,2026-11-06 直抓目录 200)Phoenix · in-repo docs areas (evaluation, datasets-and-experiments, self-hosting, tracing, prompt-engineering; directory listing direct-fetched 200 on 2026-11-06) | https://github.com/Arize-ai/phoenix/tree/main/docs/phoenix |
| docs | arize-phoenix · PyPI 官方包页(v21.0.0 页面标 Oct 30 2026、Elastic-2.0、requires-python ≥3.11、evals extras,2026-11-06 直抓 200)arize-phoenix · official PyPI package page (v21.0.0 labelled Oct 30 2026, Elastic-2.0, requires-python ≥3.11, evals extras, direct-fetched 200 on 2026-11-06) | https://pypi.org/project/arize-phoenix/ |
| changelog | Arize-ai/phoenix · Releases(当日直抓在册,最新 @arizeai/[email protected] 页面标 Nov 6)Arize-ai/phoenix · Releases (fetched today; newest @arizeai/[email protected] labelled Nov 6) | https://github.com/Arize-ai/phoenix/releases |
官方口径与未核到项Official record and unverified items
本站尚未完成实测,结论只覆盖能力面与许可面。
实测建议(三条,都指向仓内文档正文没抓全的东西):
- 数据集版本与实验比对:同一数据集换 judge 模型,历史分数是否可对齐比较
- 确定性评估器与 LLM judge 的分工边界:哪些质量判断本质上只能用规则挡
- 自托管外部依赖成本:接自有 PostgreSQL 与对象存储后的运维负担与备份口径
This site has not completed measured runs; conclusions cover the capability and license surfaces only.
Suggested measurements (three, each pointing at doc bodies we could not fetch):
- Dataset versioning and experiment comparison: with the same dataset and a different judge model, can historical scores still be lined up
- The division of labour between deterministic evaluators and LLM judges: which quality checks can only be blocked by rules
- Self-hosted dependency cost: operational load and backup semantics once an external PostgreSQL and object storage are attached
变更记录说明
本对象无独立可抓取的 changelog 页(仓库有 CHANGELOG.md,当日抓到的是 GitHub 页面外壳而非正文)。 变更记录以官方 Releases 在册,最新条目为 @arizeai/[email protected](页面标 Nov 6), 发版节奏密集,因此 lifecycle 记 active。
相关条目Related entries
- LangfuseLangfuse同为自托管观测加评测:Langfuse 核心是 MIT,Phoenix 是 ELv2,许可门槛不同。Same line: Langfuse (in evaluation and observability); this entry states only what its own official sources support.
- DeepEvalContent Credentials同为评测面:DeepEval 是跑在终端与 CI 里的评测框架,Phoenix 是带界面的观测平台。Same line: Content Credentials(内容凭证) (in evaluation and observability); this entry states only what its own official sources support.
- Sentry MCPSentry MCP / Toolkit跨大类:传统可观测厂商的 LLM 线在 mcp 大类另有 server 档案,与 Phoenix 的 trace 面互补。Same line: OpenAI Evals (in evaluation and observability); this entry states only what its own official sources support.
- OpenAI EvalsOpenAI Evals同分区对照Same layer
本页由This page is generated from the ai-handbook 数据层生成(CC BY 4.0)。data layer (CC BY 4.0).
方法论与坐标系定义见仓库内For the methodology and coordinate definitions, see METHODOLOGY.md.