跳到主要内容Skip to main content
← 深水指南Guides

怎么审 AI 供应商问卷How to vet an AI vendor questionnaire

护栏与安全Guardrails & safety

问卷的答案要能被文档指认:六组问题、三档判定、例外写进合同附录,口头承诺一律按未知记。

Every answer must be pointable to a document: six question groups, a three-way verdict, exceptions moved into the contract annex. Verbal promises count as unknown.

这一篇讲什么What this guide covers

审问卷就是要求每个答案都能被一份文档指认。 厂商说「支持」不算答案,说清在哪一版、哪个界面、什么权限才算。 本篇给六组问题、三档判定与例外处理。 答不上来的项按未知记,不进对比表,只进合同附录的追问清单。

Vetting a vendor questionnaire means every answer has to be pointable to a document. "We support it" is not an answer; which tier, which screen and which permission is. This guide gives six question groups, a three-way verdict and how to handle exceptions. Items that cannot be answered stay in the unknown column and move into the contract annex.

适用对象Who this is for

  • 采购或续约,需要把 AI 服务当供应商纳入尽调。
  • 安全或合规团队收到销售递来的能力清单,需要判断能否采信。
  • 已有站内那份 18 问清单(见「采购与权限审计清单」),要一套判答规则。
  • 要把结论交给签字的人,他需要知道哪些是查证的、哪些是没查的。

不适合:只想比功能名。功能名对比不看权限与留痕,会得出无法执行的答案。

  • Procurement or renewal where an AI service joins the supplier due-diligence set.
  • A security or compliance reviewer handed a sales capability list and asked whether it can be relied on.
  • You already have the 18-question checklist on this site (see the procurement and access audit guide) and need verdict rules.
  • A signature authority needs to know which lines were verified and which were not.

Not a fit: comparing feature names. Name-level comparisons ignore permissions and trails, and produce answers nobody can execute.

前置条件Prerequisites

  1. 你的场景清单:数据类别、用户群体、必须可审计的动作。
  2. 问题清单与判答口径先定好,别在评审会上临时发明标准。
  3. 要求书面回答并附文档链接;口头说明要有会议纪要才算数。
  4. 一个记录表:问题、答案、依据页面、核验日期、判定档位。
  5. 明确谁有权签例外放行,以及例外的有效期。
  1. Your scenario list: data categories, user groups, and the actions that must be auditable.
  2. Fix the questions and the verdict rules before the review meeting; do not invent standards in the room.
  3. Require written answers with document links; a verbal explanation counts only with meeting minutes.
  4. One record table: question, answer, source page, verification date, verdict tier.
  5. Know who may sign an exception and how long that exception stays valid.

六组问题Six question groups

组问什么可核对的证据形态
身份SSO 协议、SCIM、会话失效、角色分层管理员文档里的角色与设置页
数据训练用途、区域、保留期、可分粒度清理隐私政策与数据处理条款的具体句子
日志事件覆盖范围、导出方式、保留时长、接口审计日志文档与 API 参考
模型版本标识、下线通知期、是否可自带模型与密钥模型页与发布说明
合同输出归属、DPA 与子处理者、认证范围条款正文与证书适用性说明
退出导出格式、耗时、账号与集成停用时间导出文档与终止条款

证据句子要抄进记录表,不是只写「有」。 举两个已复核的例子(站内既有来源,2026-11-03 复核):

  • Cursor 的审计日志走 Admin API 导出。官方文档同时写明调用频率限制。
  • Microsoft 365 Copilot 的交互进入统一审计日志体系。保留与 eDiscovery 归 Purview 侧管。

这两条的价值不在结论,而在形态——答案能落到接口与页面,就可复核。

GroupWhat to askEvidence form that can be checked
IdentitySSO protocol, SCIM, session revocation, role tiersRoles and settings in the administrator documentation
DataTraining use, region, retention, per-item cleanupSpecific sentences in the privacy policy and data terms
LogsEvent coverage, export path, retention, API accessAudit-log documentation and the API reference
ModelVersion labels, deprecation notice period, bring-your-own model or keyModel pages and release notes
ContractOutput ownership, DPA and subprocessors, certificate scopeTerms text and the certificate statement of applicability
ExitExport format, duration, timing of account and integration disablementExport documentation and termination terms

Copy the evidence sentence into the record table instead of writing "yes". Two already-rechecked examples (existing in-repo sources, rechecked 2026-11-03):

  • Cursor exports audit logs through its Admin API. The documentation also states a call-frequency limit.
  • Microsoft 365 Copilot interactions enter the unified audit log system. Retention and eDiscovery sit on the Purview side.

The value is the form, not the conclusion — the answer lands on an endpoint and a page, so anyone can recheck it.

三档判定Three verdicts

  • 已证实:给出当期文档页面或条款段落,且适用档位与你签约主体一致。
  • 部分成立:能力存在但范围受限,例如只对某一档、某一区域或某一界面生效。
  • 未知:只给口头承诺、销售材料,或链接指向与你的场景无关的页面。

判定的关键是档位与主体。同一厂商的不同界面(消费端、团队版、API)常写在不同页面。 AWS 数据隐私常见问题页对内容用途有一句可直接引用的表述: 官方原文(英文):"We do not access or use your content for any purpose without your agreement." Anthropic 隐私政策则直接写明训练用途的处理方式, 官方原文(英文):"We disassociate Inputs and Outputs from your user ID to use them for training and improving our models." 两句都要按你实际签约的那一档复核,别把政策页当合同读。

  • Verified: a current documentation page or terms paragraph is given, and the tier and contracting entity match yours.
  • Partly true: the capability exists but is bounded — one tier, one region or one surface only.
  • Unknown: only verbal promises, sales material, or a link to a page unrelated to your scenario.

Tier and entity are where verdicts fail. The same vendor often documents consumer, team and API surfaces on different pages. The AWS data-privacy FAQ offers one quotable sentence on content use: "We do not access or use your content for any purpose without your agreement." The Anthropic privacy policy states its training practice directly: "We disassociate Inputs and Outputs from your user ID to use them for training and improving our models." Recheck both against the tier you actually sign for; a policy page is not a contract.

审问卷步骤Six steps

  1. 发问:按六组发出,要求书面回答与链接,注明回复期限。
  2. 逐条回源:打开链接确认页面存在、日期不旧、主体与档位对得上。
  3. 判档:按三档判定,未证实的写清「差哪一份材料」。
  4. 追问:把未知项集中成一轮追问,别在多条邮件里散着问。
  5. 落附录:判定为「部分成立」且你仍能接受的,写进合同附录并设复核时间。
  6. 定演练:签约前用试用账号做一次核对——导出审计日志、改一次策略、走一次停用。

第 6 步能抓出「文档有但界面没有」的差距。 若对方提到风险管理做法,可对照自愿框架的结构看它覆盖了哪些环节 (NIST AI RMF 官方页说明其供组织自愿使用,不规定实现方式)。

  1. Send: issue the six groups, require written answers with links, and state the reply deadline.
  2. Trace each line: open the link, confirm the page exists, is not stale, and matches your tier and entity.
  3. Assign a verdict: for anything unverified, write which document is still missing.
  4. Ask again: batch unknowns into one follow-up round instead of scattering them across threads.
  5. Annex it: lines judged partly true but acceptable go into the contract annex with a review date.
  6. Drill it: before signing, use a trial account to export audit logs, change one policy, and revoke one account.

Step 6 catches "documented but not in the console". When the vendor cites risk-management practice, compare it against the structure of a voluntary framework — the NIST AI RMF page describes it as intended for voluntary use and does not prescribe an implementation.

贯穿案例:一条「支持 SSO」的回答Worked example: one "we support SSO" answer

情境为示例,回复内容与判定过程是虚构假设,不是任何厂商的真实答复。

  • 输入:问「支持哪些 SSO 协议与自动开通」,答「支持主流企业单点登录」。
  • 处理:回源三步——要求指明协议(SAML 还是 OIDC)、是否有 SCIM 开通与停用、 管理员角色分层写在哪个页面、该能力属于哪一档;对方补了一个链接。
  • 结果判断(示例):链接页面存在,但写的是团队版功能,而你要签企业版; 且页面未提及离职停用的生效时限上限。判定为「部分成立 + 一项未知」, 不能记成「已证实」,因为档位与你的场景不一致。
  • 失败后下一步: 追问两个具体问题:企业版是否包含同一开关、停用账号到会话失效的上限时长; 在答复前,把这条从对比表移到「未知」列,评分不计入; 若商务催签,把两条承诺写成合同附录并约定上线后 30 天内用试用账号演练验证(示例期限)。

判据一句话:答案能不能变成一次可执行的核对动作。 变成不了,它就还只是宣传口径。

The scenario, the reply and the verdict process are illustrative invented assumptions, not an actual answer from any vendor.

  • Input: asked "which SSO protocols and provisioning methods", the reply is "mainstream enterprise single sign-on".
  • Processing: three back-to-source steps — name the protocol (SAML or OIDC), whether SCIM handles provisioning and deprovisioning, which page documents the admin role tiers, and which tier the capability belongs to. The vendor then supplies a link.
  • Judging the result (example): the page exists but documents the Team tier, while you are signing Enterprise; and it never states the maximum delay before a departed employee's session dies. Verdict: partly true plus one unknown. It cannot be recorded as verified because the tier does not match your scenario.
  • What to do after a failure: Ask two concrete questions: does Enterprise include the same switch, and what is the upper bound from disablement to session death; until answered, move the line to the unknown column and exclude it from scoring; if the deal is being pushed, write both commitments into the contract annex with a 30-day post-launch drill on a trial account (example deadline).

One test for the answer: can it become a check you are able to execute. If not, it is still marketing language.

验收Acceptance

  • [ ] 每个已证实项都有当期页面链接、核验日期与适用档位
  • [ ] 记录表里未知、部分成立、已证实三类数量分开统计
  • [ ] 至少一组问题落到了可演练动作(导出日志或改策略)
  • [ ] 例外项写进合同附录,含复核时间与责任人
  • [ ] 销售材料与文档的表述差异被明确列出
  • [ ] 退出路径的每一项都有格式与耗时说明,而不是「支持导出」
  • [ ] Every verified line has a current link, verification date and applicable tier
  • [ ] Unknown, partly true and verified counts are kept separate in the table
  • [ ] At least one group resolves into a drillable action (log export or policy change)
  • [ ] Exceptions sit in the contract annex with review date and owner
  • [ ] Differences between sales material and documentation are listed explicitly
  • [ ] Every exit item states format and duration rather than "export supported"

故障排查分支Troubleshooting branches

  • 答复越来越长但仍不可判定:把问题拆成是否题,要求逐条链接。
  • 链接打不开或已跳转:按未证实处理,要求提供等效页面或书面说明。
  • 只给认证不给范围:认证说明流程存在,不说明能力覆盖你用的服务;要适用性与主体清单。
  • 文档与试用账号不一致:以你能改的配置为准,把差异记成缺陷项而不是笔误。
  • 审计接口调用受限(429)或权限不足(401 / 403):这是集成条件,要单独问额度与角色要求。
  • 对方拒答某组问题:写为未知并在评审会上说明缺口,不默认放行。
  • 多家答案无法比较:统一判定口径与问题编号后再比,比排名更有用(本站不排名)。
  • Replies grow longer yet stay undecidable: split questions into yes/no items and demand one link each.
  • Links fail or redirect: treat as unverified and request an equivalent page or a written statement.
  • Certificates without scope: a certificate shows a process exists, not that it covers the service you use — ask for applicability and entity lists.
  • Documentation contradicts the trial account: trust the setting you can change, and file the gap as a defect, not a typo.
  • The audit endpoint rate-limits (429) or denies access (401 / 403): that is integration capacity — ask separately for limits and role requirements.
  • One group is refused an answer: record it as unknown, state the gap at the review, and do not default to approval.
  • Vendors cannot be compared: unify verdict rules and question numbering first; that beats a ranking (this site does not rank).

下一步Next steps

  1. 把未知项按「问供应商」和「自己演练」两类分开排期。
  2. 上线前用数据流梳理核对一次:问卷答案与图上的节点是否一致。
  3. 需要外部能力证据时,按读第三方安全报告的口径复核引用句。
  4. 续约季重跑一次判答,核验日期与页面版本一起更新。
  1. Split the unknowns into "ask the vendor" and "drill it ourselves", then schedule both.
  2. Before launch, recheck the data-flow map: do the questionnaire answers match the nodes on the diagram.
  3. When you need external capability evidence, apply the reading rules from the third-party safety report guide.
  4. Rerun the verdict process at renewal, updating verification dates and page versions together.

核验范围与未知What was verified and what is not

2026-11-06 直抓了三处官方来源:

  • Anthropic 隐私政策
  • AWS 合规与数据隐私常见问题页
  • NIST AI RMF 页

另三条为站内既有来源,沿用 2026-11-03 的复核记录,本次未重抓。 本页未联系任何厂商,也未替厂商确认能力范围。

以下未知:

  • 各厂商在你所在档位、区域与合同主体下的具体条款差异——必须按当期文档逐家核对。
  • 认证证书覆盖的服务清单与有效范围——需要索取证书适用性说明,本次未核。
  • 子处理者名单的更新频率与通知机制——各家做法不同,本页不概括。

On 2026-11-06 three official sources were fetched directly: the Anthropic privacy policy, the AWS compliance data-privacy FAQ and the NIST AI RMF page. Three further entries are existing in-repo sources that keep their 2026-11-03 recheck records and were not refetched today. No vendor was contacted for this page, and nothing here confirms any vendor's capability scope.

Unknowns:

  • Terms differences per vendor across your tier, region and contracting entity — this must be checked company by company against current documents.
  • Which services a certificate covers and until when — the statement of applicability would be needed and was not reviewed.
  • How often subprocessor lists are updated and how customers are notified — practices differ and this guide does not generalise.

出处Sources

来源Source链接URL
Anthropic 官方隐私政策(2026-11-06 直抓 200)Anthropic official privacy policy (direct fetch 200 on 2026-11-06)https://www.anthropic.com/legal/privacyhttps://www.anthropic.com/legal/privacy
AWS 合规与数据隐私常见问题官方页(2026-11-06 直抓 200)AWS compliance and data-privacy FAQ official page (direct fetch 200 on 2026-11-06)https://aws.amazon.com/compliance/data-privacy-faq/https://aws.amazon.com/compliance/data-privacy-faq/
NIST AI Risk Management Framework 官方页(2026-11-06 直抓 200)NIST AI Risk Management Framework official page (direct fetch 200 on 2026-11-06)https://www.nist.gov/itl/ai-risk-management-frameworkhttps://www.nist.gov/itl/ai-risk-management-framework
Claude · Enterprise Administrator Guide(站内既有来源,2026-11-03 复核)Claude · Enterprise Administrator Guide (existing in-repo source, rechecked 2026-11-03)https://claude.com/resources/tutorials/claude-enterprise-administrator-guidehttps://claude.com/resources/tutorials/claude-enterprise-administrator-guide
Cursor · Admin API 官方文档(审计日志导出)(站内既有来源,2026-11-03 复核)Cursor · Admin API official documentation (audit log export) (existing in-repo source, rechecked 2026-11-03)https://cursor.com/docs/account/teams/admin-apihttps://cursor.com/docs/account/teams/admin-api
Microsoft Learn · Copilot 数据保护与审计架构(站内既有来源,2026-11-03 复核)Microsoft Learn · Copilot data protection and auditing architecture (existing in-repo source, rechecked 2026-11-03)https://learn.microsoft.com/en-us/microsoft-365/copilot/architecture-data-protection-auditinghttps://learn.microsoft.com/en-us/microsoft-365/copilot/architecture-data-protection-auditing

资料快照日期:2026-11-06;单项复核范围与日期见对应正文或来源记录。产品功能与条款可能变化,使用前请核对原始来源。Source snapshot: 2026-11-06; item-specific rechecks and their scope are recorded in the text or source notes. Features and terms may change; check the original sources before use.