怎么审 AI 供应商问卷How to vet an AI vendor questionnaire
问卷的答案要能被文档指认:六组问题、三档判定、例外写进合同附录,口头承诺一律按未知记。
Every answer must be pointable to a document: six question groups, a three-way verdict, exceptions moved into the contract annex. Verbal promises count as unknown.
这一篇讲什么What this guide covers
审问卷就是要求每个答案都能被一份文档指认。 厂商说「支持」不算答案,说清在哪一版、哪个界面、什么权限才算。 本篇给六组问题、三档判定与例外处理。 答不上来的项按未知记,不进对比表,只进合同附录的追问清单。
Vetting a vendor questionnaire means every answer has to be pointable to a document. "We support it" is not an answer; which tier, which screen and which permission is. This guide gives six question groups, a three-way verdict and how to handle exceptions. Items that cannot be answered stay in the unknown column and move into the contract annex.
适用对象Who this is for
- 采购或续约,需要把 AI 服务当供应商纳入尽调。
- 安全或合规团队收到销售递来的能力清单,需要判断能否采信。
- 已有站内那份 18 问清单(见「采购与权限审计清单」),要一套判答规则。
- 要把结论交给签字的人,他需要知道哪些是查证的、哪些是没查的。
不适合:只想比功能名。功能名对比不看权限与留痕,会得出无法执行的答案。
- Procurement or renewal where an AI service joins the supplier due-diligence set.
- A security or compliance reviewer handed a sales capability list and asked whether it can be relied on.
- You already have the 18-question checklist on this site (see the procurement and access audit guide) and need verdict rules.
- A signature authority needs to know which lines were verified and which were not.
Not a fit: comparing feature names. Name-level comparisons ignore permissions and trails, and produce answers nobody can execute.
前置条件Prerequisites
- 你的场景清单:数据类别、用户群体、必须可审计的动作。
- 问题清单与判答口径先定好,别在评审会上临时发明标准。
- 要求书面回答并附文档链接;口头说明要有会议纪要才算数。
- 一个记录表:问题、答案、依据页面、核验日期、判定档位。
- 明确谁有权签例外放行,以及例外的有效期。
- Your scenario list: data categories, user groups, and the actions that must be auditable.
- Fix the questions and the verdict rules before the review meeting; do not invent standards in the room.
- Require written answers with document links; a verbal explanation counts only with meeting minutes.
- One record table: question, answer, source page, verification date, verdict tier.
- Know who may sign an exception and how long that exception stays valid.
六组问题Six question groups
| 组 | 问什么 | 可核对的证据形态 |
|---|---|---|
| 身份 | SSO 协议、SCIM、会话失效、角色分层 | 管理员文档里的角色与设置页 |
| 数据 | 训练用途、区域、保留期、可分粒度清理 | 隐私政策与数据处理条款的具体句子 |
| 日志 | 事件覆盖范围、导出方式、保留时长、接口 | 审计日志文档与 API 参考 |
| 模型 | 版本标识、下线通知期、是否可自带模型与密钥 | 模型页与发布说明 |
| 合同 | 输出归属、DPA 与子处理者、认证范围 | 条款正文与证书适用性说明 |
| 退出 | 导出格式、耗时、账号与集成停用时间 | 导出文档与终止条款 |
证据句子要抄进记录表,不是只写「有」。 举两个已复核的例子(站内既有来源,2026-11-03 复核):
- Cursor 的审计日志走 Admin API 导出。官方文档同时写明调用频率限制。
- Microsoft 365 Copilot 的交互进入统一审计日志体系。保留与 eDiscovery 归 Purview 侧管。
这两条的价值不在结论,而在形态——答案能落到接口与页面,就可复核。
| Group | What to ask | Evidence form that can be checked |
|---|---|---|
| Identity | SSO protocol, SCIM, session revocation, role tiers | Roles and settings in the administrator documentation |
| Data | Training use, region, retention, per-item cleanup | Specific sentences in the privacy policy and data terms |
| Logs | Event coverage, export path, retention, API access | Audit-log documentation and the API reference |
| Model | Version labels, deprecation notice period, bring-your-own model or key | Model pages and release notes |
| Contract | Output ownership, DPA and subprocessors, certificate scope | Terms text and the certificate statement of applicability |
| Exit | Export format, duration, timing of account and integration disablement | Export documentation and termination terms |
Copy the evidence sentence into the record table instead of writing "yes". Two already-rechecked examples (existing in-repo sources, rechecked 2026-11-03):
- Cursor exports audit logs through its Admin API. The documentation also states a call-frequency limit.
- Microsoft 365 Copilot interactions enter the unified audit log system. Retention and eDiscovery sit on the Purview side.
The value is the form, not the conclusion — the answer lands on an endpoint and a page, so anyone can recheck it.
三档判定Three verdicts
- 已证实:给出当期文档页面或条款段落,且适用档位与你签约主体一致。
- 部分成立:能力存在但范围受限,例如只对某一档、某一区域或某一界面生效。
- 未知:只给口头承诺、销售材料,或链接指向与你的场景无关的页面。
判定的关键是档位与主体。同一厂商的不同界面(消费端、团队版、API)常写在不同页面。 AWS 数据隐私常见问题页对内容用途有一句可直接引用的表述: 官方原文(英文):"We do not access or use your content for any purpose without your agreement." Anthropic 隐私政策则直接写明训练用途的处理方式, 官方原文(英文):"We disassociate Inputs and Outputs from your user ID to use them for training and improving our models." 两句都要按你实际签约的那一档复核,别把政策页当合同读。
- Verified: a current documentation page or terms paragraph is given, and the tier and contracting entity match yours.
- Partly true: the capability exists but is bounded — one tier, one region or one surface only.
- Unknown: only verbal promises, sales material, or a link to a page unrelated to your scenario.
Tier and entity are where verdicts fail. The same vendor often documents consumer, team and API surfaces on different pages. The AWS data-privacy FAQ offers one quotable sentence on content use: "We do not access or use your content for any purpose without your agreement." The Anthropic privacy policy states its training practice directly: "We disassociate Inputs and Outputs from your user ID to use them for training and improving our models." Recheck both against the tier you actually sign for; a policy page is not a contract.
审问卷步骤Six steps
- 发问:按六组发出,要求书面回答与链接,注明回复期限。
- 逐条回源:打开链接确认页面存在、日期不旧、主体与档位对得上。
- 判档:按三档判定,未证实的写清「差哪一份材料」。
- 追问:把未知项集中成一轮追问,别在多条邮件里散着问。
- 落附录:判定为「部分成立」且你仍能接受的,写进合同附录并设复核时间。
- 定演练:签约前用试用账号做一次核对——导出审计日志、改一次策略、走一次停用。
第 6 步能抓出「文档有但界面没有」的差距。 若对方提到风险管理做法,可对照自愿框架的结构看它覆盖了哪些环节 (NIST AI RMF 官方页说明其供组织自愿使用,不规定实现方式)。
- Send: issue the six groups, require written answers with links, and state the reply deadline.
- Trace each line: open the link, confirm the page exists, is not stale, and matches your tier and entity.
- Assign a verdict: for anything unverified, write which document is still missing.
- Ask again: batch unknowns into one follow-up round instead of scattering them across threads.
- Annex it: lines judged partly true but acceptable go into the contract annex with a review date.
- Drill it: before signing, use a trial account to export audit logs, change one policy, and revoke one account.
Step 6 catches "documented but not in the console". When the vendor cites risk-management practice, compare it against the structure of a voluntary framework — the NIST AI RMF page describes it as intended for voluntary use and does not prescribe an implementation.
贯穿案例:一条「支持 SSO」的回答Worked example: one "we support SSO" answer
情境为示例,回复内容与判定过程是虚构假设,不是任何厂商的真实答复。
- 输入:问「支持哪些 SSO 协议与自动开通」,答「支持主流企业单点登录」。
- 处理:回源三步——要求指明协议(SAML 还是 OIDC)、是否有 SCIM 开通与停用、 管理员角色分层写在哪个页面、该能力属于哪一档;对方补了一个链接。
- 结果判断(示例):链接页面存在,但写的是团队版功能,而你要签企业版; 且页面未提及离职停用的生效时限上限。判定为「部分成立 + 一项未知」, 不能记成「已证实」,因为档位与你的场景不一致。
- 失败后下一步: 追问两个具体问题:企业版是否包含同一开关、停用账号到会话失效的上限时长; 在答复前,把这条从对比表移到「未知」列,评分不计入; 若商务催签,把两条承诺写成合同附录并约定上线后 30 天内用试用账号演练验证(示例期限)。
判据一句话:答案能不能变成一次可执行的核对动作。 变成不了,它就还只是宣传口径。
The scenario, the reply and the verdict process are illustrative invented assumptions, not an actual answer from any vendor.
- Input: asked "which SSO protocols and provisioning methods", the reply is "mainstream enterprise single sign-on".
- Processing: three back-to-source steps — name the protocol (SAML or OIDC), whether SCIM handles provisioning and deprovisioning, which page documents the admin role tiers, and which tier the capability belongs to. The vendor then supplies a link.
- Judging the result (example): the page exists but documents the Team tier, while you are signing Enterprise; and it never states the maximum delay before a departed employee's session dies. Verdict: partly true plus one unknown. It cannot be recorded as verified because the tier does not match your scenario.
- What to do after a failure: Ask two concrete questions: does Enterprise include the same switch, and what is the upper bound from disablement to session death; until answered, move the line to the unknown column and exclude it from scoring; if the deal is being pushed, write both commitments into the contract annex with a 30-day post-launch drill on a trial account (example deadline).
One test for the answer: can it become a check you are able to execute. If not, it is still marketing language.
验收Acceptance
- [ ] 每个已证实项都有当期页面链接、核验日期与适用档位
- [ ] 记录表里未知、部分成立、已证实三类数量分开统计
- [ ] 至少一组问题落到了可演练动作(导出日志或改策略)
- [ ] 例外项写进合同附录,含复核时间与责任人
- [ ] 销售材料与文档的表述差异被明确列出
- [ ] 退出路径的每一项都有格式与耗时说明,而不是「支持导出」
- [ ] Every verified line has a current link, verification date and applicable tier
- [ ] Unknown, partly true and verified counts are kept separate in the table
- [ ] At least one group resolves into a drillable action (log export or policy change)
- [ ] Exceptions sit in the contract annex with review date and owner
- [ ] Differences between sales material and documentation are listed explicitly
- [ ] Every exit item states format and duration rather than "export supported"
故障排查分支Troubleshooting branches
- 答复越来越长但仍不可判定:把问题拆成是否题,要求逐条链接。
- 链接打不开或已跳转:按未证实处理,要求提供等效页面或书面说明。
- 只给认证不给范围:认证说明流程存在,不说明能力覆盖你用的服务;要适用性与主体清单。
- 文档与试用账号不一致:以你能改的配置为准,把差异记成缺陷项而不是笔误。
- 审计接口调用受限(429)或权限不足(401 / 403):这是集成条件,要单独问额度与角色要求。
- 对方拒答某组问题:写为未知并在评审会上说明缺口,不默认放行。
- 多家答案无法比较:统一判定口径与问题编号后再比,比排名更有用(本站不排名)。
- Replies grow longer yet stay undecidable: split questions into yes/no items and demand one link each.
- Links fail or redirect: treat as unverified and request an equivalent page or a written statement.
- Certificates without scope: a certificate shows a process exists, not that it covers the service you use — ask for applicability and entity lists.
- Documentation contradicts the trial account: trust the setting you can change, and file the gap as a defect, not a typo.
- The audit endpoint rate-limits (429) or denies access (401 / 403): that is integration capacity — ask separately for limits and role requirements.
- One group is refused an answer: record it as unknown, state the gap at the review, and do not default to approval.
- Vendors cannot be compared: unify verdict rules and question numbering first; that beats a ranking (this site does not rank).
下一步Next steps
- 把未知项按「问供应商」和「自己演练」两类分开排期。
- 上线前用数据流梳理核对一次:问卷答案与图上的节点是否一致。
- 需要外部能力证据时,按读第三方安全报告的口径复核引用句。
- 续约季重跑一次判答,核验日期与页面版本一起更新。
- Split the unknowns into "ask the vendor" and "drill it ourselves", then schedule both.
- Before launch, recheck the data-flow map: do the questionnaire answers match the nodes on the diagram.
- When you need external capability evidence, apply the reading rules from the third-party safety report guide.
- Rerun the verdict process at renewal, updating verification dates and page versions together.
核验范围与未知What was verified and what is not
2026-11-06 直抓了三处官方来源:
- Anthropic 隐私政策
- AWS 合规与数据隐私常见问题页
- NIST AI RMF 页
另三条为站内既有来源,沿用 2026-11-03 的复核记录,本次未重抓。 本页未联系任何厂商,也未替厂商确认能力范围。
以下未知:
- 各厂商在你所在档位、区域与合同主体下的具体条款差异——必须按当期文档逐家核对。
- 认证证书覆盖的服务清单与有效范围——需要索取证书适用性说明,本次未核。
- 子处理者名单的更新频率与通知机制——各家做法不同,本页不概括。
On 2026-11-06 three official sources were fetched directly: the Anthropic privacy policy, the AWS compliance data-privacy FAQ and the NIST AI RMF page. Three further entries are existing in-repo sources that keep their 2026-11-03 recheck records and were not refetched today. No vendor was contacted for this page, and nothing here confirms any vendor's capability scope.
Unknowns:
- Terms differences per vendor across your tier, region and contracting entity — this must be checked company by company against current documents.
- Which services a certificate covers and until when — the statement of applicability would be needed and was not reviewed.
- How often subprocessor lists are updated and how customers are notified — practices differ and this guide does not generalise.
出处Sources
| 来源Source | 链接URL |
|---|---|
| Anthropic 官方隐私政策(2026-11-06 直抓 200)Anthropic official privacy policy (direct fetch 200 on 2026-11-06) | https://www.anthropic.com/legal/privacyhttps://www.anthropic.com/legal/privacy |
| AWS 合规与数据隐私常见问题官方页(2026-11-06 直抓 200)AWS compliance and data-privacy FAQ official page (direct fetch 200 on 2026-11-06) | https://aws.amazon.com/compliance/data-privacy-faq/https://aws.amazon.com/compliance/data-privacy-faq/ |
| NIST AI Risk Management Framework 官方页(2026-11-06 直抓 200)NIST AI Risk Management Framework official page (direct fetch 200 on 2026-11-06) | https://www.nist.gov/itl/ai-risk-management-frameworkhttps://www.nist.gov/itl/ai-risk-management-framework |
| Claude · Enterprise Administrator Guide(站内既有来源,2026-11-03 复核)Claude · Enterprise Administrator Guide (existing in-repo source, rechecked 2026-11-03) | https://claude.com/resources/tutorials/claude-enterprise-administrator-guidehttps://claude.com/resources/tutorials/claude-enterprise-administrator-guide |
| Cursor · Admin API 官方文档(审计日志导出)(站内既有来源,2026-11-03 复核)Cursor · Admin API official documentation (audit log export) (existing in-repo source, rechecked 2026-11-03) | https://cursor.com/docs/account/teams/admin-apihttps://cursor.com/docs/account/teams/admin-api |
| Microsoft Learn · Copilot 数据保护与审计架构(站内既有来源,2026-11-03 复核)Microsoft Learn · Copilot data protection and auditing architecture (existing in-repo source, rechecked 2026-11-03) | https://learn.microsoft.com/en-us/microsoft-365/copilot/architecture-data-protection-auditinghttps://learn.microsoft.com/en-us/microsoft-365/copilot/architecture-data-protection-auditing |
资料快照日期:2026-11-06;单项复核范围与日期见对应正文或来源记录。产品功能与条款可能变化,使用前请核对原始来源。Source snapshot: 2026-11-06; item-specific rechecks and their scope are recorded in the text or source notes. Features and terms may change; check the original sources before use.