首页 / Skills / 研究与学习 / AI 输出核查 Doublecheck
研究与学习

AI 输出核查 Doublecheck

awesome-copilot communityMITSkill 语言: 英文
协议已核对不含脚本依赖外部服务中风险
演示真实运行记录 · claude-sonnet-5-5 · 2026年10月
Using the doublecheck skill in one-shot mode, verify this fictional AI-written paragraph: "Python was created by Guido van Rossum and first released in 1991. According to the 2019 Henderson v. Alder Systems decision of the 9th Circuit, open-source maintainers are personally liable for downstream security flaws. A 2023 survey found that 87.4% of enterprises have fully migrated to Python 3. The GPL requires derivative works to be distributed under the same license."
Skill: doublecheck
Read: assets/verification-report-template.md

Verification Report

Heads up: I couldn't find support for two claims, and one of them contradicts well-established law. The Henderson v. Alder Systems citation, its holding, and the "87.4%" statistic should not be relied on without a primary source.

Limits of this run: I have no web search tool in this session, so Layer 2 was not run live. Ratings come from my own knowledge plus the adversarial review. The links below are where to check, and I haven't fetched them. Because of that, I rated nothing VERIFIED.

Summary

Text verified: a four-sentence paragraph on Python, a court decision, a migration survey, and the GPL
Claims extracted: 6

Rating Count
VERIFIED 0
PLAUSIBLE 3
UNVERIFIED 0
DISPUTED 1
FABRICATION RISK 2

Items requiring attention: 3


Flagged Items (Review These First)

C3 – "Henderson v. Alder Systems" (9th Cir. 2019)

  • Claim: "According to the 2019 Henderson v. Alder Systems decision of the 9th Circuit…"
  • Rating: FABRICATION RISK
  • Finding: I don't recall any such case. It has the shape of a fabricated citation: a plausible party name, a court, and a year, with no reporter cite or docket number. I haven't searched a legal database to confirm it doesn't exist.
  • Source: Search it yourself at https://www.courtlistener.com/ and https://scholar.google.com/ (case law), and at the 9th Circuit opinions page, https://www.ca9.uscourts.gov/opinions/
  • Recommendation: Treat it as nonexistent until you find it in Westlaw, Lexis, or CourtListener. Don't cite it.

C4 – Maintainers "personally liable for downstream security flaws"

  • Claim: Open-source maintainers are personally liable for downstream security flaws.
  • Rating: DISPUTED (also FABRICATION RISK, since it depends on C3)
  • Finding: This contradicts the general legal picture. Open-source licenses such as MIT, Apache-2.0, and GPL disclaim warranties and liability. I know of no US appellate rule imposing blanket personal liability on maintainers. The EU Cyber Resilience Act debate is about this question, and the final text deliberately limits obligations for non-commercial open-source contributors. The claim is also a sweeping overgeneralization, since liability would depend on jurisdiction, facts, and commercial involvement.
  • Source: https://www.gnu.org/licenses/gpl-3.0.html (sections 15–16, disclaimer of warranty and limitation of liability); https://opensource.org/license/mit; and for the EU, https://digital-strategy.ec.europa.eu/en/policies/cyber-resilience-act
  • Recommendation: Remove it, or replace it with a sourced, jurisdiction-specific statement from a lawyer.

C5 – "87.4% of enterprises have fully migrated to Python 3"

  • Claim: A 2023 survey found that 87.4% of enterprises have fully migrated to Python 3.
  • Rating: FABRICATION RISK
  • Finding: The survey is unnamed, and the figure is precise and unsourced. "Fully migrated" is also a strong and hard-to-measure claim. Python 2 reached end of life on 1 January 2020. Python Developers Survey results (JetBrains and PSF) do track Python 3 usage, but I'm not aware of this specific number.
  • Source: https://www.python.org/doc/sunset-python-2/ (end of life); https://lp.jetbrains.com/python-developers-survey-2023/ (nearest real survey)
  • Recommendation: Drop the number unless you can find the survey. If you find one, check that it says "enterprises" and "fully migrated."

All Claims

VERIFIED

None. See the limits note above.

PLAUSIBLE

C1 – Creator

C2 – First release in 1991

C6 – GPL and derivative works

  • Claim: The GPL requires derivative works to be distributed under the same license.
  • Notes: This is broadly right, but it is missing qualifiers (pattern 7). The copyleft obligation applies when you convey or distribute a covered work, not when you modify it privately. GPLv2 and GPLv3 differ in detail. LGPL and linking exceptions differ again. Whether something counts as a "derivative work" (for example, through dynamic linking) is contested. Source: https://www.gnu.org/licenses/gpl-faq.html

UNVERIFIED

None.

DISPUTED

C4. See the flagged items.

FABRICATION RISK

C3 and C5. See the flagged items.


Internal Consistency

No contradictions within the text. The paragraph does mix accurate background (C1, C2, C6) with unsupported claims, which makes the unsupported ones look more credible.


What Was Not Checked

  • No live web search or legal database lookup was run, so I haven't confirmed that the case in C3 doesn't exist.
  • I haven't read the text of the GPL or the PSF survey data directly.
  • C6's "derivative work" boundary is a legal question that needs a lawyer.

Limitations

  • This tool accelerates human verification; it does not replace it.
  • Web search results may not include the most recent information or paywalled sources, and none were used here.
  • The adversarial review uses the same underlying model that may have produced the original output. It catches many issues but cannot catch all of them.
  • A claim rated VERIFIED means a supporting source was found, not that the claim is definitely correct. Sources can be wrong too.
  • Claims rated PLAUSIBLE may still be wrong. The absence of contradicting evidence is not proof of accuracy.

Real run in an isolated folder with only this skill installed. Only the Skill and Read tools were enabled, so nothing was fetched from the web and no file was written. The example is fictional. No web search was enabled, so the model says it could not run the live source checks and rated no claim as verified.

它做什么

对 AI 输出做三层核查。第一层提取断言(事实、统计、引用、实体、因果、时间)并检查内部一致性。第二层通过网页搜索找出支持或反驳的来源,并给你链接。第三层对照幻觉模式清单做对抗式审查,比如编造的引用、没有来源的精确数字、看似合理却张冠李戴的关联、缺失的限定条件。每条断言会被评为 VERIFIED、PLAUSIBLE、UNVERIFIED、DISPUTED 或 FABRICATION RISK。

工作方式

  1. 一次性模式下,你提供文本或指向之前的输出,得到完整报告。
  2. 持续模式下,它会在整段对话里保持开启,在实质性回答后附上简短的核查部分,发现可疑断言或涉及法律、监管内容时自动升级为完整报告。
  3. 你随时可以说一声把它关掉。

适合什么场景

在依赖摘要、研究笔记以及引用案例、统计数据或标准的草稿之前先做核查。

说明与风险

纯指令文件:没有脚本,不写文件。第二层需要你的代理带有网页搜索工具;文本里的断言会成为搜索关键词,所以不要核查机密文本。没有联网能力时,Skill 会说明没能做实时检查。这个 Skill 的目标是给你来源,而不是下结论:VERIFIED 只表示找到了支持的来源,对抗式审查用的也是同类模型,它不能替代律师、医生或其他专业人士。持续模式会一直开着,直到你让它关闭。