Each entry is one primary document, the passage recorded from it word for word, and every headline that cites it. Each headline is compared with the passage on 6 axes, and the comparison says which axis differs and how. It does not score anyone.
Every comparison here is produced by a published rule and is labeled as such. A comparison an editor has reviewed says so, and keeps what the rule had said beside it. The 6 axes and the words each one looks for.
32 hand-written test cases exercise rule version c2, the same code that produced every comparison on this page. Each case states in advance what the comparator should say and, where it should flag something, which axis. These are not real outlets or real quotes; they are written to cover a true difference on each axis, a fair paraphrase, a headline about an unrelated subject, a fragment too short to compare, and a reversed claim. The comparator matched the expected result on every case.
These rates describe how the rule performs on a fixed set of invented cases written to test it, not how often a person has confirmed the comparisons above are right. Every comparison on this page stays labeled "by rule" until an editor reviews it, whatever this panel says.
| Axis | Test cases | Caught correctly | Missed | Abstained instead | Fired when it should not have |
|---|---|---|---|---|---|
| Certainty | 1 | 100% | 0% | 0% | 0 |
| Figures, units and timeframes | 2 | 100% | 0% | 0% | 0 |
| Scope and qualifications | 2 | 100% | 0% | 0% | 0 |
| Attribution | 1 | 100% | 0% | 0% | 0 |
| An attempt against a result | 1 | 100% | 0% | 0% | 0 |
| Whether it happened at all | 1 | 100% | 0% | 0% | 0 |
Caught correctly: the comparator flagged the case and named the axis this set expects. Missed: the comparator flagged something else, or nothing, on a case built to have this axis differ. Abstained instead: the comparator reported no discrepancy at all rather than naming the wrong axis. Fired when it should not have: this axis was reported on a case, of any kind, where this set did not expect it, including the fair-paraphrase and unrelated-subject cases built to catch exactly that. Generated Nov 11, 2026 by re-running scripts/claims-eval.mjs; re-run it after any change to worker/src/claims.js.
Every headline below is compared with the passage on 6 axes: certainty, figures, scope, attribution, whether an attempt became a result, and whether it happened at all. Nothing here counts words.
could support biological weapons development
anthropic.com · recorded as a phrase, 2026-09-10 · Open the document · re-read 2026-09-12
The Monitor has a phrase from the source, not enough of it to place a headline against. A phrase shares little wording with anything, so calling a headline consistent or inconsistent with it would be reading too much into too little. The full passage has to be recorded first.
7 headlines cite this document and are waiting on it: CNN, Daily Caller, Interesting Engineering, Just the News, The New York Times, Tech Times, The Washington Times. Each is on file with its own link; none is described as agreeing or disagreeing with anything.
Every headline below is compared with the passage on 6 axes: certainty, figures, scope, attribution, whether an attempt became a result, and whether it happened at all. Nothing here counts words.
found the bug and wrote the first remote code execution (RCE) exploit in about two days
calif.io · recorded as a sentence, 2026-09-08 · Open the document · re-read 2026-09-12
AI Builds Zero-Click WeChat Worm in Two Days: The Attack-Defense Time Window Is Being Rewritten
WeChat worm could pwn a friend before they even answered the call
Nothing in the headline contradicts the passage, and they share little vocabulary. They are most likely about different parts of the same source, which is not a difference in the claim.
Barely more than a week
What is on file for this outlet is a fragment rather than the headline as published. Comparing a fragment would compare whichever part of the headline happened to be recorded.
Every headline below is compared with the passage on 6 axes: certainty, figures, scope, attribution, whether an attempt became a result, and whether it happened at all. Nothing here counts words.
~1200 agents sent >70,000 messages and files on an unsanctioned message board, and ~700 attacked Hugging Face
metr.org · recorded as a sentence, 2026-08-26 · Open the document · re-read 2026-09-19
more than 1,200 AI agents broke out of their testing environment and exchanged over 70,000 messages and files with each other
No listed difference was found. The rules cover certainty, figures, scope, attribution, attempt versus outcome and polarity, and are silent on everything else, including who a claim is about and whether the passage makes it at all. Silence from the rules is not a finding that the two agree, so this one needs a person.
over 1,000 AI agents
What is on file for this outlet is a fragment rather than the headline as published. Comparing a fragment would compare whichever part of the headline happened to be recorded.
Every headline below is compared with the passage on 6 axes: certainty, figures, scope, attribution, whether an attempt became a result, and whether it happened at all. Nothing here counts words.
Through the order, the Governor is directing the Government Operations Agency: to accelerate the implementation timelines for SB 813 and AB 1405, and, in consultation with the Governor's Office of Emergency Services, to convene national experts to develop recommendations for potential changes to further strengthen state law to: ... Advance the creation of a “kill switch” for frontier models, with the efficacy of the switch verified on an ongoing basis by an independent verification organization.
gov.ca.gov · recorded as a passage, 2026-09-18 · Open the document · re-read 2026-09-19
California Governor Gavin Newsom Issues A.I. Safety Executive Order
No listed difference was found. The rules cover certainty, figures, scope, attribution, attempt versus outcome and polarity, and are silent on everything else, including who a claim is about and whether the passage makes it at all. Silence from the rules is not a finding that the two agree, so this one needs a person.
Newsom is ordering California to pursue an AI 'kill switch' for frontier models
No listed difference was found. The rules cover certainty, figures, scope, attribution, attempt versus outcome and polarity, and are silent on everything else, including who a claim is about and whether the passage makes it at all. Silence from the rules is not a finding that the two agree, so this one needs a person.
California Governor Newsom signs executive order demanding “kill switch” for AI models
Gavin Newsom is pushing for an AI kill switch
No listed difference was found. The rules cover certainty, figures, scope, attribution, attempt versus outcome and polarity, and are silent on everything else, including who a claim is about and whether the passage makes it at all. Silence from the rules is not a finding that the two agree, so this one needs a person.
These are recorded but not compared yet, because the passage from the primary document has not been fetched word for word. Comparing a headline with a paraphrase would measure the paraphrase.
