Back to the study

Interactive dataset

Every statement from our AI code wiki fact-check

All 450 statements we checked in AI-written code wikis, with each judge's verdict and the code that decides it. Filter by tool, project and verdict.

Read the studyDownload CSVFull dataset with seed and scripts (zip)

Statements checked
450
Wrong
25/450
Angada wrong
1/200
DeepWiki wrong
22/200
cubic wrong
2/50

Showing 450 of 450 ยท 25 wrong

Group by
  • Contradicted
  • Unsupported
  • Supported

A field of 450 dots, one per statement, grouped by tool. Wrong statements sit first in each group. The table below lists the same statements.

Each dot is one statement. Point at a dot to read it, and click it to see the verdicts and the code.

Every statement

StatementCode
ContradictedDeepWikiReactNamespackages/react-refresh/src/ReactFreshRuntime.js:70-74,510-522
ContradictedDeepWikiclickDiagramsrc/click/types.py:829-852
ContradictedDeepWikiReactDiagramscripts/rollup/validate/index.js:60-66
ContradictedDeepWikiReactBehaviourscripts/rollup/build.js:434-444
ContradictedDeepWikiCobraDiagramcommand.go:919,959@6dec1ae; command.go:1117-1121,1147@6dec1ae
ContradictedDeepWikiripgrepNamescrates/core/flags/defs.rs:3434-3450
ContradictedDeepWikiripgrepBehaviourcrates/ignore/Cargo.toml:21-39
ContradictedcubicReactBehaviourcompiler/packages/babel-plugin-react-compiler/src/ReactiveScopes/InferReactiveScopeVariables.ts:42-45,107-110
ContradictedAngadaReactDiagrampackages/react-devtools-extensions/src/main/index.js:101-111,667-676
ContradictedDeepWikiReactNamespackages/react-refresh/src/ReactFreshBabelPlugin.js:26,594@b618bbb; packages/react-refresh/src/ReactFreshRuntime.js:612,630-645@b618bbb
ContradictedcubicReactDiagramcompiler/packages/babel-plugin-react-compiler/src/HIR/HIR.ts:77
ContradictedDeepWikiripgrepOverviewREADME.md:73-76
ContradictedDeepWikiCobraDiagramcommand.go:919,959@6dec1ae; command.go:1117-1121@6dec1ae
UnsupportedDeepWikiripgrepDiagramcrates/searcher/src/searcher/core.rs:121,131,148,488
UnsupportedDeepWikiclickDiagrampyproject.toml:140-207
UnsupportedDeepWikiclickStructurepyproject.toml:34-40
UnsupportedDeepWikiCobraBehaviour.github/workflows/test.yml:83-88
UnsupportedDeepWikiripgrepDiagramcrates/globset/Cargo.toml:22-37
UnsupportedDeepWikiclickDiagrampyproject.toml:28-58
UnsupportedDeepWikiclickDiagrampyproject.toml:54-58
Page 1 of 23

Make the next review clearer

Bring your codebase into focus.

Start with a GitHub repository and see the evidence for yourself.