Back to the study
Interactive dataset
Every statement from our AI code wiki fact-check
All 450 statements we checked in AI-written code wikis, with each judge's verdict and the code that decides it. Filter by tool, project and verdict.
Read the studyDownload CSVFull dataset with seed and scripts (zip)
- Statements checked
- 450
- Wrong
- 25/450
- Angada wrong
- 1/200
- DeepWiki wrong
- 22/200
- cubic wrong
- 2/50
Showing 450 of 450 ยท 25 wrong
Group by
- Contradicted
- Unsupported
- Supported
A field of 450 dots, one per statement, grouped by tool. Wrong statements sit first in each group. The table below lists the same statements.
Each dot is one statement. Point at a dot to read it, and click it to see the verdicts and the code.
Every statement
| Statement | Code | ||||
|---|---|---|---|---|---|
| Contradicted | DeepWiki | React | Names | packages/react-refresh/src/ReactFreshRuntime.js:70-74,510-522 | |
| Contradicted | DeepWiki | click | Diagram | src/click/types.py:829-852 | |
| Contradicted | DeepWiki | React | Diagram | scripts/rollup/validate/index.js:60-66 | |
| Contradicted | DeepWiki | React | Behaviour | scripts/rollup/build.js:434-444 | |
| Contradicted | DeepWiki | Cobra | Diagram | command.go:919,959@6dec1ae; command.go:1117-1121,1147@6dec1ae | |
| Contradicted | DeepWiki | ripgrep | Names | crates/core/flags/defs.rs:3434-3450 | |
| Contradicted | DeepWiki | ripgrep | Behaviour | crates/ignore/Cargo.toml:21-39 | |
| Contradicted | cubic | React | Behaviour | compiler/packages/babel-plugin-react-compiler/src/ReactiveScopes/InferReactiveScopeVariables.ts:42-45,107-110 | |
| Contradicted | Angada | React | Diagram | packages/react-devtools-extensions/src/main/index.js:101-111,667-676 | |
| Contradicted | DeepWiki | React | Names | packages/react-refresh/src/ReactFreshBabelPlugin.js:26,594@b618bbb; packages/react-refresh/src/ReactFreshRuntime.js:612,630-645@b618bbb | |
| Contradicted | cubic | React | Diagram | compiler/packages/babel-plugin-react-compiler/src/HIR/HIR.ts:77 | |
| Contradicted | DeepWiki | ripgrep | Overview | README.md:73-76 | |
| Contradicted | DeepWiki | Cobra | Diagram | command.go:919,959@6dec1ae; command.go:1117-1121@6dec1ae | |
| Unsupported | DeepWiki | ripgrep | Diagram | crates/searcher/src/searcher/core.rs:121,131,148,488 | |
| Unsupported | DeepWiki | click | Diagram | pyproject.toml:140-207 | |
| Unsupported | DeepWiki | click | Structure | pyproject.toml:34-40 | |
| Unsupported | DeepWiki | Cobra | Behaviour | .github/workflows/test.yml:83-88 | |
| Unsupported | DeepWiki | ripgrep | Diagram | crates/globset/Cargo.toml:22-37 | |
| Unsupported | DeepWiki | click | Diagram | pyproject.toml:28-58 | |
| Unsupported | DeepWiki | click | Diagram | pyproject.toml:54-58 |
Page 1 of 23