p-hacking

How fast can a coding agent p-hack? Measured: on known-zero data, realistic searches manufacture p<.05 on 33-97% of null draws, in ~1 second each. Instrumented specification-search engine + 11 Claude Code skills for econometric designs; every search leaves a verifiable ledger and an honest p-value. Research and teaching use only.

FiveThirtyEight reader responses to a food frequency questionnaire (FFQ).

Lab notebook that prevents p-hacking: seal your plan before you see the data, then compute, verify, and prove every statistic in your browser with a SHA-256 chain of custody.

A Satirical-but-Theoretically-Grounded Treatment of the Only Technique You Will Ever Need in Machine Learning Research

An adversarial AI referee for empirical economics: finds p-hacking, cherry-picking and specification search, then re-runs the result.

Why you shouldn't peek at significance levels to decide when to stop an experiment

A curated exploration of the Human Factor in Data Science, featuring interactive notebooks on Algorithmic Fairness, Cognitive Biases, Disparate Impact, and P-Hacking.

Garden of forking paths simulator. Hunt for p<0.05 in a null dataset, then see the whole multiverse of 1920 specifications

Replication package for "p-Hacking and Publication Bias in Design-Based Causal Studies in Information Systems" (Information Systems Research, 2026). hand-coded tests from IS articles, 2000–2023, across DID, IV, RCT, RD and SC designs. doi:10.1287/isre.2024.1365

LLM agent for p-hacking & selective-reporting risk screening in academic PDFs.

Will You Spot the Leaks? A Data Science Challenge When models fly too high: A perilous journey through data leakage

Benchmark for statistically valid AI scientist systems, using audit-closed protocols, transparency logs, and sequential inference to prevent false discoveries in autonomous research agents.