Loading the Hagen Cumulative Science Project…

This can take a few seconds — the app has to load its full study database.

Effect size (replication |r|)

Drag the title bar to move the window; click a band to filter the whole app by that range.

Replication criterion
Total studies
Original significant
Successfully replicated
Original vs. replication effect size

Each point is one study; point size reflects the replication's statistical power. The dashed line marks a perfect replication (equal r). Click a point to open that study in the Study Detail tab. Original → replication moves every study from the dashed line to its replication effect size (the distance travelled is the shrinkage).

How does a replication count as successful?

First author's institution country as listed on the paper itself (via OpenAlex), i.e. at the time of publication.

Click a country on the map or in the list below to filter the whole app by that country (click again to remove)
Click a bar to filter the whole app by that year

Power to detect the original effect size, using each study's replication sample size (N).

Click a bar to filter the whole app by that power range

Distribution of significant original p-values (p < .05). A right-skew (many very small p's) points to real evidential value; a flat or left-skewed curve is a warning sign of p-hacking or weak effects.

Click a bar to filter the whole app by that p-value range

Citations, author metrics, team size, field and country come from OpenAlex (retrieved on 2026-09-16, not updated live).

Each bar is a topic. Studies whose titles and abstracts use similar words were grouped into topics (at least six studies each) (OpenAlex texts). A topic is named after three of its typical words, so the name is a hint, not a definition. The bar shows the share of successful and failed replications among the studies currently shown, n = number of studies.

Click a topic to filter the whole app by it (click again to remove)
Effect sizes with 95% confidence intervals

One row pair per study: original study (black) and replication (blue = successfully replicated, orange = failed to replicate). Only studies matching the filters of the All Studies tab are shown. Click a point to open that study in the Study Detail tab.

† undirected model: the CI is a magnitude only, so it can never cross zero or point the other way; the sign shown is attached afterwards (see the footnote in the All Studies tab). "CI incl. original" = the replication's 95% CI contains the original effect size.

Results table Download CSV

Click a row to open that study in the Study Detail tab.

Filters

† undirected model: the effect involves more than one comparison at once (e.g. a factor with 3+ levels, or an r2beta-based mixed model), so its CI (square-rooted eta squared / partial R2) is a magnitude only. The sign shown is added afterwards by hand, based on the comparison the study's hypothesis is actually about (e.g. "condition A > condition B"), just so it can be plotted on the same scale as the other, directed studies -- unlike those, this CI can never cross zero or point the other way.

Select a study

Effect size: original vs. replication