nep-sog New Economics Papers
on Sociology of Economics
Issue of 2018‒06‒18
one paper chosen by
Jonas Holmström
Axventure AB

  1. Replication Studies in Economics: How Many and Which Papers Are Chosen for Replication, and Why? By Frank Mueller-Langer; Benedikt Fecher; Dietmar Harhoff; Gert G. Wagner

  1. By: Frank Mueller-Langer (European Commission – JRC); Benedikt Fecher (Alexander von Humboldt Institute for Internet and Society); Dietmar Harhoff (Max Planck Institute for Innovation and Competition); Gert G. Wagner (Max Planck Institute for Human Development; DIW Berlin, German Socio Economic Panel Study (SOEP); Institute of Labor Economics (IZA))
    Abstract: We investigate how often replication studies are published in empirical economics and what types of journal articles are eventually replicated. We find that from 1974 to 2014 0.10% of publications in the Top 50 economics journals were replications. We take into account the results of replication (negating or reinforcing) and the extent of replication: narrow replication studies are typically devoted to mere replication of prior work while scientific replication studies provide a broader analysis. We find evidence that higher-impact articles and articles by authors from leading institutions are more likely to be subject to published replication studies whereas the probability of published replications is lower for articles that appeared in higher-ranked journals. Our analysis also suggests that mandatory data disclosure policies may have a positive effect on the incidence of replication.
    Keywords: Replication, economics of science, science policy, economic methodology
    JEL: A1 B4 C12 C13
    Date: 2018–04

This nep-sog issue is ©2018 by Jonas Holmström. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.