nep-sog New Economics Papers
on Sociology of Economics
Issue of 2022‒07‒11
one paper chosen by
Jonas Holmström
Axventure AB

  1. The Null Result Penalty By Felix Chopra; Ingar K. Haaland; Christopher Roth; Andreas Stegmann

  1. By: Felix Chopra; Ingar K. Haaland; Christopher Roth; Andreas Stegmann
    Abstract: We examine how the evaluation of research studies in economics depends on whether a study yielded a null result. Studies with null results are perceived to be less publishable, of lower quality, less important, and less precisely estimated than studies with significant results, even when holding constant all other study features, including the precision of estimates. The null result penalty is of similar magnitude among PhD students and journal editors. The penalty is larger when experts predict a large effect and when statistical uncertainty is communicated with p-values rather than standard errors. Our findings highlight the value of pre-results review.
    Keywords: null results, publication bias, learning, information, scientific communication
    Date: 2022

This nep-sog issue is ©2022 by Jonas Holmström. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.