nep-sog New Economics Papers
on Sociology of Economics
Issue of 2022‒10‒24
three papers chosen by
Jonas Holmström
Axventure AB

  1. Do Negative Replications Affect Citations? By Tom Coupé; W. Robert Reed
  2. Similar-to-me Effects in the Grant Application Process: Applicants, Panelists, and the Likelihood of Obtaining Funds By Albert Banal-Estañol; Qianshuo Liu; Inés Macho-Stadler; David Pérez-Castrillo
  3. Economic research at central banks: Are central banks interested in the history of economic thought? By Ivo Maes

  1. By: Tom Coupé (University of Canterbury); W. Robert Reed (University of Canterbury)
    Abstract: This study examines the effect of negative replications on the citation rates of replicated studies. We study a set of 204 replicated studies in economics and compare their citation performance with an initial sample of 112,000 potential controls taken from Scopus. From this initial pool, we match each replicated study with multiple controls based on having comparable citation histories. Our main finding is that there is no evidence that studies that receive negative replications suffer a penalty in the form of fewer citations. We also find that replicated studies receive somewhat more citations than their matched control studies, though here the causal interpretation is more suspect.
    Keywords: Replications, Citations, Matching, Meta-science, Self-correcting science
    JEL: A11 A14 B41 C18
    Date: 2022–09–01
  2. By: Albert Banal-Estañol; Qianshuo Liu; Inés Macho-Stadler; David Pérez-Castrillo
    Abstract: We analyse if and how the characteristics of grant research panels affect the applicants' likelihood of obtaining funding and, especially, if particular types of panels favor particular types of applicants. We use the award decisions of the UK's Engineering and Physical Sciences Research Council (EPSRC). We show that not only applicants' but also panels' characteristics matter. Panels of higher quality, in terms of prior research performance, for instance, as well panels that include more female members or members of Mongoloid origin, are tougher than others. Our main results indicate that panel members tend to favor more (or penalise less) applicants with similar characteristics to them, as the similar-to-me hypothesis suggests. We show, for instance, that the quality of the applicants is more critical for panels of the highest quality than for panels of relatively lower quality, that basic oriented panels tend to penalise applied-oriented applicants, and that panels with less female members tend to penalise teams with more female applicants.
    Keywords: funding organization, scientific evaluation, similar-to-me, panel composition, research grants
    JEL: I23 O32
    Date: 2021–09
  3. By: Ivo Maes (: Robert Triffin Chair, University of Louvain and ICHEC Brussels Management School)
    Abstract: With central banks becoming monetary authorities, research departments have become a core element of a modern central bank. Crucial elements of a central bank research department are contributing to monetary policymaking and sustaining a dialogue with the academic community. The importance of historical research (and central banks do not really make a difference between economic history and the history of economic thought) varies a lot. The historical curiosity of influential central bankers and the commemoration of anniversaries are important factors hereby. Historical research can allow central banks to take more distance and can help to avoid a “this time is different” view.
    Keywords: : central banking, economic research, economic history, history of thought.
    JEL: E42 E58 G28 N10
    Date: 2022–09

This nep-sog issue is ©2022 by Jonas Holmström. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.