nep-sog New Economics Papers
on Sociology of Economics
Issue of 2021‒12‒13
three papers chosen by
Jonas Holmström
Axventure AB

  1. Do Negative Replications Affect Citations? By Tom Coupé; W. Robert Reed
  2. Adams and Eves: The Gender Gap in Economics Majors By Graziella Bertocchi; Luca Bonacini; Marina Murat
  3. The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community? By Heckelei, Thomas; Huettel, Silke; Odening, Martin; Rommel, Jens

  1. By: Tom Coupé (University of Canterbury); W. Robert Reed (University of Canterbury)
    Abstract: This study examines the effect of negative replications on the citation rates of replicated studies. We study a set of 204 replicated studies and compare their citation performance with an initial sample of 112,000 potential controls taken from Scopus. Approximately half of the replication studies refuted key findings from the original studies, with the remaining half either providing a confirmation or a mixed conclusion. Using matching criteria that accommodate differences in the lengths of time between publication of the original study and its replication, as well as differences in the number of citations, we match each replicated study with multiple controls based on having comparable citation histories. Our main samples consist of 74, 103, and 142 replicated studies and 7,044, 7,552, and 11,202 matched control studies, respectively. We have two main findings. First, studies that are replicated receive somewhat more citations than their matched control studies. Second, there is no evidence that studies that receive negative replications suffer a penalty in the form of fewer citations.
    Keywords: Replications, Citations, Matching, Hierarchical Linear Modelling, Quantile Regression
    JEL: A11 B41 Z00
    Date: 2021–11–01
  2. By: Graziella Bertocchi; Luca Bonacini; Marina Murat
    Abstract: We investigate the gender gap in Economics among bachelor's and master's grad- uates in Italy between 2010 and 2019. First we establish that being female exerts a negative impact on the choice to major in Economics: at the bachelor level, only 73 women graduate in Economics for every 100 men, with the mathematical con- tent of high school curricula as the key driver of the effect and a persistence of the gap at the master level. Second, within a full menu of major choices, Economics displays the largest gap, followed by STEM and then Business Economics. Third, decomposition analyses expose a unique role for the math background in driving the Economics gender gap relative to other fields. Fourth, a triple difference analysis of a high school reform shows that an increase in the math content of traditionally low math curricula caused an increase in the Economics gender gap among treated students.
    Keywords: Education Gender Gap, Economics, Higher Education, Business Economics, Major Choice, Major Switching, Mathematics, Stereotypes
    JEL: A22 I23 J16
    Date: 2021–12
  3. By: Heckelei, Thomas; Huettel, Silke; Odening, Martin; Rommel, Jens
    Abstract: A vivid debate is ongoing in the scientific community about statistical malpractice and the related publication bias. No general consensus exists on the consequences and this is reflected in heterogeneous rules defined by scientific journals on the use and reporting of statistical inference. This paper aims at discussing how the debate is perceived by the agricultural economics community and implications for our roles as researchers, contributors to the scientific publication process, and teachers. We start by summarizing the current state of the p-value debate and the replication crisis, and commonly applied statistical practices in our community. This is followed by motivation, design, results and discussion of a survey on statistical knowledge and practice among the researchers in the agricultural economics community in Austria, Germany and Switzerland. We conclude that beyond short-term measures like changing rules of reporting in publications, a cultural change regarding empirical scientific practices is needed that stretches across all our roles in the scientific process. Acceptance of scientific work should largely be based on the theoretical and methodological rigor and where the perceived relevance arises from the questions asked, the methodology employed, and the data used but not from the results generated. Revised and clear journal guidelines, the creation of resources for teaching and research, and public recognition of good practice are suggested measures to move forward.
    Keywords: Research Methods/ Statistical Methods
    Date: 2021–12–02

This nep-sog issue is ©2021 by Jonas Holmström. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.