nep-sog New Economics Papers
on Sociology of Economics
Issue of 2015‒11‒01
three papers chosen by
Jonas Holmström
Axventure AB

  1. Ranking Authors and Institutions by Publications in Regional Science Journals: 2010-2014 By Dan S. Rickman; John V. Winters
  2. Are Researcher Rankings Stable Across Alternative Output Measurement Schemes in the Context of a Time Limited Research Evaluation? The New Zealand Case. By David L. Anderson; John Tressler
  3. Research Assessment in the UK and Italy: Costly and Difficult, But Probably Worth it (At Least For a While) By Aldo Geuna; Matteo Piolatto

  1. By: Dan S. Rickman (Oklahoma State University); John V. Winters (Oklahoma State University)
    Abstract: In this paper, authors and institutions are ranked based on the number of publications in ten core regional science journals during the period 2010-2014. Alternative rankings are constructed by considering only publications in the top four of the ten journals and also by adjusting for journal impact factors. Two impact factors are calculated for each regional science journal. The first is based on citations by the other nine core regional science journals, and the second by citations from all journals in the database Scopus. Discussion is included regarding the patterns and consistency of the rankings across alternative criteria. Comparisons also are made to previous regional science publication rankings of authors and institutions.
    Keywords: Regional Science, Urban Economics, Economic Geography, University Rankings
    JEL: R00
    Date: 2015–10
  2. By: David L. Anderson (Queen's University); John Tressler (University of Waikato)
    Abstract: This paper focuses on the stability of rankings of academics by research productivity in the context of short-term decision making. In particular, the growing use of national research assessment exercises (NRAE) has increased interest in identifying the contributions of individual researchers to an assessment unit’s output and ranking. Our primary finding is that despite statistical evidence of a high degree of rank stability across a number of plausible journal weighting schemes, the journal selection process is of great importance to individual researchers. This applies with particular force to academics working within a NRAE environment based on individual assessment such as New Zealand’s PBRF.
    Keywords: research measurement; journal ranking schemes; time pattern of citations
    JEL: A14 C81 I23 J24
    Date: 2015–10–23
  3. By: Aldo Geuna (Department of Economics; Statistics Cognetti De Martiis, University of Torino); Matteo Piolatto (Department of Social and Political Studies, University of Milan)
    Abstract: This paper provides a comparative analysis of the development of the UK and Italian university research funding systems with a special focus on Peer Review-Based Research Assessment (PRBRA) and its cost. Much of the debate surrounding the value of performance-based allocation systems hinges on the disadvantages versus the benefits of their implementation, and there is very little evidence on either their absolute cost or their cost relative to other allocation systems. Our objective is to fill this gap, collating the best possible estimates of the costs of alternative research funding methods to inform the ongoing policy debate. First, we compare funding in the UK and Italy during the period 2005-2012 and analyze the development of performance-based allocation in the two systems. Second, based on public reports and documents collected from universities, we discuss the public agency and university costs of RAE2008 and REF2014 and provide some estimates for VQR2012. We find that RAE2008 costs accounted for less than 1% of the total performance allocation in the related period while the VQR2012 efficiency ratio is estimated at around 2.5%. Finally, we compare the costs and efficiency ratios of PRBRA with metrics-based assessment and Research Council allocations and show that costs increase going from metrics to PRBRA to Research Council allocation.
    Keywords: Higher Education Policy, Public Funding, Research Assessment, University Research challenges, public finance, financialisation, innovation
    JEL: I2 Z18 H5
    Date: 2015–10

This nep-sog issue is ©2015 by Jonas Holmström. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.