DSpace Repository

An Evaluation of Metrics Used by the Performance-Based Research Fund Process in New Zealand

Show simple item record

dc.contributor.author Buckle, Robert A
dc.contributor.author Creedy, John
dc.date.accessioned 2022-07-12T02:26:58Z
dc.date.accessioned 2019-04-01T01:49:11Z
dc.date.available 2022-07-12T02:26:58Z
dc.date.available 2019-04-01T01:49:11Z
dc.date.copyright 2017
dc.date.issued 2017
dc.identifier.uri https://ir.wgtn.ac.nz/handle/123456789/20928
dc.description.abstract The New Zealand Performance-based Research Fund (PBRF) applies a unique set of metrics to assess researchers and rank disciplines and universities. The process involves giving a ‘raw score’ to individual researchers and then assigning them to one of four Quality Evaluation Categories (QECs), used to derive Average Quality Scores (AQS). This paper evaluates the properties of these metrics and argues that QEC thresholds influence the final distribution of assessments. The paper also demonstrates that the derivation of AQSs depends on the weights assigned to each QEC and the distribution of portfolios. The method used to determine the raw scores also has an independent effect on the distribution of scores. The number of researchers included in evaluations also influences the rankings. The paper compares how research rankings of New Zealand universities would vary if alternative summary measures, based on the raw scores rather than QECs, were used to evaluate peformance. en_NZ
dc.format pdf en_NZ
dc.language.iso en_NZ
dc.publisher Te Herenga Waka—Victoria University of Wellington en_NZ
dc.relation.ispartofseries Working Papers in Public Finance ; 16/2017 en_NZ
dc.subject Research quality en_NZ
dc.subject Peer review en_NZ
dc.subject PBRF en_NZ
dc.subject New Zealand universities en_NZ
dc.title An Evaluation of Metrics Used by the Performance-Based Research Fund Process in New Zealand en_NZ
dc.type Text en_NZ
vuwschema.contributor.unit School of Accounting and Commercial Law en_NZ
vuwschema.subject.anzsrcfor 140204 Economics of Education en_NZ
vuwschema.type.vuw Working or Occasional Paper en_NZ
vuwschema.subject.anzsrcforV2 380104 Economics of education en_NZ
dc.rights.rightsholder www.victoria.ac.nz/sacl/about/cpf en_NZ

Files in this item

This item appears in the following Collection(s)

Show simple item record

Search DSpace


My Account