What works for peer review and decision-making in research funding: a realist synthesis

Research Integrity and Peer Review 7 (1) (2022)
  Copy   BIBTEX

Abstract

IntroductionAllocation of research funds relies on peer review to support funding decisions, and these processes can be susceptible to biases and inefficiencies. The aim of this work was to determine which past interventions to peer review and decision-making have worked to improve research funding practices, how they worked, and for whom.MethodsRealist synthesis of peer-review publications and grey literature reporting interventions in peer review for research funding.ResultsWe analysed 96 publications and 36 website sources. Sixty publications enabled us to extract stakeholder-specific context-mechanism-outcomes configurations for 50 interventions, which formed the basis of our synthesis. Shorter applications, reviewer and applicant training, virtual funding panels, enhanced decision models, institutional submission quotas, applicant training in peer review and grant-writing reduced interrater variability, increased relevance of funded research, reduced time taken to write and review applications, promoted increased investment into innovation, and lowered cost of panels.ConclusionsReports of 50 interventions in different areas of peer review provide useful guidance on ways of solving common issues with the peer review process. Evidence of the broader impact of these interventions on the research ecosystem is still needed, and future research should aim to identify processes that consistently work to improve peer review across funders and research contexts.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,323

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

The Ups and Downs of Peer Review: Making Funding Choices for Science.Franz A. Foltz - 2000 - Bulletin of Science, Technology and Society 20 (6):427-440.
Meta-synthesis of Qualitative Research.Angela J. Dawson - 2019 - In Pranee Liamputtong (ed.), Handbook of Research Methods in Health Social Sciences. Springer Singapore. pp. 785-804.
The principles and practices of Peer review.Ronald N. Kostoff - 1997 - Science and Engineering Ethics 3 (1):19-34.
Bias in Peer Review.Carole J. Lee, Cassidy R. Sugimoto, Guo Zhang & Blaise Cronin - 2013 - Journal of the American Society for Information Science and Technology 64 (1):2-17.
Commensuration Bias in Peer Review.Carole J. Lee - 2015 - Philosophy of Science 82 (5):1272-1283,.

Analytics

Added to PP
2022-03-05

Downloads
12 (#1,090,954)

6 months
6 (#530,399)

Historical graph of downloads
How can I increase my downloads?