Opening the Black-Box of Peer Review: An Agent-Based Model of Scientist Behaviour

Authored by Flaminio Squazzoni, Claudio Gandelli

Date Published: 2013-03

Sponsors: No sponsors listed

Platforms: NetLogo

Model Documentation: Other Narrative Mathematical description

Model Code URLs: https://www.comses.net/codebases/3145/releases/1.1.0/

Abstract

This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused on the importance of reciprocity motives in ensuring cooperation between all involved parties. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios in which we tested different interaction conditions and author and referee behaviour. We found that reciprocity cannot always have per se a positive effect on the quality of peer review, as it may tend to increase evaluation bias. It can have a positive effect only when reciprocity motives are inspired by disinterested standards of fairness.

Tags

Fairness Reciprocity Referee Behaviour Referees peer review