BEYOND PUBLICATIONS

OPEN SCIENCE AND RESEARCH ASSESSMENT REFORM

Abstract

This study maps and synthesizes, through a scoping review inspired by the PRISMA-ScR guidelines, recommendations for research assessment reform in connection with the principles and practices of Open Science. It seeks to understand how the studies reviewed articulate critiques of assessment models centered on metric-based indicators with proposals that express commitments to the openness of scientific knowledge. The search was conducted across six databases and included publications in Portuguese, Spanish, French, and English. Following the selection and eligibility stages, 68 studies were analyzed. The findings point to a convergence in the literature around the need to reconfigure research assessment systems to encompass a broader range of dimensions of research activity, including practices, outputs, and outcomes related to the opening of scientific knowledge, such as data sharing and the sharing of software and protocols, as well as scientific collaboration, open peer review, and participation in citizen science projects, among other initiatives. The synthesis of the studies yielded seven broad recommendations aimed at fostering more transparent and inclusive research assessment systems that recognize disciplinary and institutional specificities, as well as diverse trajectories and contexts. The study concludes that reconfiguring research assessment entails rethinking what should be recognized as a scientific contribution. The articulation between the Open Science and Responsible Research Assessment (RRA) agendas points to possibilities for change in research assessment systems toward more responsible and context-sensitive approaches; however, their implementation needs to take into account the disputes, tensions, and challenges posed by the increasing platformization of science.