Making research evaluation more transparent: Aligning research philosophy, institutional values, and reporting

Date created: | Last Updated:


Creating DOI. Please wait...

Create DOI

Category: Project

Description: There is a growing interest in changing the culture of psychology to improve the quality of our science. At the root of this interest is concern over the reproducibility of key findings. A variety of large-scale replication attempts have revealed that a number of previously published effects cannot be reproduced, while other analyses indicate that the published literature is rife with underpowered studies and publication bias. These revelations suggest that it is time to change how psychological science is carried out and increase transparency of reporting. We argue change will be slow until institutions adopt new procedures for evaluating scholarly activity. We consider three actions that individuals and departments can take to facilitate change throughout psychological science. These three actions are the development of individualized research philosophy statements, the creation of an annotated curriculum vitae to improve the transparency of scholarly reporting, and the use of a formal evaluative system that explicitly captures behaviors that support reproducibility. Our recommendations build on proposals for open science by enabling researchers to have a voice in articulating (and contextualizing) how they would like their work to be evaluated and by providing a mechanism for more detailed and transparent reporting of scholarly activities.


This project proposes ways of improving transparency of reporting scholarship within the context of an annotated CV and encouraging researchers to augment their research statements to include their research philosophy. The proposed Annotated CV is consistent with the guidelines proposed by within the San Francisco Declaration On Research Assessment (DORA).


Loading files...



  • Making research evaluation more transparent: Aligning research philosophy, departmental values, and reporting

    Describes two steps for implementing policies to align research practices with institutional values and reporting mechanisms

    Recent Activity

    Loading logs...


Recent Activity

Loading logs...

This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.

Create an Account Learn More Hide this message