Main content
Determining the number of raters for reliable mean ratings
Date created: 2018-02-17 04:58 PM | Last Updated: 2018-08-11 07:16 PM
Identifiers: DOI 10.17605/OSF.IO/X7FUS | ARK c7605/osf.io/x7fus
Category: Project
Description: Script to calculate Cronbach's alphas and correlations with canonical mean ratings for sub-samples with different rater Ns.
How many raters you need to sample to get reliable stimulus ratings will obviously depend on the raters, stimuli and what they’re being rated for. For example, if there is a lot of inter-rater variation or very little inter-stimulus variation, you will need more raters to generate mean ratings with any reliability.
If you have a large set of ratings of a type of stimulus, population of rater, and …
Files
Files can now be accessed and managed under the Files tab.
Citation
Recent Activity
Unable to retrieve logs at this time. Please refresh the page or contact support@osf.io if the problem persists.
Start managing your projects on the OSF today.
Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.