Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
The supplemental materials available in this page include: 1) Technical recommendations for the cognitive diagnostic modelling analysis used in the determination of mastery in the assessed attributes; 2) a ROC curve illustrating the diagnostic performance of the possible test cut scores; 3) a scatterplot illustrating the relationship between the number of attributes with demonstrated mastery and the raw number-right scores, and the occurrence of "false positives" and "false negatives" in cross-sectional testing; 4) an R script to automatize the cut-scoring procedure based on cognitive diagnostic modelling which also compares the diagnostic performance of a fixed cut score and a cut score calculated using the Cohen method; 5) an example of a response dataset to be used in the R script; 6) an example of a Q-matrix file to be used in the R script; 7) the graphical output of the script, namely a) a scatterplot; b) a ROC curve and c) graphs comparing the cutscores according to the Youden's index, sensitivity, specificity, positive predictive value, negative predictive value, area under the curve, and classification accuracy (using the results from the CDM analysis as the gold standard for pass/fail); 8) an R script to run simulation studies with 90 different scenarios (250, 500, 750, 1000, 1250 or 1500 participants; 40, 80, 120, 160, or 200 items; and 4, 5 or 6 attributes) and 9) the resulting graph comparing the diagnostic performance of the proposed CDM-based cut-scoring procedure with fixed and Cohen cut scores in the 90 simulated scenarios.
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.