Caught in the Act: Predicting Cheating in Unproctored Knowledge Assessment

Date created: | Last Updated:

: DOI | ARK

Creating DOI. Please wait...

Create DOI

Category: Project

Description: Cheating is a serious threat in unproctored ability assessment, irrespective of countermeasures taken, anticipated consequences (high vs. low stakes), and test modality (paper-pencil vs. computer-based). In the present study, we examined the power of a) questionnaire-based indicators (i.e., honesty-humility and overclaiming scales), b) test data (i.e., performance with extreme difficult items), and c) para data (i.e., reaction times, switching between browser tabs) to predict participants’ cheating behavior. To this end, 315 participants worked on a knowledge test in an unproctored online assessment and subsequently in a proctored lab assessment. We used multiple regression analysis and an extended latent change score model to assess the potential of the different indicators to predict cheating behavior. In summary, test data and para data were the best predictors of knowledge score differences between the online and lab session, while traditional questionnaire-based indicators, such as scales for honesty or overclaiming, were not predictive. We discuss the findings with respect to unproctored online testing in general and provide practical advice on the detection of cheating in online ability assessments.

Files

Loading files...

Citation

Components

  • Syntax


    Recent Activity

    Loading logs...

  • Data

    Here we provide both raw data (dat_raw.csv) and ready-to-use sum scores (dat_parcels.csv). Please see dat_raw_variable-names.txt and dat_parcels_varia...

    Recent Activity

    Loading logs...

  • Tables & Figures


    Recent Activity

    Loading logs...

Recent Activity

Loading logs...

OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.