Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
**Robust overconfidence despite years of continuous feedback and accurate information about skill** Heck, Benjamin, Simons, & Chabris **All Analyses and Figures: Main Text** This public archive analysis subcomponent contains analysis, data, and documentation files that support transparency and reproducibility for the main text of the manuscript. Note. We have taken several steps to protect the identities of respondents who participated in this study. These steps included: 1) blurring all actual USCF and FIDE ratings that were obtained as part of this research to the nearest 25-point increment, and 2) removing all individual-level demographic information about sex, race/ethnicity, age, educational attainment, income, employment status, and whether a given player held a provisional rating. This means that some analyses, rerun on the publicly available datasets, will not produce the exact values reported in the manuscript and supplement. Some analyses (i.e., those run using demographic variables) will not run at all, but we include the analysis code used to generate the results we report for transparency. We have confirmed that analyses run on deidentified (i.e., blurred) data produce results similar in directionality, significance, and magnitude to results run on the original data. Information on which variables have full information, partial (blurred) information, or are removed from the public archive, is available in ListOfPublicVariables.pdf. **Analysis files** **Public_DataAnalyses_Manuscript.R** This file contains all analysis code used to generate the results reported in the main text of the manuscript. It is structured in the same order as the paper itself, producing results in the same order they are reported. It references page and line numbers that correspond to those of the conditionally accepted version of the paper, also stored in this subcomponent (ChessManuscript_MainText_PublicArchive.pdf). We recommend first collapsing all code sections (Alt+O) to help navigate a lengthy file. We also recommend searching for specific results by referencing manuscript page/line numbers (e.g., Ctrl+F “Page 23”). Analyses that operate on deidentified “blurred” variables produce values that differ slightly from those reported in the paper. Analyses that operate on removed (i.e., potentially sensitive or identifiable) variables are tagged with #DOESNT RUN. For example, Age and other participant demographics have been removed from the public datasets and so the regression analyses controlling for demographics will not run. We include the analysis code so that interested readers can see how we specified our analyses. **Public_Figures_Manuscript.R** This file contains all analysis code used to generate the figures reported in the main text of the manuscript. It reproduces Figure 1 and Figure 2 in the manuscript. These figures do not rely on deidentified or sensitive data and so do not have the same caveats as the analysis file above. **Datasets** **Public_FinalChessData_Deidentified.csv** This is the primary data file, including respondents who chose to answer about their USCF or FIDE chess ratings. It includes deidentified (i.e., blurred) variables for actual chess ratings that could potentially be used to reidentify participants. **Public_ChessDropoutData.csv** This datafile contains select measures from participants who dropped out of the study, supporting one of the robustness checks reported in the manuscript. **Documentation** **ChessManuscript_MainText_PublicArchive.pdf** This is the conditionally accepted version of the manuscript main text, with line and page numbers inserted to cross-reference with output from the analysis scripts. **CodeBook.xlsx** This is a codebook file containing a separate sheet for each datafile. It documents variable names, a description of each variable, and the response scale and variable type for each measure. **ListOfPublicVariables.pdf** This is a document describing the variables that are made publicly available, the variables that have been blurred for public release, and the variables that are not included in the public archive.
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.