Our article is in press in Psychonomic Bulletin and Review, download the ["online first" version here][1]. This project aims to study the **validity of inferences** that are drawn using different methods of **response time data analysis**. For this goal, we asked experts in response time data analysis to apply their skills to draw inferences about a number of real data sets. In these data sets, we explicitly manipulated various properties of speeded 2-choice behavior. The study reveals how well the different properties of response time behavior are captured by the different methods of inference and to what extend conclusions from different methods of analysis converge. 17 teams of experienced response time data analysts committed to analyzing the data sets. On this osf page, you can find the data sets, the methods supplied by the different analysts and supplementary materials to the manuscript describing this joint effort. Future contributions such as reanalysis can be contributed to this project page. [1]: https://link.springer.com/article/10.3758/s13423-017-1417-2?wt_mc=Internal.Event.1.SEM.ArticleAuthorOnlineFirst