# Abstract #### Specific Application A comprehensive content validation of the REST (Research Engagement Survey Tool) that examines the level of non-academic stakeholder engagement among health research partners. [The survey details are located here.][1] #### Sources for This Method Goodman, M. S., N. Ackermann, D. J. Bowen, Members of the Delphi Panel, and V. L. S. Thompson. “Reaching Consensus on Principles of Stakeholder Engagement in Research.” *Progress in Community Health Partnerships: Research, Education, and Action* 14, no. 1 (2020): 117–27. [https://doi.org/10.1353/cpr.2020.0014](https://doi.org/10.1353/cpr.2020.0014). Goodman, Melody S., Nicole Ackermann, Kristyn A. Pierce, Deborah J. Bowen, and Vetta Sanders Thompson. “Development and Validation of a Brief Version of the Research Engagement Survey Tool.” *International Journal of Environmental Research and Public Health* 18, no. 19 (September 23, 2021): 10020. [https://doi.org/10.3390/ijerph181910020](https://doi.org/10.3390/ijerph181910020). Goodman, M. S., N. Ackermann, D. J. Bowen, and V. L. S. Thompson. “Content Validation of a Quantitative Stakeholder Engagement Measure.” *Journal of Community Psychology* 47, no. 8 (2019): 1937–51. [https://doi.org/10.1002/jcop.22239](https://doi.org/10.1002/jcop.22239). Thompson, V. L. S., N. Leahy, N. Ackermann, D. J. Bowen, and M. S. Goodman. “Community Partners’ Responses to Items Assessing Stakeholder Engagement: Cognitive Response Testing in Measure Development.” PLoS ONE 15, no. 11 (2020): e0241839. [https://doi.org/10.1371/journal.pone.0241839](https://doi.org/10.1371/journal.pone.0241839). #### Instrument Origins An original version of the REST was developed and used in 2013. The original survey tool contained 48 items on community engagement pertaining to 11 engagement principles (EP). Each EP was measured on 3-5 items assessing both quantity and quality through 5-point Likert scale response options. In 2017 to 2018, a five-round modified Delphi process was used to reach consensus on the items used in the measure of community engagement in research, resulting in a final comprehensive version of the tool containing 32 items addressing 8 principles. Through further validation in a mixed-methods study using triangulation analysis of a Delphi process, cognitive interviews, and longitudinal web surveys, the research team developed and validated a short (condensed) version of the REST that comprises only 9 items addressing 8 EPs. #### Participant Selection Virtual and in-person recruitment throughout the study via email, attending conferences, local health fairs, and community meetings, and posting flyers. #### Administration Modified Delphi process (web surveys and in-person meetings), longitudinal web surveys, cognitive interviews (in person, using digital tablets). #### Analysis of Survey Technical Characteristics Content validation via modified Delphi method; mixed-methods triangulation analysis (data, investigator, methodological), factor analysis, Cronbach’s alpha, Spearman’s correlation. #### Complementary Methods In addition to the modified Delphi process, the research team integrated different approaches to engagement (e.g., community-based participatory research, patient-centered outcomes research) to determine key EPs across approaches. #### Guidance for Using, Adapting, or Modifying This Protocol Researcher teams can use the REST with appropriate citations. #### Author Contact If information is not available on the REST website, you can contact Melody Goodman (PI) at [melody.goodman@nyu.edu](mailto:melody.goodman@nyu.edu) for more information. #### Funding This study is supported through a [Patient Centered Outcomes Research Institute (PCORI) Award (ME-1511-33027)](https://www.pcori.org/research-results/2016/creating-survey-community-engagement-research). All statements in this report, including its findings and conclusions, are solely the authors’ and do not necessarily represent the views of PCORI, its Board of Governors, or its Methodology Committee. [1]: https://osf.io/hj395/