Loading wiki pages...

Wiki Version:
<p><strong>Lessons from a failed attempt at increasing sustained use of a mobile app providing digital feedback on water drinking</strong></p> <p><strong>Background:</strong> Drinking enough water is associated with a range of health benefits. However, many people do not meet their daily water needs. A smartphone application that delivers tailored feedback on water drinking could support people in reaching their water drinking targets. Recent literature [1] supports the potential of mobile phone apps for behavioural change. Unfortunately, evidence from practice indicates that most smartphone applications fail to engage users over time [2, 3]. Little is known about how to increase the retention rates of these apps. </p> <p><strong>Objective:</strong> The aim of the current analysis was to understand the factors associated with continued use of a behaviour change health app. We looked at the effect of age, gender, motivation, perceived self-efficacy, and expected use [4] - documentary ('how much water do I drink?'), diagnostic ('has my water drinking an effect on fatigue?'), behaviour change oriented ('I want to drink more water'), reward-oriented (comparison to others, badges, etcetera), and 'fetishized' (interest in gadgets for their novelty value) - and feedback properties - feedback valence, cooperative feedback, and competitive feedback - on app retention rates. Due to the number of users who abandoned the app, we lacked the statistical power to gauge the impact of the app on behaviour change.</p> <p><strong>Methods:</strong> 538 participants were recruited through the iOS app store. After downloading and installing the app, all participants completed a questionnaire about age, gender, motivation to record and change water drinking behaviour, perceived self-efficacy in doing so, and the appropriateness of five potential goals for app use [4]: documentary ('how much water do I drink?'), diagnostic ('has my water drinking an effect on fatigue?'), behaviour change oriented ('I want to drink more water'), reward-oriented (comparison to others, badges, etcetera), and 'fetishized' (interest in gadgets for their novelty value). Participants recorded water-drinking behaviour using the smartphone app as they saw fit, with no requirements on duration and frequency of use: participants were free to skip measuring days, or abandon the trial altogether. The trial lasted for 68 days, starting on the day the questionnaire was completed. All participants started within the first week of recruitment. Participants were randomly assigned to one of five conditions: app-as-is, app with negative feedback, app with positive feedback, app with feedback to foster competition with other users, app with feedback to foster cooperation with other app users (common goals).</p> <p><strong>Results</strong>: Of the 538 participants, 23.8% (128 participants) downloaded the app, but never used it. A further 23.6% (127 participants) only used the app once. Only 129 users (24%) made it past the first week, and none of the participants made it to the end of the 68-day trial period. All participants were highly motivated to use the app upon download (µ = 5.38, SD = 1.36 on a seven-point scale), (B=.25, SE=.08, p&lt;.01, Exp(B)=1.28, 95% CI 1.09&lt;Exp(B)&lt; 1.51) and the goal to change drinking behaviour (B=.61, SE=.30, p&lt;.05, Exp(B)=1.83, 95% CI 1.02&lt;Exp(B)&lt;3.25) to actually start using the app. Once in use, gender (women more than men, B=-3.63, SE=1.77, p&lt;.05, 95% CI -7.41&lt;B&lt; -.15), and having the concurrent ‘documentary’ goal (B=4.59, SE=1.56, p&lt;.01, 95% CI 1.52&lt;B&lt;7.67) had a positive effect on sustained use. Condition, i.e. our experimental manipulations, did not affect sustained use.</p> <p><strong>Conclusions:</strong> These findings shed light on some of the challenges associated with voluntary use of mobile apps to promote behaviour change. The user attrition rate for this app is very high; with 75% of users abandoning the app within one week, which is comparable to retention rates in other domains [2]. Furthermore, it takes a very high initial motivation to start using this app, and an even higher motivation combined with a good fit between user needs and app deliverables to keep on using it long enough for behaviour change to occur. This result also calls into question the efficacy of feedback message manipulations 'per se'. Feedback valence, and message framing for cooperation or competition did not affect sustained use. This study supports the notion of 'lived informatics', the idea that people will actively select those resources that best support the behavioural change they seek, rather than the notion of 'persuasive technology', the idea that technology is capable of driving behavioural change itself.</p> <p><strong>References</strong> 1. Zhao, J., Freeman, B., & Li, M. (2016). Can mobile phone apps influence people's health behavior change? An evidence review. Journal of medical Internet research, 18(11). doi:10.2196/jmir.5692. 2. Chen, A. (2016). New data shows losing 80% of mobile users is normal, and why the best apps do better. URL: <a href="http://andrewchen.co/new-data-shows-why-losing-80-of-your-mobile-users-is-normal-and-that-the-best-apps-do-much-better/" rel="nofollow">http://andrewchen.co/new-data-shows-why-losing-80-of-your-mobile-users-is-normal-and-that-the-best-apps-do-much-better/</a> Accessed: 2016-05-24. Archived by Webcite at <a href="http://www.webcitation.org/6hjwoLkyM" rel="nofollow">http://www.webcitation.org/6hjwoLkyM</a>. 3. Perez, S. (2015). Majority Of Mobile Apps In China Don't Retain Users For More Than A Week. URL:<a href="https://www.emarketer.com/Article/Mobile-Apps-Struggle-Retain-Most-Users-China/1013366" rel="nofollow">https://www.emarketer.com/Article/Mobile-Apps-Struggle-Retain-Most-Users-China/1013366</a>. Accessed: 2017-11-02. Archived by WebCite at <a href="http://www.webcitation.org/6ufk0t7b9" rel="nofollow">http://www.webcitation.org/6ufk0t7b9</a>. 4. Rooksby, J., Rost, M., Morrison, A., & Chalmers, M.C. (2014). Personal tracking as lived informatics. In: CHI '14 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 26-May 01, Toronto, Ontario, Canada p. 1163-1172. New York, NY: ACM. doi: 10.1145/2556288.2557039.</p> <p>Keywords: Feedback Behaviour change Motivation Mobile phone app</p>
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.