577995 research-article2015

JHI0010.1177/1460458215577995Health Informatics Journal X(X)Speirs et al.Speirs et al.

Article

Recruitment and retention in an SMS-based health education program: Lessons learned from Text2BHealthy

Health Informatics Journal 1­–8 © The Author(s) 2015 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav DOI: 10.1177/1460458215577995 jhi.sagepub.com

Katherine E Speirs

University of Illinois at Urbana-Champaign, USA

Stephanie K Grutzmacher, Ashley L Munger and Lauren A Messina University of Maryland, USA

Abstract While text messages or short messaging service programs are increasingly utilized for delivering health education, few studies have explored the unique challenges of recruiting and retaining participants in such programs. This study utilizes survey and focus group data from Text2BHealthy, a short messaging service– based nutrition and physical activity promotion program, to examine barriers to enrollment and facilitators of retention among parents of elementary school students. Results show that participants were hard to reach with recruitment materials, had difficulty with self-enrollment, and were apprehensive about program costs. However, 89–90 percent of participants were retained. Results suggest that providing manual enrollment options, alternative program delivery methods (e.g. email messages), and opportunities to reenroll may facilitate participation in short messaging service–based health education and promotion programs.

Keywords mobile health, nutrition education, recruitment, retention, text messages

Introduction There is growing evidence that text messaging or short messaging service (SMS) is a powerful tool for delivering health education. Using SMS for program delivery has several benefits. SMS has the potential for wide reach: 85 percent of Americans own a cell phone, 80 percent of cell

Corresponding author: Katherine E Speirs, Department of Human & Community Development, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA. Email: [email protected]

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

2

Health Informatics Journal 

phone owners send and receive text messages, and SMS is used by traditionally underserved and hard-to-access populations, such as low-income and minority individuals.1 SMS is relatively inexpensive, easily sent to large audiences and tailored to individual people, and perceived as personal and informal, which may increase participant engagement.2 Data about message content, when messages were sent, as well as message receipt and response can be recorded automatically for later analysis. SMS is also well-suited for delivering regular reminders, which are associated with behavior change.3 Although SMS has been used for health education and promotion since only 2004,4 programs that include a text message component have already been shown to effectively modify a range of health behaviors, such as smoking cessation,5,6 safe sex practices,7 weight loss,8,9 improved dietary habits,10 physical activity,11 and diabetes management.12 SMS has also been successfully used as appointment reminders,13 to encourage participant retention,14 for self-monitoring health behaviors,15 to collect outcome data,16 and to facilitate peer support for disease management.17 SMS is an acceptable and effective means of program delivery for a range of populations, including lowincome families,18 parents,19 and African American women.20 For an SMS program to be successful, participants must enroll and remain in the program. In general, participants are enrolled in one of three ways: (1) participants self-enroll by texting a keyword to a phone number (usually five digits) or entering their phone numbers into an online form, (2) program staff manually enroll participants by entering their phone numbers into a message delivery system, or (3) participants are given cell phones to receive program messages. Although crucial aspects of any program, there is limited research examining recruitment and retention for SMS programs. What little research exists suggests that recruitment is challenging. Text4Baby, a national initiative to improve maternal and infant health funded by a public–private partnership, fell 550,000 participants short of their goal to enroll one million mothers by the end of 2012.21,22 Similarly, only 38 percent of the 756 people who were offered an SMS smoking cessation program enrolled and used the program for at least 4 days.23 Participants may struggle with self-enrollment in particular. In a study of Text4Baby enrollment, only 69 percent of the low-income women who attempted to self-enroll were successful.24 Text4Baby now recommends that their partners enroll women on-site where they can provide inperson assistance.24 Similarly, Aguilera and Muñoz25 found it necessary to teach some of their low-income participants to use SMS. The limited literature on recruitment to SMS programs suggests several factors associated with successful enrollment. Individuals who actively pursued an SMS program (rather than receiving an unsolicited invitation) and were contacted by phone (rather than email) were more likely to manually enroll in an SMS smoking cessation program.23 Additionally, higher levels of education, higher household income, living in a household with fewer people,24 and higher levels of health literacy26 were linked with successful Text4Baby self-enrollment. Retention may be less challenging than recruitment. A recent systematic review of type 1 diabetes interventions for children and teenagers that included a text message component found that only one of the seven programs reviewed had a retention rate below 80 percent.27 Another systematic review of 12 health behavior change interventions where SMS was the primary program delivery mode found that only three programs retained fewer than 75 percent of their participants.28 Additionally, in a study of Text4Baby retention (n = 209), 95 percent of the participants reported continuously receiving messages for at least 2 months.24 SMS programs may share some recruitment and retention challenges with programs that use more traditional means of delivering health information. However, there are unique recruitment and retention challenges associated with SMS programs. This article makes an important contribution to the literature on SMS programs and provides useful information for program planners by

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

3

Speirs et al. Table 1.  Text2BHealthy recruitment efforts. Recruitment method

Frequency

Method of enrollment promoted

Fliers sent home in child’s backpack Water bottles sent home in child’s backpack Magnets sent home in child’s backpack Jar openers sent home in child’s backpack Posters prominently displayed in the school

Year 1: Twice Year 2: Once Year 1: Once Year 2: Never Year 1: Once Year 2: Never Year 1: Once Year 2: Never Year 1: Two posters were displayed in each school Year 2: One poster was displayed in each school Year 1: At least one message per school Year 2: At least one message per school Year 1: At least one event at each school Year 2: At least two events at each school Year 1: Never Year 2: Once

Self-enrollment

Robo calls and newsletter items In-person promotion at school events Promotion and enrollment opportunity on the first page of the pre-test survey

Self-enrollment Self-enrollment Self-enrollment Self-enrollment

Self-enrollment Manual Manual

exploring the barriers to enrollment and facilitators of retention encountered during the first 2 years of Text2BHealthy, an SMS-based nutrition and physical activity promotion program for lowincome parents.

Method Program description Text2BHealthy is provided through a partnership between the Maryland Food Supplement Nutrition Education (FSNE) program and Title I elementary schools. Parents receive two to three SMS messages each week that promote behavior change and are targeted to their school. During year 1 (a pilot year from February 2012 to May 2012), six schools participated, and participants selfenrolled by sending an SMS to the program phone number or were manually enrolled. During year 2 (September 2012 to May 2013), 11 schools participated (five year 1 schools and six new schools), and the option to self-enroll online was added. An evaluation study of Text2BHealthy, including the measures described below, was approved by the appropriate institutional review board.

Recruitment efforts During year 1, parents received promotional materials explaining how to self-enroll, and FSNE educators promoted Text2BHealthy and helped parents enroll during school events (see Table 1). During year 2, parents were also able to enroll by providing their phone number on a pre-test survey. All recruitment efforts included information about potential program costs (regular SMS fees) and how to stop receiving messages. To avoid charging participants, individuals whose cell phone plans did not include unlimited SMS messages for a flat monthly rate were encouraged to receive messages via email.

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

4

Health Informatics Journal 

Table 2.  Parent demographic characteristics. Post-Test Survey (N = 140), n (%) Race/ethnicity   African American/Black  White  Hispanic  Asian  Other Income  US$59,999   Age in years, M (SD) Gender  Female  Male Text2BHealthy participation  Participant  Non-participant Program delivery method   Text messages   Email messages

Short Post-Implementation Survey and Focus Groups (N = 110), n (%)

79 (59) 26 (19) 8 (6) 12 (9) 9 (7)

60 (55) 32 (30) 10 (9) 2 (2) 4 (4)

62 (51) 26 (21) 16 (13) 18 (15) 36 (11.09)

22 (24) 25 (27) 22 (24) 24 (26) 39 (9.87)

125 (92) 11 (8)

95 (87) 14 (13)

35 (25) 105 (75)

25 (23) 85 (77)

24 (83) 5 (17)

19 (79) 5 (21)

SD: standard deviation. No demographic data were collected from Drop-Out Survey participants.

Measures Post-Test Survey.  In May of 2012, all parents with a child at a Text2BHealthy school received a Post-Test Survey (PTS) that measured program awareness, program satisfaction, enrollment barriers, cell phone and SMS usage, and program outcomes. PTSs were sent to parents and returned to the school through children’s backpacks. In all, 140 parents returned a PTS (5% response rate) (see Table 2). Short Post-Implementation Survey.  To supplement the PTS, in May and June of 2012, Short PostImplementation Surveys (SPISs) were administered to a convenience sample of parents at all six schools during end-of-the-year events. The two-page SPIS measured program awareness, program satisfaction, enrollment barriers, and cell phone and SMS usage. A total of 110 parents completed a SPIS (see Table 2). PTS and SPIS responses were not combined because parents who completed a PTS may have also completed a SPIS. Post-Implementation Focus Groups.  Four focus groups were conducted with parents at three schools in May and June of 2012. The focus groups generated detailed information about how parents learned about the program, program satisfaction, and why non-participants did not enroll in the program. All focus group participants also completed a SPIS.

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

5

Speirs et al.

Drop-Out Survey.  During both program years, participants who left the program were called to determine why they left the program, program satisfaction, and whether they wanted to reenroll. Drop-Out Survey (DOS) response rates were 52 percent in year 1 and 44 percent in year 2.

Analysis Frequencies, means, and standard deviations were calculated using SPSS version 17 (SPSS, Inc., Chicago, IL). Thematic analysis was used to analyze the qualitative data from the Post-Implementation Focus Groups (PIFGs).29

Results Enrollment rates During year 1, 206 parents enrolled in Text2BHealthy, a 14 percent participation rate. In all, 19 parents manually enrolled, and 187 self-enrolled. During year 2, 1149 parents enrolled, a 25 percent participation rate. In all, 367 parents self-enrolled by sending an SMS to the program phone number, 4 parents self-enrolled online, and 778 parents were manually enrolled.

Barriers to enrollment In all, 31 percent of PTS respondents and 51 percent of SPIS respondents who did not enroll reported that they had not heard of Text2BHealthy. In addition to program awareness, we identified three barriers to enrollment that are specific to SMS programs. Inability to enroll. In all, 26 percent of PTS respondents and 4 percent of SPIS respondents reported that they were interested in the program but did not know how to enroll. During the PIFGs, we learned that some participants did not know how to send an SMS to someone who was not already in their cell phone’s address book, which is necessary to self-enroll. Also, some parents had disabled short codes from their cell phone plan, meaning they could not send an SMS to a shortened phone number, which is necessary to self-enroll. Disabled short codes may be an especially salient barrier for programs targeting parents, as our respondents reported disabling short codes so that their children could not accidentally enroll them in an SMS program that charges a fee. Apprehension about SMS programs.  During the PIFG, we learned that some parents did not enroll because they were apprehensive about signing up for an SMS program. These parents, who saw recruitment materials but did not speak with program staff, reported worrying about how much the program would cost them, how long they would have to remain enrolled, and the exact content of the messages. Enrollment of non-parents.  During the PIFG, we learned that people who were not parents at participating elementary schools had enrolled. We anticipated that some teachers and school administrators would sign up because our promotional materials were displayed in the schools. Unexpectedly, grandparents who were not their grandchildren’s primary caregivers and parents of preschool-aged children also enrolled because they wanted to learn more about events at their grandchildren’s school or their children’s future school, respectively.

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

6

Health Informatics Journal 

Facilitators of retention We had more success with retention than recruitment; we retained 90 percent of our participants in year 1 and 89 percent in year 2. The DOS improved retention by providing an opportunity to reenroll parents who had unintentionally left the program. During the first year, only one person was reenrolled, but during the second year, 30 parents (50% of DOS participants) were reenrolled after mistakenly removing themselves from the program.

Discussion Using data from the first two years of Text2BHealthy, a nutrition education and physical activity promotion program, this study examined barriers to enrollment and facilitators of retention that are specific to SMS-based health promotion programs. We found several barriers to enrollment. Consistent with the extant literature, some parents had trouble self-enrolling in Text2BHealthy.24,26 Although 80 percent of cell phone users send and receive SMS,1 it should not be assumed that participants will know how to self-enroll, especially if the target population is likely to have low levels of education or health literacy.24,26 A concern about program costs prevented some parents from enrolling. Despite clearly stating that only regular text message fees would apply on all recruitment materials, some parents reported not enrolling because they were concerned about program costs. Others reported disabling short codes so that their children could not unintentionally enroll them in expensive SMS programs. Recruitment materials should clearly state any program costs and how and when participants can leave the program. This information should also be provided in multiple forms (e.g. on a poster, flier, and in a newsletter). Similar to other SMS programs, Text2BHealthy had a high retention rate.28 However, more research is needed to determine how participants use the information they receive and whether they understand how to leave the program. Our experience conducting the DOS suggests that program planners should contact participants who leave SMS programs to find out why they left and give them the option to reenroll.

Limitations There are some limitations to this study. Only a small proportion of parents who were offered Text2BHealthy and/or participated in the program completed a survey or participated in a focus group. These low response rates likely introduced bias. Additionally, our participants were parents of school-aged children and our findings may not generalize to other groups of SMS program participants, such as adolescents.

Implications for practice Our results suggest several ways to improve enrollment rates for SMS programs. We found that potential participants struggled with self-enrollment, specifically sending an SMS to a phone number that was not already in their address book. SMS program planners should consider using manual enrollment and in-person recruitment when possible. Additionally, assistance with self-enrollment can be provided through a help phone number or email address that is answered by program staff or a website that provides detailed instructions for enrolling. Wellfunded smaller programs may also consider giving participants cell phones and teaching them how to use them.

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

7

Speirs et al.

Offering an alternative to receiving messages via SMS, such as email messages, may also alleviate some concerns about the cost of the program. However, using another delivery mode may sacrifice some of the benefits of an SMS program (e.g. messages are seen as personal and casual and appear immediately on the phone’s screen, rather than being sent to a spam folder), but may retain other benefits (e.g. messages can be easily and inexpensively sent to multiple people). Finally, program developers who allow self-enrollment should expect that people outside of their target population will enroll. Screener questions can be used to determine whether new enrollees meet inclusion criteria. This information can be analyzed later and may provide the opportunity to develop additional programming. For instance, Text2BHealthy messages could be developed for grandparents of elementary school children. SMS-based programming has the potential to elicit behavior change by providing relevant, personalized health education to participants’ cell phones; however, as detailed in this article, there are unique recruitment and retention issues to be considered. Acknowledgements The authors would like to thank Lisa Lachenmayr, Erin Braunscheidel-Duru, and Laryessa Worthington for their work designing and implementing Text2BHealthy.

Funding Text2BHealthy was funded by the United States Department of Agriculture’s Supplemental Nutrition Assistance Program in cooperation with the Maryland Department of Human Resources and the University of Maryland.

References 1. Fox S and Duggan M. Mobile Health 2012. Pew Research Center’s Internet & American Life Project, Washington, DC, 8 November 2012. 2. Gold J, Lim M, Hellard M, et al. What’s in a message? Delivering sexual health promotion to young people in Australia via text messaging. BMC Public Health 2010; 10: 792–803. 3. Fry JP and Neff RA. Periodic prompts and reminders in health promotion and health behavior interventions: systematic review. J Med Internet Res 2009; 11: e16. 4. Fjeldsoe BS, Marshall AL and Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009; 36: 165–173. 5. Free C, Knight R, Robertson S, et al. Smoking cessation support delivered via mobile phone text messaging (txt2stop): a single-blind, randomised trial. Lancet 2011; 378: 49–55. 6. Rodgers A, Corbett T, Bramley D, et al. Do u smoke after txt? results of a randomised trial of smoking cessation using mobile phone text messaging. Tob Control 2005; 14: 255–261. 7. Lim MS, Hocking JS, Aitken CK, et al. Impact of text and email messaging on the sexual health of young people: a randomised controlled trial. J Epidemiol Community Health 2012; 66: 69–74. 8. Patrick K, Raab F, Adams MA, et al. A text message-based intervention for weight loss: randomized controlled trial. J Med Internet Res 2009; 13: 11: e1. 9. Shaw R and Bosworth H. Short message service (SMS) text messaging as an intervention medium for weight loss: a literature review. Health Informatics J 2012; 18: 235–250. 10. Haapala I, Barengo NC, Biggs S, et al. Weight loss by mobile phone: a 1-year effectiveness study. Public Health Nutr 2009; 12: 2382–2391. 11. Fjeldsoe BS, Miller YD and Marshall AL. MobileMums: a randomized controlled trial of an SMS-based physical activity intervention. Ann Behav Med 2010; 39: 101–111. 12. Hanauer DA, Wentzell K, Laffel N, et al. Computerized Automated Reminder Diabetes System (CARDS): e-mail and SMS cell phone text messaging reminders to support diabetes management. Diabetes Technol Ther 2009; 11: 99–106.

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

8

Health Informatics Journal 

13. Guy R, Hocking J, Wand H, et al. How effective are short message service reminders at increasing clinic attendance? A meta-analysis and systematic review. Health Serv Res 2012; 47: 614–632. 14. De Niet J, Timman R, Bauer S, et al. Short message service reduces dropout in childhood obesity treatment: a randomized controlled trial. Health Psychol 2012; 31: 797–805. 15. Shapiro JR, Bauer S, Hamer RM, et al. Use of text messaging for monitoring sugar-sweetened beverages, physical activity, and screen time in children: a pilot study. J Nutr Educ Behav 2008; 40: 385–391. 16. Macedo LG, Maher CG, Latimer J, et al. Feasibility of using short message service to collect pain outcomes in a low back pain clinical trial. Spine 2012; 37: 1151–1155. 17. Rotheram-Borus MJ, Tomlinson M, Gwegwe M, et al. Diabetes buddies: peer support through a mobile phone buddy system. Diabetes Educ 2012; 38: 357–365. 18. Arora S, Peters AL, Agy C, et al. A mobile health intervention for inner city patients with poorly controlled diabetes: proof-of-concept of the TExT-MED program. Diabetes Technol Ther 2012; 14: 492–496. 19. Stockwell MS, Kharbanda EO, Martinez RA, et al. Text4Health: impact of text message reminderrecalls for pediatric and adolescent immunizations. Am J Public Health 2012; 102: e15–e21. 20. Gerber BS, Stolley MR, Thompson AL, et al. Mobile phone text messaging to promote healthy behaviors and weight loss maintenance: a feasibility study. Health Informatics J 2009; 15: 17–25. 21. Chen H. Text4baby growing up, sets million mom goal. Office of Science and Technology Policy, Washington, DC, 9 November 2010,http://www.whitehouse.gov/blog/2010/11/09/text4baby-growingsets-million-mom-goal (accessed 28 June 2014). 22. Grider T. Text4baby partners with Feel Rich and R&B singer Tyrese to deliver mobile health information to new and expecting moms. National Healthy Mothers, Healthy Babies Coalition, Washington, DC, 14 November 2012, http://tinyurl.com/ombrsmc (accessed 28 June 2014). 23. Balmford J, Borland R, Benda P, et al. Factors associated with use of automated smoking cessation interventions: findings from the eQuit study. Health Educ Res 2013; 28: 288–299. 24. Gazmararian JA, Elon L, Yang B, et al. Text4baby program: an opportunity to reach underserved pregnant and postpartum women? Matern Child Health J 2014; 18: 223–232. 25. Aguilera A and Muñoz RF. Text messaging as an adjunct to CBT in low-income populations: a usability and feasibility pilot study. Prof Psychol: Res Pr 2011; 42: 472–478. 26. Gazmararian JA, Yang B, Elon L, et al. Successful enrollment in Text4Baby more likely with higher health literacy. J Health Commun 2012; 17: 303–311. 27. Herbert L, Owen V, Pascarella L, et al. Text message interventions for children and adolescents with type 1 diabetes: a systematic review. Diabetes Technol Ther 2013; 15: 362–370. 28. Cole-Lewis H and Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010; 32: 56–69. 29. Braun V and Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006; 3: 77–101.

Downloaded from jhi.sagepub.com at WESTERN OREGON UNIVERSITY on May 20, 2015

Recruitment and retention in an SMS-based health education program: Lessons learned from Text2BHealthy.

While text messages or short messaging service programs are increasingly utilized for delivering health education, few studies have explored the uniqu...
347KB Sizes 0 Downloads 6 Views