Article Text

Download PDFPDF

Original research
Engagement and attrition with eHealth tools for remote monitoring in chronic arthritis: a systematic review and meta-analysis
  1. Michaël Doumen1,2,
  2. Diederik De Cock3,
  3. Caroline Van Lierde1,
  4. Albrecht Betrains4,
  5. Sofia Pazmino1,
  6. Delphine Bertrand1,
  7. René Westhovens1,2 and
  8. Patrick Verschueren1,2
  1. 1Department of Development and Regeneration, Skeletal Biology and Engineering Research Centre, Katholieke Universiteit Leuven, Leuven, Belgium
  2. 2Rheumatology, KU Leuven University Hospitals, Leuven, Belgium
  3. 3Department of Public Health, Biostatistics and Medical Informatics Research Group, Vrije Universiteit Brussel, Brussels, Belgium
  4. 4General Internal Medicine, KU Leuven University Hospitals, Leuven, Belgium
  1. Correspondence to Dr Michaël Doumen; michael.doumen{at}kuleuven.be

Abstract

Objectives Although eHealth tools are potentially useful for remote disease monitoring, barriers include concerns of low engagement and high attrition. We aimed to summarise evidence on patients’ engagement and attrition with eHealth tools for remotely monitoring disease activity/impact in chronic arthritis.

Methods A systematic literature search was conducted for original articles and abstracts published before September 2022. Eligible studies reported quantitative measures of patients’ engagement with eHealth instruments used for remote monitoring in chronic arthritis. Engagement rates were pooled using random effects meta-analysis.

Results Of 8246 references, 45 studies were included: 23 using smartphone applications, 13 evaluating wearable activity trackers, 7 using personal digital assistants, 6 including web-based platforms and 2 using short message service. Wearable-based studies mostly reported engagement as the proportion of days the tracker was worn (70% pooled across 6 studies). For other eHealth tools, engagement was mostly reported as completion rates for remote patient-reported outcomes (PROs). The pooled completion rate was 80%, although between-study heterogeneity was high (I2 93%) with significant differences between eHealth tools and frequency of PRO-collection. Engagement significantly decreased with longer study duration, but attrition varied across studies (0%–89%). Several predictors of higher engagement were reported. Data on the influence of PRO-reporting frequency were conflicting.

Conclusion Generally high patient engagement was reported with eHealth tools for remote monitoring in chronic arthritis. However, we found considerable between-study heterogeneity and a relative lack of real-world data. Future studies should use standardised measures of engagement, preferably assessed in a daily practice setting.

Trial registeration number The protocol was registered on PROSPERO (CRD42021267936).

  • arthritis
  • epidemiology
  • health services research
  • patient reported outcome measures

Data availability statement

Data are available on reasonable request.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

WHAT IS ALREADY KNOWN ON THIS TOPIC

  • eHealth tools, such as smartphone applications, wearable activity trackers and web-based platforms, are increasingly used in the management of chronic arthritis. Although these tools could provide unique opportunities to improve care, for instance through remote monitoring and by facilitating patient-initiated follow-up, concerns are often raised in relation to attrition and limited patient engagement with these tools.

WHAT THIS STUDY ADDS

  • We found generally high reported engagement rates with eHealth tools used to remotely monitor disease activity or impact in patients with chronic arthritis. However, engagement declined over time to a highly variable degree and data mostly came from strictly controlled research settings, possibly underestimating the problem of attrition.

HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

  • Although remote monitoring of chronic arthritis using eHealth tools seems a feasible approach, future eHealth-related research should aim to optimally characterise feasibility in a real-world setting.

Introduction

Chronic arthritis is an umbrella term for several inflammatory and non-inflammatory musculoskeletal conditions that rank among the most prevalent chronic diseases worldwide and represent a considerable societal burden.1 People suffering from chronic arthritis are faced with pain, stiffness, fatigue and functional decline, negatively affecting their quality of life and social participation.2 These symptoms fluctuate over time and can even persist when the disease is clinically well-controlled, often giving rise to discordance between patients’ and physicians’ views on disease activity.3 Consequently, potentially relevant information about the disease’s impact between clinic visits is insufficiently captured in routine care.4 Moreover, following shifts to targeted treatment strategies, managing chronic inflammatory arthritis increasingly requires lifelong follow-up on a regular basis.5 However, the resulting increase in demand has not been met with a corresponding expansion of the rheumatology workforce, leading to increasing referral times and rising pressure on the conventional care model.6

Possible solutions to some of these challenges could be found in the form of eHealth, defined as the use of information and communication technologies to support healthcare.7 Recent years have brought a revolution of technological innovations, including the widespread availability of internet connectivity, smartphones and wearable activity trackers, all of which could provide healthcare practitioners and researchers with opportunities to improve patient care.8 One potential strategy is to use eHealth tools like these to monitor patients with chronic arthritis remotely. Remote monitoring can be implemented in a synchronous setting, where patients and care providers remain in real-time contact through digital communication tools like telephone or video calls. Alternatively, this strategy can be approached asynchronously, which implies that the eHealth tool collects information, such as patient-reported outcomes (PROs), that is only later accessed by the care provider.9 Particularly in an asynchronous setting, eHealth tools could provide researchers or care providers with a unique window into the day-to-day variability of disease activity and its impact on patients.10 Such information has also shown potential to facilitate patient-initiated follow-up, as opposed to prescheduled clinic visits,11 ultimately contributing to reduced healthcare utilisation.12 Finally, there is an ongoing evolution in technology that allows patients to self-sample capillary blood for biochemical markers like urate or C-reactive protein, and recent studies have shown promising feasibility for such devices.13–15

However, despite their potential benefits, the implementation of eHealth tools in routine rheumatology care is associated with several challenges, including concerns about vulnerable populations, legal and organisational barriers, and respondent fatigue.16 Among these, arguably the biggest challenge of eHealth studies is missing data due to attrition and limited patient engagement, potentially biasing study results and hampering larger-scale implementation.17 Consequently, it is crucial to comprehensively describe how engagement with eHealth tools is currently measured, how reliably patients use and continue to use these tools, and which population-based or study-specific factors are associated with eHealth engagement.

The objective of this systematic review was to summarise the available evidence on patients’ engagement and attrition with eHealth tools for remote monitoring of disease activity or impact in chronic arthritis. For these purposes, this review focused on asynchronous eHealth interventions, rather than on tools intended for remote consultations.

Methods

This systematic review was conducted in accordance with the Cochrane Handbook and reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines.18

Eligibility criteria

Studies were eligible for inclusion if they were conducted in patients with chronic arthritis, defined as either rheumatoid arthritis (RA), spondyloarthritis (SpA), psoriatic arthritis, osteoarthritis (OA), gout or juvenile idiopathic arthritis (JIA). Records not reporting delineable outcome data for any of these populations were excluded. Participants of all ages were eligible. Moreover, studies were considered only if they included any eHealth instrument for asynchronous remote monitoring purposes, and additionally provided information on patients’ objectively measured engagement, adherence or compliance with the use of this eHealth instrument. Records were excluded if engagement was solely self-reported or if no information on data completeness was reported. As an eHealth tool, we considered any application of information and communication technology in the context of health or health-related fields.7

Study design

We included randomised controlled trials (RCTs), observational studies and case–control studies published in English and in peer-reviewed journals. Given the rapid evolution of this research field, we additionally included conference abstracts adhering to the eligibility criteria and updated the search a second time. To allow for maximal comparability, we did not consider purely qualitative studies.

Outcomes

The primary outcome was any quantitative assessment of patients’ engagement or adherence with the reported eHealth instrument. As secondary outcomes, we aimed to summarise the evidence on attrition, defined as a loss of participant engagement over time, and to describe demographic, disease-related or study-related factors associated with engagement or attrition.

Search strategy and study selection

We systematically searched the following databases from inception to 29 May 2021 (updated to 31 August 2022): Embase, PubMed, Cochrane Central, CINAHL, Web of Science, ClinicalTrials.gov and the International Clinical Trials Registry Platform. The search string was developed in collaboration with biomedical reference librarians of KU Leuven Libraries and was based on keywords and free-text entries combining the concepts of “chronic arthritis” AND “eHealth” (online supplemental material 1). In addition, we screened the reference lists of included reports as a backward citation search.

Duplicates were removed with Endnote V.20.1. First, all records were screened by title and abstract independently by two reviewers (CVL and MD), using Rayyan QRCI (https://www.rayyan.ai/). Finally, the full texts were screened for all remaining articles. A third reviewer (DDC) was consulted to resolve conflicts.

Data extraction

Two reviewers (CVL and MD) independently extracted data from included studies into a Microsoft Excel database. The following data were considered: general study characteristics (first author, publication year, study design and study duration); population characteristics (number of participants, age, sex and diagnosis); eHealth-related characteristics (type of eHealth tool, outcomes collected by the tool, requested frequency of outcome collection and incentives for use of the tool); and engagement or attrition-related characteristics (definition and quantitative outcome).

Data synthesis

Meta-analysis was performed for engagement outcomes available in ≥3 studies. As we expected high between-study heterogeneity, a random-effects model (restricted maximum likelihood method with Hartung-Knapp adjustment) was applied to estimate the pooled effect across studies with similar engagement outcomes. An inverse variance method was used for weighting each study in the meta-analysis. The proportion of variability in effect estimates due to between-study heterogeneity was summarised using τ2 and I2. Logit-transformed proportions were used for variance stabilisation. If ≥10 studies were available and relevant subgroups were sufficiently large, heterogeneity among studies with similar engagement outcomes was further explored by subgroup analyses for the type of eHealth tool, the outcome collection frequency, diagnosis and study design (RCT or observational/case–control study). In addition, the impact of study duration was explored with univariable meta-regression. Finally, sensitivity analyses were performed by excluding abstracts. Meta-analysis was conducted with R (V.2021.09.1), using the meta package.

Risk of bias assessment

Risk of bias was assessed for all included studies for which a full text was available, using the Newcastle-Ottawa scale for cohort studies and the PEDro scale for RCTs.19 20

Results

Search results

The systematic search resulted in 10 526 potentially relevant records (figure 1). After deduplication, 5438 articles were screened by title and abstract, 186 of which were eligible for full-text screening. Among these, 45 articles were eventually included in the final review, with publication dates ranging from 2008 to 2022. No additional records meeting the inclusion criteria were identified through backward citation searching.

Figure 1

PRISMA flow chart of systematic review. ICTRP, International Clinical Trials Registry Platform.

Study characteristics and risk of bias

A total of 14 341 patients were included across the 45 eligible studies (table 1). Of these 45 studies, 32 were observational studies, 8 were RCTs or post hoc analyses thereof, 2 were case–control studies and 3 were conference abstracts. Sixteen (36%) studies were conducted in an RA population, 13 (29%) in an OA population, 9 (20%) in JIA, 2 (4%) in a population with gout and 3 (7%) in patients with ankylosing spondylitis (AS) or axial SpA, while 4 (9%) studies included mixed populations. The reported mean age of included participants ranged from <18 years in the JIA studies to over 60 years in several OA-focused studies. Most studies included a predominantly female patient population. Only six articles included mostly men with either gout,21 22 JIA,23 SpA24 25 or OA.26

Table 1

Characteristics and engagement data for included eHealth studies

Study durations varied considerably across the included studies, ranging from 7 days to up to 1 year. Moreover, a large degree of heterogeneity was seen in the studies’ approach to patient recruitment. Although most studies recruited participants during a physical clinic visit, 13 studies (29%) approached eligible participants through fully digital channels such as email, social media, short message service (SMS) messages or online surveys.

Finally, risk of bias was assessed for all 42 studies with full-text availability (online supplemental material 2). Overall, included studies had a moderate risk of bias when considering the outcome of participant engagement. The main source of bias was selection bias, with most studies including only participants who had both access to smartphones or computers and sufficient experience using them. Furthermore, some studies recruited participants based on a self-reported physician’s diagnosis of arthritis,27–33 particularly when a fully digital recruitment approach was taken, and most studies lacked control groups.

Characteristics of reported eHealth tools

In all, 23 studies (51%) evaluated the use of a smartphone application, while 13 studies (29%) reported on the use of wearable activity trackers, 7 (16%) provided participants with a personal digital assistant (PDA) e-diary, 6 (13%) used a web-based platform and 2 (4%) were based on an SMS messaging system (table 1). Generally, in studies evaluating activity trackers, participant data such as step counts and physical activity were collected continuously while wearing the tracker. By contrast, other eHealth tools primarily collected PROs, usually in the form of questionnaires sent to participants via the system. However, these eHealth systems differed significantly in the specific type of outcome measures collected, in the frequency of requested PRO-reporting, and in the incentives provided to participants to adhere to this reporting frequency. For instance, 7 studies (16%) asked participants to complete PROs three times each day, whereas once-a-day reporting was requested in 19 studies (42%), weekly reporting in 14 (31%), and monthly reporting in 6 (13%). Some systems allowed data entry at any time, for instance in case of a flare, while one study asked participants to choose their preferred reporting frequency at baseline.34 Finally, incentives to participants for providing complete data ranged from financial compensation and regular compliance checks in some studies to no incentives whatsoever in others.

Participant engagement with eHealth tools

Engagement was defined in several ways across the included studies (table 1). Some studies defined engagement categorically or based on the proportion of patients providing data above a certain threshold of completeness.

However, where applicable, most articles reported a completion rate for the collected PRO data, defined as the proportion of all requested data entries in the study that were effectively completed by participants. Meta-analysis of the 34 studies that reported completion rates (figure 2) resulted in a pooled global completion rate of 80% (95% CI 73% to 85%) with high between-study heterogeneity (τ2 0.78; I2 93%).

Figure 2

Forest plot of pooled completion rates for patient-reported outcomes collected with eHealth tools.

Subgroup analysis (figure 3) showed significant differences between eHealth tools (p for interaction<0.01), with a pooled completion rate of 73% (95% CI 64% to 80%) in studies using smartphone applications, 91% (95% CI 81% to 96%) in studies using PDA e-diaries, 81% (95% CI 54% to 94%) in studies evaluating a web-based platform and 71% (95% CI 29% to 94%) in studies using an SMS messaging system. In addition, two studies involved PRO registration via a smartwatch app and reported a pooled completion rate of 79%.

Figure 3

Forest plot of pooled completion rates according to eHealth tool. PDA, personal digital assistant; SMS, short message service; WAT, wearable activity tracker.

PRO completion rates also differed according to the requested frequency of data collection (p for interaction=0.02), with a pooled completion rate of 86% (95% CI 77% to 92%) for daily, 70% (95% CI 57% to 81%) for weekly and 71% (95% CI 50% to 86%) for monthly intervals (figure 4). In studies collecting data more than once per day, a pooled completion rate of 69% (95% CI 56% to 80%) was reported. Additional subgroup meta-analyses (online supplemental material 3) showed no apparent differences in PRO completion rates according to diagnosis (including only studies in an RA population) and study design (comparing RCTs and observational studies).

Figure 4

Forest plot of pooled completion rates according to patient-reported outcome collection frequency.

Finally, studies using a wearable activity tracker mostly defined engagement as the proportion of days the tracker was actively worn. Across the six studies for which this was reported,21 30 35–38 the pooled proportion of days worn was 70% (95% CI 39% to 90%) with high between-study heterogeneity (τ2 1.18; I2 86%) (figure 5).

Figure 5

Forest plot of pooled proportion of study days a wearable activity tracker was actively worn.

In sensitivity analyses excluding abstracts, meta-analysis resulted in a pooled global PRO-completion rate of 80% (unchanged to when considering all records) and a pooled proportional tracker wear time of 77% (compared with 70% when considering all records) (online supplemental material 4).

Attrition

In total, 20 studies reported on attrition, defined as a loss of participant engagement over time (table 2). Among these, 14 studies (70%) defined attrition as the difference between the start and end of the study in PRO-completion rate or in the amount of time the wearable tracker was worn. The remaining six articles reported on attrition either as the proportion of participants who were no longer active with the eHealth system by the end of the study, or as the proportion who did not meet a minimal threshold of data completeness.

Table 2

Overview of included studies reporting loss of eHealth engagement over time (attrition)

Generally, attrition rates were highly variable, ranging from no change in completion rate over time in a PDA e-diary study nested within a large phase III drug trial39 to as much as 89% drop-out in a smartphone feasibility study that recruited participants exclusively through social media.27 Overall, longer study durations were associated with lower completion rates (p=0.029 in univariable meta-regression) (online supplemental material 5).

Factors facilitating or hindering engagement

Facilitators or barriers to eHealth engagement were reported in 17 (38%) of the included studies (table 3), but only 13 of these studies provided quantitative assessments.

Table 3

Factors quantitatively associated with eHealth engagement in included studies

First, evidence for the influence of demographic or disease-related aspects on engagement was largely inconsistent. Overall, higher levels of engagement were reported for older adults and for children rather than adolescents with JIA. However, while one study found women with chronic arthritis to be more engaged than men,31 no such difference was apparent in others.28 40 Similarly, higher completion rates were reported with lower disease activity in an established RA population,40 whereas the inverse was found in a recent study on SpA,25 and qualitative data suggested that a lack of symptoms might hinder engagement.41 In addition, one study found higher completion rates for patients treated with biological disease-modifying drugs,32 while this finding was contradicted in another report.25 Moreover, engagement was not affected by the diagnosis itself in any of the included studies with mixed populations. Conflicting results were also reported for the influence of employment status, with one study reporting more dropouts in non-employed participants,32 whereas another found lower completion rates in fully employed patients.42

In addition, several studies indicated that the approach to outcome collection might influence participants’ engagement. For instance, less time-intensive PRO-reporting schedules, such as weekly rather than daily reporting, were associated with higher completion rates in 5 out of 6 studies for which this information was available.30 32 43–45 Moreover, higher engagement was found when feedback was provided to patients about the data they reported, either by discussing them in clinic or through data visualisation in the eHealth tool itself. Specifically, the PARADE study reported a 4% difference in attrition in favour of participants who had daily access to their data compared with those who did not.27 Similarly, using a smartphone app to provide visual feedback on step counts resulted in increased engagement with a wearable activity tracker in another report.46 Interestingly, however, using reminders to prompt data entry did not appear to have a clear effect on participant engagement in both studies that investigated this.11 25

Discussion

In this systematic review, we summarised the evidence on patients’ engagement with eHealth systems used to remotely monitor disease activity or impact in chronic arthritis. Relatively high levels of eHealth engagement were reported across 45 included studies, which primarily consisted of observational cohorts and RCTs. The pooled global completion rate for remotely monitored PROs was 80%, while wearable activity trackers were worn for a pooled global proportion of 70% of study days, rising to 77% in a sensitivity analysis excluding abstracts.

In general, these results are in line with engagement data from remote monitoring studies in other chronic diseases, including diabetes, obesity and mental health conditions.47 However, between-study heterogeneity for engagement outcomes was high in both previous research and in our review. This considerable heterogeneity encountered between studies represents a first major challenge in the current landscape of eHealth research. Among the included studies, much variability was apparent in study population and duration, ranging from only a few days to 1 year, as well as in the incentives to participants for providing complete data, and even in how engagement was defined and measured. Furthermore, some studies used an entirely digital recruitment approach without physical contact between patients and investigators, for instance by including participants via social media. All these study-related aspects might affect both engagement with an eHealth monitoring approach and the generalisability of the results. Furthermore, comparisons between studies are inevitably limited because of these differences. Similar reports on the challenges of heterogeneity in eHealth studies also emerged as major conclusions in several recent systematic reviews, focusing on synchronous telemedicine, mobile health interventions and wearable activity trackers in rheumatology.9 48 49 Moreover, this challenge is clearly not limited to the rheumatology field.50 Therefore, future research on the use of eHealth systems should not only assess engagement outcomes, but also report them in a standardised way. Based on our review results, the most suitable measures for this purpose seem to be completion rates and proportional wear time for PRO-based and wearable-based interventions, respectively.

A second challenge faced by the eHealth research field in rheumatology is the limited availability of data from daily clinical practice, as is clear from the studies included in our review. This seems particularly important when considering the issue of disengagement over time reported both in many eHealth studies and for mobile applications outside of the research setting. For instance, an estimated 71% of app users across all industries stop using the app within 3 months,17 and a study of adherence to activity trackers in students showed 75% disengagement within 4 weeks.51 In our review, only 20/45 included studies effectively reported data on attrition, and in most cases these data were collected within a strictly controlled research environment. This is particularly relevant since generally low levels of attrition were primarily reported in studies that were either of shorter duration or included strong incentives to support engagement, such as financial compensation. Similarly, completion rates for the PDA e-diaries did not show any decline over time in the phase III baricitinib trials RA-BEAM and RA-BUILD, again in a setting of close follow-up and targeted participant training.39 By contrast, much higher attrition rates were reported in several ‘fully digital’ studies, with 89% of participants disengaging within less than 3 months in the PARADE study,27 45% disengaging within 3 months in an ancillary study of the ArthritisPower registry28 and 41% not completing the 2-week lead-in period in another ArthritisPower study.32 These striking differences in attrition between closely or less closely controlled research settings have also been reported for other chronic diseases, with higher engagement rates in studies that compensated patients for their participation.52 Consequently, there is a clear need for more eHealth engagement data from routine care settings, where higher attrition rates are likely. Pending such data, the current evidence on eHealth in rheumatology might underestimate the problem of attrition.

However, we should note that some potentially relevant studies from daily practice settings were excluded from our review because they did not report engagement based on data completeness. For instance, in a 12-month, multicentric study from France, patients with RA were randomised to either usual care or additional access to the web-based Sanoia platform, developed to support self-monitoring.53 In this study, no direct incentives to access the platform were provided to optimally mirror daily care. Although satisfaction with the platform was high, 26% of patients never accessed Sanoia, and the number of accesses clearly declined over time.

The phenomenon of attrition has prompted researchers to explore the optimal target population and possible barriers and facilitators for engaging with eHealth systems. Our review identified several demographic and disease-related aspects that might be associated with eHealth engagement. Among these, the finding that older age seems associated with higher engagement is somewhat surprising, given the known barriers of ageing on technology use.54 However, since much of the available evidence stems from research populations, it is likely that the most vulnerable elderly patients were either excluded from these studies or did not express an interest to participate. Moreover, older age was associated with lower eHealth engagement in JIA studies, in line with the commonly reported lower treatment adherence in adolescents.55 Interestingly though, the diagnosis did not appear to affect eHealth engagement, either in individual studies or in subgroup meta-analysis, despite the important differences in how different types of chronic arthritis are managed.

Another intriguing finding of our review is that engagement rates do appear to be affected by the approach to outcome collection. For instance, one included study investigated the effect of different pain reporting frequencies on completion rates in JIA patients, using a randomised N-of-1 cross-over design.43 In this study, engagement was higher in less time-intensive schedules, such as weekly rather than daily reporting, even though participants tended to prefer the once-a-day schedule. Similar differences were apparent in an additional four studies,30 32 44 45 while another intervention allowed participants to choose their preferred reporting frequency up-front and found that monthly reporting was chosen most often.34 In contrast, our meta-analysis showed that completion rates were highest in studies requesting daily PRO reporting. This discrepancy might be explained by differences in study or population characteristics. Nevertheless, these findings are particularly interesting in relation to concerns, raised in qualitative research, that more frequent reporting could cause more internal resistance or illness behaviour in patients.16 41 Evidence to support this concern is still limited, however, with one trial indeed showing a negative effect of a gout self-management app on illness perceptions,56 while Lee et al found no differences in pain interference between reporting schedules in their N-of-1 trial.43 Interestingly, the choice of outcome measure to be collected by the eHealth system might be equally important, with some studies allowing participants to freely select their preferred outcome measure.28 34

Regardless of the way eHealth tools are implemented, benefiting from their promising potential requires efforts to maximise and maintain participant engagement. To achieve this, previous research has highlighted the importance of co-designing eHealth systems with patients, optimising system usability, minimising workload and time commitment for users, including community-building efforts or personal contact with care providers, and sending automated reminders for data entry.17 Interestingly though, reminders did not appear to have a clear effect on data completeness in both included studies that quantitatively assessed this. Additionally, qualitative results from the studies included in our review suggested that eHealth engagement might be hindered in case of well-controlled symptoms or by system-related technical issues, lack of digital literacy, interference of other daily activities and internal resistances like respondent fatigue.24 30 34 41 57 58

Furthermore, our review showed positive effects on engagement when feedback was provided to participants, either by the physician or by the eHealth system itself,27 46 a finding that is extensively supported by qualitative evidence.16 24 30 34 41 Finally, motivational techniques such as gamification could help users to remain engaged and are generally underused in the existing array of eHealth systems.59 60 Our systematic review adds to this growing body of evidence and could support researchers and system developers in designing and implementing eHealth tools that optimally meet the challenges of attrition and low engagement.

Some limitations of this systematic review should be acknowledged. We focused specifically on remote monitoring in an asynchronous setting, which implies that eHealth tools were not considered if they were intended to facilitate real-time contact between patients and care providers. Consequently, studies based on telehealth interventions like telephone or video consultations were not included. The results of this systematic review can therefore not be extended to any type of eHealth intervention. In addition, we did not consider purely qualitative studies. Finally, both the conclusions and the generalisability of our review are inherently limited by selection bias in the included studies, the majority of which considered participants only if they had access to digital tools and sufficient experience using them.

However, our review was conducted and reported according to commonly recommended guidelines. The protocol was registered in PROSPERO, the search string was developed in collaboration with biomedical reference librarians, study selection and data extraction were conducted independently by two reviewers in both published and ‘grey’ literature, and a third reviewer was consulted to resolve conflicts. Moreover, the search was updated at a later time, and a meta-analysis was performed with subgroup and sensitivity analyses to explore between-study heterogeneity.

Conclusion

Relatively high levels of participant engagement were reported in studies involving eHealth systems for asynchronous remote monitoring in chronic arthritis. However, comparisons were hindered by considerable heterogeneity and a relative lack of data from routine care settings. This is of particular importance given the observed differences in attrition in closely controlled versus less incentivised research settings, as well as the finding that engagement tends to decline with longer study duration. To provide a clear picture of the feasibility of remote monitoring eHealth strategies, future studies should therefore use standardised measures of engagement, such as PRO-completion rates or proportional tracker wear time, and assess them with study designs that optimally reflect daily clinical practice.

Data availability statement

Data are available on reasonable request.

Ethics statements

Patient consent for publication

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Twitter @DoumenMichael, @DiederikDeCock, @Will_I_Am_Osler, @sophie_33pl

  • Contributors MD, DDC and PV designed the study. CVL, MD and DDC drafted the PROSPERO protocol. CVL and MD performed the systematic literature search, and DDC acted as third reviewer to resolve conflicts. CVL and MD extracted the data and performed the descriptive analyses. MD and AB performed the meta-analysis. CVL and MD assessed risk of bias for included studies. MD drafted the article. DDC, CVL, AB, SP, DB, RW and PV revised the article critically for content. All authors gave final approval of the manuscript to be published. PV and MD are the guarantors.

  • Funding MD has received a Strategic Basic Research Fellowship grant from Fonds Wetenschappelijk Onderzoek (FWO) (grant number 1S85521N). No financial funding was received for the study itself.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.