Article Text
PDF
Abstract
Objectives To describe (1) the representativeness of (a) users of an online health community (HealthUnlocked.com (HU)) with rheumatoid arthritis (RA) and (b) paid members of an RA patient organisation, the National Rheumatoid Arthritis Society (NRAS), compared with the general RA population; and (2) the willingness of HU users with RA to participate in types of research (surveys, use of an app or activity tracker, and trials).
Methods A pop-up survey was embedded on HU to determine the characteristics of users and their willingness to participate in research. An anonymous data set of NRAS member characteristics was provided by the NRAS (N=2044). To represent the general RA population, characteristics of people with RA were identified from the Clinical Practice Research Datalink (CPRD) (N=20 594). Cross-sectional comparisons were made across the three groups.
Results Compared with CPRD, HU respondents (n=615) were significantly younger (49% aged below 55 years compared with 23% of CPRD patients), significantly more deprived (21% in the most deprived Townsend quintile compared with 12% of CPRD patients) and had more recent disease, with 62% diagnosed between 2010 and 2016 compared with 37% of CPRD patients. NRAS members were more similar to the CPRD, but significantly under-represented those aged 75 years or over and over-represented those aged 55–75 years compared with the CPRD. High proportions of HU users were willing to participate in future research of all types.
Conclusions NRAS members were broadly representative of the general RA population. HU users were younger, more deprived and more recently diagnosed. HU users were willing to participate in most types of research.
- rheumatoid arthritis
- epidemiology
- patient perspective.
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Key messages
What is already known about this subject?
Studies are starting to recruit participants online and through patient organisations, but we do not know how representative these groups are.
What does this study add?
Patient organisation members with rheumatoid arthritis (RA) were broadly representative of the general RA population, and online health community (OHC) users with RA were younger, more recently diagnosed and from more deprived areas.
A high proportion of OHC users were willing to take part in all types of research (surveys, use of an app or activity tracker, and trials).
How might this impact on clinical practice?
Future studies may be able to recruit more efficiently from OHCs and patient organisations with confidence in how these populations represent the study population.
Introduction
Large population studies often require significant numbers of participants to generate enough statistical power. This often requires multisite recruitment through rheumatology departments. A study of trials conducted in 2002–2008 found only 55% recruited to their prespecified sample size.1 This leads to an underpowered study and possible inconclusive results.
Study recruitment may be improved in both numbers and efficiency by recruiting patients directly. This may be coordinated via patient organisations or, as patients are increasingly online,2 through the internet. For example, studies have recruited through social media,3 4 recruited through online forums,5–7 advertised on health websites4 or advertised based on health-related search terms on Google.8 However the representativeness of online health communities (OHCs) and patient organisations, particularly in a rheumatoid arthritis (RA) population, is not clear.
The aims of this study were to describe (1) the representativeness of paid members of a patient organisation with prevalent RA and users of an OHC with RA when compared with the general RA population, and (2) the types of studies that OHC users with RA would participate in.
Methods
Design
This cross-sectional study compared the characteristics of adults with RA from the National Rheumatoid Arthritis Society (NRAS) members who had paid for membership and visitors to the NRAS community group on HealthUnlocked.com (HU) with adults with RA identified from the Clinical Practice Research Datalink (CPRD), a database of anonymised UK primary care electronic medical records. As the CPRD is broadly representative of the UK population,9 adults with RA identified from the CPRD were considered representative of adults with RA in the UK.
Patient organisation population
The NRAS is a patient organisation for people living with RA. When people join NRAS or renew their membership, they can provide demographic and medical information. An anonymised data set of all members, past and present up until 1 May 2016, was provided by the NRAS. For consistency with the other data sets, and to avoid selection bias, only current NRAS members were used. The data set contained (self-reported) year of RA diagnosis, ethnicity, current age, gender, employment status, and ever use of disease-modifying antirheumatic drugs (DMARDs), biologics and glucocorticoids (GC). To be included in the analyses, respondents had to be residents in the UK to allow comparison with the other UK data sets.
HU population
HU is Europe’s largest OHC, with over 4.5 million visitors per month.10 The NRAS has a community group on HU for people with RA with, on average, 169 000 visitors per month. Anybody can visit the NRAS community on HU irrespective of a diagnosis of RA, NRAS membership or following the NRAS HU community. As people join HU without providing demographic information, a survey was developed to determine self-reported RA diagnosis, year of RA diagnosis, medications used, willingness to participate in different types of research (including questionnaires of varying durations, using an app, wearing an activity tracker and different types of trial), demographics (age, gender, employment, postcode and ethnicity) and the types of electronic devices owned (details of survey development in online supplementary file 1). After review by a combined patient and public involvement group and agreement with the NRAS, the finalised survey (online supplementary figure 1) was embedded in all posts within the NRAS HU community and popped up for completion when these posts were viewed by someone with a UK IP address. Prior to starting the survey, respondents confirmed they were over 18 years of age. The survey then started with an eligibility question to determine self-reported RA. The survey started on 6 May 2016 and was live for 3 months or until 1000 people had completed the survey, whichever was soonest. Postcode was converted to Townsend Deprivation Index11 by a health data scientist outside of the research team prior to analysis.
Supplemental material
Supplemental material
CPRD population
A prevalent cohort of patients with a diagnosis of RA prior to 1 June 2016 was identified using a validated algorithm.12 Eligibility criteria were (1) aged 18 years or over at RA diagnosis, (2) registered at a practice on 1 May 2016 and (3) data met the CPRD quality standards.9 Age, gender, year of RA diagnosis, ethnicity, ever DMARD and GC use, and Townsend Deprivation Index (for practices that consented to linkage) were identified for these patients (covariate definitions in online supplementary file 1).
Analysis
For each data set, the characteristics were categorised and tabulated to match the HU survey responses to allow comparison between data sets. A Z-test for the difference in proportions within each category of each characteristic was calculated comparing NRAS with CPRD, and HU with CPRD, where CPRD data were available. The characteristics of those who would definitely or probably take part in each type of research are reported. Logistic regression was used to identify any characteristics that were independently associated with definite or probable participation in each type of research.
Missing data
To be included in this analysis, individuals had to have information on at least age and gender. For CPRD employment status was available for less than 5% of patients so it was not used in this analysis. For NRAS members, postcode and therefore Townsend Deprivation Index were unavailable. For all variables, except age and gender, when the variable was available for the data set, the percentage of missing data is reported.
Results
Data sets
NRAS
The NRAS provided a data set of 4505 current and past members. Of those, 1498 were not currently members, 22 were from overseas and 941 did not have information on age and gender, resulting in a data set of 2044 current members with RA.
HealthUnlocked survey
The HU survey was live for 74 days between 6 May 2016 and 12 August 2016 and had 100 112 pop-ups to unique IP addresses. There were 2647 pop-ups clicked, 900 respondents agreed to take part, 750 respondents were eligible, and 135 did not provide age and gender, resulting in 615 respondents available for analysis. Recruitment was steady with an average of 12 responses per day.
CPRD
Of 4 776 441 people in the CPRD, there were 20 594 (0.43%) patients with a diagnosis of RA on 1 June 2016.
Characteristics
Table 1 and figure 1 show that NRAS members had a reasonably similar age distribution to patients with RA from the CPRD up to age 55. After this age there were statistically significant differences in proportions, with an over-representation of people aged 55–75 years and an under-representation of people aged 75 years and over in NRAS members. HU users were a significantly younger population compared with the CPRD, with fewer responders aged 65 years or over. Both NRAS and HU were predominantly female, with significantly higher proportions (~85%) compared with CPRD (70%). HU users had shorter disease duration, with significantly more respondents diagnosed between 2010 and 2016 (62%) compared with CPRD participants (37%), while NRAS members has a longer disease duration, with significantly fewer people diagnosed between 2010 and 2016 (25%). HU responders had a significantly higher proportion of people from more deprived areas (most deprived Townsend quintile: HU: 22% vs CPRD 12%) and significantly less from affluent areas (least deprived Townsend quintile: HU: 18% vs CPRD 23%) (data not available for NRAS members). All DMARDs had significantly more ever use in both HU and NRAS compared with CPRD.
Characteristics of patients with RA who are NRAS members, or who responded to a survey on HU and those identified from CPRD
Proportions in each age group by data set. CPRD, Clinical PracticeResearch Datalink; HU, HealthUnlocked.com; NRAS, National RheumatoidArthritis Society.
Participation in future research (HealthUnlocked only)
HU responders commonly reported they were definitely or probably willing to take part in future research, particularly questionnaires, with 89% reporting willingness to complete a questionnaire of 10 min. A lower proportion reported willingness to use an app (63%) compared with wearing an activity tracker (74%). Half of the respondents reported willingness to take part in a drug trial via the internet or with site visits. When stratified by age, overall those over 65 years of age reported less willingness to take part in all research types. When stratified by gender, men reported more willingness to use an app while women reported more willingness to wear an activity tracker (table 2). The most striking result from multivariate logistic regression showed that participants over 45 years of age were significantly less willing to use an app compared with those aged 18–34 years. Those aged 45–54 years had a 92% lower odds of using an app (OR: 0.08 (95% CI 0.01 to 0.58)), and those aged 75 years and over had 98% lower odds of using an app compared with those aged 18–34 years (OR: 0.02 (95% CI 0.002 to 0.23)). There were no statistically significant differences by gender (online supplementary table 1).
Proportion of HealthUnlocked users who would definitely or probably take part in types of research
Supplemental material
Discussion
This study shows that people with RA who were NRAS members were reasonably representative of the general RA population, although fewer were aged 75 years or over. HU visitors were a younger RA population, with more recent disease and more deprivation than the general RA population. Most respondents from the OHC were willing to take part in studies with lower burden. More than half were willing to take part in any type of study including a drug trial via the internet. Younger participants were more willing to use an app. We have also demonstrated that over 600 responses to a short questionnaire can be collected over a short period of time using pop-ups within an OHC.
Recruiting online through HU was a straightforward and less labour-intensive method of recruiting a reasonably large sample of respondents in a short space of time. Once the survey had been designed and then implemented by HU, other than monitoring the numbers of surveys completed, it did not require further work by the study team as data were automatically captured. This contrasts to more traditional methods where a person is required to collect data for each survey throughout data collection. Ninety per cent of those aged 55–64 reported they recently used the internet in a UK national survey.13 This is seen in this study with good representation of people aged 45–65 years in our sample. Those aged over 75 years were not well represented and may be expected given that one in four of those aged 75 or over are online,13 and this may impact the generalisability of study results and would need to be considered by investigators designing studies. For example, if the disease of interest affects elderly people, studies using HU may wish to consider additional recruitment sources to ensure that elderly patients are represented. Conversely, if investigators are interested in deprivation or people recently diagnosed with RA, then HU may be a good source of participants.
Few studies have looked specifically at the representativeness of members of a patient organisation or internet users with RA. A study including a group of patients with RA found that internet users were younger, more educated and more commonly employed compared with those who did not use the internet for health.14 In this study HU responders were younger, with a similar proportion employed compared with NRAS members, although we did not have CPRD as comparison. Although there was no CPRD comparison, the proportion who had ever taken biologics was high in both HU and NRAS compared with the reported UK estimates of 11%–16%.15 16 This may indicate that both NRAS and HU respondents have more severe disease requiring biologics, and this may be why they are using HU or NRAS. However as we do not have disease activity measures, we cannot be sure of this.
There were some limitations to this study. RA diagnosis in the CPRD relies on Read (diagnosis) codes and drug codes so there may be some misclassification. The prevalence rate of RA (0.43%) is lower than the 1% prevalence otherwise estimated,17 which supports some misclassification. RA diagnosis relied on self-report for both the NRAS and HU, so there may have been some misclassification; however, as these groups are both specific for RA, it is likely that any misclassification would be small. NRAS characteristics relied on members providing personal details: there may be some selection bias if those who gave information were different from those who did not. Further to this, as NRAS membership requires payment, there may be some selection bias in that NRAS members may be less deprived than the general population; however, we were unable to capture the Townsend Deprivation Index for this group. There may be some HU respondents who were NRAS members also; 114 HU respondents indicated they were NRAS members. However, it was not possible to cross-reference the NRAS and HU data sets. The HU characteristics reflect the characteristics of those who completed the survey, so may not be representative of all HU users, but does provide insight into the characteristics of those willing to join studies via this route. Although we did not survey NRAS paid members about their willingness to participate in research, recent experience demonstrates that patients with RA, both members and non-members, are responsive to participating in research following outreach from the NRAS.
This study gives an indication of the representativeness of groups that investigators may consider using to recruit people with RA to studies, while also demonstrating the feasibility of recruitment from OHCs. People in OHCs are willing to take part in many types of research, with the proportion declining as the burden of the research increases.
Acknowledgments
We would like to thank the following colleagues for their advice in developing the survey: Rebecca Joseph, Meghna Jani and Kimme Hyrich. We would also like to thank the Research User Group for their input during survey development. We would like to thank Kamilla Kopec-Harding for her help converting postcodes to the Townsend Deprivation Index.
Footnotes
Contributors WGD conceived the idea. WGD, JM and RC were responsible for the design of the study, MJE and CJ contributed towards the design of the study. RC conducted the analysis and drafted the manuscript. All authors interpreted the results, critically revised the manuscript for important intellectual content and approved the final manuscript.
Funding The work was supported by Arthritis Research UK Centre for Epidemiology (grant number: 20380).
Competing interests RC, JM and WGD have no competing interests. MJE is the Chief Medical Officer and cofounder of HealthUnlocked.com. CJ is employed by the NRAS.
Patient consent Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.