You are here

  • Home
  • Archive
  • Volume 5, Issue 2
  • Routine Assessment of Patient Index Data 3 (RAPID3) alone is insufficient to monitor disease activity in rheumatoid arthritis in clinical practice

Article Text

Article menu

Download PDFPDF

Rheumatoid arthritis
Original article
Routine Assessment of Patient Index Data 3 (RAPID3) alone is insufficient to monitor disease activity in rheumatoid arthritis in clinical practice
  1. Niels W Boone1,
  2. Alexandre Sepriano2,3,
  3. Paul-Hugo van der Kuy4,
  4. Rob Janknegt1,
  5. Ralph Peeters5 and
  6. Robert B M Landewé5,6
  1. 1Department of Clinical Pharmacy, Pharmacology and Toxicology, Zuyderland Medical Centre Sittard-Geleen, Sittard-Geleen, Limburg, The Netherlands
  2. 2Department of Rheumatology, Leiden University Medical Center, Leiden, Zuid-Holland, The Netherlands
  3. 3NOVA Medical School, Universidade Nova de Lisboa, Lisbon, Portugal
  4. 4Department of Clinical Pharmacy, Erasmus MC, Rotterdam, Zuid-Holland, The Netherlands
  5. 5Department of Rheumatology, Zuyderland Medical Centre Heerlen, Heerlen, Limburg, The Netherlands
  6. 6Department of Rheumatology, Amsterdam University Medical Centres, Amsterdam, Noord-Holland, The Netherlands
  1. Correspondence to Niels W Boone; nwboone{at}gmail.com

Abstract

Objective To test the longitudinal association between patient-reported outcome, Routine Assessment of Patient Index Data 3 (RAPID3) and the Disease Activity Score in 28 joints that includes the erythrocyte sedimentation rate (DAS28-ESR) in routine-care patients with rheumatoid arthritis (RA).

Methods Patients with RA treated with disease-modifying antirheumatic drugs were included in this prospective observational cohort. The longitudinal association between RAPID3 (0–10) and DAS28-ESR and its individual components (swollen joint count (SJC), erythrocyte sedimentation rate (ESR) (mm/hour), tender joint count (TJC) and patient global assessment (PGA)) was tested using generalised estimating equations in patients with more than two consecutive visits with data on RAPID3 and DAS28-ESR. Interactions between RAPID3 and gender, pain, PGA and age at baseline were tested, and if significant (p<0.20) and clinically relevant, models were fit in the corresponding strata.

Results In total, 330 patients were included (mean follow-up 10.7 (SD 9.7) months, female gender 67.9%). The longitudinal association between RAPID3 and DAS28-ESR was weak (β=0.29 (95% CI 0.24 to 0.35), n=207), meaning that one unit increase in RAPID3 corresponded to a 0.29 unit increase in Disease Activity Score in 28 joints (DAS28). RAPID3 was most strongly associated with subjective (TJC: β=0.89 (95% CI 0.61 to 1.17); PGA: β=0.94 (95% CI 0.84 to 1.04)) and not with objective components of DAS28 (SJC: β=0.29 (95% CI 0.17 to 0.41), n=172). The association between RAPID3 and ESR was poor but modified by gender, being only significant in men (β=0.37 (95% CI 0.08 to 0.67)).

Conclusions These data suggest that RAPID3 does not sufficiently capture changes in objective inflammatory signs. Monitoring by RAPID3 alone is therefore insufficient to follow disease activity in patients wth RA in clinical practice.

  • Rheumatoid arthritis
  • disease activity
  • DAS28
  • RAPID3
  • responsiveness
  • patient reported outcome measure (PROM)

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

https://doi.org/10.1136/rmdopen-2019-001050

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Key messages

    What is already known about this subject?

    • The Routine Assessment of Patient Index Data 3 (RAPID3) is considered one of the best validated patient-reported outcome measures in rheumatoid arthritis (RA).

    What does this study add?

    • RAPID3 is poorly associated with Disease Activity Score in 28 joints that includes the erythrocyte sedimentation rate and especially with its objective components, swollen joint count and erythrocyte sedimentation rate, over time in patients with RA followed up in daily practice and stable on treatment.

    • RAPID3 associates very well with the subjective components of Disease Activity Score in 28 joints, tender joint count and patient global assessment, which confirms that RAPID3 is strongly driven by subjective pain instead of inflammatory disease activity.

    How might this impact on clinical practice?

    • RAPID3 alone is insufficient to capture objective signs of inflammation in routine-care patients with RA.

    • The sole use of subjective patient monitoring instruments can be misleading and potentially lead to overtreatment of patients with RA, especially in the absence of convincing signs of inflammation.

    Introduction

    Patient-reported outcome measures (PROMs) yield clinically important information and have been used for many years in the development and evaluation of medical interventions.1–4 These measures primarily aim at reflecting patients’ unique perspectives and, as such, can contribute to engage patients, clinicians and other stakeholders (eg, government and payers) in judging the relevance of treatment effects and the development of value-based healthcare.5 6

    PROMs have been awarded a prominent place in the management of rheumatic and musculoskeletal diseases such as rheumatoid arthritis (RA). For instance, the patient global assessment (PGA) has been included as one criterion to define the American College of Rheumatology (ACR)–EULAR Boolean definition of remission.3 7 8 Also, both ACR and EULAR prescribe the use of patient-driven constructs as part of the core set to measure disease activity in daily practice as well as clinical research.3 4

    One example of a composite disease activity PROM is the Routine Assessment of Patient Index Data 3 (RAPID3), which is considered the best validated PROM in RA.9 10 In contrast to the Disease Activity Score in 28 joints that includes the erythrocyte sedimentation rate (DAS28-ESR) and the presence of swelling in 28 joints, RAPID3 is solely based on three (subjective) patient-reported domains: physical function, pain and PGA. Thus, it has been suggested that RAPID3 (similar to other PROMs) could mostly translate factors other than inflammation, such as fatigue, depression or even symptoms driven by comorbidities.11 12 In reality, the question if whether or not RAPID3 truly captures inflammation-driven disease activity in clinical practice is still unanswered.10 If not, this means that if RAPID3 is used to guide treatment decisions on drugs mainly targeting inflammation, clinicians may expose patients to unnecessary risks with only little or no benefit.

    We investigate here the longitudinal relationship between RAPID3 and DAS28-ESR (including its individual components) in patients with RA in order to determine RAPID3’s ability to monitor changes in inflammation-driven disease activity appropriately.

    Patients and methods

    Patients and study design

    Patients with a clinical diagnosis of RA (and fulfilling the ACR 1987 classification criteria13) were included in this prospective observational study performed in a large rheumatology unit in the Netherlands. Patients could have been treated with conventional synthetic disease-modifying antirheumatic drugs (csDMARDs) and/or biological disease-modifying antimodifying antirheumatic drugs (bDMARDs) according to their treating rheumatologists and were followed up every 3 months for a up to 2 years (April 2013–April 2016). All patients provided informed consent before inclusion.

    Data collection and disease scores

    Patients’ characteristics, including gender, age and disease duration (years), were collected at baseline by rheumatologists and research nurses. Measures of disease activity (DAS28-ESR and RAPID3), laboratory data (erythrocyte sedimentation rate (ESR)) and medication status (bDMARD and/or csDMARD, yes/no) were assessed every 3 months. RAPID3 is composed of three domains: physical function (0–10), pain (Visual Analogue Scale 0–10) and PGA of disease activity (0–10).9 The sum of the three domains is expressed as a continuous total score (range from 0 (best) to 30 (worst)). To facilitate comparison with DAS28-ESR, we converted the total score to a 0–10 scale in accordance with the RAPID3 score template.9 The total DAS28-ESR (range: 0–9.3)14 was computed with four variables: tender joint count (TJC 0–28), swollen joint count (SJC 0–28), PGA (0–10) and ESR.

    Statistical analysis

    First, we used generalised estimating equations (GEEs), with time as the explanatory variable of interest, to assess how RAPID3 and Disease Activity Score in 28 joints (DAS28) changed over time (in separate models). Different transformations of time were tested to assess which yielded the best fit (assessed by the quasi-likelihood under the independence model criterion). A non-linear model was chosen if best fitting the data and if the non-linear factor (eg, quadratic term) was statistically significant (p<0.05).

    Second, the longitudinal association between RAPID3 (explanatory variable) and DAS28-ESR (main outcome) was tested in GEE models with autoregression (ie, adjusting for the outcome in t-1). The association between RAPID3 and each individual component of DAS28 (SJC, ESR, TJC and PGA) was also tested in separate GEE models. GEE models with autoregression allow for a truly longitudinal interpretation of the association of interest by ‘isolating’ the within-subject effect while correcting for the inherent correlation by specifying a ‘working correlation matrix’. The exchangeable correlation matrix was used since it proved to better fit the data. Interactions between RAPID3 and gender, pain, PGA and age were tested, and if statistically significant (p<0.20) and clinically relevant, the association of interest was tested in stratified models (median value at baseline for continuous variables). In all models, only patients with data on the outcome and explanatory variable available in at least two consecutive visits were included (details on statistical analysis available in online supplementary text S1). All analyses were performed in STATA V.15.1).

    Results

    In total, 330 patients (1348 visits; mean 4.0 (SD 2.7) number of visits, mean 10.7 (SD 9.7) months of follow-up) were included. Baseline characteristics, disease activity parameters and treatment status are shown in table 1.

    View this table:
    Table 1

    Baseline characteristics of included patients

    In our population, both DAS28 and RAPID3 had shown very limited change over time following a linear distribution. On average, DAS28 decreased 0.02 units per month (β=−0.02 (95% CI −0.02 to −0.01)), while RAPID3 increased 0.01 units (β=0.01 (95% CI 0.00 to 0.01)).

    Longitudinal association between RAPID3 and DAS28

    There was a weak but statistically significant longitudinal association between RAPID3 and DAS28-ESR (β=0.29 (95% CI 0.24 to 0.35), n=207). This means that 1 unit increase in RAPID3 corresponded to only 0.29 unit increase in DAS28 over time (figure 1). The association between RAPID3 and DAS28 individual components (n=172) yielded different results for subjective and objective domains (table 2). The difference in the numbers of patients included between models with DAS28 and models with individual components stems from the fact that the individual components of DAS28 were not available to all patients, although the overall score was.

    View this table:
    Table 2

    Longitudinal association between RAPID3 (0–10) and DAS28-ESR, including individual components

    Figure 1
    Figure 1

    Longitudinal association between RAPID3 and DAS28-ESR over time (N=207). Longitudinal GEE model with autoregression. RAPID3 0–30 converted to a 0–10 scale; high numbers reflect worse outcome. RAPID3 domains: functioning, pain and patient global assessment; DAS28 (four variables, erythrocyte sedimentation rate-based). DAS28, Disease Activity Score in 28 joints; DAS28-ESR, Disease Activity Score in 28 joints that includes the erythrocyte sedimentation rate; GEE, generalised estimating equation; RAPID3, Routine Assessment of Patient Index Data 3.

    RAPID3 was found to be strongly associated with the TJC (β=0.89 (95% CI 0.61 to 1.17)) and with PGA (β=0.94 (95% CI 0.84 to 1.04)). This means that 1 unit increase in RAPID3 corresponds to almost 1 unit increase of PGA. In comparison, the association between RAPID3 and the SJC was weak at best (β=0.29 (95% CI 0.17 to 0.41)). Only the association between RAPID3 and ESR was modified by gender (interaction p value of 0.141). It was somewhat stronger in men (β=0.37 (95% CI 0.08 to 0.67)) than in women (β=−0.03 (95% CI −0.47 to 0.41)). No other significant interactions were found.

    Discussion

    In this prospective observational study, we have shown that RAPID3 is poorly associated with DAS28-ESR over time in patients with RA followed in daily practice. This is mainly due to the weak association between RAPID3 and the objective components of DAS28 (SJC and ESR), while RAPID3 associates very well with DAS28 subjective components (TJC and PGA).

    The association between RAPID3 and DAS28, including the individual components of DAS28, have been previously investigated but, thus far, only in cross-sectional observational studies.15–17 Our findings are mostly in line with these studies, which have shown a weak to moderate association between the two scores. Our study adds to the existing literature by showing that this association is also absent in a longitudinal setting, thus increasing internal validity, and in patients followed up in routine clinical practice (external validity). Despite the lack of association between RAPID3 and DAS28 in observational studies, RAPID3 and other PROMs have been consistently shown to discriminate well regarding responses between active treatment and placebo in randomised clinical trials (RCTs).18 19 Although these data strongly argue in favour of PROMs to detect treatment effects in trials, these do not necessarily support their use in daily clinical practice. In fact, we have recently shown, using data from the same cohort, that patients treated with both bDMARDs and methotrexate did not have different RAPID3 scores over time compared with those on bDMARDs alone, while a difference could have been clearly seen with DAS28 (especially with SJC).11 20

    Differences in patients’ characteristics may, at least in part, explain why RAPID3 seems to capture treatment effects differently in RCTs and observational cohorts. RAPID3 mostly relies on subjective assessments of disease activity, and these are potentially influenced by comorbidities that are less likely to occur in patients selected for RCTs. In addition, patients from trials usually have high levels of inflammation at study entry. In such setting, ‘subjective pain’ may be less relevant than ‘inflammatory pain’, and outcome measures to quantify disease activity will mostly reflect the latter. It should be noted, however, that our data stem from a single-centre cohort of patients on stable treatment and with limited change in disease activity over time. Limited change may preclude subtle associations to be detected (eg, between ‘subjective’ and ‘objective’ pain). Larger studies in patients with higher levels of, and most importantly, larger changes in disease activity (measured also by scores other than DAS28) should give resolution.

    Taken all together, these data suggest that RAPID3 is most likely not suitable to be used alone for monitoring disease activity in patients with RA in daily clinical practice, since important objective information on the presence of inflammation (acute phase reactants and swollen joints) is missed. For instance, if subjective pain is driving high scores in a patient and this leads to treatment intensification (eg, changing or adding disease-modifying antimodifying antirheumatic drugs), the end result might be ‘overtreatment’, which carries negative consequences both to the patient and to the society.21 A so-called ‘dual strategy’ has been proposed by Ferreira et al,22 which defends the use of PROMS as complementary to evaluate the global impact of disease beyond inflammatory-driven disease activity in order to define additional needs for care. This approach still needs to be proven in practice.

    In conclusion, our results show that DAS28 and RAPID3 do not associate with each other in patients with RA from daily clinical practice. RAPID3 is strongly driven by (subjective) ‘pain’, and its sole use as a monitoring instrument to guide treatment decisions can be misleading and potentially harmful to patients.

    Acknowledgments

    The authors are grateful to all patients, research nurses and rheumatologists who participated in this study.

    References

    1. ↵
      1. U.S
      . Department of health and human services FDA center for drug evaluation and research. guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes2006;4:79.doi:10.1186/1477-7525-4-79
    2. ↵
      1. European Medicines Agency
      . Committee for medicinal products for human use (CHMP). reflection paper on the regulatory guidance for the use of health-related quality of life (HRQL) measures in the evaluation of medicinal products, 2005.
    3. ↵
      1. Singh JA,
      2. Saag KG,
      3. Bridges SL, et al
      . 2015 American College of rheumatology guideline for the treatment of rheumatoid arthritis. Arthritis Care Res2016;68:1–25.doi:10.1002/acr.22783
      OpenUrlCrossRef
    4. ↵
      1. Radner H,
      2. Chatzidionysiou K,
      3. Nikiphorou E, et al
      . 2017 EULAR recommendations for a core data set to support observational research and clinical care in rheumatoid arthritis. Ann Rheum Dis2018;77:476–9.doi:10.1136/annrheumdis-2017-212256
      OpenUrlAbstract/FREE Full Text
    5. ↵
      1. International Consortium for Health Outcome Measurement
      . Inflammatory Arthritis data collection reference guide version 1.0.0 [Internet]. Cambridge USA: ICHOM, 2018. Available: https://ichom.org/files/medical-conditions/inflammatory-arthritis/inflammatory-arthritis-reference-guide.pdf [Accessed updated 2018 April 27; cited 2019 September 27].
    6. ↵
      1. Selby JV,
      2. Beal AC,
      3. Frank L
      . The patient-centered outcomes research Institute (PCORI) national priorities for research and initial research agenda. JAMA2012;307:1583–4.doi:10.1001/jama.2012.500
      OpenUrlCrossRefPubMedWeb of Science
    7. ↵
      1. Smolen JS,
      2. Landewé R,
      3. Bijlsma J, et al
      . EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2016 update. Ann Rheum Dis2017;76:960–77.doi:10.1136/annrheumdis-2016-210715
      OpenUrlAbstract/FREE Full Text
    8. ↵
      1. Felson DT,
      2. Smolen JS,
      3. Wells G, et al
      . American College of Rheumatology/European League against rheumatism provisional definition of remission in rheumatoid arthritis for clinical trials. Arthritis Rheum2011;6363:573–86.
      OpenUrl
    9. ↵
      1. Pincus T,
      2. Swearingen CJ,
      3. Bergman MJ, et al
      . RAPID3 (routine assessment of patient index data) on an MDHAQ (multidimensional health assessment questionnaire): agreement with DAS28 (disease activity score) and CDAI (clinical disease activity index) activity categories, scored in five versus more than ninety seconds. Arthritis Care Res2010;62:181–9.doi:10.1002/acr.20066
      OpenUrlCrossRefWeb of Science
    10. ↵
      1. Hendrikx J,
      2. de Jonge MJ,
      3. Fransen J, et al
      . Systematic review of patient-reported outcome measures (PROMs) for assessing disease activity in rheumatoid arthritis. RMD Open2016;2.doi:10.1136/rmdopen-2015-000202
    11. ↵
      1. Boone NW,
      2. Sepriano A,
      3. van der Kuy P-H, et al
      . Cotreatment with methotrexate in routine care patients with rheumatoid arthritis receiving biological treatment yields better outcomes over time. RMD Open2019;5.doi:10.1136/rmdopen-2018-000836
    12. ↵
      1. Ferreira RJO,
      2. Duarte C,
      3. Ndosi M, et al
      . Suppressing inflammation in rheumatoid arthritis: does patient global assessment blur the target? A practice-based call for a paradigm change. Arthritis Care Res2018;70:369–78.doi:10.1002/acr.23284
      OpenUrl
    13. ↵
      1. Arnett FC,
      2. Edworthy SM,
      3. Bloch DA, et al
      . The American rheumatism association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum1988;31:315–24.doi:10.1002/art.1780310302
      OpenUrlCrossRefPubMedWeb of Science
    14. ↵
      1. Fransen J,
      2. Creemers MC,
      3. Van Riel PL
      . Remission in rheumatoid arthritis: agreement of the disease activity score (DAS28) with the Ara preliminary remission criteria. Rheumatology2004;43:1252–5.doi:10.1093/rheumatology/keh297
      OpenUrlCrossRefPubMedWeb of Science
    15. ↵
      1. Kim S-K,
      2. Park S-H,
      3. Bae J, et al
      . Performance of routine assessment of patient index data 3 (RAPID3) for assessment of rheumatoid arthritis in clinical practice: differential agreement of RAPID3 according to disease activity categories. Rheumatol Int2014;34:1311–8.doi:10.1007/s00296-014-3042-y
      OpenUrl
    16. ↵
      1. Singh H,
      2. Gupta V,
      3. Ray S, et al
      . Evaluation of disease activity in rheumatoid arthritis by routine assessment of patient index data 3 (RAPID3) and its correlation to disease activity score 28 (DAS28) and clinical disease activity index (CDAI): an Indian experience. Clin Rheumatol2012;31:1663–9.doi:10.1007/s10067-012-2070-9
      OpenUrlCrossRefPubMed
    17. ↵
      1. Yokogawa N,
      2. Kaneko T,
      3. Nagai Y, et al
      . Validation of RAPID3 using a Japanese version of multidimensional health assessment questionnaire with Japanese rheumatoid arthritis patients: characteristics of RAPID3 compared to DAS28 and CDAI. Mod Rheumatol2015;25:264–9.doi:10.3109/14397595.2014.948587
      OpenUrl
    18. ↵
      1. Pincus T,
      2. Furer V,
      3. Keystone E, et al
      . RAPID3 (routine assessment of patient index data 3) severity categories and response criteria: similar results to DAS28 (disease activity score) and CDAI (clinical disease activity index) in the rapid 1 (rheumatoid arthritis prevention of structural Damag. Arthritis Care Res2011;63:1142–9.doi:10.1002/acr.20481
      OpenUrlCrossRefWeb of Science
    19. ↵
      1. Strand V,
      2. Cohen S,
      3. Crawford B, et al
      . Patient-Reported outcomes better discriminate active treatment from placebo in randomized controlled trials in rheumatoid arthritis. Rheumatology2004;43:640–7.doi:10.1093/rheumatology/keh140
      OpenUrlCrossRefPubMedWeb of Science
    20. ↵
      1. Gabay C,
      2. Riek M,
      3. Scherer A, et al
      . Effectiveness of biologic DMARDs in monotherapy versus in combination with synthetic DMARDs in rheumatoid arthritis: data from the Swiss clinical quality management registry. Rheumatology2015;54:1664–72.doi:10.1093/rheumatology/kev019
      OpenUrlCrossRefPubMed
    21. ↵
      1. Landewé RBM
      . Response to: ’Dual target strategy: a proposal to mitigate the risk of overtreatment and enhance patient satisfaction in rheumatoid arthritis' by Ferreira et al. Ann Rheum Dis2019;78:e110.I.doi:10.1136/annrheumdis-2018-214221
    22. ↵
      1. Ferreira RJO,
      2. Ndosi M,
      3. de Wit M, et al
      . Dual target strategy: a proposal to mitigate the risk of overtreatment and enhance patient satisfaction in rheumatoid arthritis. Ann Rheum Dis2019;78:e109.doi:10.1136/annrheumdis-2018-214199

    Footnotes

    • Contributors NWB, AS and RL had full access to all of the data and take responsibility for data integrity and accuracy of data analysis. NWB, AS and RL were involved in the data processing and analysis. NWB, AS, RL, P-HvdK RJ and RP were involved in the study design and writing of the manuscript. All authors contributed to the critical revision and the final approval of the manuscript.

    • Funding There was no funding for this study. AS is supported by a doctoral grant from Fundação para a Ciência e Tecnologia (Foundation for Science and Technology) (SFRH/BD/108246/2015).

    • Competing interests None.

    • Patient consent for publication Not required.

    • Ethics approval The local medical ethics committee reviewed the study and approved the protocol.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data availability statement No additional data are available for sharing.