Objective To develop and validate a responsive and feasible ultrasound inflammation score for rheumatoid arthritis (RA).
Methods We used data from cohorts of early RA (development) and established RA starting/switching biologic therapy (validation). 4 tendons and 36 joints were examined by a grey scale (GSUS) and power Doppler semiquantitative ultrasound (PDUS) scoring system (full score). Ultrasound score components were selected based on factor analyses of 3-month change in the development cohort. Responsiveness was assessed by standardised response means (SRMs). We assessed the proportion of information retained from the full score by linear regression.
Results 118 patients with early and 212 patients with established RA were included. The final ultrasound score included 8 joints (metacarpophalangeal 1–2–3, proximal interphalangeal 2–3, radiocarpal, metatarsophalangeal 2–3) and 1 tendon (extensor carpi ulnaris) examined bilaterally. The 6-month SRMs for the final score were −1.24 (95% CI −1.47 to −1.02) for GSUS, and −1.09 (−1.25 to −0.92) for PDUS in early RA, with 87% of total information retained for GSUS and 90% for PDUS. The new score performed somewhat better than formerly proposed scores in the validation cohort.
Conclusions The Ultrasound in Rheumatoid Arthritis 9 joint/tendon score (USRA9) inflammation score showed good responsiveness, retained most of the information from the original full score and overall performed better than previous scores in a validation cohort.
Trial registration numbers NCT01205854, ACTRN12610000284066; Post-results.
- Rheumatoid Arthritis
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
What is already known about this subject?
Ultrasound is increasingly used to detect and monitor inflammation in rheumatoid arthritis.
What does this study add?
By applying a data-driven process we have developed the Ultrasound in Rheumatoid Arthritis 9 joint/tendon score (USRA9), a feasible and responsive reduced ultrasound inflammation score for assessing rheumatoid arthritis, which retains most of the information from a more extensive examination.
How might this impact on clinical practice?
This USRA9 score can be useful for monitoring inflammation in rheumatoid arthritis.
Ultrasound (US) is increasingly used to detect and monitor inflammation in rheumatoid arthritis (RA), in clinical practice and research. There is no agreement on which joints and tendons should be assessed for a sensitive, responsive and feasible US measure of inflammation in RA.1
The research agenda proposed in recent European League against Rheumatism (EULAR) recommendations includes evaluation of which joints should be assessed by US.2 Several reduced joint scores for US joint inflammation have been developed, but, to the best of our knowledge, their development has to a limited degree been based on data-driven approaches.3–5
Our research group recently developed two candidate sets of reduced US joint inflammation scores in early RA through a data-driven approach in cross-sectional data, aiming to retain as much information as possible from the full score.6 The candidate scores performed well in a validation cohort of established RA, and performed better than previously proposed reduced joint scores.3–5 Although these results showed that a reduced US assessment might efficiently contribute to assessment in RA, an US score has to be responsive in order to be an important tool to monitor disease activity.
In the present study, longitudinal US data from the ARCTIC trial, which became available after publication of our previous paper, were used. The objective of the current study was to develop a feasible US inflammation score focusing on sensitivity to change, and to validate the score by comparison with formerly proposed US scores in an independent longitudinal cohort.
Patients (>18 years) with RA were included in one of two cohorts between January 2010 and June 2013: early disease-modifying antirheumatic drug (DMARD)-naïve patients with RA fulfilling the 2010 American College of Rheumatology (ACR)/EULAR classification criteria with indication for methotrexate treatment (the ARCTIC trial, ClinicalTrials.gov identifier NCT01205854), and patients with established RA with active disease and indication for initiation of, or change of, biological DMARD (the ULRABIT study, Anzctr.org.au identifier ACTRN12610000284066).
An extensive US examination was performed at baseline, 3 and 6 months by experienced sonographers using a 0–3 semiquantitative scoring system for grey-scale (GSUS) and power Doppler US (PDUS) in each of the following 36 joints and 4 tendons: metacarpophalangeal (MCP) 1–5, proximal interphalangeal (PIP) 2–3, radiocarpal, intercarpal, radioulnar, elbow, knee, talocrural, metatarsophalangeal (MTP) 1–5, extensor carpi ulnaris (ECU) tendon and tibialis posterior (TP) tendon bilaterally. The range of the sum scores was 0–120 for GSUS and PDUS, and the scanning protocol was a slight modification of a previously published 32-joint protocol, with the addition of bilateral PIP2–3, ECU and TP tendons.7 The scoring was performed with defined probe placement and patient positioning and an US atlas as a reference.7 US workshops with static and dynamic hands-on exercises to calibrate readers were arranged yearly.
We used Siemens Antares Sonoline or GE Logiq E9 machines with linear probes (11.4/13.0 MHz) and power Doppler parameters were adjusted according to the device used (pulse repetition frequency 391/600 Hz; Doppler frequency 7.3/10.0 MHz) for US assessments.8 There were no changes in US settings during the study, and no upgrading of software.
Finally, we performed a substudy assessing the feasibility of the final Ultrasound in Rheumatoid Arthritis 9 joint/tendon score (USRA9) in clinical practice. Five sonographers with experience in structured US assessment were chosen, and recorded the time for bilateral scanning and recording of the USRA9 score in 35 consecutive patients with polyarthritis.
Laboratory and clinical examinations
Assessments in both cohorts included erythrocyte sedimentation rate (mm/hour), C reactive protein (mg/L), anticyclic citrullinated peptide (IU/mL) and visual analogue scales for investigator's and patients global assessments of disease activity (0–100 mm). In the early RA cohort, 44-swollen joint count and Ritchie articular index were performed, while 28 swollen and tender joint counts were performed in the established RA cohort.9 ,10
We performed factor analyses of GSUS and PDUS changes from baseline to 3 months (ΔGSUS and ΔPDUS) in the early RA cohort to identify joint/tendon groups with high internal correlation. The factor analyses were based on all joints/tendons examined in the US protocol. We used the principal component methodology, with the factors rotated according to the varimax criteria. The number of factors was based on eigenvalues with a cut-off of 1. Based on these analyses, we identified groups with correlating scores to guide the selection of the final US joint set. In groups with more than one joint identified by factor analysis, the selection process was based on factor loading and previous work to identify joints that retained most information from the extensive score.6 The final US score was defined as the sum of the joint/tendon scores in the final joint set.
Second, standardised response means (SRMs; mean change divided by the SD of the change) with 95% CIs (by bootstrapping) were calculated at 3 and 6 months for the final score and formerly proposed scores in the early RA cohort. We also calculated 3 and 6 months SRMs for the final score and previously proposed scores in the validation cohort.
Finally, we assessed the proportion of total information retained by the final score at baseline (both GSUS and PDUS) using linear regression analyses with the total US score (0–120) as the dependent variable and each individual joint/tendon score in the final joint set as independent variables. The proportion of information retained was assessed using R2.
Statistical analyses were performed using SPSS (V.21 SPSS, Chicago, Illinois, USA), except for factor analyses and bootstrapping, which were calculated in the SAS software package (V.9.2 SAS Institute, Cary, North Carolina, USA).
In total, 118 DMARD-naïve patients with early RA with indication for methotrexate and 212 patients with established RA with indication for starting or switching biological DMARD were included. Baseline demographic and patient characteristics in the two cohorts are presented in table 1. The 18 patients in the established RA cohort who were in the Disease Activity Score-28 (DAS28) remission had active arthritis in the feet/ankles (n=15) or received intra-articular steroids prior to inclusion (n=3).
Based on the factor analyses for ΔGSUS and ΔPDUS, we identified 12 joint groups, representing joints/tendons with correlating scores (see online supplementary table S1). Three groups (elbow, TP tendon and MTP1) were characterised by small changes in GSUS and PDUS over 3 months and were excluded from the final candidate score. In groups with multiple joints, the radiocarpal joint, MCP3 and MTP3 were selected based on the highest factor loading. Other groups were represented by one joint or tendon which all was included in the model (MCP1, MCP2, PIP2, PIP3, MTP2 and ECU tendon). The final US inflammation score, named the USRA9 score, is presented in figure 1.
Sensitivity to change of USRA9 compared with previously proposed US scores
The USRA9 score displayed the same or better sensitivity to change than our previous candidate sets and other proposed reduced US scores for GSUS and PDUS at 3 and 6 months in the early RA cohort (figure 2A, B and online supplementary table S2A, B).
In the validation cohort, the USRA9 score had the same level or somewhat larger SRMs compared with our previous candidate sets and other US scores (figure 2C, D, and online supplementary table S2C,D). The USRA9 score retained 87% of GSUS and 90% of PDUS information from the full score (36 joints and 4 tendons) before DMARD initiation in the early RA cohort. The corresponding numbers in the established RA cohort were 90% for GSUS and 92% for PDUS (table 2). The median (range) time to complete the USRA9 score bilaterally was 3 min 14 s (1 min 50 s to 5 min 53 s).
In this study, we present a feasible and responsive US inflammation score for RA, the USRA9 score, which includes examination of eight joints and one tendon. The USRA9 score was selected based on factor analysis of 3-month change in US scores in a recent longitudinal cohort, as well as previous work to identify joints that contribute the best information on inflammation in US examination. Most of the information from an extensive 36 joints and 4 tendons score is retained, and the score is more feasible than our previously proposed candidate scores.6
Somewhat surprisingly, there were no substantial differences in the SRMs between unilateral and bilateral US examinations (see online supplementary table S1A,B), and it is less time consuming to examine joints/tendons only on one side of the body. The total information retained was however higher if both sides were examined (table 2), which is also supported by previous studies indicating that RA is not necessarily a symmetrical disease.11 ,12 Unilateral examination of dominant side may be sufficient in some settings, but our findings indicate that a bilateral US joint/tendon examination should be preferred.
Limitations of all synovial Doppler US grading systems include the varying sensitivity of scanners and variable US machine settings. In the present study, both the machines and software were standardised between the different centres, with no upgrade of software during the follow-up. However, recent developments in the hardware and software of US scanners may allow even higher sensitivity to change, and computerised determination of the colour fraction may be more objective than subjective estimation.13 Only dorsal examinations of the joints were performed, thus we could not assess the implications of applying different projections. The study is strengthened by the validated semiquantitative scoring system for GSUS and PDUS with high intra-rater and inter-rater reliability, trained and calibrated sonographers, defined probe placements, availability of an US atlas as reference, standardised equipment and an extensive approach with two large independent cohorts of RA where a substantial number of joints were examined.7 In a substudy experienced sonographers familiar with the inflammation score spent a median of just over 3 min to perform bilateral scanning and recording of the USRA9 score. Our final US inflammation score includes many of the same joints as in a previous study based on clinical judgement and observed frequency of involvement in mixed cohorts of RA.4 Feasibility of the final score is improved compared with our previous candidate sets by reducing the number of joints.
In conclusion, we have developed a feasible and responsive reduced US inflammation score for RA, retaining most of the information from an extensive score, and which hopefully can contribute to a consensual US inflammation score for RA. The final score can be useful in clinical trials to assess US inflammation in RA. The objective measure of joint inflammation provided by US gives unique opportunities to answer research questions related to disease activity and inflammation in RA.
The authors thank the patients for participating in this study and the local rheumatology staff for data collection.
Contributors A-BA and EAH designed the study, recruited and enrolled participants, collected, analysed, and interpreted data, and wrote the report. ICO designed the study, analysed and interpreted data, and reviewed the manuscript. SL analysed, interpreted data and wrote the report. HBH designed the study, recruited participants, interpreted data and reviewed the manuscript. TU designed the study, recruited and enrolled participants, interpreted data, and reviewed the manuscript. HF, TMM, ÅSL, HH, ER, CH, HS, ALN, IJWH and GB recruited and enrolled patients, interpreted data, and reviewed the manuscript. DvdH and TKK designed the study, interpreted data and reviewed the manuscript. All authors have approved the final draft and vouch for the accuracy and completeness of the data and analyses.
Funding This trial was supported by the Norwegian Research Council, Norwegian South-Eastern Health Region, Norwegian Women's Public Health Association, Norwegian Rheumatism Association, investigator initiated research grants from AbbVie, UCB Pharma, Pfizer, MSD Norway, Roche Norway. Siemens Healthcare and GE Healthcare provided technical support regarding standardisation of ultrasound equipment. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.
Competing interests All authors have completed the Unified Competing Interest form at http://www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: EAH has received research funding from Pfizer, UCB, Roche, MSD and AbbVie for the submitted work, honoraria as a speaker from Pfizer, UCB, Roche, and AbbVie, honoraria for development of educational material from Pfizer, and has been on advisory board for Pfizer that might have an interest on the submitted work in the previous 3 years. A-BA has been on advisory boards for UCB, AbbVie and Pfizer, and received honoraria for development of educational material for UCB. HBH has received honoraria as a speaker from AbbVie, Bristol-Myers Squibb, Roche, UCB Pharma and Pfizer. HH has been on advisory boards for UCB and AbbVie. GB has received honoraria as a speaker from AbbVie and has been on advisory board for Pfizer. DvdH has received consultancy honoraria from AbbVie, Amgen, Astellas, AstraZeneca, Bristol-Myers Squibb, Celgene, Daiichi, Eli Lilly, Galapagos, Merck, Novartis, Pfizer, Roche, Sanofi Aventis, Janssen and UCB, and is owner of Imaging Rheumatology. TKK has received consultancy honoraria from AbbVie, Bristol-Myers Squibb, Celltrion, Epirus, Hospira, Merck-Serono, MSD, Orion Pharma, Pfizer and UCB that might have an interest on the submitted work in the previous 3 years.
Patient consent Obtained.
Ethics approval The study was approved by an Independent Ethics Committee (REC South-East; reference number 2010/744) and appropriate Institutional Review Boards.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.