Objective To develop a model that assesses the risk for progressive disease in patients with systemic sclerosis (SSc) over the short term, in order to guide clinical management.
Methods Baseline characteristics and 1 year follow-up results of 163 patients with SSc referred to a multidisciplinary healthcare programme were evaluated. Progressive disease was defined as: death, ≥10% decrease in forced vital capacity, ≥15% decrease in diffusing capacity for carbon monoxide, ≥10% decrease in body weight, ≥30% decrease in estimated-glomerular filtration rate, ≥30% increase in modified Rodnan Skin Score (with Δ≥5) or ≥0.25 increase in Scleroderma Health Assessment Questionnaire. The number of patients with progressive disease was determined. Univariable and multivariable logistic regression analyses were used to assess the probability of progressive disease for each individual patient. Performance of the prediction model was evaluated using a calibration plot and area under the receiver operating characteristic curve.
Results 63 patients had progressive disease, including 8 patients who died ≤18 months after first evaluation. Multivariable analysis showed that friction rubs, proximal muscular weakness and decreased maximum oxygen uptake as % predicted, adjusted for age, gender and use of immunosuppressive therapy at baseline, were significantly associated with progressive disease. Using the prediction model, the predicted chance for progressive disease increased from a pretest chance of 37% to 67–89%.
Conclusions Using the prediction model, the chance for progressive disease for individual patients could be doubled. Friction rubs, proximal muscular weakness and maximum oxygen uptake as % predicted were identified as relevant parameters.
Statistics from Altmetric.com
What is already known about this subject?
Few studies have described algorithms on an individualised basis to predict mortality after 2 to 15 years of follow-up in systemic sclerosis (SSc).
What does this study add?
A prediction model assessing the chance for progressive disease for individual patients at short term was currently developed.
How might this impact on clinical practice?
Using the prediction model, the predicted chance for progressive disease could be doubled from a pretest chance of 37% to 67-89%.
Maximum oxygen uptake as measured by CPET is identified as biomarker for progressive SSc.
Individualised management and treatment is one of the most important challenges in medicine. Systemic sclerosis (SSc) is a rare multisystem disease which is highly heterogeneous in presentation and disease course. Recent evidence suggests that earlier initiation of adequate treatment based on regular screening for organ involvement contributes to improved survival.1 The availability of new treatment options, such as autologous haematopoietic stem cell transplantation (HSCT), offers the chance for prolonged event-free survival.2 For optimal efficacy of this treatment, careful timing in the disease course is of pivotal importance. Given the associated treatment-related mortality during the first year, this treatment option underlines the need to identify patients with a high risk of severe organ involvement in the short term.
Numerous attempts have been made to identify predictors for severe organ involvement and mortality in SSc.3–11 Only a few studies have described algorithms to predict outcome on a more individualised basis.12–16 The aforementioned studies defined outcome of interest after 2–15 years of follow-up. In contrast, a recently published study containing observational data from the EUSTAR database described a model identifying, among patients with diffuse cutaneous SSc, those with a 44% chance of skin fibrosis progression during the first year, as compared to 9.7% in the whole cohort.17 Ideally, in order to guide individualised management of patients with SSc, a model combining outcome parameters for several organ systems and mortality predicting disease course in the short term should be available. Whether it is possible to reliably identify patients at risk using such a model, given the heterogeneous nature of SSc, remains to be determined.
The present study aimed to develop a model that predicts progressive disease in the short term, defined by either deterioration of organ functions, or mortality, in patients with SSc. The derived prediction model is evaluated for discriminative performance, and a cut-off value is determined in order to evaluate utility in clinical practice.
Patients and methods
This study is performed using data from a prospective cohort study in patients with SSc who participated in an annual 2-day multidisciplinary healthcare programme aiming to structure screening for organ involvement and to provide multidisciplinary care for patients with SSc. Ethical approval was obtained from the Institutional Review Board of the Leiden University Medical Centre (LUMC). All participants gave written informed consent.
Data from all patients referred to the multidisciplinary healthcare programme between April 2009 and January 2014 were collected. Patients were included if they had a diagnosis of SSc according to the American Rheumatism Association,18 the LeRoy criteria19 or the ACR/EULAR 2013 classification criteria.20
On the basis of the degree of skin involvement, three subtypes of patients were classified:
Diffuse cutaneous SSc (DcSSc) with skin involvement proximal to the elbows and knees.
Limited cutaneous SSc (LcSSc) with skin involvement distal to the elbows and knees.
Limited non-cutaneous SSc (LSSc) without skin involvement.
Skin scores were all performed by experienced rheumatologists (AS, JVB, AAS). Patients were classified on the basis of their maximum skin score ever. For example, if a patient had had a skin score of 30 and underwent HSCT after which the skin score decreased to 6, the patient was still classified as DcSSc.
For the current analysis, selected patients had to have participated in the care programme at least twice, with the second visit 1 year after the baseline visit (range 10–23 months).
Multidisciplinary healthcare programme
All patients participated in the healthcare programme that combines annual extensive organ screening with multidisciplinary team care. Cardiopulmonary investigations included: high-resolution CT (HRCT) of the thorax, pulmonary function tests (including analyses of forced vital capacity (FVC) and diffusing capacity for carbon monoxide (DLCO)), cardiopulmonary exercise test (CPET; including analyses of maximum heart rate, maximum wattage, maximum oxygen consumption (VO2) and maximum ventilation), echocardiography and 24 h Holter electrocardiography (ECG). Furthermore, laboratory investigations including measurement of autoantibodies and nailfold videocapillaroscopy were performed.
In addition, the patients completed the Scleroderma Health Assessment Questionnaire (SHAQ) for assessment of physical functioning and the Short Form-36 (SF-36) for quality of life.
Diagnosis of interstitial lung disease (ILD) was determined on the basis of the presence of a non-specific interstitial pneumonia pattern or usual interstitial pneumonia pattern on the HRCT-thorax,21 as reported by the radiologist.
The systolic pulmonary artery pressure (SPAP) was estimated using echocardiography by an experienced cardiologist and elevated pulmonary pressure is defined using a cut-off value of 35 mm Hg.22 Left ventricular end-diastolic and end-systolic volumes were measured using the biplane modified Simpson's rule. Left ventricular ejection fraction was calculated as left ventricular end-diastolic—LV end-systolic volume/left ventricular end-diastolic volume. Furthermore, the presence of pericardial effusion was noted. The presence of arrhythmias was defined as the presence of multiform ventricular extrasystole >100 per day, couplets or runs of ventricular tachycardia or supraventricular tachycardia of at least 30 s on 24 h Holter ECG monitoring.23 Conduction abnormalities were defined as a complete left bundle branch block or right bundle branch block, atrioventricular block (first, second or third degree) or pacemaker rhythm for sinus node dysfunction.23
Change of treatment
Initiation of new immunosuppressive treatment is mainly considered in case of extensive and/or progressive skin involvement, relevant decline in VC and/or DLCO (without using an absolute threshold) in combination with the presence of non-specific interstitial pneumonia or usual interstitial pneumonia on HRCT. Autologous HSCT is applied according to the inclusion criteria and treatment regimen as described in the ASTIS trial (24). Azathioprine (AZA) is prescribed in case of primary biliary cirrhosis and hydroxychloroquine (HCQ) in case of SSc overlap syndrome with rheumatoid arthritis (RA). Rituximab is given as part of a randomised placebo-controlled clinical trial (RITIS), registered at https://www.clinicaltrialsregister.eu/ EudraCT Number: 2008-007180-16.
Since we aimed to define risk for progressive disease in general, in order to guide clinical management, several variables were chosen, each reflecting a different organ system. Cut-offs for these variables were based on reported values for minimal important difference (MID). Selected variables were: (1) death before the second visit; (2) decrease of ≥10% in FVC (percentage of predicted);16 (3) decrease of ≥15% in DLCO (percentage of predicted);16 (4) decrease of ≥10% in body weight;24 (5) decrease of ≥30% in estimated-glomerular filtration rate (eGFR);25 (6) increase of ≥30% in modified Rodnan Skin Score (mRSS) with a minimum of Δ5;26 ,27 or 7 ≥0.25 increase in SHAQ.27 Overall progressive disease was defined as the occurrence of at least one of the above prespecified outcomes during 1 year of follow-up.
Associations between baseline variables and the presence of progressive disease were evaluated and expressed as ORs with the 95% CIs and p values.
Missing values of variables used to define overall progressive disease and baseline predictors were replaced by multiple imputation using multiple regression modelling by the multiple imputations by chained equations procedure as implemented in SPSS.28 Missing CPET were considered missing not at random, as an inability to perform CPET most likely reflects severe impaired cardiopulmonary performance status. Therefore, VO2 max was not imputed and the missing-indicator method was used.28 When CPET was missing, an indicator variable, with value 1 if the CPET was missing and 0 if the result was present, was created.
Univariable logistic regression analysis was used to determine the independent association between baseline characteristics and overall progressive disease after 1 year of follow-up.
Possible correlations between all variables which were significantly contributing in the univariable logistic regression analyses were checked for multicollinearity using a variance inflation factor (VIF) of 10.29 In case of multicollinearity between variables (VIF >10), the most significant variable was selected for further analysis.
For the multivariable model, all predictor variables with a p value smaller than 0.05 in the univariable analysis, indicating an important association with progressive disease, were selected using a predictor selection approach (forward selection). Univariable and multivariable logistic regression analyses were always adjusted for previous and current immunosuppressive therapy (including cyclophosphamide, methotrexate and HSCT) at baseline. Multivariable logistic regression analysis was adjusted for age and gender.
The predicted probability of progressive disease was calculated for every patient.
The predicted probabilities were compared with the observed percentage of patients with progressive disease. The positive predictive value (PPV) and negative predictive value (NPV) were determined for several cut-off values of the predicted probability.
The predictive performance of the model was assessed by examining measures of calibration and discrimination. Calibration refers to how close predicted progressive disease agrees with observed progressive disease and was assessed with a calibration plot.30 Since progressive disease is a binary outcome, a loess algorithm was used as a smoothing technique to estimate the observed probability.31
The discrimination of the prediction model was assessed by receiver operating characteristic (ROC) curve analysis.
For internal validation, a bootstrap procedure was performed for control for overfitting.32
All statistical analyses were executed using SPSS V.20.0 software (SPSS Inc, Chicago, USA), except that bootstrap validation was performed by using R V.3.1.1.
By January 2014, 163 patients with SSc had had a second evaluation after a mean period of 13.5 months (SD 2.5). Eight patients died before the second visit could have been performed. Baseline characteristics of the 171 included patients are presented in table 1. The patients were mostly women (80%), Caucasian (70%) and, on average, 53 years (SD 14). Patients had a median disease duration of 2 years. The disease subset at baseline was classified as DcSSc in 61 patients, LcSSc in 75 patients and LSSc in 28 patients.
At baseline, 63 (39%) patients were treated with immunosuppressive medication, including 55 (32%) patients who were previously treated with one or more immunosuppressive medications including autologous HSCT (n=13), cyclophosphamide (n=18), corticosteroids (n=28), methotrexate (MTX; n=28) and AZA (n=2), HCQ (n=2) and 60 (35%) patients currently being treated with immunosuppressive medication, including mycophenolate mofetil (MMF; n=6), corticosteroids (n=24), MTX (n=22), AZA (n=5) and HCQ (n=7). In total, 65 (38%) patients were previously, or are currently, treated at baseline evaluation with cyclophosphamide, MTX or HSCT.
Change of treatment
On the basis of the findings during the multidisciplinary healthcare programme, new immunosuppressive treatment (one or more medications) was started at baseline in 37 patients (22%). Newly prescribed treatment included autologous HSCT (n=2), cyclophosphamide (n=10), MMF (n=5), corticosteroids (n=4), MTX (n=7), AZA (n=1), HCQ (n=2) and rituximab/placebo (n=8). In none of the patients with previous HSCT was new immunosuppressive medication started.
Within 1 year after the first visit, eight patients (mean age 62.6 years) died, including four patients with DcSSc, three patients with LcSS and one patient with LSSc. Three patients died due to ILD, one due to PAH, one due to adenocarcinoma of the lung (in a non-smoker), one due to cardiac failure and one due to cytomegalovirus pneumonitis after allogeneic SCT. In one patient (died at age 87 years after suffering from renal disease), the exact cause of death could not be determined. All patients were classified as those with ‘progressive disease’, since for none of the patients could an association between SSc and death be ruled out with absolute certainty.
Sixty-three patients showed overall progressive disease at follow-up evaluation according to the predefined criteria, including eight patients who died (table 2). Overall progressive disease was found in 25 (39%) patients with DcSSc, in 30 (38%) with LcSSc and in eight (29%) with LSSc. One patient with LcSSC and one patient with LSSc progressed to DcSSc within 1 year of follow-up. Three patients with LSSc evolved to LcSSc based on development of sclerodactyly. Progressive disease in patients with LSSc was primarily based on a decrease of pulmonary function; FVC decreased in four patients and DLCO in one patient.
The organ systems and number of prespecified outcomes contributing to overall progressive disease are demonstrated in online supplementary figure 1. The majority of the patients (71%) had overall progressive disease based on one event, while in 13% of the patients two events and in 3% of the patients three events contributed to overall progressive disease.
Age, gender, disease subset, SSc-related autoantibodies, friction rubs, proximal muscular weakness, eGFR, ESR and body weight were available for all patients. The following baseline variables were missing and imputed: mRSS (N=3), FVC (N=3) and DLCO (N=4), urine protein (N=7), SHAQ (N=4) and physical component summary score (according to SF-36 (PCSS); N=12).
CPET was not performed in 11 patients due to an inability to cycle based on bad physical performance (N=4) and musculoskeletal disability (N=2).
At follow-up, the following outcome parameters were missing and imputed: mRSS (N=2), FVC (N=3), DLCO (N=5) and SHAQ (N=22).
Prediction of progressive disease
Table 3 shows results of the univariable logistic regression analysis, adjusted for previous and current immunosuppressive therapy. After adjusting for immunosuppressive therapy, friction rubs, proximal muscular weakness, pulmonary crackles, mRSS, DLCO, VO2 max, SHAQ and PCSS according to SF-36 were significantly associated with progressive disease after 1 year of follow-up. FVC and gender were borderline significant (p value <0.10).
No multicollinearity was found between friction rubs, proximal muscular weakness, pulmonary crackles, mRSS, DLCO, VO2 max, SHAQ and PCSS.
Prediction in subpopulations with DcSSc and LcSSc
No significant predictors for progressive disease in patients with DcSSc were identified. In patients with LcSSc, VO2 max % predicted and PCSS of SF-36 were identified as significant predictors for progressive disease. However, the multivariable logistic regression analysis for patients with LcSSc did not identify significant predictors for progressive disease (see online supplementary material file).
Multivariable analyses and derivation of the prediction model
In the multivariable logistic regression analysis, independent predictive variables for progressive disease were friction rubs, proximal muscular weakness, VO2 max % predicted and immunosuppressive therapy. OR for progressive disease increased with 12.462 (95% CI 1.253 to 123.905) in the presence of friction rubs and 5.550 (95% CI 1.000 to 30.796) in the presence of proximal muscular weakness, and decreased with 0.979 (95% CI 0.964 to 0.995) per unit increase in VO2 max % predicted. A missing VO2 max was accompanied by its corresponding missing indicator variable. The coefficients for the prediction model are listed in table 4.
The multivariable model remained unchanged when adding the borderline significant variable in the univariable analysis: FVC was excluded from the final model resulting from the forward selection.
Predictive performance of the prediction model
Table 5 shows the predictive performance of several cut-off values for the predicted probability and the number of observed patients with progressive disease. Using cut-off values 0.25 and 0.75, 80% of the patients who had a score of <0.25 did not develop progressive disease (NPV 80%, 95% CI 69% to 91%), and 89% of the patients who had a score of >0.75 did develop progressive disease (PPV 89%, 95% CI 84% to 94%). The calibration plot of the prediction model is shown in the online supplementary file (figure 2). The prediction model showed a reliable calibration, predicting progressive disease in agreement with the observed progressive disease. The calibration plot showed that for predicted probabilities smaller than 0.55, the prediction model is overestimating the observed overall disease progression. For the probabilities higher than 0.60, the model slightly underestimates the chance for progressive disease.
The discriminative ability of the model was evaluated with an ROC curve (see online supplementary file, figure 3), showing an AUC of 0.707 (95% CI 0.682 to 0.732). The optimum cut-off value of the prediction model, as verified by the ROC curve, showed a sensitivity of 60% and a specificity of 85%, corresponding to a cut-off value of 0.38 for the predicted probability, with a PPV of 42% and an NPV of 76%.
The AUC of the bootstrap predictions equalled the AUC value of the prediction model (0.72, 95% CI 0.64 to 0.81), indicating that overfitting was not a problem.
This study is the first attempt to develop a clinical model to assess the chance for overall progressive disease in the short term in patients with SSc in order to guide clinical management. Our study shows that even in a cohort of patients with SSc not selected for disease duration or subtype, overall disease progression is frequently observed. By applying the model, the expected chance for progression could be increased from 37% to 67–89%, depending on the chosen cut-off value, indicating that improved discrimination of patients is a reasonable possibility. The current prediction model is not externally validated and should therefore be validated in other cohorts. However, internal validation showed that overfitting was not a problem, and results seem to be robust.
A broad set of variables was available for evaluation of association with overall disease and its role in pulmonary involvement. Friction rubs, proximal muscular weakness and VO2 max % predicted as determined by CPET were the relevant predicting variables included in the model, after correction for age, gender and immunosuppressive treatment. This suggests that friction rubs, proximal muscular weakness and VO2 max are relatively sensitive variables in measuring overall progressive disease. Recently, a EUSTAR study concerning predictors of progressive disease has been published,4 identifying joint synovitis and tendon friction rubs as parameters independently associated with disease progression after 2 years of follow-up. In our population, we did not find an association between synovitis and progressive disease; however, friction rubs were significantly associated with progressive disease, confirming the relevance of this finding. As compared to this EUSTAR study, we used a different definition of progressive disease, generally identifying patients at an earlier disease stage.
CPET evaluates patients during exercise, so it is likely to detect cardiopulmonary abnormalities not measurable at rest. Different aspects of pulmonary involvement can be evaluated during CPET (lung parenchymal damage as well as vascular abnormalities). Furthermore, it is highly reproducible, non-invasive and operator-independent. The role of the CPET in organ involvement screening is a relatively new finding. Most studies focused on the role of CPET in identifying PAH33 ,34 Very few studies have investigated CPET as a possible biomarker for active/progressive disease in SSc. Cuomo et al35 suggested including CPET in screening programmes for severity of SSc. They found that an impaired maximum oxygen uptake was present in 93% of the patients and independently associated with the severity of lung involvement. Our study confirmed the importance of CPET in identifying patients at risk for progressive disease in general, including progressive disease based on other parameters than pulmonary involvement or PAH.
Our study has several limitations which should be taken into account.
First, no validated definition of progressive disease is available, and therefore overall progressive disease was defined as a combination of MIDs as used in randomised clinical trials in SSc. Whether this definition is a useful outcome parameter should be evaluated in future studies. We have chosen to define outcome parameters reflecting the different organ systems (skin, lungs, kidneys), as well as parameters reflecting health in general (weight loss, mortality, functional ability). The cut-off values have been based on defined MIDs, as our intention is to select patients with a high risk for significant deterioration for more stringent annual follow-up. Second, the accuracy of our model is moderate. However, it is in line with other prediction models.12–15 ,17 We hypothesise that the poor discriminative ability is at least partially caused by our decision to define a broad outcome parameter describing several organ systems in the relatively short term.
Third, while other prediction models specifically have focused on patients with DcSSc,14 ,17 we were interested in predicting progressive disease in the whole patient population, as regular follow-up of all patients with SSC is being advocated.36 ,37 In line with this, recently developed diagnostic criteria also aim at classifying patients earlier in the disease course,20 ,38 in order to identify significant organ involvement at an earlier time point. As a matter of interest, we did evaluate possible predictive factors in subpopulations with DcSSc and LcSSc, but no significantly strong predictors were identified. This can possibly be explained by the low number of patients when only selecting either DcSSc (n=64) or LcSSc (n=79). In addition, since most patients with DcSSc had long-standing disease (mean disease duration of 5.1±6 years), discrimination of those patients who still progress is even more difficult, and larger patient groups are needed. Including patients with L(c)SSc and patients with DcSSc with longer disease duration naturally decreased the overall percentage of patients with progressive disease in our cohort as patients presenting with early DcSSc have a different natural history.39 Within 1 year of follow-up, progression to DcSSc was found in 2% of patients with L(c)SSc. Strikingly, although all subpopulations of SSc, including LSSc, LcSSc and DcSSc, were included, mRSS was not selected for the final prediction model. We believe that this is explained by the fact that part of the patients with DcSSc had been treated successfully before the baseline visit and had stable low skin scores during the time frame under study. However, since our intention was to develop a prediction rule which can be used to guide clinical practice, for all patients with SSc currently in follow-up irrespective of disease duration or previous treatment, we explicitly chose to also include these patients.
Lastly, 38% of the patients were previously or currently treated with cyclophosphamide, MTX or autologous HSCT at baseline evaluation, which can have influenced our findings. Therefore, all logistic regression analyses were repeated including only patients who had not been treated before. Multivariable logistic regression analyses in these patients identified VO2 max % predicted as the only significant predictor (data not shown). Since our aim was to develop a prediction rule which can be used to guide clinical practice, also in patients who have been treated before, we explicitly chose to develop our model based on a population including untreated patients and treated patients.
This study explored the possibility of prediction of progressive disease in the short term in a heterogeneous population with SSc. The advantages of our study are that the data were prospectively derived from a single centre cohort of patients with SSc. The number of missing values was very low. Since all patients fulfilling SSc classification criteria that visit in the healthcare programme are scheduled for a follow-up visit, independent of disease duration and subtype, the study population reflects the whole population present in a tertiary care centre and therefore the risk of selection bias is low. As compared to other cohorts with SSc, the sociodemographic characteristics, disease severity and functional status of our cohort are comparable to those of other cohorts.40 ,41
In conclusion, our study shows that individualised management in patients with SSc is a reasonable possibility. Using the developed prediction model, the chance for progressive disease could be increased from 39 to 67–89%, advocating annual stringent follow-up at least in patients with friction rubs, proximal muscle weakness and low maximum oxygen uptake at baseline. Future studies are needed to further optimise prediction of disease progression for the individual patient. In addition, maximum oxygen uptake as measured by CPET was identified as a possible new biomarker for progressive disease in SSc. This finding should be replicated in different cohorts of patients with SSc.
- Received April 7, 2015.
- Revision received August 19, 2015.
- Accepted October 3, 2015.
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
- Data supplement 1 - Online supplement
Contributors JM collected the data, was involved in statistical analysis, writing and critically reviewing the manuscript, and approved the final version. AAS, NAM and MKN collected the data, were involved in critically reviewing the manuscript and approved the final version. TS was involved in statistical analysis and in critically reviewing the manuscript, and approved the final version. HP was involved in statistical analysis and approved the final version. TWJH was involved in critically reviewing the manuscript and approved the final version. JKdV-B collected the data, reviewed the data statistics, was involved in writing and critically reviewing the manuscript, and approved the final version.
Funding JM was supported by an unrestricted educational grant of Actelion Pharmaceuticals Nederland BV (Woerden, The Netherlands).
Competing interests None declared
Patient consent Obtained.
Acknowledgements We would like to thank Annemie J.M. Schuerwegh for her involvement in the clinical care of the multidisciplinary health care program.
Ethics approval Leiden, The Netherlands.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.