Objective Patients and physicians commonly differ in their assessments of rheumatoid arthritis (RA) activity. Clinically meaningful discordance thresholds or validation of their ability to predict functional outcomes are lacking. We explored whether an unbiased, person-centred latent profile analysis (LPA) approach could classify cases based on patient global assessment (PtGA) and physician global assessment (MDGA) assessments of RA activity. We further examined whether the LPA groups displayed greater differences in clinical outcomes compared with traditional threshold-based groups. Finally, we evaluated whether LPA yielded higher explanatory power for clinical outcomes.
Methods LPA was performed in 618 patients with established RA from a single centre. A threshold-based discordance definition was used as a comparator, with patients classified into concordant (PtGA–MDGA within ± 3 cm), positively discordant (PtGA–MDGA ≥3 cm) and negatively discordant groups (PtGA–MDGA ≤−3 cm).
Results LPA yielded five distinct groups: low PtGA/low MDGA (35.9%), moderate PtGA/moderate MDGA (18.6%), high PtGA/high MDGA (14.7%), high PtGA/low MDGA (23.3%) and low PtGA/high MDGA (7.4%). Groups differed across clinical, physical function, pain, fatigue, health-related quality of life, work productivity and activity impairment outcomes (p<0.001). Concordance groups, in particular, displayed marked heterogeneity in outcomes depending on the magnitude of disease activity reported, with the low/low group faring the best (p<0.001). The LPA solution demonstrated superior explanatory power for all outcomes (p<0.001).
Conclusions We confirmed the validity and advantages of LPA in characterising the relationship between PtGA and MDGA over a conventional threshold-based definition. LPA yielded optimally distinct, clinically meaningful and cohesive groupings, demonstrating superior explanatory power for disease-related outcomes of interest.
- Rheumatoid arthritis
- disease activity
- patient perspective
- outcomes research
This is an Open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
What is already known about this subject?
Patients and physicians commonly differ in their evaluations of rheumatoid arthritis activity. Clinically meaningful discordance thresholds have not been empirically derived, and the ability of the ones used to optimally differentiate clinical, functional and health-related quality of life (HRQoL) outcomes has not been adequately explored.
What does this study add?
An unbiased, empirically derived, patient-centred latent profile analysis approach to characterise the relationship between patient and physician assessments of disease activity identified diverse and clinically meaningful patient groups.
This five-profile solution was numerically distinct from the traditional three-group, threshold-based discordance approach and demonstrated greater predictive power for disease-related, clinical, functional and HRQoL outcomes.
How might this impact on clinical practice?
Our findings suggest that simply considering the magnitude of disagreement between patients and physicians is less clinically useful than carefully contemplating the reporting pattern (ie, which informant reports greater disease activity) and whether patients and physicians agree or disagree on the presence of high or low disease activity levels.
Patients and physicians commonly differ in their evaluations of rheumatoid arthritis (RA) activity.1–4 Such discrepancies have been traditionally reported as a difference or discordance score by subtracting physician global assessment (MDGA) from patient global assessment (PtGA).1 2 4 5 Based on this, patients are arbitrarily classified as concordant, positively discordant (higher patient activity) or negatively discordant (higher physician activity). Despite this being intuitively appealing and computationally convenient, there are neither empirical evidence nor strong a priori hypotheses supporting the number or nature of the groups that qualify the relationship between PtGA and MDGA. Both are integral components of the American College of Rheumatology (ACR) core set and (some) remission definitions and further inform therapeutic decisions.6 7 Since determinants of those scores and their relative contributions are vastly disparate, the concept of a discrepancy score generated by simple subtraction of two heterogeneous constructs as a predictor of functional outcomes is theoretically and statistically problematic.8 Moreover, the ability of the various, widely reported arbitrary cut-offs to optimally differentiate clinical, functional and health-related quality of life (HRQoL) outcomes between patient groups has not been explored. Additionally, the magnitude of RA activity patients and physicians consensually report is not taken into consideration in the conventional framework of a difference score. It has been shown that when RA is in remission, patients enjoy superior physical function and incur less radiographic progression than when it is highly active.9
Another concern is that studies evaluating the impact of patient–physician discordance on various outcomes of interest have used variable-centred methodologies such as multiple regression1 4; such approaches assume that the entire population is homogeneous and therefore results reflect the relationships averaged over the entire population. Additionally, since they focus on the structure of the variables across persons, rather than the patterns of response within persons,10 they may be inappropriate when seeking to interpret individual data.11 In contrast, person-centred approaches assume that the population is heterogeneous and allow for examination of patterns and relationships among variables at the individual level.11–13
Latent profile analysis (LPA) is an empirically derived, person-centred approach that focuses on relations among individuals with the purpose of sorting them into groups of subjects who are similar to each other and different from the other groups. It identifies the smallest number of latent groups required to account for the distribution of individuals across indicators.14 15 The number of groups that best fits the data is determined statistically rather than subjectively.16 The purpose of our study was to evaluate the ability of LPA to classify cases based on the patterns of relationships between PtGA and MDGA. We then examined the potential overlap and discrepancies between the latent profiles and traditional discordance groups and compared their respective explanatory power for outcomes of interest. We lastly assessed the concurrent validity of the LPA-generated groups by exploring associations between the profiles and clinical, functional and HRQoL outcomes.
Study design and participants
Study participants were enrolled in the Harbor-University of California Los Angeles (UCLA) prospective observational RA cohort between 2012 and 2017.17 The first visit with complete data available for all predictors and outcomes of interest within that time frame was selected for analysis. We evaluated 618 patients with established RA. Patients were included in the study if they were ≥18 years old and fulfilled 2010 ACR criteria for RA.18 Patients with overlapping autoimmune syndromes or comorbid conditions that could confound RA treatments (including chronic infections, advanced or decompensated heart failure, class II chronic kidney disease or above and cancer within 5 years) or at risk of suicide were excluded. All patients provided written informed consent in compliance with the Helsinki Declaration, and the study was approved by the Harbor-UCLA Institutional Review Board.
PtGA and MDGA ratings were recorded on 10 cm visual analogue scale (VAS) anchored by ‘very good’ or ‘no activity’ on the left and ‘very bad’ or ‘high activity’ on the right, respectively. Prior to the visit, patients completed self-report questionnaires; the PtGA question asked was ‘Considering all the ways your arthritis has affected you, how do you feel your arthritis is today?’. This was in accordance to the proposed phrasing by the ACR/European Leagues Against Rheumatology remission criteria related to disease activity.19 20 After conclusion of the index visit, the examining physician (blinded to the patient’s rating) recorded their activity evaluation (MDGA) based on history, physical examination and available laboratory tests. The prompt given to the physician was ‘Mark on the line below to indicate disease activity (independent of the patient’s self-assessment)’. The conventional discordance definition comparator included a PtGA–MDGA difference score of ≥3, informed by a recent meta-analysis indicating this to be the most frequently used threshold (5); based on this cut-off, patients were classified into three groups: concordant (PtGA–MDGA within ± 3 cm), positively discordant (PtGA–MDGA ≥3 cm) and negatively discordant (PtGA–MDGA ≤−3 cm).
Demographic, clinical, serological, laboratory, radiographic and treatment data were obtained via chart review. Disease activity assessment was based on 28-joint counts for tenderness joint count, swelling joint coun and erythrocyte sedimentation rate (ESR). Presence of erosions and irreversible articular damage (IAD) defined as subluxation, fusion, contracture or fixed deformity, arthrodesis or prosthesis were recorded. The presence of fibromyalgia based on the ACR preliminary classification criteria21 was also captured.
Physical function was evaluated using the Health Assessment Questionnaire Disability Index (HAQ-DI).22 The nine-item Patient Health Questionnaire (PHQ-9)23 24 assessed depressive symptoms (range 0–27). Pain and fatigue were both measured using 10 cm VAS. HRQoL was evaluated by the physical component summary and mental component summary and eight domain scores of the 36-item Short Form Survey (SF-36).25 The Work Productivity and Activity Impairment Questionnaire26 assessed activity impairment due to RA and percentage of work productivity loss among employed subjects.
We performed LPA using the Mplus software package (Muthen & Muthen). LPA models with increasing number of groups were fit to the data. The optimal number of profiles was determined based on the Bayesian information criterion, the Vuong-Lo-Mendell-Rubin likelihood ratio test, the Akaike information criterion and entropy.14 27 28 An a priori decision was made to abort testing models with increasing group numbers if at least two fit statistics suggested no further improvement. The Mplus output includes scores for the conditional probability of each patient being a member of any of the LPA groups, allowing evaluation of how well the model classifies patients.29 For the purposes of group comparison and external validation, we assigned patients to the profile for which they had the highest conditional probability. Latent profiles were related to demographic and clinical characteristics with analysis of variance (ANOVA) or χ2 tests. The meaningfulness of the LPA solution was assessed using analysis of covariance, which evaluated between-group differences on clinical, functional and HRQoL outcomes. We used adjusted ∆R 2 value (per cent unique variance explained) to assess the incremental explanatory power of regression models from the LPA-derived solution compared with the traditional discordance group definition to predict outcomes of interest after the effects of relevant clinical covariates had been removed. Age, gender, RA duration, IAD and fibromyalgia were included as descriptive clinical variables in all covariate adjusted analyses. Significance level was set at p<0.05, and post hoc pairwise comparisons were Benjamini-Hochberg corrected.30 Analyses were performed using SPSS V.21.
LPA identifies five distinct patient groups
A five-group solution provided the best fit for the data (online supplementary table 1). The five distinct patient groups based on different pairings of PtGA and MDGA appear in figure 1: group 1: low PtGA/low MDGA (n=222, 35.9%); group 2: moderate PtGA/moderate MDGA (n=115, 18.6%); group 3: high PtGA/high MDGA (n=91, 14.7%); group 4: high PtGA/low MDGA (n=144, 23.3%); and group 5: low PtGA/high MDGA (n=46, 7.4%). Demographics and clinical characteristics for all groups are summarised in table 1 below.
Patients were largely female with established, robustly seropositive and erosive RA. Seropositivity, radiographic erosions and treatment characteristics were similarly distributed across all LPA groups. Group 4 members were older, with longer disease duration and higher fibromyalgia rates compared with other groups (all p≤0.01). Clinical and serological inflammatory burden was significantly different across groups (p<0.001).
Comparisons of LPA and traditional discordance groups
The PtGA and MDGA distributions across the three traditional threshold-based groups (negatively discordant, concordant and positively discordant versus those in the LPA-generated class definition are shown in online supplementary figure 1. Similar to the traditional concordance category, patients in LPA groups 1, 2 and 3 displayed congruent PtGA and MDGA scores; however, this congruence referred to three very different inflammatory activity states. In group 1, both parties reported low disease activity (mean PtGA and MDGA of 1.9 and 1.0, respectively), in group 2: moderate disease activity (5.3 and 4.4, respectively) and in group 3: high disease activity (7.4 and 8.6, respectively). A cross-tabulation of LPA-derived and the traditional discordance groups appears in table 2.
This revealed that patients assigned to positive and negative discordance groups using the conventional definition were, for the most part, members of a latent profile with comparable PtGA–MDGA differences: high PtGA/low MDGA (group 4) and low PtGA/high MDGA (group 5), respectively. In contrast, the traditional concordance category was more of a true amalgam of members from the low PtGA/low MDGA group 1 (54.4%), moderate PtGA/moderate MDGA group 2 (26.0%) and high PtGA/high MDGA group 3 (19.6%) latent profiles.
The LPA group solution demonstrated significantly higher explanatory power (adjusted incremental R2) for all inflammatory activity parameters, as well as physical function, pain, fatigue, depression, HRQoL, work productivity and activity impairment outcomes than the traditional discordance definition (figure 2, all p<0.001); this was above and beyond that accounted for by age, gender, RA duration, IAD and fibromyalgia.
Clinical, functional and HRQoL outcomes
The LPA groups differed across all clinical and laboratory evaluations of inflammatory burden (table 1). More importantly, they also reported diverse functional, HRQoL, work productivity and activity impairment outcomes as shown in figure 3 and table 3.
This was particularly true for groups 1, 2, and 3, which would, under usual circumstances, be collapsed into a singular traditional concordance category. Group 1 (low PtGA/low MDGA) reported the lowest burden of physical impairment, pain, fatigue, depression, work productivity and activity impairment and enjoyed near normal physical and mental function (compared with age-matched and gender-matched norms). In contrast, group 3 (high PtGA/high MDGA) fared the worst of all groups; it reflected the highest inflammatory burden, greatest physical, mental and social function restrictions, along with worst pain, fatigue and depression scores. Group 4 (high PtGA/low MDGA) patients experienced significant RA impact despite low inflammatory burden. Surprisingly, patients in group 5 (low PtGA/high MDGA) reported significantly lower physical limitations, pain, fatigue, depression, work productivity loss and activity impairment and superior physical and mental function than group 3 subjects, despite comparable MDGA scores (table 3).
Our study demonstrates the validity and advantages of an empirically derived, person-centred approach characterising the relationship between patient and physician assessments of RA activity based on two simple measures (PtGA and MDGA); both are collected in routine practice, represent ACR core set components and inform therapeutic decisions.6
We describe several novel findings: first, LPA yielded a statistically robust five-profile solution representing distinct patient groups with clinically meaningful phenotypes. Second, the LPA-generated solution was quantitatively and qualitatively distinct from the conventional three-group discordance definition. This difference stemmed mainly from heterogeneity in the traditional concordance category regarding the magnitude of disease activity patients and physicians consensually report; despite congruent PtGA and MDGA ratings, LPA groups 1, 2, and 3 represented clearly distinct patient clusters with increasing inflammatory burden as well as progressively worse clinical, functional, HRQOL, work-related and activity impairment outcomes. These three highly disparate, empirically defined groups were essentially collapsed into a singular, conventional concordance category, which was arbitrarily defined and—by design—disregarded the absolute levels of the individual PtGA and MDGA components. Hence, the lesson learnt here was that all agreement is not created equal; rather, it is the magnitude of the disease activity that both patients and physicians concur on that largely defines functional outcomes.
Third, when both parties report high disease activity (group 3), there is objective evidence of high inflammatory burden and patients experience worse physical function, pain, fatigue, depression, HRQOL, activity impairment and work productivity than any other group. This is in agreement with reported associations of high RA inflammatory activity with worse fatigue,31–33 depression,34 pain35 36 and physical disability.9 However, within the context of a traditional concordance construct, patients and physicians unanimously reported high disease activity in only a minority of cases (73/373 or 19.6%). In fact, in the majority of instances (203/373 or 54.4%), both parties reported low or absent disease activity (group 1). As a result, the magnitude of adverse impact conferred by the high disease activity cluster 3 to the extended traditional concordance group outcomes may be grossly attenuated. Consistent with that notion, several recent studies using conventional definitions reported that patients with concordant PtGA and MDGA ratings experience better functional outcomes compared with those with positive discordance.4 37 38 Our results, however, clearly indicate that all such outcomes are significantly worse in group 3 that unanimously reported high disease activity compared with group 4 (high PtGA/low MDGA), closely resembling the conventional positive discordance cluster.
Fourth, our LPA results confirmed the presence of groups qualitatively resembling the arbitrarily defined positive and negative discordance groups: latent profiles 4 and 5, respectively; this allows continued confidence in previous research derived based on such methodologies, regarding descriptions of such group characteristics and outcomes. Nevertheless, both such groups are more strictly defined by LPA; specifically, LPA group 4 represents a more homogeneous group compared with the broader traditional positive discordance cluster that is contaminated up to 18.7% by patients from groups 1 and 2, both of whom have superior outcomes. LPA group 4 patients are older, with longer disease duration and higher prevalence of fibromyalgia than all other groups. Despite minimal inflammation, indistinguishable from group 1, they experience substantial RA impact: they report significantly higher pain, fatigue and depression that directly contribute to their high PtGA scores4 and yield worse functional, HRQOL and work productivity outcomes, even after controlling for age, gender, disease duration, IAD and fibromyalgia. These subjects are more poised to benefit from psychological and/or behavioural interventions to attain comprehensive remission rather than pharmacological treatments targeting RA inflammation.39 Similarly, LPA group 5 is more homogeneous compared with the extended conventional negative discordance group, which is contaminated up to 31% by group 2 and 3 patients. Specifically, LPA group 5 subjects experience significantly lower functional impairment and disease impact than expected, despite high inflammatory burden. It is possible that more adaptive illness cognitions and effective coping mechanisms40 41 account for the significantly lower levels of pain, fatigue and depression that these patients report and contribute to their advanced social functioning, mental health, HRQOL and work productivity that resemble group 1 patients. Nevertheless, most physical function outcomes were still worse in group 5 compared with group 1 patients who were essentially at therapeutic target.
Fifth, the patient-centred LPA solution offered superior explanatory power for all disease-related parameters and outcomes of interest compared with the traditional discordance construct. This observation further supports its higher clinical relevance, validity and suitability in characterising the relationship between PtGA and MDGA. This is particularly notable since variable-oriented approaches, in general, show greater predictive power compared with person-oriented approaches.42
Our findings collectively suggest that the traditional consideration of the PtGA and MDGA relationship as a discordance or difference score (PtGA–MDGA)—although intuitively appealing and computationally convenient—is arbitrary, qualitatively restrictive and methodologically suboptimal for multiple reasons. First, it is subject to all the restrictions of a variable-centred approach such as assumptions of population homogeneity and non-empirically derived, artificial cut-offs. Second, difference scores are less reliable than either of their component measures8; they are inherently ambiguous, as they combine into a single score constructs that are structurally and functionally disparate; they confound the effects of their component measures on outcomes and impose constraints on these effects that are rarely tested empirically8; correlations between difference scores and outcomes are often spurious as they essentially reflect the correlation of an outcome with the components from which the difference score is calculated. Since difference scores tend to correlate with either one or both of their components, the chances of observing correlations with other constructs connected to those components are amplified. Third, in the qualitatively distinct LPA solution, the number of latent groups that best fits the data is determined statistically rather than subjectively.
Hence, if one’s intention is to examine the relationship between PtGA and MDGA, LPA represents a less biased and more insightful way to visualise the spatial positioning of patients across the two outcomes, beyond the problems and biases of arbitrary difference scores. However, LPA analyses may not be the most practical solution for the routine group assignment of patients based on PtGA and MDGA in daily clinical practice. The analyses are generally complex to conduct and are sample and sample size specific, in that they yield groups that may differ from study to study. The most salient point, however, is that each of the two outcomes has its own significance and therapeutic implications and therefore commands individual attention and consideration; PtGA being a broader indicator of disease impact and experience by the patient and MDGA as a barometer of inflammatory burden. We previously reported that the most significant, independent predictors of PtGA were pain (27%), fatigue (15%), depression (9%), functional impairment (8%), general health perceptions (7%) and tender joint counts (6%).4 Notably, improvement of PtGA over time was associated with commensurate improvements in the same exact parameters.4 Consequently, disaggregation of domains within the PtGA should be contemplated to develop management pathways targeting optimal patient-centred outcomes.43 This would be particularly true in the case of moderate or high PtGA, where illuminating the exact contribution of each of the aforementioned variables may yield a mixture of both biomedical as well as psychological/behavioural/cognitive interventions. Future research should inform a feasible, time-efficient set of patient-reported outcomes and define how to best integrate them into daily practice. The findings should foster a standardised approach to evaluation and management, as well as improvement of patient–physician communication and shared decision making. However, we showed that MDGA bore significant correlation with composite disease activity scores such as 28 joint-based disease activity index with ESR (r=0.85), and its improvement over time reflected improvement in swollen joint counts, tender joint counts, fatigue and ESR. The implications of MDGA are, therefore, largely biomedical, an arena most rheumatologists feel more comfortable navigating.
The current work has important implications for rheumatology research: existing discordance data may be reanalysed in an effort to enrich findings already published in the literature; this may include derivation of LPA algorithms in training sets and their validation in test populations. Prevalent datasets may be combined into a unique body of evidence with the intention to cross-validate congruence relationships using LPA. This might represent a more comprehensive attempt to reveal complexities in disease state definition by patient and physicians that have eluded empirical investigation due to the use of difference scores.
Several limitations of our study should be acknowledged: first, LPA was used as an exploratory approach in our study; therefore, replication of our findings in independent samples is necessary. Although we considered validation in an independent sample within our patient population, this was not feasible; despite the absence of a formal approach in the literature for the definition of sample size requirements for the performance of LPA, a size of at least 500 seems to be a general consensus for best practice.44 Our cohort, representing a single centre, is not large enough to generate the requisite sample size for a separate validation set. It is encouraging, however, that a recent large study from the Early Rheumatoid Arthritis Network and British Society of Rheumatology Biologics Register revealed identical patient groupings to ours using a similar LPA approach.45 Second, since findings were based on a sample of Hispanic whites from the USA, our results may not be generalisable to other RA patient populations. Third, given the cross-sectional nature of our study, caution is recommended in interpreting the predictive power of the latent profiles as causal relationships cannot be inferred. Future research should examine the stability and longitudinal trajectories of latent profiles and their associations with clinical, functional and HRQoL outcomes. Fourth, physicians were blinded to PtGA scores and all patient-reported outcomes at the time of their MDGA assessment in our study; although this could theoretically impact the results, it is consistent with clinical trial practices and allows for a more impartial physician rating.
An unbiased, empirically derived, patient-centred LPA approach to characterise the relationship between patient and physician assessments of disease activity identified distinct, homogeneous and clinically meaningful patient groups. The five-profile solution was quantitatively and qualitatively distinct from the traditional threshold-based discordance definition; it confirmed that the magnitude of disease activity consensually reported by patients and physicians is a pivotal determinant of functional outcomes and demonstrated greater predictive power for disease-related, clinical, functional and HRQoL outcomes. Further validation of our findings may corroborate its clinical relevance, validity and suitability characterising the relationship between PtGA and MDGA.
The authors would like to thank all patients who participated in this research and acknowledge the contributions of Harbor-UCLA Medical Center Rheumatologists Benedict Chou and Gopika Miller, who participated in the clinical evaluation and assessment of participants in the study.
Contributors All authors were involved in the study design and/or collection, analysis and interpretation of the data, provided critical revision of the manuscript and approved the final version to be submitted for publication.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Patient consent Not required.
Ethics approval John F Wolf Human Subjects committee, Los Angeles Biomedical Research Institute at Harbor-UCLA Medical Center.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.