Original Article

Training Course Results of the Assessment of Modified Rodnan Skin Score in Scleroderma

10.4274/nkmj.galenos.2021.04274

  • Gerçek CAN
  • Aydan KÖKEN AVŞAR
  • Sinem Burcu KOCAER
  • Gökçe KENAR
  • Dilek SOLMAZ
  • Fatoş ÖNEN
  • Süleyman Serdar KOCA
  • Ali AKDOĞAN
  • Merih BİRLİK

Received Date: 24.06.2021 Accepted Date: 05.11.2021 Namik Kemal Med J 2022;10(1):43-47

Aim:

Modified Rodnan Skin Score (mRSS) is generally used to assess skin involvement in patients with scleroderma. There are conflicting data on the effectiveness of mRSS training courses in previous studies. The aim of this study to evaluate the effectiveness of a mRSS training course applied to rheumatology minor residents.

Materials and Methods:

Ten rheumatology minor residents were included in the study. The participants were given a 1-hour theoretical training including skin involvement in scleroderma and mRSS evaluation, by three experienced rheumatology specialists. Then training continued with performing mRSS on 4 patients with scleroderma for 1 hour. Participants made scores on a paper form on 2 patients before and after the training, including 17 regions, and the total score was between 0 and 51. Inter- observer reliability for pre- and post-training was evaluated with intra-class correlation coefficient (ICC) analysis. Agreement was evaluated with Fleiss’s kappa according to 12 different score regions before and after the training.

Results:

The ICC was detected as 0.867 [95% confidence interval (CI): 0.625-1.00, p=0.05] before the training, and 0.905 (95% CI: 0.045-1.00, p=0.02) after the training. When the regions of mRSS were evaluated individually, an increase in agreement was observed in some of the scores while there was no change in one region and a decrease in agreement was observed in some.

Conclusion:

This study has shown that mRSS is an effective scoring that can be easily conveyed with training courses.

Keywords: Scleroderma, skin thickening, modified Rodnan Skin Score, training

INTRODUCTION

Systemic sclerosis (SSc) is a chronic inflammatory connective tissue disease that is characterized by skin fibrosis and can involve many organs such as the heart, lung, kidney, and gastrointestinal system1. SSc is divided into two main categories as diffuse cutaneous SSc and limited cutaneous SSc. The diffuse cutaneous form is more associated with mortality and morbidity, and skin involvement may progress rapidly in this form of the disease2.

It has been shown that the increase in skin thickness in patients with diffuse cutaneous SSc, reflecting the severity of the disease, is associated with the involvement of internal organs and increased mortality. In this respect, skin score measurement is important3. In addition, improvement in skin score is associated with better clinical outcomes2. One of the best ways to identify high-risk patients for clinical trials is to measure the severity and extent of skin involvement4.

Modified Rodnan Skin Score (mRSS), which is a measure of skin involvement, is used as a primary outcome measure in multicenter clinical studies because its feasibility, reliability and validity have been demonstrated5.

While creating the scoring, the skin thickness of the distal forearm in patients with SSc was first scored by skin palpation (using a scale of 0-4) and this value was compared with the weight of the skin punch biopsy taken from the same site. A good correlation has been demonstrated between the degree of clinical palpation and the weight of the biopsy specimen6. Subsequently, the clinical palpation score method was used to estimate skin thickness at 26 skin sites, and the first full description of this methodology was published in 1982 by Clements et al.3 in a controlled study of D-penicillin in SSc. A few years later, this scoring was modified using a 0-3 scale across 17 body regions. Nine of the skin regions [neck (1), shoulders (2), breasts (2), back (1), waist (1), toes (2)] were excluded from the calculation due to high inter-observer variation. One of the first applications of mRSS was a randomized clinical trial comparing high dose versus low dose D-penicillin in the early stages of diffuse cutaneous SSc7. Although there are scoring systems developed by other researchers, it has been agreed over time that mRSS is the gold standard for measuring skin thickness in SSc8.

Modified RSS stands out with its easy applicability. The aim of this study is to evaluate the effectiveness of a practically applied mRSS course given to rheumatology minor residents by means of pre-training and post-training scorings.


MATERIALS AND METHODS

Selection and Definition of Cases

Ten rheumatology minor assistants studying at different universities were included in the study. Minor residents had not previously attended a course on mRSS. The participants were given theoretical training on skin involvement and mRSS evaluation, which lasted for 1 hour, by 3 rheumatology specialists experienced in SSc. Then, practical training was applied on 4 patients for 1 hour. Participants scored on a paper form before and after the training, including 17 regions on 2 patients and the total score between 0 and 51 (Figure 1). The forms of the participants were collected and evaluated.

The study were approved by the Dokuz Eylül University of Ethics Committee (protocol number: E-36862155, date: 14.09.2021).

Technical Information

Modified Rodnan Skin Score Calculation

In the calculation of mRSS, which is applied based on the literature, a total value is obtained by squeezing the skin between the fingers in 17 different parts of the body (face, chest, abdomen, as well as right/left fingers, hands, forearms, arms, thighs, legs, feet) and scoring the skin thickness between 0 and 3 (0=normal, 1=mild thickness, 2=moderate thickness, 3=severe thickness) (total score 0-51). Finally, three more anatomical regions (neck, upper back and lower back) were included in the scoring system5,9.

How to apply the skin thickness measurement during the training was also explained on the patient. For this measurement, the skin should be slightly rounded or pinched using the index finger and thumb, or as a second method, the fold formed on the skin by the laterals of both thumbs should be examined. During measurement, it is important to understand the relative distribution of subcutaneous adipose tissue and underlying musculoskeletal structures in different anatomical regions.

a. mRSS=0: normal skin,

b. mRSS=1: thickened skin,

c. mRSS=2: thickened and unable to pinch skin,

d. mRSS=3: thickened and unable to move skin10.

Statistical Analysis

Inter-observer reliability for pre- and post-training mRSS was evaluated with intraclass correlation (ICC) analysis using the Statistical Package for the Social Sciences 15 software. Compliance was evaluated with the Fleiss’s kappa according to 12 different Rodnan score regions before and after the training.


RESULTS

The ICC value for the total Rodnan score was 0.867 before training [95% confidence interval (CI): 0.625-1.00; p=0.05] and 0.905 (95% CI: 0.045-1.00, p=0.02) after training. When the mRSS score regions were examined separately, an increase in compliance was observed in some of them after the training. There was no change in one of the score regions, while a decrease in compliance was detected in some (Table 1).


DISCUSSION

In this study, it was determined that the intra-class correlation coefficient increased after the training in the pre- and post-training evaluation of a theoretical and practical mRSS course given to rheumatology minor residents. In addition to theoretical information, it is seen that a training with this method, which includes evaluating on patients, enables mRSS to be taught in a short time to residents who are receiving rheumatology minor education.

There are different mechanical devices such as durometer, t ultrasonography, elastometer, caliper, and tonometer that have been fully or partially validated to measure skin thickness11-13. However, mRSS is considered the most appropriate technique for assessing skin thickness. Various studies have shown that mRSS assessment is easily applicable and reliable, repeatable, accurate, and sensitive to change5,9,12,14,15. Evaluation of mRSS requires experience and careful learning15. The intra-observer correlation coefficient (ICC) may be low if scoring is done by inexperienced rheumatologists16.

The European Scleroderma Trials and Research Group (EUSTAR) conducted a study to standardize the mRSS measurement. In the study, which aimed to develop an effective methodology for teaching mRSS, it was stated that the coefficient of variation and ICC improved significantly in the repeated course, although the results of the first course were not satisfactory. In the aforementioned study, while the ICC increased from 0.496 to 0.722 to the “good” level, the coefficient of variation decreased from 54% to 32%. These results were comparable to the two previous studies [18.3% standard deviation (SD) 4.6 and 17.7% (SD 4.6), respectively]15,17. With this study, it has been confirmed that mRSS is a suitable tool for measuring skin score, and it has been shown that it is possible to teach skin score measurement technique to many rheumatologists in a short time.

In a previous study, the interobserver variation of mRSS was reported to be approximately 50%5. The outcome of this course is also similar after repeated training. The initially good ICC did not increase among experienced rheumatologists, but increased from 0.50 to 0.72 in less experienced rheumatologists. This highlights the importance of the second training course for less experienced rheumatologists. It is encouraging that the intra-observer variability is around 20%. Although it had a low ICC value, it was observed that the second repeated teaching course was generally satisfactory and this was in line with previous experience14. For example, in the first EUSTAR/EULAR course, 100 young rheumatologists were trained and the intra-patient SD values were determined at a relatively good level (5,4)5. Most participants had low ICC results. Inter-observer variability after a single training still persisted despite experienced experts educating students, but after repeated training, inter-observer variability was significantly reduced. After the completion of the course, the intra-patient SD for interobserver variability was detected to be 5.5. A good ICC value was also obtained in the mixed patient population. Consequently, given the significant observer variability, it has been suggested that teaching courses be repeated at least twice for inexperienced rheumatologists16.

There is also a study in the literature showing that good results of repetitive training courses can be stabilized. In this study, it was observed that the good initial ICC results obtained in two courses held 7 months apart continued to be similar. Therefore, the investigators suggested that training with 2 different subgroups of patients with a large number of diffuse-limited cutaneous SSc patients contributes to obtaining good results and a repeat course may not be necessary. However, it was stated that if there were significantly different scores between the trainer and the participant, a second training would be necessary. Higher coefficients of variation were obtained in patients with limited cutaneous SSc than in the diffuse cutaneous SSc subgroup18.

Although it is accepted that the modified RSS tends to worsen in early disease and improve in late disease, the time when the peak value is reached has not been clearly determined. In early diffuse cutaneous SSc, rapid and severe skin thickness increase often develops 1-3 years after the onset of the disease. In the late stage, softening is observed as a result of the decrease in the extent and severity of induration of the skin19,20. One of the main goals of modified RSS teaching is to distinguish between the active period with skin thickening and the chronic period with skin atrophy.

Study Limitations

As a limitation of the study, our training was not repeated after a certain period of time, as suggested in previous studies, but was applied in a single step. For the optimization of the results, it may be appropriate to increase the number of trainees and patients and the duration of the course in future studies.


CONCLUSION

This study shows that the training of a relatively inexperienced group by rheumatologists specialized in mRSS can be done effectively and simply. Considering that skin involvement of scleroderma is a good indicator of the course of the disease, it seems that a scoring such as mRSS has a place not only for use in studies but also for patient follow-up. For this reason, it seems appropriate to make it a part of the education through practically applied courses during rheumatology minor education.

Ethics

Ethics Committee Approval: The study were approved by the Dokuz Eylül University of Ethics Committee (protocol number: E-36862155, date: 14.09.2021).

Informed Consent: Consent form was filled out by all participants.

Peer-review: Externally peer-reviewed.

Authorship Contributions

Concept: G.C., F.Ö., S.S.K., A.A., M.B., Design: G.C., F.Ö., D.S., A.A., M.B., Data Collection or Processing: G.C., A.K.A., S.B.K., G.K., Analysis or Interpretation: G.C., A.K.A., D.S., Literature Search: G.C., S.B.K., Writing: G.C., G.K.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The authors declared that this study received no financial support.


Images

  1. Medsger TA, Jr., Steen V. Classification and Prognosis In Systemic Sclerosis. In: Clements PJ, Furst DE, editors. Systemic Sclerosis. Baltimore: Williams and Wilkins; 1996. p. 51-64.
  2. Steen VD, Medsger TA Jr. Improvement in skin thickening in systemic sclerosis associated with improved survival. Arthritis Rheum. 2001;44:2828-35.
  3. Clements PJ, Hurwitz EL, Wong WK, Seibold JR, Mayes M, White B, et al. Skin thickness score as a predictor and correlate of outcome in systemic sclerosis: high-dose versus low-dose penicillamine trial. Arthritis Rheum. 2000;43:2445-54.
  4. White B, Bauer EA, Goldsmith LA, Hochberg MC, Katz LM, Korn JH, et al. Guidelines for clinical trials in systemic sclerosis (scleroderma). I. Disease-modifying interventions. The American College of Rheumatology Committee on Design and Outcomes in Clinical Trials in Systemic Sclerosis. Arthritis Rheum. 1995;38:351-60.
  5. Clements P, Lachenbruch P, Siebold J, White B, Weiner S, Martin R, et al. Inter and intraobserver variability of total skin thickness score (modified Rodnan TSS) in systemic sclerosis. J Rheumatol. 1995;22:1281-5.
  6. Perera A, Fertig N, Lucas M, Rodriguez-Reyna TS, Hu P, Steen VD, et al. Clinical subsets, skin thickness progression rate, and serum antibody levels in systemic sclerosis patients with anti-topoisomerase I antibody. Arthritis Rheum. 2007;56:2740-6.
  7. Steen VD, Medsger TA Jr, Rodnan GP. D-Penicillamine therapy in progressive systemic sclerosis (scleroderma): a retrospective analysis. Ann Intern Med. 1982;97:652-9.
  8. Domsic RT, Rodriguez-Reyna T, Lucas M, Fertig N, Medsger TA Jr. Skin thickness progression rate: a predictor of mortality and early internal organ involvement in diffuse scleroderma. Ann Rheum Dis. 2011;70:104-9.
  9. Silman A, Harrison M, Brennan P. Is it possible to reduce observer variability in skin score assessment of scleroderma? The ad hoc International Group on the Assessment of Disease Outcome in Scleroderma. J Rheumatol. 1995;22:1277-80.
  10. Khanna D, Furst DE, Clements PJ, Allanore Y, Baron M, Czirjak L, et al. Standardization of the modified Rodnan skin score for use in clinical trials of systemic sclerosis. J Scleroderma Relat Disord. 2017;2:11-18.
  11. Dugar M, Woolford R, Ahern MJ, Smith MD, Roberts-Thomson PJ. Use of electronic tonometer to assess skin hardness in systemic sclerosis: a pilot cross-sectional study. Clin Exp Rheumatol. 2009;27(3 Suppl 54):70.
  12. Czirják L, Foeldvari I, Müller-Ladner U. Skin involvement in systemic sclerosis. Rheumatology (Oxford). 2008;47 Suppl 5:v44-5.
  13. Merkel PA, Silliman NP, Denton CP, Furst DE, Khanna D, Emery P, et al. Validity, reliability, and feasibility of durometer measurements of scleroderma skin disease in a multicenter treatment trial. Arthritis Rheum. 2008;59:699-705.
  14. Pope JE, Baron M, Bellamy N, Campbell J, Carette S, Chalmers I, et al. Variability of skin scores and clinical measurements in scleroderma. J Rheumatol. 1995;22:1271-6.
  15. Brennan P, Silman A, Black C, Bernstein R, Coppock J, Maddison P, et al. Reliability of skin involvement measures in scleroderma. The UK Scleroderma Study Group. Br J Rheumatol. 1992;31:457-60.
  16. Czirják L, Nagy Z, Aringer M, Riemekasten G, Matucci-Cerinic M, Furst DE; EUSTAR. The EUSTAR model for teaching and implementing the modified Rodnan skin score in systemic sclerosis. Ann Rheum Dis. 2007;66:966-9.
  17. Clements PJ, Lachenbruch PA, Seibold JR, Zee B, Steen VD, Brennan P, et al. Skin thickness score in systemic sclerosis: an assessment of interobserver variability in 3 independent studies. J Rheumatol. 1993;20:1892-6.
  18. Ionescu R, Rednic S, Damjanov N, Varjú C, Nagy Z, Minier T et al. Repeated teaching courses of the modified Rodnan skin score in systemic sclerosis. Clin Exp Rheumatol. 2010;28(2 Suppl 58):S37-41.
  19. Nihtyanova SI, Denton CP. Current approaches to the management of early active diffuse scleroderma skin disease. Rheum Dis Clin North Am. 2008;34:161-79.
  20. Medsger TA Jr. Natural history of systemic sclerosis and the assessment of disease activity, severity, functional status, and psychologic well-being. Rheum Dis Clin North Am. 2003;29:255-73.