Develop Med Child Neuro - 2017 - Marsico - The Trunk Control Measurement Scale Reliability and Discriminative Validity in
Develop Med Child Neuro - 2017 - Marsico - The Trunk Control Measurement Scale Reliability and Discriminative Validity in
PUBLICATION DATA AIM This study investigated the intra- and interrater reliability of the Trunk Control
Accepted for publication 8th February 2017. Measurement Scale (TCMS) German version, with its subscores, in children with neuromotor
Published online 4th April 2017. disorders. Further, the discriminative validity of the TCMS was assessed by comparing the
TCMS scores with the Functional Independence Measure for children.
ABBREVIATIONS METHOD Bland–Altman analyses and intraclass correlation coefficients were applied to
AUC Area under the curve investigate reliability. The discriminative ability of the TCMS was evaluated with receiver
GMFCS Gross Motor Function operating characteristics.
Classification System RESULTS Ninety children (mean age 11y 5mo; range 5y–18y 11mo) participated for the
ICC Intraclass correlation coefficient reliability, and 50 for the discriminative validity study. The reliability proved to be excellent
SDD Smallest detectable difference (intrarater: bias=0.57 points, 95% confidence interval [CI] 3.71 to 4.85; interrater: bias= 0.31
TCMS Trunk Control Measurement points, 95% CI 5.77 to 5.10). A change in the TCMS total score of six points (10%) can be
Scale considered a true change. The TCMS subscores appeared to be clinically relevant because
WeeFIM Functional Independence children with less than around 80% of the static balance score, less than 55% of the dynamic
Measure for children reaching score, or less than around 35% of the selective movement control score needed
support for daily life activities.
INTERPRETATION The TCMS is a reliable and clinically relevant assessment for children aged
5 years and older with different neurological impairments.
The central role of trunk control on function and activity dynamic sitting balance; the latter is divided into selective
in children and young people with neuromotor disorders is movement control and dynamic reaching.7 This assessment
currently being discussed in the literature.1,2 Often, postu- tool shows good relative reliability in children aged 8 to
ral control is impaired in persons with a neurological con- 15 years with spastic CP.7 Information on absolute measure-
dition, and this can affect trunk stability, mobility, and ment errors is needed to interpret whether observed changes
selectivity of the upper limbs.2–5 In clinical practice, we can be considered ‘true’ or not. While the same study inves-
address these impairments with different approaches, such tigated also the absolute measurement error of the total
as balance training during physical therapy or hippother- score (the smallest detectable difference [SDD] was 4.66
apy. To assess the efficacy of such interventions, we need points for intrarater reliability and 5.47 points for interrater
valid, reliable, and responsive outcome measures to assess reliability), such information is missing for subscores of the
(changes in) trunk control. TCMS. Furthermore, these results were obtained in a rela-
In a recent review, the psychometric properties of sitting tively small group of children (n=26) and were restricted to
balance measures for children with cerebral palsy (CP) were children with spastic CP. In clinical practice, impaired trunk
discussed.6 Seven outcome assessments were included: the control can also be observed in younger children and those
Pediatric Reach Test; the Level of Sitting Scale; the Sitting with other neurological diagnoses (e.g. dyskinetic or ataxic
Assessment for Children with Neuromotor Dysfunction; the CP and other neuromotor disorders, such as acquired brain
Segmental Assessment of Trunk Control; the Seated Postu- injuries, myelomeningocele, or different syndromes), so it is
ral Control Measurement; the Trunk Impairment Scale; and important to investigate whether these findings also apply to
the Trunk Control Measurement Scale (TCMS).6 With the a broader group.
TCMS, an objective outcome measure is available to score Besides the reliability of the TCMS, we were also inter-
trunk ability in sitting. The TCMS consists of static and ested to learn how much trunk control a child needs to be
Reliability of the Trunk Control Measurement Scale Petra Marsico et al. 707
14698749, 2017, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/dmcn.13425 by Universidad Nacional Mayor De San Marcos, Wiley Online Library on [26/04/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
(i.e. WeeFIM item score of 0) or needed assistance to per- the highest sensitivity plus highest specificity minus one).20
form the activity (total assistance until minimal assistance, The area under the curve (AUC) was taken as an indicator
i.e. WeeFIM item score of 1–4) were grouped as ‘depen- of the accuracy and interpreted by the following bench-
dent’. We included the scores made by rater A for these marks: outstanding (AUC ≥0.90); excellent (AUC 0.80–
comparisons. 0.89); acceptable (AUC 0.70–0.79). In general, a was set at
0.05.21
Statistical analysis
We performed statistical calculations with SPSS (IBM RESULTS
SPSS Statistics 19; IBM, Armonk, NY, USA). All variables Participants
were visually inspected for normal distribution (histogram), Ninety children (44 females, 46 males) with a mean age of
and skewness and kurtosis were analysed. 11 years and 5 months (range 5y–18y 11mo) were included
For the relative intra- and interrater reliability analysis of in the reliability study. Twenty-one children were younger
the TCMS total and subscores, intraclass correlation coeffi- than 8 years (mean age 6y 3mo [SD 10mo]). The distribu-
cients (ICC) and 95% confidence intervals (CIs) with the tion of diagnoses and GMFCS levels of both groups (relia-
two-way random-effect model were calculated.15 The ICC bility and clinical importance) are shown in Table I.
was calculated as follows: ICC=rs2/(rs2+rt2+re2), where WeeFIM data were available from the 50 inpatients.
rs2 reflects the between-subjects’ effect, rt2 the amount of
trial effect or systematic error (between the two ratings), Reliability
and re2 the amount of residual variance (i.e. random error In two children, item 15 (reach across the midline –
variance).16 For interpretation, the following benchmarks subscore dynamic reaching) was not video-recorded. For
were used: very high reliability (ICC >0.90); high reliability these children, the reliability analyses of the dynamic
(ICC 0.70–0.89); moderate validity (ICC 0.50–0.69); low reaching and total TCMS score were based on items 13
reliability (ICC 0.26–0.49); poor reliability (ICC <0.25).17 and 14. All other datasets were complete. Rater A per-
To quantify the absolute reliability, the standard error of formed the assessment in 54 children, and rater B in 36
measurement (SEM) and the SDD were calculated, with children.
the following formulae: SEM=√(rt2+re2) and The relative intra- and interrater reliability were very
18
SDD=1.969√29SEM. We also expressed the SDD as a high, with ICC >0.90 for the total and all subscores
percentage of the maximum score. Additionally, for visual (Table II). The absolute measurement errors of the total
interpretation, we provided Bland–Altman plots.19 With and subscores were calculated. The SDD of the total score
the Blind–Altman plots we show the bias (i.e. the mean dif- of the TCMS remained lower than 10% of the maximal pos-
ference between the two ratings) and the limits of agree- sible score (Table II). The Bland–Altman plots represented
ment (biastwo times the standard deviation [SD]). The the bias and the limits of agreement (95% CI) both for the
upper limit of agreement and the lower limit of agreement intrarater (Fig. 1a) and interrater (Fig. 1b) reliability. The
mark the 95% CI. As most TCMS studies did not evaluate 95% CIs were well in agreement with the SDD values.
psychometric properties of the TCMS in children younger For the intrarater reliability, children younger than
than 8 years, we performed separate analyses for this group. 8 years of age had a bias of 0.67 (95% CI 4.37 to 6.09),
To estimate whether TCMS total and subscores could while children aged 8 years and older showed a bias of
distinguish between children who were independent in 0.55 (95% CI 3.53 to 4.63). For the interrater reliability,
mobility or self-care, receiver operating characteristics children younger than 8 years had a bias of 0.83 (95%
were performed. For each measure, corresponding cut-off CI 6.54 to 4.88), while children aged 8 years and older
levels were calculated, based on the Youden Index (this is had a bias of 0.16, (95% CI 5.48 to 5.16). A separate
Table I: Number of participants apportioned by diagnosis and disability level according to the Gross Motor Function Classification System (GMFCS)
GMFCS Spastic cerebral Ataxic and dyskinetic Acquired brain Others Total
Analysis level palsy (n) cerebral palsy (n) injuries (n) (n)a (n)
Reliability I 20 6 13 2 41
II 13 6 3 1 23
III 12 3 0 2 17
IV 4 3 1 1 9
Total 49 18 17 6 90
Clinical I 5 1 10 1 17
relevance II 6 3 4 1 14
III 8 1 0 2 11
IV 4 2 1 1 8
Total 23 7 15 5 50
a
Includes four children with myelomeningocele/hydrocephalus, one child with Guillain–Barre syndrome, and one child with hereditary
paraplegia (this child was an outpatient and was only included in the reliability analysis).
(a) Intrarater reliability: TCMS total score (n=90) (b) Interrater reliability: TCMS total score (n=90)
6 6
Difference (1–2 scoring)
5 5 Upper LOA:
Figure 1: Intra- and interrater reliability of the Trunk Control Measurement Scale (TCMS) total score. (a) Intrarater reliability and (b) interrater reliability
expressed by Bland–Altman plots, with the bias and the limits of agreement. LOA, limit of agreement. [Colour figure can be viewed at wileyonlinelibrary.com]
Bland–Altman plot of the children with ataxic and dyski- sitting, dynamic reaching, and selective movement control
netic CP, acquired brain injury, and other neurological dis- respectively. Similar values were obtained to discriminate
orders (n=41) is included in Figure S1 (online supporting between children with dependent versus independent
information). All results were in line with those from the mobility: 82.5%, 55.0%, and 41.1% respectively. Eight
whole group. children were, according to the WeeFIM self-care domain,
dependent, despite the fact that their total TCMS score
Discriminative validity exceeded the cut-off level of 30.5 points. In the mobility
The mean age of the 50 children collected by the WeeFIM part, six children (two with acquired brain injury, one with
was 11 years and 5 months (range 5y –18y 11mo). These myelomeningocele, two with spastic CP, and one with
children showed a mean TCMS total score of 32 (SD 16), dyskinetic CP), who were rated as dependent, even if their
with a minimum score of 1 and a maximum score of 57. TCMS total score exceeded the cut-off value of 30.5
Results of the subscores were as follows: mean static sitting points. On the contrary, three children (self-care) and two
balance 14 (SD 5), range 1 to 20; mean selective movement children (mobility) were rated as independent, despite the
control 12 (SD 8), range 0 to 27; mean dynamic reaching 6 fact that their TCMS total score was below the cut-off
(SD 3), range 0 to 10 points. The mean WeeFIM score value. These were children diagnosed with spastic CP (two
amounted to 95 (SD 35) and ranged from 27 to 126. All children) and one child with myelomeningocele out of the
receiver operating characteristics showed a significant AUC group of children younger than 8 years of age (in self-care
(Fig. 2). The TCMS total score could discriminate with and mobility).
best combined sensitivity and specificity between dependent
and independent children at a cut-off value of 30.5 (i.e. DISCUSSION
52.6% from the maximal possible TCMS score), both for The aim of this study was to determine the relative and
self-care and mobility WeeFIM subscores (see also Fig. 2). absolute reliability and the discriminative validity of the
The relative cut-off values that could discriminate best German TCMS version in children aged 5 to 19 years
between children with dependent versus independent self- with neuromotor disorders. The ICCs indicated a very
care amounted to 77.5%, 55.0%, and 30.4% for static high intra- and interrater reliability. The results were in
Reliability of the Trunk Control Measurement Scale Petra Marsico et al. 709
14698749, 2017, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/dmcn.13425 by Universidad Nacional Mayor De San Marcos, Wiley Online Library on [26/04/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
(a) WeeFIM self-care and TCMS scores
Sensitivity: 0.86, specificity: 0.72 Sensitivity: 0.81, specificity: 0.69 Sensitivity: 0.95, specificity: 0.69 Sensitivity: 0.81, specificity: 0.83
AUC: 0.83 (p<0.001) AUC: 0.81 (p<0.001) AUC: 0.81 (p<0.001) AUC: 0.89 (p<0.001)
60 20 30 10
55 18 27 9
Dynamic reaching
14 15.5 21 7
40
Total TCMS
35 12 18 6
5.5
30 30.5 10 15 5
25 8 12 4
20 6 9 3
15 8.5
4 6 2
10
5 2 3 1
0 0 0 0
Dependent Independent Dependent Independent Dependent Independent Dependent Independent
WeeFIM self-care WeeFIM self-care WeeFIM self-care WeeFIM self-care
16.5 24 8
Dynamic reaching
45
14 21 7
Total TCMS
40
35 12 18 6
30 30.5 10 15 5 5.5
25 8 12 4
20 6 9 11.5 3
15
4 6 2
10
5 2 3 1
0 0 0 0
Dependent Independent Dependent Independent Dependent Independent Dependent Independent
WeeFIM mobility WeeFIM mobility WeeFIM mobility WeeFIM mobility
<8y ≥8y
Figure 2: Discriminative validity. Cut-off values, sensitivity, specificity, and area under the curve (AUC) values of the Trunk Control Measurement Scale
(TCMS) scores (total score, static sitting balance, selective movement control, and dynamic reaching scores) to distinguish between children who are,
according to the Functional Independence Measure for children (WeeFIM), dependent versus independent for (a) the self-care domain and (b) mobility.
[Colour figure can be viewed at wileyonlinelibrary.com]
line with those of previous studies.7,11 More importantly, we scored the TCMS using video recordings, we did not
the small SEM and SDD values indicate a good absolute account for the natural variability regarding performance,
agreement. As we also presented the SEM and SDD values motivation, mood, and compliance, as this would be con-
of the three subscores, we can better interpret the results ducted in a test–retest design. While these factors could
of a recently published study.22 In the study by Pham reduce the reliability of the TCMS, especially in younger
et al.,22 the change scores of the TCMS after were investi- children, our results are still in line with those of Heyrman
gated 3 weeks of intensive physical training. All changes et al.,7 who used a repeated measurement procedure with a
lied under the SDD of the subscores, and therefore they mean time of 10 days in between the assessments. Accord-
could be a result of measurement error and not a result of ing to our results, the TCMS score should increase by at
a real improvement in trunk control. As the measurement least six points or 10% of its total score to account for the
errors were smaller when tested by the same rater, we measurement error and be considered a true change. In
recommend that if the TCMS is used to picture clinical future studies the responsiveness and minimal clinically
progress, the same rater should assess the child. important difference should be determined. This additional
The TCMS was reliable in children with highly information would help therapists to better interpret the
impaired trunk control, as well as in children with slight TCMS test results.
impairments. Even in children younger than 8 years, the The TCMS was able to differentiate well between chil-
test showed reliable results (see Fig. 1, distribution of dren who are independent in self-care and mobility (mea-
mean scores). The TCMS could be applied reliably to chil- sured with the WeeFIM) and those who are not, indicating
dren with neurological diagnosis other than spastic CP in a good discriminative validity. The excellent AUCs were
our study (Fig. S1). The children with dyskinetic CP had significant, indicating that the discrimination of the TCMS
more difficulty reaching higher points in the selective was above chance. This was the case for the TCMS total
trunk control part, as they show many involuntary move- score and for all three subscores. Interestingly, the relative
ments and the selectivity was markedly impaired. Because cut-off values of the static sitting balance, dynamic
REFERENCES
1. Curtis DJ, Butler P, Saavedra S, et al. The central role 6. Ba~
nas BB, Gorgon EJ. Clinimetric properties of sitting 10. Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bou-
of trunk control in the gross motor function of children balance measures for children with cerebral palsy: a sys- ter LM, de Vet HC. Rating the methodological quality
with cerebral palsy: a retrospective cross-sectional study. tematic review. Phys Occup Ther Pediatr 2014; 34: 313– in systematic reviews of studies on measurement proper-
Dev Med Child Neurol 2014; 57: 351–7. 34. ties: a scoring system for the COSMIN checklist. Qual
2. Saether R, Helbostad JL, Adde L, Braendvik S, 7. Heyrman L, Molenaers G, Desloovere K, et al. A clini- Life Res 2012; 21: 651–7.
Lydersen S, Vik T. The relationship between trunk con- cal tool to measure trunk control in children with cere- 11. Jeon JY, Shin WS. Reliability and validity of the Korean
trol in sitting and during gait in children and adoles- bral palsy: the Trunk Control Measurement Scale. Res version of the Trunk Control Measurement Scale
cents with cerebral palsy. Dev Med Child Neurol 2015; Dev Disabil 2011; 32: 2624–35. (TCMS-K) for children with cerebral palsy. Res Dev Dis-
57: 344–50. 8. Msall ME, DiGaudio K, Rogers BT, et al. The abil 2014; 35: 581–90.
3. Brogren Carlberg E, L€
owing K. Does goal setting in Functional Independence Measure for Children 12. Mitteregger E, Marsico P, Balzer J, van Hedel HJA.
activity-focused interventions for children with cerebral (WeeFIM). Conceptual basis and pilot use in children with Translation and construct validity of the Trunk Control
palsy influence treatment outcome? Dev Med Child Neu- developmental disabilities. Clin Pediatr 1994; 33: 421–30. Measurement Scale in children with brain lesions. Res
rol 2013; 55: 47–54. 9. Ziviani J, Ottenbacher KJ, Shephard K, Foremen S, Dev Disabil 2015; 45–46: 343–52.
4. Heyrman L, Desloovere K, Molenaers G, et al. Clinical Astbury W, Ireland P. Concurrent validity of the 13. Russell DJ, Avery LM, Rosenbaum PL, Raina PS, Walter
characteristics of impaired trunk control in children with Functional Independence Measure for Children (Wee- SD, Palisano RJ. Improved scaling of the gross motor func-
spastic cerebral palsy. Res Dev Disabil 2013; 34: 327–34. FIMTM) and the Pediatric Evaluation of Disabilities tion measure for children with cerebral palsy: evidence of
5. van der Heide JC, Hadders-Algra M. Postural muscle Inventory in children with development disabilities and reliability and validity. Phys Ther 2000; 80: 873–5.
dyscoordination in children with cerebral palsy. Neural acquired brain injuries. Phys Occup Ther Pediatr 2001; 14. Palisano R, Rosenbaum P, Walter S, Russel D, Wood
Plast 2005; 12: 197–204. 21: 91–101. E, Galuppi B. Development and reliability of a
Reliability of the Trunk Control Measurement Scale Petra Marsico et al. 711
14698749, 2017, 7, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/dmcn.13425 by Universidad Nacional Mayor De San Marcos, Wiley Online Library on [26/04/2023]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
system to classify gross motor function in children 17. Katz JN, Larson MG, Phillips CB, Fossel AH, Liang MH. 20. Youden WJ. Index for rating diagnostic tests. Cancer
with cerebral palsy. Dev Med Child Neurol 1997; 39: Comparative measurement sensitivity of short and longer 1950; 3: 32–5.
214–33. health status instruments. Med Care 1992; 30: 917–25. 21. Hosmer D, Lemeshow S, Sturdivant R. Applied Logistic
15. Shrout P, Fleiss J. Intraclass correlations: uses in 18. De Vet HCW, Terwee CB, Knol DL, Bouter LM. Regression. 3rd edn. Hoboken, NJ: Wiley, 2013.
assessing rater reliability. Psyschological Bull 1979; 86: When to use agreement versus reliability measures. J 22. Pham HP, Eidem A, Hansen G, et al. Validity and
420–8. Clin Epidemiol 2006; 59: 1033–9. responsiveness of the Trunk Impairment Scale and
16. Rousson V, Gasser T, Seifert B. Assessing intrarater, 19. Bland JM, Altman DG. Comparing methods of mea- Trunk Control Measurement Scale in young individuals
interrater and test-retest reliability of continuous mea- surement: why plotting difference against standard with cerebral palsy. Phys Occup Ther Pediatr 2016; 36:
surements. Stat Med 2002; 21: 3431–46. method is misleading. Lancet 1995; 346: 1085–7. 440–52.