Skip to main content

02.05.2024 | Scientific Article

Inter-rater variability and repeatability in the assessment of the Tanner–Whitehouse classification of hand radiographs for the estimation of bone age

verfasst von: Jian Geng, Wenshuang Zhang, Yufeng Ge, Ling Wang, Pengju Huang, Yandong Liu, Jia Shi, Fengyun Zhou, Kangkang Ma, Glen M. Blake, Gang Xu, Dong Yan, Xiaoguang Cheng

Erschienen in: Skeletal Radiology

Einloggen, um Zugang zu erhalten

Abstract

Objective

To determine which bones and which grades had the highest inter-rater variability when employing the Tanner–Whitehouse (T-W) method.

Materials and methods

Twenty-four radiologists were recruited and trained in the T-W classification of skeletal development. The consistency and skill of the radiologists in determining bone development status were assessed using 20 pediatric hand radiographs of children aged 1 to 18 years old. Four radiologists had a poor concordance rate and were excluded. The remaining 20 radiologists undertook a repeat reading of the radiographs, and their results were analyzed by comparing them with the mean assessment of two senior experts as the reference standard. Concordance rate, scoring, and Kendall’s W were calculated to evaluate accuracy and consistency.

Results

Both the radius, ulna, and short finger (RUS) system (Kendall’s W = 0.833) and the carpal (C) system (Kendall’s W = 0.944) had excellent consistency, with the RUS system outperforming the C system in terms of scores. The repeatability analysis showed that the second rating test, performed after 2 months of further bone age assessment (BAA) practice, was more consistent and accurate than the first. The capitate had the lowest average concordance rate and scoring, as well as the lowest overall concordance rate for its D classification. Moreover, the G classifications of the seven carpal bones all had a concordance rate less than 0.6. The bones with lower Kendall’s W were likewise those with lower scores and concordance rates.

Conclusion

The D grade of the capitate showed the highest variation, and the use of the Tanner–Whitehouse 3rd edition (T-W3) to determine bone age (BA) was frequently inconsistent. A more comprehensive description with a focus on inaccuracy bones or ratings and a modification to the T-W3 approach would significantly advance BAA.
Literatur
1.
Zurück zum Zitat Schwarze CP, Arens D, Haber HP, Wollmann HA, Binder G, Mayer EI, et al. Bone age in 116 untreated patients with Turner’s syndrome rated by a computer-assisted method (CASAS). Acta Paediatr. 1998;87(11):1146–50.CrossRefPubMed Schwarze CP, Arens D, Haber HP, Wollmann HA, Binder G, Mayer EI, et al. Bone age in 116 untreated patients with Turner’s syndrome rated by a computer-assisted method (CASAS). Acta Paediatr. 1998;87(11):1146–50.CrossRefPubMed
2.
Zurück zum Zitat Jones G, Ma D. Skeletal age deviation assessed by the Tanner-Whitehouse 2 method is associated with bone mass and fracture risk in children. Bone. 2005;36(2):352–7.CrossRefPubMed Jones G, Ma D. Skeletal age deviation assessed by the Tanner-Whitehouse 2 method is associated with bone mass and fracture risk in children. Bone. 2005;36(2):352–7.CrossRefPubMed
3.
Zurück zum Zitat Tanner JM, Landt KW, Cameron N, Carter BS, Patel J. Prediction of adult height from height and bone age in childhood. A new system of equations (TW Mark II) based on a sample including very tall and very short children. Arch Dis Child. 1983;58(10):767–76.CrossRefPubMedPubMedCentral Tanner JM, Landt KW, Cameron N, Carter BS, Patel J. Prediction of adult height from height and bone age in childhood. A new system of equations (TW Mark II) based on a sample including very tall and very short children. Arch Dis Child. 1983;58(10):767–76.CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Malina RM, Coelho ESMJ, Figueiredo AJ, Philippaerts RM, Hirose N, Pena Reyes ME, et al. Tanner-Whitehouse skeletal ages in male youth soccer players: TW2 or TW3? Sports Med. 2018;48(4):991–1008.CrossRefPubMed Malina RM, Coelho ESMJ, Figueiredo AJ, Philippaerts RM, Hirose N, Pena Reyes ME, et al. Tanner-Whitehouse skeletal ages in male youth soccer players: TW2 or TW3? Sports Med. 2018;48(4):991–1008.CrossRefPubMed
5.
Zurück zum Zitat Acheson RM. A method of assessing skeletal maturity from radiographs; a report from the Oxford child health survey. J Anat. 1954;88(4):498–508.PubMedPubMedCentral Acheson RM. A method of assessing skeletal maturity from radiographs; a report from the Oxford child health survey. J Anat. 1954;88(4):498–508.PubMedPubMedCentral
6.
Zurück zum Zitat So LL. Skeletal maturation of the hand and wrist and its correlation with dental development. Aust Orthod J. 1997;15(1):1–9.PubMed So LL. Skeletal maturation of the hand and wrist and its correlation with dental development. Aust Orthod J. 1997;15(1):1–9.PubMed
7.
Zurück zum Zitat Subramanian S, Viswanathan VK. Bone age. StatPearls. Treasure Island (FL); 2022. Subramanian S, Viswanathan VK. Bone age. StatPearls. Treasure Island (FL); 2022.
8.
Zurück zum Zitat Taylor CJ, Monahan M, Roalfe AK, Barton P, Iles R, Hobbs FDR. The REFER (REFer for EchocaRdiogram) study: a prospective validation and health economic analysis of a clinical decision rule, NT-proBNP or their combination in the diagnosis of heart failure in primary care. Southampton (UK); 2017. Taylor CJ, Monahan M, Roalfe AK, Barton P, Iles R, Hobbs FDR. The REFER (REFer for EchocaRdiogram) study: a prospective validation and health economic analysis of a clinical decision rule, NT-proBNP or their combination in the diagnosis of heart failure in primary care. Southampton (UK); 2017.
9.
Zurück zum Zitat Zachmann M, Frasier SD, McLaughlin J, Hurley L, Nessi P. Importance and accuracy of bone age ratings in a computerized growth evaluation system. Horm Res. 1983;18(4):160–7.CrossRefPubMed Zachmann M, Frasier SD, McLaughlin J, Hurley L, Nessi P. Importance and accuracy of bone age ratings in a computerized growth evaluation system. Horm Res. 1983;18(4):160–7.CrossRefPubMed
10.
Zurück zum Zitat Bull RK, Edwards PD, Kemp PM, Fry S, Hughes IA. Bone age assessment: a large scale comparison of the Greulich and Pyle, and Tanner and Whitehouse (TW2) methods. Arch Dis Child. 1999;81(2):172–3.CrossRefPubMedPubMedCentral Bull RK, Edwards PD, Kemp PM, Fry S, Hughes IA. Bone age assessment: a large scale comparison of the Greulich and Pyle, and Tanner and Whitehouse (TW2) methods. Arch Dis Child. 1999;81(2):172–3.CrossRefPubMedPubMedCentral
11.
Zurück zum Zitat Gertych A, Zhang A, Sayre J, Pospiech-Kurkowska S, Huang HK. Bone age assessment of children using a digital hand atlas. Comput Med Imaging Graph. 2007;31(4–5):322–31.CrossRefPubMedPubMedCentral Gertych A, Zhang A, Sayre J, Pospiech-Kurkowska S, Huang HK. Bone age assessment of children using a digital hand atlas. Comput Med Imaging Graph. 2007;31(4–5):322–31.CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Zhou XL, Wang EG, Lin Q, Dong GP, Wu W, Huang K, et al. Diagnostic performance of convolutional neural network-based Tanner-Whitehouse 3 bone age assessment system. Quant Imaging Med Surg. 2020;10(3):657–67.CrossRefPubMedPubMedCentral Zhou XL, Wang EG, Lin Q, Dong GP, Wu W, Huang K, et al. Diagnostic performance of convolutional neural network-based Tanner-Whitehouse 3 bone age assessment system. Quant Imaging Med Surg. 2020;10(3):657–67.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Wang X, Zhou B, Gong P, Zhang T, Mo Y, Tang J, et al. Artificial intelligence-assisted bone age assessment to improve the accuracy and consistency of physicians with different levels of experience. Front Pediatr. 2022;10:818061.CrossRefPubMedPubMedCentral Wang X, Zhou B, Gong P, Zhang T, Mo Y, Tang J, et al. Artificial intelligence-assisted bone age assessment to improve the accuracy and consistency of physicians with different levels of experience. Front Pediatr. 2022;10:818061.CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat Computer-assisted diagnosis. Lancet (London, England). 1989;2(8676):1371. Computer-assisted diagnosis. Lancet (London, England). 1989;2(8676):1371.
15.
Zurück zum Zitat Lee BD, Lee MS. Automated bone age assessment using artificial intelligence: the future of bone age assessment. Korean J Radiol. 2021;22(5):792–800.CrossRefPubMedPubMedCentral Lee BD, Lee MS. Automated bone age assessment using artificial intelligence: the future of bone age assessment. Korean J Radiol. 2021;22(5):792–800.CrossRefPubMedPubMedCentral
16.
Zurück zum Zitat Groell R, Lindbichler F, Riepl T, Gherra L, Roposch A, Fotter R. The reliability of bone age determination in central European children using the Greulich and Pyle method. Br J Radiol. 1999;72(857):461–4.CrossRefPubMed Groell R, Lindbichler F, Riepl T, Gherra L, Roposch A, Fotter R. The reliability of bone age determination in central European children using the Greulich and Pyle method. Br J Radiol. 1999;72(857):461–4.CrossRefPubMed
17.
Zurück zum Zitat Gao C, Qian Q, Li Y, Xing X, He X, Lin M, et al. A comparative study of three bone age assessment methods on Chinese preschool-aged children. Front Pediatr. 2022;10:976565.CrossRefPubMedPubMedCentral Gao C, Qian Q, Li Y, Xing X, He X, Lin M, et al. A comparative study of three bone age assessment methods on Chinese preschool-aged children. Front Pediatr. 2022;10:976565.CrossRefPubMedPubMedCentral
18.
Zurück zum Zitat Yuh YS, Chou TY, Tung TH. Bone age assessment: large-scale comparison of Greulich-Pyle method and Tanner-Whitehouse 3 method for Taiwanese children. J Chin Med Assoc. 2023;86(2):246–53.CrossRefPubMed Yuh YS, Chou TY, Tung TH. Bone age assessment: large-scale comparison of Greulich-Pyle method and Tanner-Whitehouse 3 method for Taiwanese children. J Chin Med Assoc. 2023;86(2):246–53.CrossRefPubMed
19.
Zurück zum Zitat Ashizawa K, Kumakura C, Zhou X, Jin F, Cao J. RUS skeletal maturity of children in Beijing. Ann Hum Biol. 2005;32(3):316–25.CrossRefPubMed Ashizawa K, Kumakura C, Zhou X, Jin F, Cao J. RUS skeletal maturity of children in Beijing. Ann Hum Biol. 2005;32(3):316–25.CrossRefPubMed
20.
Zurück zum Zitat Wang YM, Tsai TH, Hsu JS, Chao MF, Wang YT, Jaw TS. Automatic assessment of bone age in Taiwanese children: a comparison of the Greulich and Pyle method and the Tanner and Whitehouse 3 method. Kaohsiung J Med Sci. 2020;36(11):937–43.CrossRefPubMed Wang YM, Tsai TH, Hsu JS, Chao MF, Wang YT, Jaw TS. Automatic assessment of bone age in Taiwanese children: a comparison of the Greulich and Pyle method and the Tanner and Whitehouse 3 method. Kaohsiung J Med Sci. 2020;36(11):937–43.CrossRefPubMed
21.
Zurück zum Zitat Büken B, Erzengin OU, Büken E, Safak AA, Yazici B, Erkol Z. Comparison of the three age estimation methods: which is more reliable for Turkish children? Forensic Sci Int. 2009;183(1–3):103.e101-107. Büken B, Erzengin OU, Büken E, Safak AA, Yazici B, Erkol Z. Comparison of the three age estimation methods: which is more reliable for Turkish children? Forensic Sci Int. 2009;183(1–3):103.e101-107.
22.
Zurück zum Zitat Zhang A, Sayre JW, Vachon L, Liu BJ, Huang HK. Racial differences in growth patterns of children assessed on the basis of bone age. Radiology. 2009;250(1):228–35.CrossRefPubMedPubMedCentral Zhang A, Sayre JW, Vachon L, Liu BJ, Huang HK. Racial differences in growth patterns of children assessed on the basis of bone age. Radiology. 2009;250(1):228–35.CrossRefPubMedPubMedCentral
23.
Zurück zum Zitat Han Y, Wang G. Skeletal bone age prediction based on a deep residual network with spatial transformer. Comput Methods Programs Biomed. 2020;197:105754.CrossRefPubMed Han Y, Wang G. Skeletal bone age prediction based on a deep residual network with spatial transformer. Comput Methods Programs Biomed. 2020;197:105754.CrossRefPubMed
25.
Zurück zum Zitat Nadeem MW, Goh HG, Ali A, Hussain M, Khan MA, Ponnusamy VA. Bone age assessment empowered with deep learning: a survey, open research challenges and future directions. Diagnostics (Basel). 2020;10(10). Nadeem MW, Goh HG, Ali A, Hussain M, Khan MA, Ponnusamy VA. Bone age assessment empowered with deep learning: a survey, open research challenges and future directions. Diagnostics (Basel). 2020;10(10).
Metadaten
Titel
Inter-rater variability and repeatability in the assessment of the Tanner–Whitehouse classification of hand radiographs for the estimation of bone age
verfasst von
Jian Geng
Wenshuang Zhang
Yufeng Ge
Ling Wang
Pengju Huang
Yandong Liu
Jia Shi
Fengyun Zhou
Kangkang Ma
Glen M. Blake
Gang Xu
Dong Yan
Xiaoguang Cheng
Publikationsdatum
02.05.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
Skeletal Radiology
Print ISSN: 0364-2348
Elektronische ISSN: 1432-2161
DOI
https://doi.org/10.1007/s00256-024-04664-w

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.