Effectiveness of a screening test for early identification of autistic spectrum disorders in children
Abstract
Early diagnosis of autism spectrum disorders (ASD) is a key factor in ensuring timely intervention and improving long-term outcomes for children with this pathology. The development and validation of effective screening tools for use in primary health care are of significant clinical interest.
Objective. To evaluate the effectiveness of a test for the early diagnosis of ASD, developed for use in outpatient health care organizations.
Materials and methods. In the 2023—2024 study, 1984 children were screened using an original screening test developed by specialists in the healthcare system of the Republic of Belarus. The test included 24 questions grouped into six scales: sensory sphere, emotional sphere, visual contact, social interaction, speech development and cognitive sphere. The test results were assessed on a scale from 24 to 96 points with the following interpretation: 24—36 points — high risk of ASD; 37—63 points — average risk; 64—96 points — low risk. The diagnostic value of the test was assessed using ROC analysis with determination of sensitivity, specificity, positive and negative predictive value.
Results. Of the 1984 examined children, 64 (3.23 %) had a clinically confirmed diagnosis of ASD. The average test score was 76.16 (±13.14) in the overall group; 30.31 (±4.05) in the group with ASD; 77.69 (±13.14) in the group without ASD. The area under the ROC curve (AUC) was 0.9931, indicating excellent discriminatory ability of the test. The optimal threshold for detecting ASD is 38 points with a sensitivity of 100 % (95 % CI (100—100)) and a specificity of 97.60 % (95 % CI (96.92—98.29)). With a standard high risk threshold of 36 points, the test showed a sensitivity of 96.88 % and a specificity of 98.07 %, a positive predictive value of 62.63 % and a negative predictive value of 99.89 %.
Conclusion. The developed screening test demonstrates high efficiency for the early detection of ASD in young children. The optimal threshold for clinical practice is 38 points, but the standard threshold of 36 points also provides a good balance between sensitivity and specificity. The test can be recommended for widespread use in outpatient practice as a screening tool for the primary diagnosis of ASD.
About the Authors
A. I. KudlatchBelarus
L. V. Shalkevich
Belarus
O. S. Litvinova
Belarus
A. A. Novikov
Belarus
K. I. Grinkevich
Belarus
R. I. Bogdan
Belarus
S. M. Polyakov
Belarus
M. F. Pоdoliak
Belarus
References
1. Diagnostic and Statistical Manual of Mental Disorders (DSM-5) / American Psychiatric Association. — 5th ed. — Washington, 2013. — URL: https://www.psychiatry.org/psychiatrists/ practice/dsm (date of access: 01.10.2024).
2. International Classification of Diseases, 11th Revision (ICD-11). — Geneva : World Health Organization, 2022. — URL: https://www.who.int/news/item/11-02-2022-icd-11-2022-release (date of access: 11.02.2022).
3. Prevalence and characteristics of autism spectrum disorder among children aged 8 years — autism and developmental disabilities monitoring network, 11 Sites, United States, 2020 / M. J. Maenner, K. A. Shaw, A. V. Bakian [et al.] // MMWR Surveillance Summaries. — 2023. — Vol. 72 (2). — Р. 1—14.
4. Global prevalence of autism : a systematic review update / J. Zeidan, E. Fombonne, J. Scorah [et al.] // Autism Research. — 2022. — Vol. 15 (5). — Р. 778—790.
5. Long-term outcomes of early intervention in 6-year-old children with autism spectrum disorder / A. Estes, J. Munson, S. J. Rogers [et al.] // Journal of the American Academy of Child and Adolescent Psychiatry. — 2015. — Vol. 54 (7). — Р. 580—587.
6. Fuller, E. A. The effects of early intervention on social communication outcomes for children with autism spectrum disorder : a meta-analysis / E. A. Fuller, A. P. Kaiser // Journal of Autism and Developmental Disorders. — 2020. — Vol. 50 (5). — Р. 1683—1700.
7. Early intervention for children with autism spectrum disorder under 3 years of age : recommendations for practice and research / L. Zwaigenbaum, M. L. Bauman, R. Choueiri [et al.] // Pediatrics. — 2015. — Vol. 136, Suppl. 1. — DOI: 10.1542/peds.2014-3667E.
8. Validation of the modified checklist for autism in toddlers, revised with follow-up (M-CHATR/F) / D. L. Robins, K. Casagrande, M. Barton [et al.] // Pediatrics. — 2014. — Vol. 133 (1). — P. 37—45.
9. Screening for autistic spectrum disorder in children aged 14—15 months. II: population screening with the Early Screening of Autistic Traits Questionnaire (ESAT). Design and general findings / C. Dietz, S. Swinkels, E. van Daalen [et al.] // Journal of Autism and Developmental Disorders. — 2006. — Vol. 36 (6). — Р. 713—722.
10. The Q-CHAT (Quantitative Checklist for Autism in Toddlers): a normally distributed quantitative measure of autistic traits at 18—24 months of age : preliminary report / C. Allison, S. Baron-Cohen, S. Wheelwright [et al.] // Journal of Autism and Developmental Disorders. — 2008. — Vol. 38 (8). — Р. 1414—1425.
11. Sensitivity and specificity of the Baby and Infant Screen for Children with aUtIsm Traits (BISCUIT): Validity and cutoff scores for autism and PDD-NOS in toddlers / J. L. Matson, J. Wilkins, B. Sharp [et al.] // Research in Autism Spectrum Disorders. — 2009. — Vol. 3 (4). — Р. 924—930.
12. Simundic, A. M. Measures of diagnostic accuracy: basic definitions / A. M. Simundic // The electronic Journal of the International Federation of Clinical Chemistry. — 2009. — Vol. 19 (4). — Р. 203—211.
13. Deeks, J. J. Diagnostic tests 4: likelihood ratios / J. J. Deeks, D. G. Altman // British Medical Journal. — 2004. — Vol. 329 (7458). — Р. 168—169.
14. The diagnostic odds ratio : a single indicator of test performance / A. S. Glas,J. G. Lijmer, M. H. Prins [et al.] // Journal of Clinical Epidemiology. — 2003. — Vol. 56 (11). — Р. 1129—1135.
15. Cohen, J. Statistical power analysis for the behavioral sciences / J. Cohen. — 2nd ed. — Hillsdale, NJ : Lawrence Erlbaum Associates, 1988. — 579 р.
16. Accuracy of autism screening in a large pediatric network / W. Guthrie, K. Wallis, A. Bennett [et al.] // Pediatrics. — 2019. — Vol. 144 (4). — DOI: 10.1542/peds.2018-3963.
17. Brief Report: evaluation of the short quantitative checklist for autism in toddlers (Q-CHAT-10) as a brief screen for autism spectrum disorder in a high-risk sibling cohort / S. Raza, L. Zwaigenbaum, L. A. Sacrey [et al.] // Journal of Autism and Developmental Disorders. — 2019. — Vol. 49 (5). — Р. 2210—2218.
18. A comparison of emotional and behavioral symptom profiles in children with autism and PDDNOS / J. L. Matson, J. Wilkins, J. A. Sevin [et al.] // Behavior Modification. — 2009. — Vol. 33 (4). — P. 437—453.
19. Large-scale use of the modified checklist for autism in low-risk toddlers / C. Chlebowski, D. L. Robins, M. L. Barton [et al.] // Pediatrics. — 2013. — Vol. 131 (4). — DOI: 10.1542/peds.2012-1525.
20. Autism spectrum disorder / C. Lord, M. Elsabbagh, G. Baird, J. Veenstra-Vanderweele // Lancet. — 2018. — Vol. 392 (10146). — P. 508—520.
Review
For citations:
Kudlatch A.I., Shalkevich L.V., Litvinova O.S., Novikov A.A., Grinkevich K.I., Bogdan R.I., Polyakov S.M., Pоdoliak M.F. Effectiveness of a screening test for early identification of autistic spectrum disorders in children. Healthcare. 2025;(7):28—36. (In Russ.)