The time has come for living systematic reviews in autism research

While the inclusion of more recent estimates can improve accuracy and utility of systematic reviews, there is a key challenge: how can evidence influence policy if it cannot be updated in real time?

Autism prevalence estimates have been used for decades to inform policy and practice in research and service delivery. In our recent systematic review update (Zeidan et al., 2022), we found a large increase in the number of estimates available relative to the first systematic review we conducted in 2012 (Elsabbagh et al., 2012). The increase was most notable in world regions which were largely unrepresented in the past.

In their Letter to the Editor, Roman-Urrestarazu et al. (2021) argued that a missing study from our review, led to inaccurate estimates for the European region. We caution against interpreting prevalence estimates as “ground truth” but rather as useful snapshots in time of who is being counted or not counted as having autism. In our systematic review, we comprehensibly examined methodological features such as definitions of autism, study design attributes, data sources, and sampling procedures that substantially impact prevalence estimates.

Roman-Urrestarazu et al. (2021) is indeed a unique study because it went beyond estimating prevalence to examining key social determinants modifying prevalence in a large population of school-age children. However, when our search was last updated in November 2021, the publication from Roman-Urrestarazu et al. (2021) despite being in the database, had not yet been indexed, and was therefore not captured by our literature search.

While the inclusion of more recent estimates can indeed improve accuracy and utility of systematic reviews, there is a key challenge: how can evidence effectively influence policy if it cannot be comprehensively updated in real time? Traditional systematic reviews like the one we conducted are time-consuming, costly, and their results necessarily lag behind. The proliferation of epidemiological literature all over the world amplifies the challenge of maintaining prevalence estimates up to date.

To illustrate this point, we reran our search on March 16, 2022. Not surprisingly the updated search identified Roman-Urrestarazu et al. (2021) embedded within a large number of 267 articles published in this area only in the last few months (Supporting Information, Figure S1). We went further and screened these articles to check if they contained new epidemiological estimates. Indeed, we identified not one but eight new estimates in different world regions. As expected, our global estimates remain largely similar with the addition of the new estimates but regional estimates were more susceptible to change only in those regions where fewer estimates are available (Table 1).

Summary of autism prevalence estimates across world regions from 2012 to 2022 (updated search on March 16, 2022).
Open file to view table: PDF icon The time has come for living systematic reviews in autism research

We believe that the utility of systematic reviews lies in the transparency of the search and availability of all the data extracted (Supporting Information, Tables S1 and S2). As we did here, researchers and knowledge users can reuse the extracted data to perform updates, more targeted analyses such as regional ones, and new analyses such as economic estimates.

Another solution is on the horizon. A new review format has been developed (Elliott et al., 2014) and implemented in a number of journals (Rahal et al., 2016) leading to a Cochrane guidance (Cochrane Community, 2019). A “living systematic review” is one that is updated continually to include new evidence. Key to its success is commitment to monthly updates of the search, inclusion, and interpretation of new evidence. The time has come for living reviews in autism research.

Letter to the editor originally published in Autism Research on May 15, 2022. 


Data availability statement
The data that supports the findings of this study are available in the supplementary material of this article
Mayada Elsabbagh1
Afiqah Yusuf1
Jinan Zeidan1
Julie Scorah1
Eric Fombonne2
Maureen S. Durkin3
Shekhar Saxena4
Andy Shih5
1Montreal Neurological Institute-Hospital, Faculty of Medicine & Health Sciences, McGill University, Montreal, Canada
2Department of Psychiatry, Oregon Health and Science University, Portland, Oregon, USA
3Population Health Sciences, Department of Pediatrics, Waisman Center, University of Wisconsin-Madison, Madison, Wisconsin, USA
4Department of Global Health and Population, Harvard T H Chan School of Public Health, Boston, Massachusetts, USA
5Science, Autism Speaks, New York City, New York, USA
Correspondence
Mayada Elsabbagh, Montreal Neurological Institute-Hospital, Faculty of Medicine & Health Sciences, McGill University, 3775 Rue University, Room C18, Montreal, Quebec H3A 2B4, Canada.
Email: mayada.elsabbagh [at] mcgill.ca
ORCID
Mayada Elsabbagh https://orcid.org/0000-0002-7311-9059
Andy Shih https://orcid.org/0000-0003-1957-8200 
References
Cochrane Community. 2019. Guidance for the production and publication of Cochrane living systematic reviews: Cochrane reviews in living mode - version December 2019. https://community.cochrane.org/sites/default/files/uploads/inline-files/Transform/201912_LSR_Revised_Guidance.pdf.
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014). Living systematic reviews: An emerging opportunity to narrow the evidence-practice gap. PLoS Medicine, 11(2), e1001603. https://doi.org/10.1371/journal.pmed.1001603
Elsabbagh, M., Divan, G., Koh, Y.-J., Kim, Y. S., Kauchali, S., Marcín, C., Montiel-Nava, C., Patel, V., Paula, C. S., Wang, C., Yasamy, M. T., & Fombonne, E. (2012). Global prevalence of autism and other pervasive developmental disorders. Autism Research, 5(3), 160–179. https://doi.org/10.1002/aur.239
Rahal, A. K., Badgett, R. G., & Hoffman, R. M. (2016). Screening coverage needed to reduce mortality from prostate cancer: A living systematic review. PLoS One, 11(4), e0153417. https://doi.org/10.1371/journal.pone.0153417
Roman-Urrestarazu, A., van Kessel, R., Allison, C., Matthews, F. E., Brayne, C., & Baron-Cohen, S. (2021). Association of Race/ethnicity and social disadvantage with autism prevalence in 7 million school children in England. JAMA Pediatrics, 175(6), e210054. https://doi.org/10.1001/jamapediatrics.2021.0054
Supporting information
Additional supporting information may be found in the online version of the article at the publisher’s website.
Cite this article
Elsabbagh, M., Yusuf, A., Zeidan, J., Scorah, J., Fombonne, E., Durkin, M.S., Saxena, S. and Shih, A. (2022), The time has come for living systematic reviews in autism research. Autism Research, 15: 1187-1188. https://doi.org/10.1002/aur.2739

The Neuro logo McGill logoMcGill University Health Centre logoKillam Laureates

 

The Neuro (Montreal Neurological Institute-Hospital) is a bilingual academic healthcare institution. We are a McGill research and teaching institute; delivering high-quality patient care, as part of the Neuroscience Mission of the McGill University Health Centre. We are proud to be a Killam Institution, supported by the Killam Trusts.

 

 

FacebookinstagramtwitterlinkedInyoutube

Back to top