Towards the automatic detection of social biomarkers in autism spectrum disorder: introducing the simulated interaction task (SIT).

NPJ Digital Medicine
Hanna DrimallaIsabel Dziobek

Abstract

Social interaction deficits are evident in many psychiatric conditions and specifically in autism spectrum disorder (ASD), but hard to assess objectively. We present a digital tool to automatically quantify biomarkers of social interaction deficits: the simulated interaction task (SIT), which entails a standardized 7-min simulated dialog via video and the automated analysis of facial expressions, gaze behavior, and voice characteristics. In a study with 37 adults with ASD without intellectual disability and 43 healthy controls, we show the potential of the tool as a diagnostic instrument and for better description of ASD-associated social phenotypes. Using machine-learning tools, we detected individuals with ASD with an accuracy of 73%, sensitivity of 67%, and specificity of 79%, based on their facial expressions and vocal characteristics alone. Especially reduced social smiling and facial mimicry as well as a higher voice fundamental frequency and harmony-to-noise-ratio were characteristic for individuals with ASD. The time-effective and cost-effective computer-based analysis outperformed a majority vote and performed equal to clinical expert ratings.

References

Nov 1, 1975·Journal of Psychiatric Research·M F FolsteinP R McHugh
Jun 1, 1994·Journal of Voice : Official Journal of the Voice Foundation·J E Sussman, C Sapienza
May 29, 2002·British Journal of Psychology·Vasudevi ReddyAmy Vaughan
Jan 7, 2003·Journal of Voice : Official Journal of the Voice Foundation·Carole T Ferrand
Apr 9, 2005·Journal of the American Geriatrics Society·Ziad S NasreddineHoward Chertkow
Feb 1, 2008·IEEE Transactions on Bio-medical Engineering·Elliot MooreLydia Weisser
Sep 16, 2008·Schizophrenia Research·Christian G KohlerRuben C Gur
Nov 17, 2009·Biological Psychology·Ursula Hess, Patrick Bourgeois
Mar 30, 2010·Journal of Child Psychology and Psychiatry, and Allied Disciplines·Ginny RussellJean Golding
May 8, 2010·Neuroscience Letters·Megha ShardaNandini C Singh
May 27, 2010·Journal of Autism and Developmental Disorders·Jennifer C KirchnerIsabel Dziobek
Sep 3, 2010·Neuropsychology Review·Madeline B HarmsGregory L Wallace
Dec 15, 2010·Journal of Autism and Developmental Disorders·Jojanneke A BastiaansenAnnelies de Bildt
May 26, 2011·Autism : the International Journal of Research and Practice·Susan W WhiteBethany C Bray
Nov 17, 2011·Fortschritte der Neurologie-Psychiatrie·F-G LehnhardtK Vogeley
Nov 2, 2012·Journal of Autism and Developmental Disorders·Mirko Uljarevic, Antonia Hamilton
Jan 26, 2013·Personality and Social Psychology Review : an Official Journal of the Society for Personality and Social Psychology, Inc·Ursula Hess, Agneta Fischer
Oct 1, 2013·European Archives of Psychiatry and Clinical Neuroscience·K VogeleyI Dziobek
Oct 22, 2013·Acta Psychologica·Romi ZäskeStefan R Schweinberger
Oct 24, 2013·Journal of Autism and Developmental Disorders·James W Tanaka, Andrew Sung
Mar 5, 2014·Journal of Autism and Developmental Disorders·Marisa G FilipeSelene G Vicente
Apr 2, 2014·Journal of Speech, Language, and Hearing Research : JSLHR·Daniel BoneShrikanth Narayanan
Jun 11, 2014·Development and Psychopathology·Leah M LozierAbigail A Marsh
Nov 7, 2014·Journal of Autism and Developmental Disorders·Sayaka YoshimuraMotomi Toichi
Feb 6, 2015·Journal of Autism and Developmental Disorders·Alessandro CrippaIsabella Castiglioni
Jun 16, 2015·Current Biology : CB·Teodora GligaUNKNOWN BASIS Team
Sep 1, 2015·Frontiers in Psychology·Beate SeibtPeter Weyers
Nov 8, 2015·Neuroscience and Biobehavioral Reviews·Filippo CastellanoGiuseppe Carrà
Dec 19, 2015·Computational and Mathematical Methods in Medicine·Ömer Eskidere, Ahmet Gürhanlı
Feb 2, 2016·The Journal of the Acoustical Society of America·J R Orozco-ArroyaveE Nöth
Feb 27, 2016·Neuroscience and Biobehavioral Reviews·H DaviesK Tchanturia
Apr 3, 2016·Autism Research : Official Journal of the International Society for Autism Research·Wenbo LiuLi Yi
Jul 11, 2016·Neuroscience and Biobehavioral Reviews·Aleksandra KupferbergGregor Hasler
May 1, 2015·IEEE International Conference on Automatic Face & Gesture Recognition and Workshops·Sharifa AlghowinemMichael Breakspear
Aug 9, 2016·Autism Research : Official Journal of the International Society for Autism Research·Riccardo FusaroliSebastian B Gaigg
Sep 23, 2016·Journal of Clinical Child and Adolescent Psychology : the Official Journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53·Andrea Trubanova Wieckowski, Susan W White
Dec 10, 2016·Frontiers in Psychology·Krystyna RymarczykIwona Szatkowska
Apr 10, 2017·Journal of Autism and Developmental Disorders·Shuo ZhaoMotomi Toichi
Jul 30, 2017·Journal of Autism and Developmental Disorders·Laura Fusar-PoliPierluigi Politi
Oct 19, 2017·Scientific Reports·Apoorva Rajiv MadipakkamPhilipp Sterzer
Nov 28, 2017·Neuroscience and Biobehavioral Reviews·Jack CotterJennifer H Barnett

❮ Previous
Next ❯

Software Mentioned

learn
Librosa
Parselmouth Praat Scripts
scikit
OpenFace

Related Concepts

Related Feeds

Autism

Autism spectrum disorder is associated with challenges with social skills, repetitive behaviors, and often accompanied by sensory sensitivities and medical issues. Here is the latest research on autism.

Related Papers

Journal of Autism and Developmental Disorders
Mariëlle StelRaymond C Smeets
Autism Research : Official Journal of the International Society for Autism Research
Martin Schulte-RütherKerstin Konrad
© 2021 Meta ULC. All rights reserved