Classifying Facial Actions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Gianluca DonatoT J Sejnowski

Abstract

The Facial Action Coding System (FACS) [23] is an objective method for quantifying facial movement in terms of component actions. This system is widely used in behavioral investigations of emotion, cognitive processes, and social interaction. The coding is presently performed by highly trained human experts. This paper explores and compares techniques for automatically recognizing facial actions in sequences of images. These techniques include analysis of facial motion through estimation of optical flow; holistic spatial analysis, such as principal component analysis, independent component analysis, local feature analysis, and linear discriminant analysis; and methods based on the outputs of local filters, such as Gabor wavelet representations and local principal components. Performance of these systems is compared to naive and expert human subjects. Best performances were obtained using the Gabor wavelet representation and the independent component representation, both of which achieved 96 percent accuracy for classifying 12 facial actions of the upper and lower face. The results provide converging evidence for the importance of using local filters, high spatial frequencies, and statistical independence for classifying facial ...Continue Reading

References

Sep 1, 1995·The British Journal of Social Psychology·S J McKelvie
Nov 1, 1995·Neural Computation·A J Bell, T J Sejnowski
Jan 1, 1993·Journal of Nursing Care Quality·P Ludwig-BeymerK T Czurylo
Jun 28, 1996·Science·D Beymer, T Poggio
Jan 13, 1998·Vision Research·A J Bell, T J Sejnowski
Apr 9, 1999·Psychophysiology·M S BartlettT J Sejnowski
Jan 1, 1996·IEEE Transactions on Neural Networks·M RosenblumL S Davis
Oct 1, 1999·IEEE Transactions on Pattern Analysis and Machine Intelligence·Gianluca DonatoTerrence J Sejnowski
Jan 1, 1991·Journal of Cognitive Neuroscience·M Turk, A Pentland

❮ Previous
Next ❯

Citations

Jul 10, 2003·Neural Networks : the Official Journal of the International Neural Network Society·Masakazu MatsuguYuji Kaneda
Dec 24, 2002·Journal of Cognitive Neuroscience·Matthew N DaileyRalph Adolphs
Apr 26, 2002·Neural Computation·Dan RothNarendra Ahuja
Aug 2, 2006·Diagnostic Pathology·Christos D KatsisDimitrios I Fotiadis
Nov 1, 2003·Behavior Research Methods, Instruments, & Computers : a Journal of the Psychonomic Society, Inc·Jeffrey F CohnTakeo Kanade
Apr 20, 2007·Journal of Neuroscience Methods·Christopher AlvinoRagini Verma
Mar 27, 2013·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yongqiang LiQiang Ji
May 9, 2014·IEEE Transactions on Neural Networks and Learning Systems·Wentao Fan, Nizar Bouguila
Jan 13, 2006·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yulia Gizatdinova, Veikko Surakka
Oct 6, 2004·IEEE Transactions on Pattern Analysis and Machine Intelligence·Chengjun Liu
Jul 15, 2005·IEEE Transactions on Pattern Analysis and Machine Intelligence·Joes StaalMax A Viergever
Jun 10, 2005·IEEE Transactions on Pattern Analysis and Machine Intelligence·Sylvie C W Ong, Surendra Ranganath
Aug 19, 2007·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yan TongQiang Ji
Feb 1, 2001·IEEE Transactions on Pattern Analysis and Machine Intelligence·Ying-Li TianJeffrey F Cohn
Sep 19, 2009·IEEE Transactions on Pattern Analysis and Machine Intelligence·Jacob WhitehillJavier Movellan
May 15, 2007·IEEE Transactions on Pattern Analysis and Machine Intelligence·Jesse Hoey, James J Little
Apr 28, 2006·IEEE Transactions on Pattern Analysis and Machine Intelligence·Chengjun Liu
May 7, 2005·IEEE Transactions on Pattern Analysis and Machine Intelligence·Yongmian Zhang, Qiang Ji
Dec 24, 2009·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Stefanos Zafeiriou, Maria Petrou
Apr 11, 2006·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·Maja Pantic, Ioannis Patras
Feb 8, 2007·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Irene Kotsia, Ioannis Pitas
Jan 20, 2009·IEEE Transactions on Neural Networks·Stefanos Zafeiriou
Jun 9, 2005·IEEE Transactions on Neural Networks·Meng Joo ErShiqian Wu
Dec 9, 2004·Journal of Neuroscience Methods·Ragini VermaRuben C Gur
Jul 20, 2011·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Caifeng Shan
May 15, 2012·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society· Songfan Yang, Bir Bhanu
May 17, 2012·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society· Tingfan WuJavier R Movellan
Sep 20, 2011·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·Michel F Valstar, Maja Pantic
Oct 16, 2004·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·Maja Pantic, Leon J M Rothkrantz
Jun 11, 2008·IEEE Transactions on Neural Networks·Ioan BuciuIoannis Pitas
Feb 5, 2008·IEEE Transactions on Neural Networks·M S BartlettT J Sejnowski
Oct 1, 1999·IEEE Transactions on Pattern Analysis and Machine Intelligence·Gianluca DonatoTerrence J Sejnowski
Feb 6, 2008·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·C Liu, H Wechsler
Feb 5, 2008·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Chengjun Liu, Harry Wechsler
Oct 16, 2004·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·L Ma, K Khorasani
Feb 2, 2008·IEEE Transactions on Neural Networks·Chengjun Liu, H Wechsler
Feb 5, 2008·IEEE Transactions on Neural Networks·Meng Joo ErHock Lye Toh
Jun 21, 2005·Neural Networks : the Official Journal of the International Neural Network Society·Spiros V IoannouStefanos D Kollias
Apr 9, 2001·Vision Research·A J CalderS Akamatsu
Apr 5, 2003·Vision Research·Aleix M Martínez
Feb 1, 2013·Computational Intelligence and Neuroscience·Arindam KarMahantapas Kundu
May 11, 2016·Journal of Alzheimer's Disease : JAD·Pongsatorn PaholpakMario F Mendez
Jul 28, 2016·Epilepsia·Krzysztof A BujarskiRobert M Roth
Oct 4, 2006·Progress in Brain Research·Adrian SchwaningerSarah D Chiller-Glaus
Apr 30, 2014·Journal of Autism and Developmental Disorders·Iris GordonJames W Tanaka
Jun 28, 2012·Sensors·Shiqing ZhangBicheng Lei

❮ Previous
Next ❯

Related Concepts

Related Feeds

BRAIN Initiative Cell Census Network (BICCN)

The BRAIN Initiative Cell Census Network aims to identify and provide experimental access to the different brain cell types to determine their roles in health and disease. Discover the latest research from researchers in the BRAIN Initiative Cell Census Network here.

Related Papers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Ying-Li TianJ F Cohn
IEEE Transactions on Pattern Analysis and Machine Intelligence
Yongmian Zhang, Qiang Ji
IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
Maja Pantic, Leon J M Rothkrantz
© 2021 Meta ULC. All rights reserved