Dynamic texture recognition using local binary patterns with an application to facial expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Guoying Zhao, Matti Pietikäinen

Abstract

Dynamic texture (DT) is an extension of texture to the temporal domain. Description and recognition of DTs have attracted growing attention. In this paper, a novel approach for recognizing DTs is proposed and its simplifications and extensions to facial image analysis are also considered. First, the textures are modeled with volume local binary patterns (VLBP), which are an extension of the LBP operator widely used in ordinary texture analysis, combining motion and appearance. To make the approach computationally simple and easy to extend, only the co-occurrences of the local binary patterns on three orthogonal planes (LBP-TOP) are then considered. A block-based method is also proposed to deal with specific dynamic events such as facial expressions in which local information and its spatial locations should also be taken into account. In experiments with two DT databases, DynTex and Massachusetts Institute of Technology (MIT), both the VLBP and LBP-TOP clearly outperformed the earlier approaches. The proposed block-based method was evaluated with the Cohn-Kanade facial expression database with excellent results. The advantages of our approach include local processing, robustness to monotonic gray-scale changes, and simple compu...Continue Reading

References

Nov 17, 2006·IEEE Transactions on Pattern Analysis and Machine Intelligence·Timo AhonenMatti Pietikäinen
Feb 6, 2008·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Chin-Hwee Peh, Loong-Fah Cheong

❮ Previous
Next ❯

Citations

Aug 9, 2011·Journal of Medical Systems·Subrahmanyam MuralaR Balasubramanian
Dec 11, 2013·Computational and Mathematical Methods in Medicine·Hamed Habibi AghdamAgusti Solanas
Jan 13, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Chih-Chung HsuChia-Wen Lin
Dec 11, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yazhou LiuQuansen Sun
Mar 15, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Jianfeng RenJunsong Yuan
Dec 30, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Nick C TangHong-Yuan Mark Liao
Mar 18, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Hamdi DibekliogluTheo Gevers
Mar 31, 2015·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Seyedehsamaneh ShojaeilangariEam Khwang Teoh
Dec 15, 2015·Computers in Biology and Medicine·Alessandra LuminiSheryl Brahnam
Sep 12, 2015·Medical Image Analysis·Wenqi LiStephen J McKenna
Sep 5, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Adín Ramírez Rivera, Oksam Chae
Aug 6, 2013·IEEE Transactions on Cybernetics·Michael J RealeShaun Canavan
Oct 11, 2013·IEEE Transactions on Medical Imaging·Stefan JaegerClement J McDonald
Mar 27, 2013·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yongqiang LiQiang Ji
May 28, 2013·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Jianjun QianYong Xu
Apr 16, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Xiaopeng HongXilin Chen
Jun 13, 2013·IEEE Transactions on Cybernetics·Bihan JiangMaja Pantic
Sep 10, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Mahsa BaktashmotlaghMathieu Salzmann
May 9, 2014·IEEE Transactions on Neural Networks and Learning Systems·Wentao Fan, Nizar Bouguila
Apr 3, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Amit SatpathyHow-Lung Eng
Aug 29, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Rouzbeh MaaniYee-Hong Yang
Apr 25, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Bin FanPascal Fua
Sep 10, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Adeel MumtazAntoni B Chan
Sep 10, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Xianbiao QiXiaoou Tang
May 21, 2013·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yimo GuoMatti Pietikainen
May 18, 2013·IEEE Transactions on Pattern Analysis and Machine Intelligence·Adeel MumtazAntoni B Chan
Sep 12, 2015·IEEE Transactions on Pattern Analysis and Machine Intelligence·Evangelos SariyanidiAndrea Cavallaro
Nov 22, 2014·IEEE Transactions on Cybernetics·Boulbaba Ben AmorAnuj Srivastava
Jun 26, 2013·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Jianfeng RenJunsong Yuan
Sep 18, 2010·IEEE Transactions on Pattern Analysis and Machine Intelligence·Sander KoelstraIoannis Patras
Nov 9, 2011·IEEE Transactions on Pattern Analysis and Machine Intelligence·Konstantinos G Derpanis, Richard P Wildes
Jul 17, 2010·IEEE Transactions on Pattern Analysis and Machine Intelligence·Jie ChenWen Gao
Sep 19, 2009·IEEE Transactions on Pattern Analysis and Machine Intelligence·Jacob WhitehillJavier Movellan
Feb 5, 2010·IEEE Transactions on Medical Imaging·Lauge SørensenMarleen de Bruijne
Aug 2, 2012·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Jie ChenMatti Pietikäinen
Nov 4, 2009·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·Mingli SongMengchu Zhou
Aug 23, 2012·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Jun ZhangHeng Zhao
Aug 23, 2012·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Hui JiYong Xu
Mar 11, 2010·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Zhenhua GuoDavid Zhang
Nov 6, 2009·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Baochang ZhangJianzhuang Liu
Apr 2, 2009·IEEE Transactions on Bio-medical Engineering·Shu HeDongshan Xing
Dec 11, 2008·IEEE Transactions on Neural Networks·Irene KotsiaIoannis Pitas
Mar 10, 2016·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Yimo GuoMatti Pietikainen
Apr 23, 2011·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Fakhry M Khellah
Jun 28, 2012·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·Michel F ValstarKlaus Scherer
May 25, 2012·IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society·T SenechalL Prevost

❮ Previous
Next ❯

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Timo AhonenMatti Pietikäinen
IEEE Transactions on Pattern Analysis and Machine Intelligence
Zhihong ZengThomas S Huang
IEEE Transactions on Pattern Analysis and Machine Intelligence
Yongmian Zhang, Qiang Ji
IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
Irene Kotsia, Ioannis Pitas
IEEE Transactions on Pattern Analysis and Machine Intelligence
Marko Heikklä, Matti Pietikäinen
© 2021 Meta ULC. All rights reserved