Human gesture recognition under degraded environments using 3D-integral imaging and deep learning.

Optics Express
Gokul KrishnanBahram Javidi

Abstract

In this paper, we propose a spatio-temporal human gesture recognition algorithm under degraded conditions using three-dimensional integral imaging and deep learning. The proposed algorithm leverages the advantages of integral imaging with deep learning to provide an efficient human gesture recognition system under degraded environments such as occlusion and low illumination conditions. The 3D data captured using integral imaging serves as the input to a convolutional neural network (CNN). The spatial features extracted by the convolutional and pooling layers of the neural network are fed into a bi-directional long short-term memory (BiLSTM) network. The BiLSTM network is designed to capture the temporal variation in the input data. We have compared the proposed approach with conventional 2D imaging and with the previously reported approaches using spatio-temporal interest points with support vector machines (STIP-SVMs) and distortion invariant non-linear correlation-based filters. Our experimental results suggest that the proposed approach is promising, especially in degraded environments. Using the proposed approach, we find a substantial improvement over previously published methods and find 3D integral imaging to provide sup...Continue Reading

References

Oct 23, 1997·Neural Computation·S Hochreiter, J Schmidhuber
Jan 17, 2007·IEEE Transactions on Pattern Analysis and Machine Intelligence·Thomas SerreTomaso Poggio
Nov 21, 2007·Optics Letters·Ju-Seog Jang, Bahram Javidi
Nov 23, 2007·Optics Letters·H Arimoto, B Javidi
Aug 6, 2007·Optics Express·Albertina CastroBahram Javidi
Nov 1, 1988·Applied Optics·N DaviesL Yang
Mar 7, 2012·IEEE Transactions on Pattern Analysis and Machine Intelligence·Shuiwang JiKai Yu
Mar 1, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Ivo EvertsTheo Gevers
May 29, 2015·Nature·Yann LeCunGeoffrey Hinton
Nov 15, 2016·Optics Letters·Myungjin Cho, Bahram Javidi

❮ Previous
Next ❯

Related Concepts

Related Feeds

Cell Imaging in CNS

Here is the latest research on cell imaging and imaging modalities, including light-sheet microscopy, in the central nervous system.