Hyperspectral video restoration using optical flow and sparse coding

Optics Express
Ajmal Mian, Richard Hartley

Abstract

Hyperspectral video acquisition is a trade-off between spectral and temporal resolution. We present an algorithm for recovering dense hyperspectral video of dynamic scenes from a few measured multispectral bands per frame using optical flow and sparse coding. Different set of bands are measured in each video frame and optical flow is used to register them. Optical flow errors are corrected by exploiting sparsity in the spectra and the spatial correlation between images of a scene at different wavelengths. A redundant dictionary of atoms is learned that can sparsely approximate training spectra. The restoration of correct spectra is formulated as an ℓ1 convex optimization problem that minimizes a Mahalanobis-like weighted distance between the restored and corrupt signals as well as the restored signal and the median of the eight connected neighbours of the corrupt signal such that the restored signal is a sparse linear combination of the dictionary atoms. Spectral restoration is followed by spatial restoration using a guided dictionary approach where one dictionary is learned for measured bands and another for a band that is to be spatially restored. By constraining the sparse coding coefficients of both dictionaries to be the s...Continue Reading

References

Dec 13, 2006·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Michael Elad, Michal Aharon
Jan 31, 2008·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Julien MairalGuillermo Sapiro
Apr 15, 2009·Optics Express·Ashwin A WagadarikarDavid J Brady
Apr 2, 2010·Applied Optics·Mohan ShankarDavid J Brady
May 21, 2010·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Jianchao YangYi Ma
Dec 22, 2010·Applied Optics·David KittleDavid J Brady

❮ Previous
Next ❯

Citations

Nov 25, 2018·Optics Express·Xi WangGonzalo R Arce
Nov 2, 2019·Optics Express·Xuemei HuQionghai Dai

❮ Previous
Next ❯

Related Concepts

Related Feeds

Cell Imaging in CNS

Here is the latest research on cell imaging and imaging modalities, including light-sheet microscopy, in the central nervous system.

Related Papers

Journal of the Optical Society of America. A, Optics and Image Science
S KawataS Minami
IEEE Transactions on Pattern Analysis and Machine Intelligence
Julien MairalJean Ponce
IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
Julio Martin Duarte-Carvajalino, Guillermo Sapiro
© 2021 Meta ULC. All rights reserved