A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera

Sensors
Ge ZhuQing Zhao

Abstract

This paper reports an efficient method for sound extraction from high-speed light spot videos reconstructed from the coded light spot images captured with a low-speed camera based on compressive sensing, but at the expense of consuming time. The proposed method first gets the high-speed video of the light spot that is illuminated on the vibrating target caused by sound. Then the centroid of the light spot is used to recover the sound. Simulations of the proposed method are carried out and experimental results are demonstrated. The results show that high-speed videos with a frame rate of 2000 Hz can be reconstructed with a low-speed (100 Hz) charge-coupled device (CCD) camera, which is randomly modulated by a digital micro-mirror device (DMD) 20 times during each exposure time. This means a speed improvement of 20 times is achieved. The effects of synchronization between CCD image recording and DMD modulation, the optimal sampling patterns of DMD, and sound vibration amplitudes on the performance of the proposed method are evaluated. Using this compressive camera, speech (counting from one to four in Chinese) was recovered well. This has been confirmed by directly listening to the recovered sound, and the intelligibility value (...Continue Reading

References

Dec 21, 2007·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·José M Bioucas-Dias, Mario A T Figueiredo
Apr 28, 2010·IEEE Transactions on Pattern Analysis and Machine Intelligence·Ashok VeeraraghavanRamesh Raskar
Jan 1, 2009·Sensors·Munir El-DesoukiDavid Armstrong
Apr 16, 2013·Sensors·Mohammadreza DadkhahShahram Shirani
May 15, 2013·Optics Express·Patrick LlullDavid J Brady
Dec 21, 2013·IEEE Transactions on Pattern Analysis and Machine Intelligence·Dengyu LiuShree K Nayar
Nov 13, 2014·IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society·Reza Pournaghi, Xiaolin Wu
Jul 21, 2015·Optics Express·Roman KollerAggelos K Katsaggelos
Sep 3, 2016·The Review of Scientific Instruments·Dashan ZhangChang'an Zhu

❮ Previous
Next ❯

Software Mentioned

MATLAB
TwIST
GAP

Related Concepts

Related Feeds

CZI Human Cell Atlas Seed Network

The aim of the Human Cell Atlas (HCA) is to build reference maps of all human cells in order to enhance our understanding of health and disease. The Seed Networks for the HCA project aims to bring together collaborators with different areas of expertise in order to facilitate the development of the HCA. Find the latest research from members of the HCA Seed Networks here.

Addiction

This feed focuses mechanisms underlying addiction and addictive behaviour including heroin and opium dependence, alcohol intoxication, gambling, and tobacco addiction.

Related Papers

Optics Express
Zihao WangHuaijin Chen
IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
S Derin BabacanAggelos K Katsaggelos
© 2022 Meta ULC. All rights reserved