Reconstruction of multispectral light field (5d plenoptic function) based on compressive sensing with colored coded apertures from 2D projections
In the last decade, spatio – angular (light field) acquisition systems have advanced due to the inclusion of coded apertures in the optical path. These coded apertures, modulate the light, encoding the information before being captured. Traditionally, these coded apertures are binary, i.e. block and unblock the light rays in the spatial dimension, capturing sparse information of the scene. In this work, the binary coded aperture is replaced by a colored coded aperture which modulates the source not only spatially but spectrally. Thereby, it is possible to capture light fields in multiple wavelengths yielding high spectral resolution. The spectral information provides many features of a scene in different wavelengths, these features are not present in the visible range of the electromagnetic spectrum. In this paper, an algorithm that simulates the light field sampling with colored coded apertures is proposed. The proposed algorithm, exploits the redundant information of the scene based on the compressive sensing theory thus, capturing just a sparse signal. The multidimensional image can be recovered from the underlying signal through a reconstruction algorithm. Several simulations show the quality of the multispectral light field reconstructions. The PSNR (Peak Signal to Noise Ratio) values obtained for the reconstructions are around 25 dB.
E. Candès, “Compressive sampling”, in International Congress of Mathematicians, Madrid, Spain, 2006, pp. 1433-1452.
M. Fornasier and H. Rauhut, “Compressive sensing”, in Handbook Mathematical Methods in Imaging, O. Scherzer (ed). New York, USA: Springer, 2011, pp. 187-228.
D. Donoho, “Compressed sensing”, IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, 2006.
G. Shaw and H. Burke, “Spectral imaging for remote sensing”, Lincoln Lab. J., vol. 14, no. 1, pp. 3-28, 2003.
K. Marwah, G. Wetzstein, Y. Bando and R. Raskar, “Compressive light field photography using overcomplete dictionaries and optimized projections”, ACM Trans. Graph., vol. 32, no. 4, 2013.
A. Mian and R. Hartley, “Hyperspectral video restoration using optical flow and sparse coding”, Optics Express, vol. 20, no. 10. p. 10658-10673, 2012.
K. Choi and D. Brady, “Coded aperture computed tomography”, in SPIE 7468: Adapt. Coded Aperture Imaging, Non-Imaging, Unconv. Imaging Sens. Syst., San Diego, USA, 2009.
E. Adelson and J. Bergen, “The plenoptic function and the elements of early vision”, in Computational Models of Visual Processing, M. Landy and J. Movshon (eds). Cambridge, USA: MIT Press, 1991, pp. 3-20.
G. Wetzstein, I. Ihrke, D. Lanman and W. Heidrich, “Computational plenoptic imaging”, Comput. Graph. Forum, vol. 30, no. 8, pp. 2397-2426, 2011.
H. Rueda, H. Arguello and G. Arce, “Compressive spectral imaging based on colored coded apertures”, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy, 2014, pp. 7799-7803.
S. Babacan, R. Ansorge, M. Luessi, R. Molina and A. Katsaggelos, “Compressive Sensing of Light Fields”, in IEEE International Conference on Image Processing (ICIP), Cairo, Egypt, 2009, pp. 2337-2340.
R. Ng, “Digital light field photography”, Ph.D. dissertation, Standford University, Stanford, USA, 2006.
M. Aharon, M. Elad and A. Bruckstein, “K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation”, IEEE Trans. Signal Process., vol. 54, pp. 4311-4322, 2006.
A. Brückner, “Microoptical Multi Aperture Imaging Systems”, Ph.D. dissertation, Friedrich Schiller University Jena, Jena, Germany, 2011.
S. Kim, E. Lee, M. Hayes and J. Paik, “Multifocusing and depth estimation using a color shift model-based computational camera”, IEEE Trans. Image Process., vol. 21, no. 9, pp. 4152-4166, 2012.
Y. Bando, B. Chen and T. Nishita, “Extracting depth and matte using a color-filtered aperture”, ACM Transactions on Graphics, vol. 27, no. 5, 2008.
H. Arguello and G. Arce, “Colored coded aperture design by concentration of measure in compressive spectral imaging”, IEEE Trans. Image Process., vol. 23, pp. 1896-1908, 2014.
H. Arguello, H. Rueda, Y. Wu, D. Prather and G. Arce, “Higher-order computational model for coded aperture spectral imaging”, Appl. Opt., vol. 52, no. 10, pp. 12-21, 2013.
E. van den Berg and M. Friedlander, “Probing the Pareto Frontier for Basis Pursuit Solutions”, SIAM Journal on Scientific Computing, vol. 31, no. 2. pp. 890-912, 2009.
Z. Wang, A. Bovik, H. Sheikh and E. Simoncelli, “Image quality assessment: From error visibility to structural similarity”, IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, 2004.
Copyright (c) 2016 Revista Facultad de Ingeniería Universidad de Antioquia
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors can archive the pre-print version (i.e., the version prior to peer review) and post-print version (that is, the final version after peer review and layout process) on their personal website, institutional repository and / or thematic repository
- Upon acceptance of an article, it will be published online through the page https://revistas.udea.edu.co/index.php/ingenieria/issue/archive in PDF version with its correspondent DOI identifier
The Revista Facultad de Ingeniería -redin- encourages the Political Constitution of Colombia, chapter IV
Chapter IV Sanctions 51
The following shall be liable to imprisonment for two to five years and a fine of five to 20 times the legal minimum monthly wage: (1) any person who publishes an unpublished literary or artistic work, or part thereof, by any means, without the express prior authorization of the owner of rights; (2) any person who enters in the National Register of Copyright a literary, scientific or artistic work in the name of a person other than the true author, or with its title altered or deleted, or with its text altered, deformed, amended or distorted, or with a false mention of the name of the publisher or phonogram, film, videogram or software producer; (3) any person who in any way or by any means reproduces, disposes of, condenses, mutilates or otherwise transforms a literary, scientific or artistic work without the express prior authorization of the owners thereof; (4) any person who reproduces phonograms, videograms, software or cinematographic works without the express prior authorization of the owner, or transports, stores, stocks, distributes, imports, sells, offers for sale, acquires for sale or distribution or in any way deals in such reproductions. Paragraph. If either the material embodiment or title page of or the introduction to the literary work, phonogram, videogram, software or cinematographic work uses the name, business style, logotype or distinctive mark of the lawful owner of rights, the foregoing sanctions shall be increased by up to half.