Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
DOI:
https://doi.org/10.17533/udea.redin.n78a12Keywords:
multispectral filter array-based sensors, compressive sensing, spectral imagesAbstract
Spectral imaging systems capture spectral and spatial information from a scene to produce a spectral data cube. Technical progress has allowed developing multispectral filter array (MSFA)-based sensors in order to expand the reconstruction of more bands than RGB cameras. However, reconstructing the spectral image with traditional methods following a least squares or demosaicing approach is unfeasible. Some works in the literature implement multispectral demosaicing for reconstructing images with specific spatio-spectral resolution depending on the number of pixels in the detector and the filter mosaic. Recently, compressive sensing technique has been developed that allows reconstructing signals with fewer measurements than the traditional methods by using the sparse representation of a signal. The selection of neighborhoods pixels in the MSFA-based sensor to calculate the spectral response of a single pixel in the reconstructed spectral images could improve the reconstruction, based on exploiting the sparse representation of the spectral images. This paper proposes two models for spectral images reconstruction from the selection of MSFA-based sensor measurements neighborhoods using the principle of compressive sensing. The spatial resolution of the reconstructed spectral images is adjusted depending the size of the neighborhood. To verify the effectiveness of the reconstruction models simulated measurements for synthetic spectral images and real spectral images based on MSFA are used. Ensembles of random dichroic and random band pass filters are used. The two approaches with traditional scheme reconstructions of mosaic filters are compared. The proposed methods improve the quality (PSNR) of the image reconstruction up 7 dB for real spectral images.
Downloads
References
J. Ryan, C. Davis, N. Tufillaro, R. Kudela and B. Gao, “Application of the Hyperspectral Imager for the Coastal Ocean to Phytoplankton Ecology Studies in Monterey Bay, CA, USA”, Remote Sens., vol. 6, no. 2, pp. 1007-1025, 2014.
Z. Xiong, A. Xie, D. Sun, X. Zeng and D. Liu, “Applications of hyperspectral imaging in chicken meat safety and quality detection and evaluation: a review”, Crit. Rev. Food Sci. Nutr., vol. 55, no. 9, pp. 1287-1301, 2014.
G. Bellante, S. Powell, R. Lawrence, K. Repasky and T. . Dougher, “Aerial detection of a simulated CO2 leak from a geologic sequestration site using hyperspectral imagery”, Int. J. Greenh. Gas Control , vol. 13, pp. 124- 137, 2013.
M. Mehrübeoglu, G. Buck and D. Livingston, “Differentiation of bacterial colonies and temporal growth patterns using hyperspectral imaging”, in SPIE Optics + Photonics (vol. 9222 Imaging Spectrometry XIX), San Diego, USA, 2014.
G. Lu and B. Fei, “Medical hyperspectral imaging: a review”, J. Biomed. Op t., vol. 19, no. 1, pp. 1-23, 2014.
J. Barrie, K. Aitchison, G. Rossano and M. Abraham, “Patterning of multilayer dielectric optical coatings for multispectral CCDs”, Thin Solid Films , vol. 270, no. 1-2, pp. 6-9, 1995.
Z. Frentress, L. Young and H. Edwards, “Field Photometer with Nine-Element Filter Wheel”, Appl. Opt. , vol. 3, no. 2, pp. 303-308, 1964.
P. Lapray, X. Wang, J. Thomas and P. Gouton, “Multispectral Filter Arrays: Recent Advances and Practical Implementation”, Sensors , vol. 14, no. 11, pp. 21626-21659, 2014.
L. Miao, H. Qi, R. Ramanath and W. Snyder, “Binary tree-based generic demosaicking algorithm for multispectral filter arrays”, IEEE Trans. Image Process., vol. 15, no. 11, pp. 3550-3558, 2006.
J. Brauers and T. Aach, “A Color Filter Array Based Multispectral Camera”, in 12 Workshop Farbbildverarbeitung , Ilmenau, Germany, 2006, pp. 1-11.
Y. Monno, M. Tanaka and M. Okutomi, “Multispectral Demosaicking Using Adaptive Kernel Upsampling”, in 18 th IEEE International Conference on Image Processing (ICIP) , Brussels, Belgium, 2011, pp. 3157-3160.
Z. Sadeghipoor, Y. Lu and S. Susstrunk, “A Novel Compressive Sensing Approach to Simultaneously Acquire Color and Near-Infrared Images on a Single Sensor”, in International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, 2013, pp. 1646-1650.
H. Aggarwal and A. Majumdar, “Compressive Sensing Multi-spectral Demosaicing from Single Sensor Architecture”, in IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), Xi’an, China, 2014, pp. 334-338.
H. Arguello and G. Arce, “Colored coded aperture design by concentration of measure in compressive spectral imaging”, IEEE Trans. Image Process ., vol. 23, no. 4, pp. 1896-908, 2014.
Department of Computer Science/Columbia University , CAVE | Projects: Multispectral Image Database . [Online]. Available: http://www.cs.columbia.edu/CAVE/databases/multispectral/. Accessed on: Feb. 24, 2015.
M. Figueiredo, R. Nowak and S. Wright, “Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems”, IEEE J. Sel. Top. Signal Process ., vol. 1, no. 4, pp. 586-597, 2007.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2016 Revista Facultad de Ingeniería Universidad de Antioquia
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Revista Facultad de Ingeniería, Universidad de Antioquia is licensed under the Creative Commons Attribution BY-NC-SA 4.0 license. https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en
You are free to:
Share — copy and redistribute the material in any medium or format
Adapt — remix, transform, and build upon the material
Under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
The material published in the journal can be distributed, copied and exhibited by third parties if the respective credits are given to the journal. No commercial benefit can be obtained and derivative works must be under the same license terms as the original work.
