Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors
Spectral imaging systems capture spectral and spatial information from a scene to produce a spectral data cube. Technical progress has allowed developing multispectral filter array (MSFA)-based sensors in order to expand the reconstruction of more bands than RGB cameras. However, reconstructing the spectral image with traditional methods following a least squares or demosaicing approach is unfeasible. Some works in the literature implement multispectral demosaicing for reconstructing images with specific spatio-spectral resolution depending on the number of pixels in the detector and the filter mosaic. Recently, compressive sensing technique has been developed that allows reconstructing signals with fewer measurements than the traditional methods by using the sparse representation of a signal. The selection of neighborhoods pixels in the MSFA-based sensor to calculate the spectral response of a single pixel in the reconstructed spectral images could improve the reconstruction, based on exploiting the sparse representation of the spectral images. This paper proposes two models for spectral images reconstruction from the selection of MSFA-based sensor measurements neighborhoods using the principle of compressive sensing. The spatial resolution of the reconstructed spectral images is adjusted depending the size of the neighborhood. To verify the effectiveness of the reconstruction models simulated measurements for synthetic spectral images and real spectral images based on MSFA are used. Ensembles of random dichroic and random band pass filters are used. The two approaches with traditional scheme reconstructions of mosaic filters are compared. The proposed methods
J. Ryan, C. Davis, N. Tufillaro, R. Kudela and B. Gao, “Application of the Hyperspectral Imager for the Coastal Ocean to Phytoplankton Ecology Studies in Monterey Bay, CA, USA”, Remote Sens., vol. 6, no. 2, pp. 1007-1025, 2014.
Z. Xiong, A. Xie, D. Sun, X. Zeng and D. Liu, “Applications of hyperspectral imaging in chicken meat safety and quality detection and evaluation: a review”, Crit. Rev. Food Sci. Nutr., vol. 55, no. 9, pp. 1287-1301, 2014.
G. Bellante, S. Powell, R. Lawrence, K. Repasky and T. . Dougher, “Aerial detection of a simulated CO2 leak from a geologic sequestration site using hyperspectral imagery”, Int. J. Greenh. Gas Control , vol. 13, pp. 124- 137, 2013.
M. Mehrübeoglu, G. Buck and D. Livingston, “Differentiation of bacterial colonies and temporal growth patterns using hyperspectral imaging”, in SPIE Optics + Photonics (vol. 9222 Imaging Spectrometry XIX), San Diego, USA, 2014.
G. Lu and B. Fei, “Medical hyperspectral imaging: a review”, J. Biomed. Op t., vol. 19, no. 1, pp. 1-23, 2014.
J. Barrie, K. Aitchison, G. Rossano and M. Abraham, “Patterning of multilayer dielectric optical coatings for multispectral CCDs”, Thin Solid Films , vol. 270, no. 1-2, pp. 6-9, 1995.
Z. Frentress, L. Young and H. Edwards, “Field Photometer with Nine-Element Filter Wheel”, Appl. Opt. , vol. 3, no. 2, pp. 303-308, 1964.
P. Lapray, X. Wang, J. Thomas and P. Gouton, “Multispectral Filter Arrays: Recent Advances and Practical Implementation”, Sensors , vol. 14, no. 11, pp. 21626-21659, 2014.
L. Miao, H. Qi, R. Ramanath and W. Snyder, “Binary tree-based generic demosaicking algorithm for multispectral filter arrays”, IEEE Trans. Image Process., vol. 15, no. 11, pp. 3550-3558, 2006.
J. Brauers and T. Aach, “A Color Filter Array Based Multispectral Camera”, in 12 Workshop Farbbildverarbeitung , Ilmenau, Germany, 2006, pp. 1-11.
Y. Monno, M. Tanaka and M. Okutomi, “Multispectral Demosaicking Using Adaptive Kernel Upsampling”, in 18 th IEEE International Conference on Image Processing (ICIP) , Brussels, Belgium, 2011, pp. 3157-3160.
Z. Sadeghipoor, Y. Lu and S. Susstrunk, “A Novel Compressive Sensing Approach to Simultaneously Acquire Color and Near-Infrared Images on a Single Sensor”, in International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, 2013, pp. 1646-1650.
H. Aggarwal and A. Majumdar, “Compressive Sensing Multi-spectral Demosaicing from Single Sensor Architecture”, in IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), Xi’an, China, 2014, pp. 334-338.
H. Arguello and G. Arce, “Colored coded aperture design by concentration of measure in compressive spectral imaging”, IEEE Trans. Image Process ., vol. 23, no. 4, pp. 1896-908, 2014.
Department of Computer Science/Columbia University , CAVE | Projects: Multispectral Image Database . [Online]. Available: http://www.cs.columbia.edu/CAVE/databases/multispectral/. Accessed on: Feb. 24, 2015.
M. Figueiredo, R. Nowak and S. Wright, “Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems”, IEEE J. Sel. Top. Signal Process ., vol. 1, no. 4, pp. 586-597, 2007.
Copyright (c) 2016 Revista Facultad de Ingeniería Universidad de Antioquia
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors can archive the pre-print version (i.e., the version prior to peer review) and post-print version (that is, the final version after peer review and layout process) on their personal website, institutional repository and / or thematic repository
- Upon acceptance of an article, it will be published online through the page https://revistas.udea.edu.co/index.php/ingenieria/issue/archive in PDF version with its correspondent DOI identifier
The Revista Facultad de Ingeniería -redin- encourages the Political Constitution of Colombia, chapter IV
Chapter IV Sanctions 51
The following shall be liable to imprisonment for two to five years and a fine of five to 20 times the legal minimum monthly wage: (1) any person who publishes an unpublished literary or artistic work, or part thereof, by any means, without the express prior authorization of the owner of rights; (2) any person who enters in the National Register of Copyright a literary, scientific or artistic work in the name of a person other than the true author, or with its title altered or deleted, or with its text altered, deformed, amended or distorted, or with a false mention of the name of the publisher or phonogram, film, videogram or software producer; (3) any person who in any way or by any means reproduces, disposes of, condenses, mutilates or otherwise transforms a literary, scientific or artistic work without the express prior authorization of the owners thereof; (4) any person who reproduces phonograms, videograms, software or cinematographic works without the express prior authorization of the owner, or transports, stores, stocks, distributes, imports, sells, offers for sale, acquires for sale or distribution or in any way deals in such reproductions. Paragraph. If either the material embodiment or title page of or the introduction to the literary work, phonogram, videogram, software or cinematographic work uses the name, business style, logotype or distinctive mark of the lawful owner of rights, the foregoing sanctions shall be increased by up to half.