Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors

Keywords: Spectral images, multispectral filter array-based sensors, compressive sensing


Spectral imaging systems capture spectral and spatial information from a scene to produce a spectral data cube. Technical progress has allowed developing multispectral filter array (MSFA)-based sensors in order to expand the reconstruction of more bands than RGB cameras. However, reconstructing the spectral image with traditional methods following a least squares or demosaicing approach is unfeasible. Some works in the literature implement multispectral demosaicing for reconstructing images with specific spatio-spectral resolution depending on the number of pixels in the detector and the filter mosaic. Recently, compressive sensing technique has been developed that allows reconstructing signals with fewer measurements than the traditional methods by using the sparse representation of a signal. The selection of neighborhoods pixels in the MSFA-based sensor to calculate the spectral response of a single pixel in the reconstructed spectral images could improve the reconstruction, based on exploiting the sparse representation of the spectral images. This paper proposes two models for spectral images reconstruction from the selection of MSFA-based sensor measurements neighborhoods using the principle of compressive sensing. The spatial resolution of the reconstructed spectral images is adjusted depending the size of the neighborhood. To verify the effectiveness of the reconstruction models simulated measurements for synthetic spectral images and real spectral images based on MSFA are used. Ensembles of random dichroic and random band pass filters are used. The two approaches with traditional scheme reconstructions of mosaic filters are compared. The proposed methods

= 83 veces | PDF
= 89 veces|


Download data is not yet available.

Author Biographies

Yuri Hercilia Mejía Melgarejo, Universidad Industrial de Santander
Facultad de Ingenierías Fisicomecánicas
Ofelia Patricia Villarreal Dulcey, Universidad Industrial de Santander
Facultad de Ingenierías Fisicomecánicas
Henry Arguello Fuentes, Universidad Industrial de Santander

Profesor asociado, Escuela de Ingeniería y sistemas computacionales, Facultad de Ingenierías Fisicomecánicas


J. Ryan, C. Davis, N. Tufillaro, R. Kudela and B. Gao, “Application of the Hyperspectral Imager for the Coastal Ocean to Phytoplankton Ecology Studies in Monterey Bay, CA, USA”, Remote Sens., vol. 6, no. 2, pp. 1007-1025, 2014.

Z. Xiong, A. Xie, D. Sun, X. Zeng and D. Liu, “Applications of hyperspectral imaging in chicken meat safety and quality detection and evaluation: a review”, Crit. Rev. Food Sci. Nutr., vol. 55, no. 9, pp. 1287-1301, 2014.

G. Bellante, S. Powell, R. Lawrence, K. Repasky and T. . Dougher, “Aerial detection of a simulated CO2 leak from a geologic sequestration site using hyperspectral imagery”, Int. J. Greenh. Gas Control , vol. 13, pp. 124- 137, 2013.

M. Mehrübeoglu, G. Buck and D. Livingston, “Differentiation of bacterial colonies and temporal growth patterns using hyperspectral imaging”, in SPIE Optics + Photonics (vol. 9222 Imaging Spectrometry XIX), San Diego, USA, 2014.

G. Lu and B. Fei, “Medical hyperspectral imaging: a review”, J. Biomed. Op t., vol. 19, no. 1, pp. 1-23, 2014.

J. Barrie, K. Aitchison, G. Rossano and M. Abraham, “Patterning of multilayer dielectric optical coatings for multispectral CCDs”, Thin Solid Films , vol. 270, no. 1-2, pp. 6-9, 1995.

Z. Frentress, L. Young and H. Edwards, “Field Photometer with Nine-Element Filter Wheel”, Appl. Opt. , vol. 3, no. 2, pp. 303-308, 1964.

P. Lapray, X. Wang, J. Thomas and P. Gouton, “Multispectral Filter Arrays: Recent Advances and Practical Implementation”, Sensors , vol. 14, no. 11, pp. 21626-21659, 2014.

L. Miao, H. Qi, R. Ramanath and W. Snyder, “Binary tree-based generic demosaicking algorithm for multispectral filter arrays”, IEEE Trans. Image Process., vol. 15, no. 11, pp. 3550-3558, 2006.

J. Brauers and T. Aach, “A Color Filter Array Based Multispectral Camera”, in 12 Workshop Farbbildverarbeitung , Ilmenau, Germany, 2006, pp. 1-11.

Y. Monno, M. Tanaka and M. Okutomi, “Multispectral Demosaicking Using Adaptive Kernel Upsampling”, in 18 th IEEE International Conference on Image Processing (ICIP) , Brussels, Belgium, 2011, pp. 3157-3160.

Z. Sadeghipoor, Y. Lu and S. Susstrunk, “A Novel Compressive Sensing Approach to Simultaneously Acquire Color and Near-Infrared Images on a Single Sensor”, in International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, 2013, pp. 1646-1650.

H. Aggarwal and A. Majumdar, “Compressive Sensing Multi-spectral Demosaicing from Single Sensor Architecture”, in IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), Xi’an, China, 2014, pp. 334-338.

H. Arguello and G. Arce, “Colored coded aperture design by concentration of measure in compressive spectral imaging”, IEEE Trans. Image Process ., vol. 23, no. 4, pp. 1896-908, 2014.

Department of Computer Science/Columbia University , CAVE | Projects: Multispectral Image Database . [Online]. Available: Accessed on: Feb. 24, 2015.

M. Figueiredo, R. Nowak and S. Wright, “Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems”, IEEE J. Sel. Top. Signal Process ., vol. 1, no. 4, pp. 586-597, 2007.

How to Cite
Mejía Melgarejo Y. H., Villarreal Dulcey O. P., & Arguello Fuentes H. (2016). Adjustable spatial resolution of compressive spectral images sensed by multispectral filter array-based sensors. Revista Facultad De Ingeniería Universidad De Antioquia, (78), 89-98.