Reconstruction of 3d video from 2d real-life sequences
AbstractIn this paper, a novel method that permits to generate 3D video sequences using 2D real-life sequences is proposed. Reconstruction of 3D video sequence is realized using depth map computation and anaglyph synthesis. The depth map is formed employing the stereo matching technique based on global error energy minimization with smoothing functions. The anaglyph construction is implemented using the red component alignment interpolating the previously formed depth map. Additionally, the depth map transformation is realized in order to reduce the dynamic range of the disparity values, minimizing ghosting and enhancing color preservation. Several real-life color video sequences that contain different types of motions, such as translational, rotational, zoom and combination of previous ones are used demonstrating good visual performance of the proposed 3D video sequence reconstruction.
B. Blundell, A. Schwartz. Volumetric three dimensional display systems. Ed. Wiley. New York. Vol. 5. 2000. pp. 196-200.
M. Halle. “Autostereoscopic displays and computer graphics”. Comput Graph. Vol. 31. 1997. pp. 58-62.
E. Dubois. “A projection method to generate anaglyph stereo”. IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 3. 2001. pp. 1661- 1664.
I. Ideses, L. Yaroslavsky. “A method for generating 3D video from a single video stream”. Proc of the Vision, Modeling and Visualization. Ed. Aka Gmbh. Erlangen. Germany. 2002. pp. 435-438.
I. Ideses, L. Yaroslavsky. “New Methods to produce high quality color anaglyphs for 3-D visualization”. Lecture Notes in Computer Science. Vol. 3212. 2004. pp. 273-380.
S. S. Beauchemin, J. L. Barron. “The computation of optical flow”. ACM Computing surveys. Vol. 27. 1995. pp. 436-466.
J. L. Barron, D. J. Fleet, S. S. Beauchemin. “Performance of optical flow techniques”. International Journal of Computer Vision. Vol. 12. 1994. pp. 43-77.
D. J. Heeger. “Model for the extraction of image flow”. Journal of the Optical Society of America. Vol. 4. 1987. pp. 1455-1471.
D. J. Heeger. “Optical flow using spatiotemporal filters”. International Journal Computer Vision. Vol. 1. 1988. pp. 279-302.
X. Huang, E. Dubois. “3D reconstruction based on a hybrid disparity estimation algorithm”. IEEE International Conference on Image Processing. Vol. 8. 2006. pp. 1025-1028.
C. Zitnick, T. Kanade. “A cooperative algorithm for stereo matching and occlusion detection”. Robotics Institute Technical Reports. No. CMU.RI-TR-99-35. Carnegie Mellon University. 1999.
H. H. Barker, T. O. Binford. “Depth from edge and intensity based stereo”. Proc. of the 7th International Joint Conference on Artificial Intelligence. Vancouver. 1981. pp. 631-636.
D. Comaniciu, P. Meer. “Mean-shift: a robust approach toward feature space analysis”. IEEE Transactions Pattern Anal Machine Intelligence. Vol. 24. 2002. pp. 603-619.
B. B. Alagoz. “Obtaining depth maps from color images by region based stereo matching algorithms”. OncuBilim Algorythm and Systems Labs. Vol. 08. 2008. Art.4. pp. 1-12.
I. Ideses, L. Yaroslavsky, B. Fishbain. “Real time 2D to 3D video conversion”. J. Real Time Image Proc. Vol. 2. 2007. pp. 3-9.
I. Ideses, L. Yaroslavsky. “3 methods to improve quality of color anaglyph”. J. Optics A. Pure, Applied Optics. Vol. 7. 2005. pp. 755-762.
I. Ideses, L. Yaroslavsky, B. Fishbain, R. Vistuch. “3D compressed from 2D video”. Stereoscopic displays and virtual reality systems XIV in Proc. of SPIE & IS&T Electronic Imaging. Vol. 6490. 2007. pp. 64901C.
L. Yaroslavsky, J. Campos, M. Espínola, I. Ideses. “Redundancy of steroscopic images: Experimental evaluation”. Optics Express. Vol. 13. 2005. pp. 0895-10907.
L. Yaroslavsky, Holography and digital image processing. Ed. Kluwer Academic Publishers. Boston. 2004. pp. 600.
W. Sanders, D. McAllister. Producing anaglyphs formsynthetic images. Conf. 5005: A stereoscopic displays and applications XIV. Proc. SPIE/IS&T. Vol. 5006. 2003. pp. 348-358.
Copyright (c) 2018 Revista Facultad de Ingeniería
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors can archive the pre-print version (i.e., the version prior to peer review) and post-print version (that is, the final version after peer review and layout process) on their personal website, institutional repository and / or thematic repository
- Upon acceptance of an article, it will be published online through the page https://revistas.udea.edu.co/index.php/ingenieria/issue/archive in PDF version with its correspondent DOI identifier
The Revista Facultad de Ingeniería -redin- encourages the Political Constitution of Colombia, chapter IV
Chapter IV Sanctions 51
The following shall be liable to imprisonment for two to five years and a fine of five to 20 times the legal minimum monthly wage: (1) any person who publishes an unpublished literary or artistic work, or part thereof, by any means, without the express prior authorization of the owner of rights; (2) any person who enters in the National Register of Copyright a literary, scientific or artistic work in the name of a person other than the true author, or with its title altered or deleted, or with its text altered, deformed, amended or distorted, or with a false mention of the name of the publisher or phonogram, film, videogram or software producer; (3) any person who in any way or by any means reproduces, disposes of, condenses, mutilates or otherwise transforms a literary, scientific or artistic work without the express prior authorization of the owners thereof; (4) any person who reproduces phonograms, videograms, software or cinematographic works without the express prior authorization of the owner, or transports, stores, stocks, distributes, imports, sells, offers for sale, acquires for sale or distribution or in any way deals in such reproductions. Paragraph. If either the material embodiment or title page of or the introduction to the literary work, phonogram, videogram, software or cinematographic work uses the name, business style, logotype or distinctive mark of the lawful owner of rights, the foregoing sanctions shall be increased by up to half.