3D-2D Gesture reconstruction using monocular video information applied to a robotic arm

Authors

  • Sandra Nope University of Valle
  • Humberto Loaiza University of Valle
  • Eduardo Caicedo University of Valle

Keywords:

robotic arm, direct cinematic, imitation, gesture reconstruction, artificial vision

Abstract

A model for gesture reconstruction performed by a human arm is presented. The model uses the information from a monocular vision system constituted by an uncalibrated basic webcam. A set of gestures were used to test the model, those gestures were performed by different people and distances from the camera. The mean square error of the robotic arm joints’ trajectories was less than 0.317 pixels. This error was computed on the 2D projection of the 3D reconstruction for the selected gestures.

|Abstract
= 91 veces | PDF (ESPAÑOL (ESPAÑA))
= 46 veces|

Downloads

Download data is not yet available.

Author Biographies

Sandra Nope, University of Valle

Group in Perception and Intelligent Systems.

Humberto Loaiza, University of Valle

Group in Perception and Intelligent Systems.

Eduardo Caicedo, University of Valle

Group in Perception and Intelligent Systems.

References

E. L. Thorndike. Animal Intelligence. Ed. Macmillan. New York. 1911. Citado en: B. G. Galef Imitation in animals: History, definition and interpretation of data from psychological laboratory. T. Zental & B. G. Galef (editores). Ed. Hillsdale. New Jersey. 1988. pp. 3-28.

H. Barlow. “Possible principles underlying the transformation of sensory messages”. Rosenblith (editor). Sensory Communication. Ed. MIT Press. Cambridge. MA (USA). 1961. pp. 217-234.

Y. Derimis, G. Hayes. “Imitations as a dual-route process featuring predictive and learning components: a biologically plausible computational model”. Imitation in animals and artifacts. Ed. MIT Press. Cambridge. MA (USA). 2002. pp. 327-361.

H. Sidenbladh, M. J. Black, L Sigal. “Implicit probabilistic models of human motion for synthesis and tracking”. European Conference on Computer Vision. Copenhague. Dinamarca. 2002. pp. 784-800.

N. Howe, M. E. Leventon, W. T. Freeman. “Bayesian reconstruction of 3d human motion from single-camera video”. En S. Solla, T. Leen. K. R. Müller (editores.). Advances in neural information processing systems. Cambridge. MA: MIT Press. 1999. pp. 820-826.

R. Bowden. “Learning statistical models of human motion”. IEEE Workshop on Human Modeling, Analysis and Synthesis. Hilton Head. Carolina del Sur. USA. 2000. pp. 10-17.

C. Sminchisescu, B. Triggs. “Kinematic jump processes for monocular 3D human tracking”. Proceddings of the International Conference on Computer Vision and Pattern Recognition. Madison, (WI). 2003. Vol. 1. pp. 69-76.

M. J. Park, M. G. Choi, S. Y. Shin. “Human motion reconstruction from inter-frame feature correspondences of a single video stream using a motion library”. 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation. San Antonio. Texas (USA). 2002. pp. 113-120.

C. Bregler, J. Malik. “Tracking people with twists and exponential maps”. IEEE International Conference on Computer Vision and Pattern Recognition. Anchorage. (Alaska). 1998. pp. 8-15.

E. D. Bernardo, L. Goncalves, P. Perona. “Monocular tracking of the human arm in 3d: realtime implementation and experiments”. IEEE International Conference on Pattern Recognition. Viena. Austria. 1996. pp. 622-626.

C. J. Taylor. “Reconstruction of articulated objects from point correspondences in a single uncalibrated image”. Computer Vision and Image Understanding. Hilton Head. Carolina del Sur. USA.Vol. 1. 2000. pp. 349-363.

M. Cabido, J. Santos Victor. “Visual Transformations in Gesture Imitation: what you see is what you do”. 2003 IEEE International Conference on Robotics & Automation. Taipei. (Taiwan). 2003. pp. 2375-2381.

S. Nope, E. Caicedo, H. Loaiza. “Aplicaciones del Movimiento y su Representación Biológica en el Reconocimiento de Gestos”. Ingeniería y Competitividad. Vol. 8. 2006. pp. 55-63.

Downloads

Published

2013-03-07

How to Cite

Nope, S., Loaiza, H., & Caicedo, E. (2013). 3D-2D Gesture reconstruction using monocular video information applied to a robotic arm. Revista Facultad De Ingeniería Universidad De Antioquia, (53), 145–154. Retrieved from https://revistas.udea.edu.co/index.php/ingenieria/article/view/14783

Issue

No. 53 (2010): Revista Facultad de Ingeniería (Apr-Jun 2010)

Section

Articles

License

Copyright (c) 2018 Revista Facultad de Ingeniería

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Revista Facultad de Ingeniería, Universidad de Antioquia is licensed under the Creative Commons Attribution BY-NC-SA 4.0 license. https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en

You are free to:

Share — copy and redistribute the material in any medium or format

Adapt — remix, transform, and build upon the material

Under the following terms:

Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

NonCommercial — You may not use the material for commercial purposes.

ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.

The material published in the journal can be distributed, copied and exhibited by third parties if the respective credits are given to the journal. No commercial benefit can be obtained and derivative works must be under the same license terms as the original work.