Touchless control module for diagnostic images at the surgery room using the Leap Motion system and 3D Slicer software
DOI:
https://doi.org/10.17533/udea.redin.n82a05Keywords:
diagnostic imaging, human-computer interaction, image guided neurosurgery, medical informatics computing, positioning systemAbstract
During surgical procedures, it is important that the personnel (surgeon, residents, or assistants) interact with the patient avoiding any physical contact with equipment and materials that might have not been appropriately sterilized. This is done in order to prevent patient’s infections and complications after surgery. With the increased availability of diagnostic images, this technology has become indispensable in operating rooms but to maintain asepsis control of computer equipment on which the visualization programs are executed is not always possible, hindering access to personnel to information contained in the images. This paper describes the development of a system that allows the personnel to manipulate a medical imaging display program using gestures, avoiding the surgeon or the nurse to have a direct contact with the computer. The system, which requires a computer with 3D-Slicer software and Leap Motion (LM) device, allows through gestures made with the hands, to access the basic operations such as the movement between sections of a volume, to change the image size and the anatomical plane visualization; operations that are essential to the surgeon for the spatial location and decision making.
Downloads
References
R. Johnson, K. O’Hara, A. Sellen, C. Cousins, and A. Criminisi, “Exploring the Potential for Touchless Interaction in Image-Guided Interventional Radiology,” in 29th Int. Conf. Hum. Factors Comput. Syst., Vancouver, Canada, 2011, pp. 3323-3332.
L. C. Ebert, G. Hatch, M. J. Thali, and S. Ross, “Invisible touch—Control of a DICOM viewer with finger gestures using the Kinect depth camera,” J. Forensic Radiol. Imaging, vol. 1, no. 1, pp. 10-14, 2013.
A. Fedorov et al., “3D Slicer as an image computing platform for the Quantitative Imaging Network.,”Magn. Reson. Imaging, vol. 30, no. 9, pp. 1323-1341, 2012.
M. Sato et al., “Development of an image operation system with a motion sensor in dental radiology,” Radiol. Phys. Technol., vol. 8, no. 2, pp. 243-247, 2015.
A. Nishikawa et al., “FAce MOUSe: a novel human- machine interface for controlling the position of a laparoscope,” IEEE Trans. Robot. Autom., vol. 19, no. 5, pp. 825-841, 2003.
A. B. Albu, “Vision-Based User Interfaces for Health Applications : A Survey,” in Advances in Visual Computing, G. Bebis et al. (eds). Germany: Springer, 2006, pp. 771-782.
M. Spiegelmock, Leap motion development essentials, 1st ed. Birmingham, UK: Packt Publishing Ltd., 2013.
P. Garg, N. Aggarwal, and S. Sofat, “Vision based hand gesture recognition,” Int. J. of Computer, Electrical, Automation, Control and Information Engineering, vol. 3, no. 1, pp. 186-191, 2009.
K. Sabir and B. Tabor, “The molecular control toolkit: Controlling 3d molecular graphics via gesture and voice,” in IEEE Symposium on Biological Data Visualization (BioVis), Atlanta, GA, USA, 2013, pp. 49-56.
S. Webel, M. Olbrich, T. Franke, and J. Keil, “Immersive experience of current and ancient reconstructed cultural attractions,” in Digital Heritage International Congress (DigitalHeritage), Marseille, France, 2013.
Cyber Science 3D, Products. [Online]. Available: http://cyberscience3d.com/products/. Accessed on: Mar. 15, 2016.
W. Schroeder, K. Martin, and B. Lorensen, The Visualization Toolkit-30, 3rd ed. Kitware, 1996.
Leap Motion, Inc., Recalibrating your Leap Motion Controller. [Online]. Available: https://support.leapmotion.com/hc/en-us/articles/223782328-Recalibratingyour-Leap-Motion-Controller. Accessed on: Mar. 15, 2016
N. Bizzotto et al., “Leap Motion Gesture Control With OsiriX in the Operating Room to Control Imaging: First Experiences During Live Surgery,” Surg. Innov., vol. 21, no. 6, pp. 655-656, 2014.
L. Di Tommaso, S. Aubry, J. Godard, H. Katranji, and J. Pauchot, “A new human machine interface in neurosurgery: The Leap Motion (R). Technical note regarding a new touchless interface,” Neurochirurgie, vol. 62, no. 3, pp. 178-181, 2016.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2017 Revista Facultad de Ingeniería Universidad de Antioquia
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Revista Facultad de Ingeniería, Universidad de Antioquia is licensed under the Creative Commons Attribution BY-NC-SA 4.0 license. https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en
You are free to:
Share — copy and redistribute the material in any medium or format
Adapt — remix, transform, and build upon the material
Under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
The material published in the journal can be distributed, copied and exhibited by third parties if the respective credits are given to the journal. No commercial benefit can be obtained and derivative works must be under the same license terms as the original work.
Twitter