Medical Image Analysis
Volume 16, Issue 3 , Pages 612-631 , April 2012

Gaze-Contingent Motor Channelling, haptic constraints and associated cognitive demand for robotic MIS

  • George P. Mylonas

      Affiliations

    • Royal Society/Wolfson Foundation Medical Image Computing Laboratory, Imperial College London, London SW7 2AZ, United Kingdom
    • Corresponding Author InformationCorresponding author. Address: Institute of Biomedical Engineering, 509 Bessemer, South Kensington Campus, Imperial College, London SW7 2AZ, United Kingdom. Tel.: +44 20 7594 0769; fax: +44 20 7581 8024.
  • ,
  • Ka-Wai Kwok

      Affiliations

    • Royal Society/Wolfson Foundation Medical Image Computing Laboratory, Imperial College London, London SW7 2AZ, United Kingdom
  • ,
  • David R.C. James

      Affiliations

    • Department of Biosurgery and Surgical Technology, Queen Elizabeth the Queen Mother Wing (QEQM), St. Mary’s Campus, Imperial College London, London W2 1NY, United Kingdom
  • ,
  • Daniel Leff

      Affiliations

    • Department of Biosurgery and Surgical Technology, Queen Elizabeth the Queen Mother Wing (QEQM), St. Mary’s Campus, Imperial College London, London W2 1NY, United Kingdom
  • ,
  • Felipe Orihuela-Espina

      Affiliations

    • Royal Society/Wolfson Foundation Medical Image Computing Laboratory, Imperial College London, London SW7 2AZ, United Kingdom
  • ,
  • Ara Darzi

      Affiliations

    • Department of Biosurgery and Surgical Technology, Queen Elizabeth the Queen Mother Wing (QEQM), St. Mary’s Campus, Imperial College London, London W2 1NY, United Kingdom
  • ,
  • Guang-Zhong Yang

      Affiliations

    • Royal Society/Wolfson Foundation Medical Image Computing Laboratory, Imperial College London, London SW7 2AZ, United Kingdom

Received 13 September 2009 ,Revised 5 July 2010 ,Accepted 22 July 2010.

References 

  1. Abbott J, Marayong P, et al. Haptic virtual fixtures for robot-assisted manipulation. Robotics Research. 2007;5:49–64
  2. Davies, B., 2006. Active Constraints for Robotic Knee Surgery. Robotic Surgery: The Kindest Cut of All, 2006. The Institution of Engineering and Technology Seminar on (Ref. No. 2006/11372).
  3. Davies B, Jakopec M, et al. Active-constraint robotics for surgery. Proceedings of the IEEE. 2006;94(9):1696–1704
  4. Debaere F, Wenderoth N, et al. Changes in brain activation during the acquisition of a new bimanual coordination task. Neuropsychologia. 2004;42(7):855–867
  5. Fox PT, Raichle ME. Focal physiological uncoupling of cerebral blood flow and oxidative metabolism during somatosensory stimulation in human subjects. Proceedings of the National Academy of Sciences of the United States of America. 1986;83(4):1140–1144
  6. Halsband U, Lange RK. Motor learning in man: a review of functional and clinical studies. Journal of Physiology – Paris. 2006;99(4–6):414–424
  7. Hoshi Y. Functional near-infrared spectroscopy: current status and future prospects. Journal of Biomedical Optics. 2007;12(6):062106
  8. Jenkins IH, Brooks DJ, et al. Motor sequence learning: a study with positron emission tomography. Journal of Neuroscience. 1994;14(6):3775–3790
  9. Jurcak V, Tsuzuki D, et al. 10/20, 10/10 and 10/5 system revisited: their validity as a relative head-surface-based positioning systems. NeuroImage. 2007;34:1600–1611
  10. Kelly AM, Garavan H. Human functional neuroimaging of brain changes associated with practice. Cerebral Cortex. 2005;15(8):1089–1102
  11. Kwok, K.-W., Mylonas, G., et al., 2009. Dynamic active constraints for hyper-redundant flexible robots. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009, pp. 410–417.
  12. Leff, D.R., 2009. An Assessment of Cortical Function in Expert and Novice Surgeons. Royal Society/Wolfson Foundation Medical Image Computing Laboratory. PhD, Imperial College London, London, p. 298.
  13. Leff DR, Elwell CE, et al. Changes in prefrontal cortical behaviour depend upon familiarity on a bimanual co-ordination task: an fNIRS study. NeuroImage. 2008;39(2):805–813
  14. Leff, D.R., Orihuela-Espina, F., et al., 2009. Circadian cortical compensation: a longitudinal fNIRS study of sleep deprivation in surgical trainees. Annals of Surgery, in press.
  15. Leong, J.H.J.J., 2009. Hand–Eye Coordination in Surgery. Department of Biosurgery and Surgical Technology Royal Society/Wolfson Foundation Medical Image Computing Laboratory Imperial College London University of London. PhD, Imperial College London, London, p. 219.
  16. Leong J, Atallah L, et al. Investigation of partial directed coherence for hand–eye coordination in laparoscopic training. Medical Imaging and Augmented Reality. 2008;270–278
  17. Li, M., Taylor, R.H., 2004. Spatial motion constraints in medical robot using virtual fixtures generated by anatomy. In: Robotics and Automation, 2004. Proceedings. ICRA ‘04. 2004 IEEE International Conference on.
  18. Maki A, Yamashita Y, et al. Spatial and temporal analysis of human motor activity using non-invasive NIR topography. Medical Physics. 1995;22(12):1997–2005
  19. Mylonas GP, Darzi A, et al. Gaze contingent depth recovery and motion stabilisation for minimally invasive robotic surgery. Medical Imaging and Augmented Reality. 2004;311–319
  20. Mylonas, G.P., Stoyanov, D., et al., 2005. Gaze-contingent soft tissue deformation tracking for minimally invasive robotic surgery. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2005, pp. 843–850.
  21. Mylonas GP, Darzi A, et al. Gaze-contingent control for minimally invasive robotic surgery. Computer Aided Surgery. 2006;11(5):256–266
  22. Noonan, D.P., Mylonas, G.P., et al., 2008. Gaze contingent articulated robot control for robot assisted minimally invasive surgery. In: Intelligent Robots and Systems, 2008. IROS 2008. IEEE/RSJ International Conference on.
  23. Okamura AM. Methods for haptic feedback in teleoperated robot-assisted surgery. Industrial Robot: An International Journal. 2004;31(6):499–508
  24. Park S, Howe RD, et al. Virtual fixtures for robotic cardiac surgery. In: Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer-Verlag; 2001;
  25. Puttemans V, Wenderoth N, et al. Changes in brain activation during the acquisition of a multifrequency bimanual coordination task: from the cognitive stage to advanced levels of automaticity. Journal of Neuroscience. 2005;25(17):4270–4278
  26. Ren J, Patel RV, et al. Dynamic 3-D virtual fixtures for minimally invasive beating heart procedures. Medical Imaging, IEEE Transactions on. 2008;27(8):1061–1070
  27. Rosenberg LB. Virtual fixtures: perceptual tools for telerobotic manipulation. In: Virtual Reality Annual International Symposium, 1993. IEEE; 1993;
  28. Sailer U, Flanagan JR, et al. Eye–hand coordination during learning of a novel visuomotor task. Journal of Neuroscience. 2005;25(39):8833–8842
  29. Sakatani K, Lichty W, et al. Effects of aging on language-activated cerebral blood oxygenation changes of the left prefrontal cortex: near infrared spectroscopy study. Journal of Stroke Cerebrovascular Diseases. 1999;8(6):398–403
  30. Sakatani K, Murata Y, et al. BOLD functional MRI may overlook activation areas in the damaged brain. Acta Neurochirurgica. 2003;87(Suppl.):59–62
  31. Shadmehr R, Holcomb HH. Neural correlates of motor memory consolidation. Science. 1997;277(5327):821–825
  32. Strangman G, Boas DA, et al. Non-invasive neuroimaging using near-infrared light. Biological Psychiatry. 2002;52:679–693
  33. Tobii-Technology, 2003. User Manual.
  34. Tracey MR, Lathan CE. The interaction of spatial ability and motor learning in the transfer of training from a simulator to a real task. Studies in Health Technology and Informatics. 2001;81:521–527
  35. Villringer A, Chance B. Non-invasive optical spectroscopy and imaging of human brain function. Trends in Neuroscience. 1997;20(10):435–442
  36. Yang G-Z, Dempere-Marco L, et al. Visual search: psychophysical models and practical applications. Image and Vision Computing. 2002;20(4):291–305
  37. Yang G-Z, Mylonas G, et al. Perceptual docking for robotic control. Medical Imaging and Augmented Reality. 2008;21–30

PII: S1361-8415(10)00099-X

doi: 10.1016/j.media.2010.07.007

Medical Image Analysis
Volume 16, Issue 3 , Pages 612-631 , April 2012