Optical merger of direct vision with virtual images for scaled teleoperation

IEEE Transactions on Visualization and Computer Graphics
Samuel T ClantonG D Stetten

Abstract

Scaled teleoperation is increasingly prevalent in medicine, as well as in other applications of robotics. Visual feedback in such systems is essential and should make maximal use of natural hand-eye coordination. This paper describes a new method of visual feedback for scaled teleoperation in which the operator manipulates the handle of a remote tool in the presence of a registered virtual image of the target in real time. The method adapts a concept already used successfully in a new medical device called the Sonic Flashlight, which permits direct in situ visualization of ultrasound during invasive procedures. The Sonic Flashlight uses a flat-panel monitor and a half-silvered mirror to merge the visual outer surface of a patient with a simultaneous ultrasound scan of the patient's interior. Adapting the concept to scaled teleoperation involves removing the imaging device and the target to a remote location and adding a master-slave control device. This permits the operator to see his hands, along with what appears to be the tool, and the target, merged in a workspace that preserves natural hand-eye coordination. Three functioning prototypes are described, one based on ultrasound and two on light microscopy. The limitations and...Continue Reading

References

Jan 1, 1995·Journal of Image Guided Surgery·P J EdwardsM Gleeson
Sep 25, 2002·Medical Image Analysis·Michael RosenthalHenry Fuchs

❮ Previous
Next ❯

Citations

Jul 1, 2011·IEEE Transactions on Haptics· Dangxiao Wang Zhongyuan Chen
Aug 25, 2009·Journal of Vascular and Interventional Radiology : JVIR·Nikhil B AmesurGeorge D Stetten
May 4, 2005·Academic Radiology·George StettenOlaf von Ramm

❮ Previous
Next ❯

Related Concepts

Related Feeds

Ataxias (MDS)

Ataxia is a neurological condition characterized by lack of voluntary coordination of muscle movements including loss of coordination, balance, and speech. Discover the latest research on ataxia here.

Ataxia

Ataxia is a neurological condition characterized by lack of voluntary coordination of muscle movements including loss of coordination, balance, and speech. Discover the latest research on ataxia here.

© 2021 Meta ULC. All rights reserved