Informatics in radiology: Intuitive user interface for 3D image manipulation using augmented reality and a smartphone as a remote control

Radiographics : a Review Publication of the Radiological Society of North America, Inc
Norio NakataKunihiko Fukuda

Abstract

Although widely used as a pointing device on personal computers (PCs), the mouse was originally designed for control of two-dimensional (2D) cursor movement and is not suited to complex three-dimensional (3D) image manipulation. Augmented reality (AR) is a field of computer science that involves combining the physical world and an interactive 3D virtual world; it represents a new 3D user interface (UI) paradigm. A system for 3D and four-dimensional (4D) image manipulation has been developed that uses optical tracking AR integrated with a smartphone remote control. The smartphone is placed in a hard case (jacket) with a 2D printed fiducial marker for AR on the back. It is connected to a conventional PC with an embedded Web camera by means of WiFi. The touch screen UI of the smartphone is then used as a remote control for 3D and 4D image manipulation. Using this system, the radiologist can easily manipulate 3D and 4D images from computed tomography and magnetic resonance imaging in an AR environment with high-quality image resolution. Pilot assessment of this system suggests that radiologists will be able to manipulate 3D and 4D images in the reading room in the near future. Supplemental material available at http://radiographics...Continue Reading

References

Mar 22, 2002·Scientific American·Steven K Feiner
Oct 31, 2006·Journal of Public Health·Stefanie EtteltJuha Teperi
Jul 27, 2007·Medical & Biological Engineering & Computing·D MageeD Kessel
Jan 1, 2008·International Journal of Radiation Oncology, Biology, Physics·Robert KrempienWolfgang Harms
Sep 25, 2008·Surgical Endoscopy·Sanne M B I Botden, Jack J Jakimowicz
Oct 1, 2009·Journal of Digital Imaging·George ShihPaul Nagy
Mar 20, 2010·Journal of Visual Communication in Medicine·Rhys Gethin ThomasJohn Michael Delieu
Sep 8, 2010·Journal of Surgical Education·Fabien LeblancUNKNOWN Colorectal Surgery Training Group

❮ Previous
Next ❯

Citations

May 18, 2018·Insights Into Imaging·Antoine IannessiMaki Sugimoto

❮ Previous
Next ❯

Related Concepts

Related Feeds

Bioinformatics in Biomedicine

Bioinformatics in biomedicine incorporates computer science, biology, chemistry, medicine, mathematics and statistics. Discover the latest research on bioinformatics in biomedicine here.

Related Papers

Medical Reference Services Quarterly
Donna R Berryman
Reports of Practical Oncology and Radiotherapy : Journal of Greatpoland Cancer Center in Poznań and Polish Society of Radiation Oncology
Alfonso Gomez-IturriagaJuanita Crook
Minimally Invasive Therapy & Allied Technologies : MITAT : Official Journal of the Society for Minimally Invasive Therapy
Lars Eirik BøToril A Nagelhus Hernes
© 2021 Meta ULC. All rights reserved