ARssist: augmented reality on a head-mounted display for the first assistant in robotic surgery

Healthcare Technology Letters
Long QianPeter Kazanzides

Abstract

In robot-assisted laparoscopic surgery, the first assistant (FA) is responsible for tasks such as robot docking, passing necessary materials, manipulating hand-held instruments, and helping with trocar planning and placement. The performance of the FA is critical for the outcome of the surgery. The authors introduce ARssist, an augmented reality application based on an optical see-through head-mounted display, to help the FA perform these tasks. ARssist offers (i) real-time three-dimensional rendering of the robotic instruments, hand-held instruments, and endoscope based on a hybrid tracking scheme and (ii) real-time stereo endoscopy that is configurable to suit the FA's hand-eye coordination when operating based on endoscopy feedback. ARssist has the potential to help the FA perform his/her task more efficiently, and hence improve the outcome of robot-assisted laparoscopic surgeries.

References

Apr 12, 2006·World Journal of Urology·Rajeev Kumar, Ashok K Hemal
Jun 7, 2006·Minimally Invasive Therapy & Allied Technologies : MITAT : Official Journal of the Society for Minimally Invasive Therapy
May 25, 2010·Surgical Endoscopy·Olivia Sgarbura, Catalin Vasilescu
May 21, 2013·The Journal of Surgical Research·Nicolas C BuchsPhilippe Morel
Jul 11, 2013·Medical Image Analysis·L Maier-HeinD Stoyanov
Jun 22, 2014·International Journal of Computer Assisted Radiology and Surgery·Y KoreedaM G Fujie
Aug 25, 2016·Indian Journal of Urology : IJU : Journal of the Urological Society of India·Rishi NayyarPrem Nath Dogra
Feb 6, 2017·Medical Image Analysis·Sylvain BernhardtChristophe Doignon
Mar 28, 2017·International Journal of Computer Assisted Radiology and Surgery·Long QianBernhard Fuerst
Aug 16, 2017·IEEE Transactions on Visualization and Computer Graphics·Yuta ItohMaki Sugimoto

❮ Previous
Next ❯

Citations

Aug 18, 2017·Health Informatics Journal·Julian HammGheorghita Ghinea
Aug 19, 2020·International Journal of Computer Assisted Radiology and Surgery·Qichang SunXiaojun Chen
Mar 14, 2019·International Journal of Computer Assisted Radiology and Surgery·Javad FotouhiNassir Navab
Apr 14, 2021·Computerized Medical Imaging and Graphics : the Official Journal of the Computerized Medical Imaging Society·Ruotong LiPheng-Ann Heng
Apr 22, 2021·International Journal of Computer Assisted Radiology and Surgery·Jonas HeinNassir Navab
Nov 25, 2021·International Journal of Computer Assisted Radiology and Surgery·Trong NguyenRaj Shekhar
Nov 16, 2021·The International Journal of Medical Robotics + Computer Assisted Surgery : MRCAS·Maria-Paola ForteKatherine J Kuchenbecker
Dec 23, 2021·Der Urologe. Ausg. A·P SparwasserH Borgmann
Dec 1, 2021··Christina GsaxnerDieter Schmalstieg

❮ Previous
Next ❯

Software Mentioned

relay
lpar
ARToolKit
Ubuntu
arssist
Microsoft HoloLens
streamer
OST
ROS
Meta 2

Related Concepts

Trending Feeds

COVID-19

Coronaviruses encompass a large family of viruses that cause the common cold as well as more serious diseases, such as the ongoing outbreak of coronavirus disease 2019 (COVID-19; formally known as 2019-nCoV). Coronaviruses can spread from animals to humans; symptoms include fever, cough, shortness of breath, and breathing difficulties; in more severe cases, infection can lead to death. This feed covers recent research on COVID-19.

Blastomycosis

Blastomycosis fungal infections spread through inhaling Blastomyces dermatitidis spores. Discover the latest research on blastomycosis fungal infections here.

Nuclear Pore Complex in ALS/FTD

Alterations in nucleocytoplasmic transport, controlled by the nuclear pore complex, may be involved in the pathomechanism underlying multiple neurodegenerative diseases including Amyotrophic Lateral Sclerosis and Frontotemporal Dementia. Here is the latest research on the nuclear pore complex in ALS and FTD.

Applications of Molecular Barcoding

The concept of molecular barcoding is that each original DNA or RNA molecule is attached to a unique sequence barcode. Sequence reads having different barcodes represent different original molecules, while sequence reads having the same barcode are results of PCR duplication from one original molecule. Discover the latest research on molecular barcoding here.

Chronic Fatigue Syndrome

Chronic fatigue syndrome is a disease characterized by unexplained disabling fatigue; the pathology of which is incompletely understood. Discover the latest research on chronic fatigue syndrome here.

Evolution of Pluripotency

Pluripotency refers to the ability of a cell to develop into three primary germ cell layers of the embryo. This feed focuses on the mechanisms that underlie the evolution of pluripotency. Here is the latest research.

Position Effect Variegation

Position Effect Variagation occurs when a gene is inactivated due to its positioning near heterochromatic regions within a chromosome. Discover the latest research on Position Effect Variagation here.

STING Receptor Agonists

Stimulator of IFN genes (STING) are a group of transmembrane proteins that are involved in the induction of type I interferon that is important in the innate immune response. The stimulation of STING has been an active area of research in the treatment of cancer and infectious diseases. Here is the latest research on STING receptor agonists.

Microbicide

Microbicides are products that can be applied to vaginal or rectal mucosal surfaces with the goal of preventing, or at least significantly reducing, the transmission of sexually transmitted infections. Here is the latest research on microbicides.

Related Papers

Studies in Health Technology and Informatics
Gunther SudraR Dillmann
International Journal of Urology : Official Journal of the Japanese Urological Association
Soichiro YoshidaYasuhisa Fujii
Biomedizinische Technik. Biomedical Engineering
Tobias SalbRüdiger Dillmann
© 2022 Meta ULC. All rights reserved