Holographic reconstructions can aid surgical planning before partial nephrectomy: A head-to-head comparison with standard ct scan (original) (raw)

Development of Holoeyes Holographic Image-Guided Surgery and Telemedicine System: Clinical Benefits of Extended Reality (Virtual Reality, Augmented Reality, Mixed Reality), The Metaverse, and Artificial Intelligence in Surgery with a Systematic Review

Medical Research Archives, 2023

ABSTRACT: Image-guided surgery using XR (extended reality: VR/AR/MR) technology has the potential to revolutionize the field of surgery by improving surgical accuracy, reducing procedure time, and enhancing communication and collaboration among the surgical team. We have developed a web-based system, Holoeyes, integrating XR, AI, and metaverse technology to facilitate holographic image- guided surgery. Holoeyes extracts organ shape data from CT or MRI scans and renders them with positional information to obtain X, Y, and Z coordinates. These coordinates are then converted into polygonal information for use in XR technology. The medical device, Holoeyes MD, was developed to create XR applications for surgical planning and navigation. It provides an immersive experience for the surgical team, improving both accuracy and efficiency. The integration of the metaverse in surgery allows for spatial conferencing and review of training, and the avatars replicate the hand and eye movements of the actual surgical procedure. Our Holoeyes system has already been utilized in numerous institutions for pre-and post-operative conferences, surgical planning, and surgical records, with multiple people wearing the headset and sharing information about the pathology, extent of resection, and layers of dissection from all directions. We conducted a systematic review of the literature to investigate the effectiveness of Holoeyes, focusing on the use of XR and the metaverse in surgery. We believe that Holoeyes has the potential to become an indispensable tool in the field of surgery, and we encourage further research and development in this field.

Toward Holographic-Guided Surgery

Surgical Innovation, 2018

The implementation of augmented reality (AR) in image-guided surgery (IGS) can improve surgical interventions by presenting the image data directly on the patient at the correct position and in the actual orientation. This approach can resolve the switching focus problem, which occurs in conventional IGS systems when the surgeon has to look away from the operation field to consult the image data on a 2-dimensional screen. The Microsoft HoloLens, a head-mounted AR display, was combined with an optical navigation system to create an AR-based IGS system. Experiments were performed on a phantom model to determine the accuracy of the complete system and to evaluate the effect of adding AR. The results demonstrated a mean Euclidean distance of 2.3 mm with a maximum error of 3.5 mm for the complete system. Adding AR visualization to a conventional system increased the mean error by 1.6 mm. The introduction of AR in IGS was promising. The presented system provided a solution for the switchi...

3D-Holoscopic Imaging: A New Dimension to Enhance Imaging in Minimally Invasive Therapy in Urologic Oncology

Journal of Endourology, 2013

Background and Purpose: Existing imaging modalities of urologic pathology are limited by three-dimensional (3D) representation on a two-dimensional screen. We present 3D-holoscopic imaging as a novel method of representing Digital Imaging and Communications in Medicine data images taken from CT and MRI to produce 3D-holographic representations of anatomy without special eyewear in natural light. 3D-holoscopic technology produces images that are true optical models. This technology is based on physical principles with duplication of light fields. The 3D content is captured in real time with the content viewed by multiple viewers independently of their position, without 3D eyewear. Methods: We display 3D-holoscopic anatomy relevant to minimally invasive urologic surgery without the need for 3D eyewear. Results: The results have demonstrated that medical 3D-holoscopic content can be displayed on commercially available multiview auto-stereoscopic display. Conclusion: The next step is validation studies comparing 3D-Holoscopic imaging with conventional imaging.

An Interactive Holographic Curriculum for Urogynecologic Surgery

Obstetrics & Gynecology, 2018

BACKGROUND: Urogynecologic surgery, transvaginal pelvic floor surgery in particular, requires learning by feel and high-volume pattern recognition. In the era of limited duty hours and case numbers, we sought to develop a curriculum, one that can be self-guided, to help trainees develop a spatial understanding of the relationships of pelvic floor musculature, ligamentous supports, and surrounding neurovasculature outside of the operating room.

Computer-generated real-time digital holography: first time use in clinical medical imaging

European Heart Journal – Cardiovascular Imaging, 2016

Assessment of the feasibility of creating real-time interactive 3D digital holograms in a standard catheterization laboratory. 3D medical images are typically displayed and interacted with on 2D screens limiting their usefulness. A digital computer-generated real-time holographic display of patient's 3D data could provide a spatially accurate image with all the depth cues and afford interaction within the image. Methods and results We performed a feasibility study of creating real-time interactive 3D digital holograms with a purpose-built prototype using intraprocedural data from 3D rotational angiography and live 3D transesophageal echocardiography. The primary objective was to demonstrate that all the anatomical landmarks identified on standard imaging can be similarly identified using dynamic and static holographic images. The secondary objective was to demonstrate the usability of interactions with the image. Parameters were assessed by a rating scale. Eight patients were enrolled of whom five underwent transcatheter ASD closure using 3DTEE and three patients were evaluated by 3D rotational angiography. In all cases dynamic real-time and static 3D holograms were created in standard cath lab conditions. Four individual observers identified all anatomical landmarks on the holographic display independently from the 2D display. Interactions with the hologram including marking, cropping and rotation were performed. There were no adverse events. Conclusions This study demonstrates, for the first time, the feasibility of generating high quality, clinically relevant, 3D real-time colour dynamic holograms in a standard clinical setting with real patient volumetric data. The impact of computer-generated holography needs to be evaluated in controlled clinical trials.