Preliminary trials of trackerless augmented reality in endoscopic endonasal surgery (original) (raw)

Abstract

Purpose

We present a novel method for augmented reality in endoscopic endonasal surgery. Our method does not require the use of external tracking devices and can show hidden anatomical structures relevant to the surgical intervention.

Methods

Our method registers a preoperative 3D model of the nasal cavity to an intraoperative 3D model by estimating a scaled-rigid transformation. Registration is based on a two-stage ICP approach on the reconstructed nasal cavity. The hidden structures are then transferred from the preoperative 3D model to the intraoperative one using the estimated transformation, projected and overlaid into the endoscopic images to obtain the augmented reality.

Results

We performed qualitative and quantitative validation of our method on 12 clinical cases. Qualitative results were obtained from an ENT surgeon from visual inspection of the hidden structures in the augmented images. Quantitative results were obtained by measuring a target registration error using a novel transillumination-based approach. The results show that the hidden structures of interest are augmented at the expected locations in most cases.

Conclusion

Our method was able to augment the endoscopic images in a sufficiently precise manner when the intraoperative nasal cavity did not deform considerably with respect to its preoperative state. This is a promising step towards trackerless augmented reality in endonasal surgery.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. Mosges R, Klimek L (1993) Computer-assisted surgery of the paranasal sinuses. J Otolaryngol 22(2):69–71
    CAS PubMed Google Scholar
  2. Vicaut E, Bertrand B, Betton J-L, Bizon A, Briche D, Castillo L, Lecanu J-B, Lindas P, Lombard B, Malard O, Merol J-C, Monteyrol P-J, Nasser T, Navailles B, Pruliére-Escabasse V, Stringini R, Verillaud B (2019) Use of a navigation system in endonasal surgery: impact on surgical strategy and surgeon satisfaction. A prospective multicenter study. Eur Annals Otorhinolaryngol Head Neck Dis 136(6):461–464
    Article CAS Google Scholar
  3. Winne C, Khan M, Stopp F, Jank E, Keeve E (2011) Overlay visualization in endoscopic ent surgery. Int J Comput Assist Radiol Surg 6(3):401–406. https://doi.org/10.1007/s11548-010-0507-7
    Article PubMed Google Scholar
  4. Citardi MJ, Agbetoba A, Bigcas J-L, Luong A (2016) Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study. Int Forum Allergy Rhinol 6(5):523–528. https://doi.org/10.1002/alr.21702
    Article PubMed Google Scholar
  5. Linxweiler M, Pillong L, Kopanja D, Kühn JP, Wagenpfeil S, Radosa JC, Wang J, Morris LGT, Al Kadah B, Bochen F, Körner S, Schick B (2020) Augmented reality-enhanced navigation in endoscopic sinus surgery: a prospective, randomized, controlled clinical trial. Laryngoscope Investig Otolaryngol 5(4):621–629
    Article PubMed PubMed Central Google Scholar
  6. Collin medical: ENT surgical navigation system (2024). https://www.collinmedical.fr/en/collin-navigation-solutions/4554-collin-navigation-solution.html. [Online; accessed 11-January-2024]
  7. Medtronic: fusion ENT navigation system (2024). https://www.medtronic.com/ca-en/healthcare-professionals/products/ear-nose-throat/image-guided-surgery/fusion-ent-navigation-system.html. [Online; accessed 11-January-2024]
  8. Brainlab: kick EM (2024) https://www.brainlab.com/surgery-products/overview-ent-products/ent-navigation-application/. [Online; accessed 11-January-2024]
  9. Bimedis: surgical navigation systems for sale (2024). https://bimedis.com/search/search-items/operating-room-surgical-navigation-systems?maincategory=113303. [Online; accessed 11-January-2024]
  10. Clarke JV, Deakin AH, Nicol AC, Picard F (2010) Measuring the positional accuracy of computer assisted surgical tracking systems. Comput Aided Surg 15(1–3):13–18. https://doi.org/10.3109/10929081003775774
    Article CAS PubMed Google Scholar
  11. Cheema MN, Nazir A, Sheng B, Li P, Qin J, Kim J, Feng DD (2019) Image-aligned dynamic liver reconstruction using intra-operative field of views for minimal invasive surgery. IEEE Trans Biomed Eng 66(8):2163–2173
    Article PubMed Google Scholar
  12. Collins T, Pizarro D, Gasparini S, Bourdel N, Chauvet P, Canis M, Calvet L, Bartoli A (2021) Augmented reality guided laparoscopic surgery of the uterus. IEEE Trans Med Imaging 40(1):371–380. https://doi.org/10.1109/TMI.2020.3027442
    Article CAS PubMed Google Scholar
  13. Ullrich K, Malhotra R, Patel B (2021) Dacryocystorhinostomy,
  14. Duan H-G, Ji F, Yuan H, Wang H-L, Chen M, Ma D-J (2023) Ma D-J (2023) Modified sphenoidotomy for isolated sphenoid sinus disease: a series of 117 cases. Sci Progress. https://doi.org/10.1177/00368504231189538
    Article Google Scholar
  15. Snyderman CH, Goldman SA, Carrau RL, Ferguson BJ, Grandis JR (1999) Endoscopic sphenopalatine artery ligation is an effective method of treatment for posterior epistaxis. Am J Rhinol 13(2):137–140. https://doi.org/10.2500/105065899782106805
    Article CAS PubMed Google Scholar
  16. Kennedy DW, Adappa ND (2011) Endoscopic maxillary antrostomy: not just a simple procedure. Laryngoscope 121(10):2142–2145. https://doi.org/10.1002/lary.22169
    Article PubMed Google Scholar
  17. Slicer: 3D Slicer (2024). https://www.slicer.org/. [Online; accessed 11-January-2024]
  18. Agisoft: Metashape (2024). https://www.agisoft.com/. [Online; accessed 11-January-2024]
  19. Cignoni P, Callieri M, Corsini M, Dellepiane M, Ganovelli F, Ranzuglia G (2008) MeshLab: an open-source mesh processing tool. In: Scarano V, Chiara RD, Erra U (eds.) Eurographics Italian chapter conference. The Eurographics Association, ??? . https://doi.org/10.2312/LocalChapterEvents/ItalChap/ItalianChapConf2008/129-136
  20. Zhou Q-Y, Park J, Koltun V (2018) Open3D: a modern library for 3D data processing. arXiv:1801.09847

Download references

Author information

Authors and Affiliations

  1. DRCI, DIA2M, CHU de Clermont-Ferrand, 28 Place Henri Dunant, 63000, Clermont-Ferrand, France
    Yamid Espinel, Nalick Lombion, Luce Compagnone, Nicolas Saroul & Adrien Bartoli

Authors

  1. Yamid Espinel
  2. Nalick Lombion
  3. Luce Compagnone
  4. Nicolas Saroul
  5. Adrien Bartoli

Corresponding author

Correspondence toYamid Espinel.

Ethics declarations

Conflict of interest

Yamid Espinel declares to have no potential conflicts of interest. Nalick Lombion declares to have no potential conflicts of interest. Luce Compagnone declares to have no potential conflicts of interest. Nicolas Saroul declares to have no potential conflicts of interest. Adrien Bartoli declares to have no potential conflicts of interest.

Ethics approval

All procedures involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. This study is also supported by an ethical approval with ID IRB00008526-2020-CE95, issued by CPP Sud-Est VI in Clermont-Ferrand, France.

Informed consent was obtained from the patients included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (mp4 176583 KB)

Rights and permissions

About this article

Cite this article

Espinel, Y., Lombion, N., Compagnone, L. et al. Preliminary trials of trackerless augmented reality in endoscopic endonasal surgery.Int J CARS 19, 1385–1389 (2024). https://doi.org/10.1007/s11548-024-03155-6

Download citation

Keywords

Supplementary file 1 (mp4 176583 KB)