Multicentric validation of EndoDigest: a computer vision platform for video documentation of the critical view of safety in laparoscopic cholecystectomy (original) (raw)

References

  1. van de Graaf FW, Lange MM, Spakman JI, van Grevenstein WM, Lips D, de Graaf EJ, Menon AG, Lange JF (2019) Comparison of systematic video documentation with narrative operative report in colorectal cancer surgery. JAMA Surg 154:381–389
    Article PubMed PubMed Central Google Scholar
  2. Birkmeyer JD, Finks JF, O’Reilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJO, Collaborative MBS (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442. https://doi.org/10.1056/NEJMsa1300625
    Article CAS PubMed Google Scholar
  3. Curtis NJ, Foster JD, Miskovic D, Brown CSB, Hewett PJ, Abbott S, Hanna GB, Stevenson ARL, Francis NK (2020) Association of surgical skill assessment with clinical outcomes in cancer surgery. JAMA Surg. https://doi.org/10.1001/jamasurg.2020.1004
    Article PubMed PubMed Central Google Scholar
  4. Hu Y-Y, Mazer LM, Yule SJ, Arriaga AF, Greenberg CC, Lipsitz SR, Gawande AA, Smink DS (2017) Complementing operating room teaching with video-based coaching. JAMA Surg 152:318–325. https://doi.org/10.1001/jamasurg.2016.4619
    Article PubMed Google Scholar
  5. Scully RE, Deal SB, Clark MJ, Yang K, Wnuk G, Smink DS, Fryer JP, Bohnen JD, Teitelbaum EN, Meyerson SL, Meier AH, Gauger PG, Reddy RM, Kendrick DE, Stern M, Hughes DT, Chipman JG, Patel JA, Alseidi A, George BC (2020) Concordance between expert and nonexpert ratings of condensed video-based trainee operative performance assessment. J Surg Educ 77:627–634. https://doi.org/10.1016/j.jsurg.2019.12.016
    Article PubMed Google Scholar
  6. Maier-Hein L, Vedula SS, Speidel S, Navab N, Kikinis R, Park A, Eisenmann M, Feussner H, Forestier G, Giannarou S (2017) Surgical data science for next-generation interventions. Nat Biomed Eng 1:691–696
    Article PubMed Google Scholar
  7. Maier-Hein L, Eisenmann M, Sarikaya D, März K, Collins T, Malpani A, Fallert J, Feussner H, Giannarou S, Mascagni P, Nakawala H, Park A, Pugh C, Stoyanov D, Vedula SS, Cleary K, Fichtinger G, Forestier G, Gibaud B, Grantcharov T, Hashizume M, Heckmann-Nötzel D, Kenngott HG, Kikinis R, Mündermann L, Navab N, Onogur S, Sznitman R, Taylor RH, Tizabi MD, Wagner M, Hager GD, Neumuth T, Padoy N, Collins J, Gockel I, Goedeke J, Hashimoto DA, Joyeux L, Lam K, Leff DR, Madani A, Marcus HJ, Meireles O, Seitel A, Teber D, Ückert F, Müller-Stich BP, Jannin P, Speidel S (2021) Surgical data science—from concepts toward clinical translation. arXiv:201102284 [cs, eess]
  8. Ward TM, Mascagni P, Madani A, Padoy N, Perretta S, Hashimoto DA (2021) Surgical data science and artificial intelligence for surgical education. J Surg Oncol. https://doi.org/10.1002/jso.26496
    Article PubMed Google Scholar
  9. Ward TM, Mascagni P, Ban Y, Rosman G, Padoy N, Meireles O, Hashimoto DA (2021) Computer vision in surgery. Surgery 169:1253–1256. https://doi.org/10.1016/j.surg.2020.10.039
    Article PubMed Google Scholar
  10. Twinanda AP, Shehata S, Mutter D, Marescaux J, de Mathelin M, Padoy N (2017) EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36:86–97. https://doi.org/10.1109/TMI.2016.2593957
    Article PubMed Google Scholar
  11. Hashimoto DA, Rosman G, Witkowski ER, Stafford C, Navarette-Welton AJ, Rattner DW, Lillemoe KD, Rus DL, Meireles OR (2019) Computer vision analysis of intraoperative video: automated recognition of operative steps in laparoscopic sleeve gastrectomy. Ann Surg 270:414–421. https://doi.org/10.1097/SLA.0000000000003460
    Article PubMed Google Scholar
  12. Nwoye CI, Gonzalez C, Yu T, Mascagni P, Mutter D, Marescaux J, Padoy N (2020) Recognition of instrument-tissue interactions in endoscopic videos via action triplets. In: Martel AL, Abolmaesumi P, Stoyanov D, Mateus D, Zuluaga MA, Zhou SK, Racoceanu D, Joskowicz L (eds) Medical image computing and computer assisted intervention—MICCAI 2020. Springer, Cham, pp 364–374
    Chapter Google Scholar
  13. Padoy N (2019) Machine and deep learning for workflow recognition during surgery. Minim Invasive Ther Allied Technol 28:82–90. https://doi.org/10.1080/13645706.2019.1584116
    Article PubMed Google Scholar
  14. Kitaguchi D, Takeshita N, Matsuzaki H, Oda T, Watanabe M, Mori K, Kobayashi E, Ito M (2020) Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: experimental research. Int J Surg. https://doi.org/10.1016/j.ijsu.2020.05.015
    Article PubMed Google Scholar
  15. Mascagni P, Alapatt D, Urade T, Vardazaryan A, Mutter D, Marescaux J, Costamagna G, Dallemagne B, Padoy N (2021) A computer vision platform to automatically locate critical events in surgical videos: documenting safety in laparoscopic cholecystectomy. Ann Surg 274:e93. https://doi.org/10.1097/SLA.0000000000004736
    Article PubMed Google Scholar
  16. Michael Brunt L, Deziel DJ, Telem DA, Strasberg SM, Aggarwal R, Asbun H, Bonjer J, McDonald M, Alseidi A, Ujiki M, Riall TS, Hammill C, Moulton C-A, Pucher PH, Parks RW, Ansari MT, Connor S, Dirks RC, Anderson B, Altieri MS, Tsamalaidze L, Stefanidis D, Prevention of Bile Duct Injury Consensus Work Group (2020) Safe cholecystectomy multi-society practice guideline and state-of-the-art consensus conference on prevention of bile duct injury during cholecystectomy. Surg Endosc 34:2827–2855. https://doi.org/10.1007/s00464-020-07568-7
    Article CAS PubMed Google Scholar
  17. Mascagni P, Fiorillo C, Urade T, Emre T, Yu T, Wakabayashi T, Felli E, Perretta S, Swanstrom L, Mutter D (2019) Formalizing video documentation of the critical view of safety in laparoscopic cholecystectomy: a step towards artificial intelligence assistance to improve surgical safety. Surg Endosc 34(6):2709–2714
    Article PubMed Google Scholar
  18. Yu T, Mutter D, Marescaux J, Padoy N (2019) Learning from a tiny dataset of manual annotations: a teacher/student approach for surgical phase recognition. arXiv:181200033 [cs, stat]
  19. Nwoye CI, Mutter D, Marescaux J, Padoy N (2019) Weakly supervised convolutional LSTM approach for tool tracking in laparoscopic videos. Int J Comput Assist Radiol Surg 14:1059–1067. https://doi.org/10.1007/s11548-019-01958-6
    Article PubMed Google Scholar
  20. McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med 22:276–282
    Article Google Scholar
  21. Zech JR, Badgeley MA, Liu M, Costa AB, Titano JJ, Oermann EK (2018) Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study. PLoS Med 15:e1002683. https://doi.org/10.1371/journal.pmed.1002683
    Article PubMed PubMed Central Google Scholar
  22. Bar O, Neimark D, Zohar M, Hager GD, Girshick R, Fried GM, Wolf T, Asselmann D (2020) Impact of data on generalization of AI for surgical intelligence applications. Sci Rep 10:22208. https://doi.org/10.1038/s41598-020-79173-6
    Article CAS PubMed PubMed Central Google Scholar
  23. Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D (2019) Key challenges for delivering clinical impact with artificial intelligence. BMC Med 17:195. https://doi.org/10.1186/s12916-019-1426-2
    Article CAS PubMed PubMed Central Google Scholar
  24. Madani A, Namazi B, Altieri MS, Hashimoto DA, Rivera AM, Pucher PH, Navarrete-Welton A, Sankaranarayanan G, Brunt LM, Okrainec A (2021) Artificial intelligence for intraoperative guidance: using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy. Ann Surg. https://doi.org/10.1097/SLA.0000000000004594
    Article Google Scholar
  25. Ward TM, Hashimoto DA, Ban Y, Rattner DW, Inoue H, Lillemoe KD, Rus DL, Rosman G, Meireles OR (2021) Automated operative phase identification in peroral endoscopic myotomy. Surg Endosc 35:4008–4015. https://doi.org/10.1007/s00464-020-07833-9
    Article PubMed Google Scholar
  26. Nijssen MAJ, Schreinemakers JMJ, Meyer Z, Van Der Schelling GP, Crolla R, Rijken AM (2015) Complications after laparoscopic cholecystectomy: a video evaluation study of whether the critical view of safety was reached. World J Surg 39:1798–1803
    Article CAS PubMed Google Scholar
  27. Mascagni P, Rodríguez-Luna MR, Urade T, Felli E, Pessaux P, Mutter D, Marescaux J, Costamagna G, Dallemagne B, Padoy N (2021) Intraoperative time-out to promote the implementation of the critical view of safety in laparoscopic cholecystectomy: a video-based assessment of 343 procedures. J Am Coll Surg. https://doi.org/10.1016/j.jamcollsurg.2021.06.018
    Article PubMed Google Scholar
  28. Stefanidis D, Chintalapudi N, Anderson-Montoya B, Oommen B, Tobben D, Pimentel M (2017) How often do surgeons obtain the critical view of safety during laparoscopic cholecystectomy? Surg Endosc 31:142–146
    Article PubMed Google Scholar
  29. Mascagni P, Vardazaryan A, Alapatt D, Urade T, Emre T, Fiorillo C, Pessaux P, Mutter D, Marescaux J, Costamagna G, Dallemagne B, Padoy N (2021) Artificial intelligence for surgical safety: automatic assessment of the critical view of safety in laparoscopic cholecystectomy using deep learning. Ann Surg. https://doi.org/10.1097/SLA.0000000000004351
    Article PubMed Google Scholar

Download references