Computer-assisted three-dimensional surgical planning and simulation: 3D color facial model generation (original) (raw)

Automatic Reconstruction of 3D Human Face from CT and Color Photographs

Ieice Transactions on Information and Systems, 1999

This paper proposes an automatic method for reconstructing a realistic 3D facial image from C T (computer tomography) and three color photographs: front, left and right views, which can be linked easily with the underlying bone and soft tissue models. This work is done as a part of surgery simulation. T h e 3D facial surface derived from C T by the m,arching cubes algorithm is obviously colorless. Our task is t o add the color texture of the same patient actually taken with a digital camera to the colorless 3D surface. T o do this it needs an accurate registration between the 3D facial image and the color p h~t~o g r a p h .

Facial modeling for plastic surgery using magnetic resonance imagery and 3D surface data

SPIE Electronic …, 2004

We describe a novel facial modeling and real-time pre-surgery planning + visualization tool for surgical and esthetic plastic surgery. The modeling pipeline accepts geometry both in the form of Magnetic Resonance Imagery (MRI) and/or 3D facial surface scans. The MRI data is first used to segment the skin surface as well as the underlying tissues of interest. Textures taken with a digital camera are mapped on the 3D model for display purposes. The facial scanner, when available, provides an alternate means for doctors to obtain high quality 3D skin information and texture at the same time. Multiple facial expressions can be recorded to study tissue deformation. Our solution allows for using the two types of sensors separately or in conjunction with one another. The resulting models and additional information, such as the animated MRI slides, provide doctors with better means of surgical planning. Currently, we are further developing the system to integrate finite element calculations (FEM) that help better planning and understanding of the possible outcomes of a surgery and thereby reduce the risk for any given patient. The presentation reviews the methodologies, algorithms and tools in the context of a real-life application.

Three-dimensional facial model reconstruction and plastic surgery simulation

IEEE Transactions on Information Technology in Biomedicine, 1999

Facial model reconstruction and surgical simulation are essential to plastic surgery in today's medicine. Both can help surgeons to design appropriate repair plans and procedures prior to actual surgery. In this paper, we exploit a metamorphosis technique in our new design. First, using metamorphosis and vision techniques, we can establish three-dimensional facial models from a given photo. Second, we design several morphing operators, including augmentation, cutting, and lacerating. Experiments show that the proposed algorithms can successfully create acceptable facial models and generate realistically visual effects of surgical simulation.

A physically based model to simulate maxillo-facial surgery from 3D CT images

Future Generation Computer Systems, 1999

Computer-based surgery simulation represents a rapidly emerging and increasingly important area of research that combines a number of disciplines for the common purpose of improving health care. Generally, the goal of computer-based surgery simulation is to enable a surgeon to experiment with different surgical procedures in an artificial environment. This paper describes an approach for elastic modelling of human tissue based on the use of embedded boundary condition techniques. Embedded boundary condition models allow to simulate the cranio-facial surgery directly on the grid of the 3D CT image of the patient. Previously simulated operations have been performed using surface models or by using a low detailed model of the tissue volume. The approach proposed here involves complete 3D modelling of the solid highly detailed structure of the object, starting from the information present in the 3D diagnostic images. Due to the huge amount of data and the computational complexity of the problem, a parallel version of the software has been implemented on the supercomputer CRAY T3E. The application of this approach for modelling the elastic deformation of human tissue in response to movement of bones is demonstrated both on the visible human data set of the National Library of Medicine and on the CT data set of real patients. 0167-739X/99/$ -see front matter c 1999 Elsevier Science B.V. All rights reserved. PII: S 0 1 6 7 -7 3 9 X ( 9 8 ) 0 0 0 6 5 -X

Three dimensional digitization of the face and skull

Journal of maxillofacial surgery, 1985

The possibility of using computer-aided design as a tool for the planning and simulation of facial reconstruction surgery is discussed and has been shown to be feasible. Methods of acquiring the essential measurements on the facial surface and the underlying bone structure in a computer-compatible form are described, including a new approach which has been implemented using a system of fanned laser beams and a television camera for data acquisition. A mathematical analysis of the properties of this kind of imaging system is given. Finally the requirements of a complete aid to surgery system based on this approach are outlined and plans for the implementation of such a system are described.

Computer-based modeling of soft tissues for medical and gisapplications

2005

The advances in medical imaging, beginning from the discovery of X-rays have nowadays opened new perspectives for improvements in the area of computer assisted surgical planning. Meanwhile, modern medical imaging techniques, such as Computer Tomography (CT) and Magnetic Resonance Imaging (MRI), are widely-used for diagnostic and require 3D models of human anatomy for visualization purposes. 3D body models provide the information on the geometrical disposition of different anatomical structures. In craniofacial surgery, there is a great demand for efficient computer assisted methods, which could enable flexible, accurate and robust simulations for the realistic prediction of postoperative appearance. The computer assisted surgical planning has many advantages in comparison with conventional planning systems. Once the virtual model of a patient is generated, various case scenarios of the surgical impact and their outcomes can be extensively studied. Better preparation, shorter operati...

A New 3-D Tool for Planning Plastic Surgery

IEEE Transactions on Biomedical Engineering, 2000

Face plastic surgery (PS) plays a major role in today medicine. Both for reconstructive and cosmetic surgery, achieving harmony of facial features is an important, if not the major goal. Several systems have been proposed for presenting to patient and surgeon possible outcomes of the surgical procedure. In this paper, we present a new 3D system able to automatically suggest, for selected facial features as nose, chin, etc, shapes that aesthetically match the patient's face. The basic idea is suggesting shape changes aimed to approach similar but more harmonious faces. To this goal, our system compares the 3D scan of the patient with a database of scans of harmonious faces, excluding the feature to be corrected. Then, the corresponding features of the k most similar harmonious faces, as well as their average, are suitably pasted onto the patient's face, producing k+1 aesthetically effective surgery simulations. The system has been fully implemented and tested. To demonstrate the system, a 3D database of harmonious faces has been collected and a number of PS treatments have been simulated. The ratings of the outcomes of the simulations, provided by panels of human judges, show that the system and the underlying idea are effective.

Three-dimensional virtual-reality surgical planning and soft-tissue prediction for orthognathic surgery

2001

Complex maxillofacial malformations continue to present challenges in analysis and correction beyond modern technology. The purpose of this paper is to present a virtual-reality workbench for surgeons to perform virtual orthognathic surgical planning and soft-tissue prediction in three dimensions. A resulting surgical planning system, i.e., three-dimensional virtual-reality surgical-planning and soft-tissue prediction for orthognathic surgery, consists of four major stages: computed tomography (CT) data post-processing and reconstruction, three-dimensional (3-D) color facial soft-tissue model generation, virtual surgical planning and simulation, soft-tissue-change preoperative prediction. The surgical planning and simulation are based on a 3-D CT reconstructed bone model, whereas the soft-tissue prediction is based on color texture-mapped and individualized facial soft-tissue model. Our approach is able to provide a quantitative osteotomy-simulated bone model and prediction of postoperative appearance with photorealistic quality. The prediction appearance can be visualized from any arbitrary viewing point using a low-cost personal-computer-based system. This cost-effective solution can be easily adopted in any hospital for daily use.

Virtual Surgical Planning and Pre-operative Simulation for Maxillofacial Reconstruction with 3D Printing Technology in Tumor-affected Facial Deformity

BackgroundThe high anatomical complexity of maxillofacial defects caused by tumor can pose a formidable challenge for clinicians when designing an appropriate plan for surgical reconstruction. The intention of this work was to restore the complex anatomy with maximum possible facial functionality and aesthetics of the patient. Based on the medical images generated by computed tomography (CT) scan an optimal therapeutic planning for complex maxillofacial reconstruction was designed. MethodFirstly, the volumetric data sets were carefully evaluated and deeply inspected for accurate diagnosis. Regarding 3D visualization of the CT scan images 3D virtual models for regions of interest were created using a special software of 3D Slicer. Using the resulting 3D virtual models a well-defined virtual surgical planning was generated for multiple surgical procedures, including the osteotomies for bone defects, harvesting autogenous bone graft and creating a customized implant. ResultsThe relevan...