An Evaluation of Three Popular Computer Vision Approaches for 3-D Face Synthesis (original) (raw)

Abstract

We have evaluated three computer approaches to 3-D reconstruction – passive computational binocular stereo and active structured lighting and photometric stereo – in regard to human face reconstruction for modelling virtual humans. An integrated experimental environment simultaneously acquired images for 3-D reconstruction and data from a 3-D scanner which provided an accurate ground truth. Our goal was to determine whether today’s computer vision approaches are accurate and fast enough for practical 3-D facial reconstruction applications. We showed that the combination of structured lighting with symmetric dynamic programming stereo has good prospects with reasonable processing time and accuracy.

Chapter PDF

Similar content being viewed by others

References

  1. Ayache, N., Hansen, C.: Rectification of Images for Binocular and Trinocular Stereovision. In: Proc. 9th Int. Conf. on Pattern Recognition, Rome. IEEE CS Press, Los Alamitos (1988)
    Google Scholar
  2. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Analysis and Machine Intelligence 23(11), 1222–1239 (2001)
    Article Google Scholar
  3. Chan, M., Delmas, P., Gimel’farb, G., Leclercq, P.: Comparative study of 3d face acquisition techniques. In: Gagalowicz, A., Philips, W. (eds.) CAIP 2005. LNCS, vol. 3691, pp. 740–747. Springer, Heidelberg (2005)
    Chapter Google Scholar
  4. An, D., Woodward, A., Delmas, P., Chen, C.: Comparison of Structured Lighting Techniques with a View for Facial Reconstruction. In: Proc. Image and Vision Computing New Zealand Conf., Dunedin, New Zealand, pp. 195–200 (2005)
    Google Scholar
  5. Klette, R., Schluns, K.: Computer Vision - Three-dimensional Data from Images. Springer, Berlin (1998)
    MATH Google Scholar
  6. Kurihara, T., Arai, K.: A transformation method for modeling and animation of the human face from photographs. In: Proc. Computer Animation 1991 Conf., Tokyo, pp. 45–58 (1991)
    Google Scholar
  7. Leclercq, P., Liu, J., Chan, M., Woodward, A., Gimel’farb, G., Delmas, P.: Comparative study of stereo algorithms for 3D face reconstruction. In: Proc. Int. Conf. on Advanced Concepts for Intelligent Vision Systems, Brussels, Belgium (September 2004)
    Google Scholar
  8. Lee, Y., Terzopoulos, D., Waters, K.: Realistic modeling for facial animation. In: Proc. ACM SIGGRAPH 1995 Conf., pp. 55–62 (1995)
    Google Scholar
  9. Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Computer Vision 47(1), 7–42 (2002)
    Article MATH Google Scholar
  10. Wen, Z., Huang, T.S.: 3D Face Processing: Modeling, Analysis and Synthesis. The International Series in Video Computing, vol. 8. Springer, Berlin (2004)
    Google Scholar
  11. Woodward, A., Delmas, P.: Towards a low cost realistic human face modelling and animation framework. In: Proc. Image and Vision Computing New Zealand, Akaroa, Christchurch, New Zealand, pp. 11–16 (November 2004)
    Google Scholar
  12. Woodward, A.M., Delmas, P.: Synthetic Ground Truth for Comparison of Gradient Field Integration Methods for Human Faces. In: Proc. Image and Vision Computing New Zealand, Dunedin, New Zealand, pp. 155–160 (November 2005)
    Google Scholar
  13. Tsai, R.Y.: A Versatile Camera Calibration Technique for High Accuracy 3-D Machine Vision Metrology using Off the Shelf TV Cameras and Lenses. Int. J. Robotics and Automation 3(4), 323–344 (1987)
    Article Google Scholar
  14. Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient Belief Propagation for Early Vision. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 261–268. IEEE CS Press, Los Alamitos (2004)
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Dept. of Computer Science, The University of Auckland, Tamaki Campus, Auckland, New Zealand
    Alexander Woodward, Da An, Yizhe Lin, Patrice Delmas, Georgy Gimel’farb & John Morris

Authors

  1. Alexander Woodward
  2. Da An
  3. Yizhe Lin
  4. Patrice Delmas
  5. Georgy Gimel’farb
  6. John Morris

Editor information

Editors and Affiliations

  1. Hong Kong University of Science and Technology,
    Dit-Yan Yeung
  2. Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
    James T. Kwok
  3. Instituto de Telecomunicações, Instituto Superior Técnico, Lisbon, Portugal
    Ana Fred
  4. Department of Electrical and Electronic Engineering, University of Cagliari, Piazza d’Armi, 09123, Cagliari, Italy
    Fabio Roli
  5. Faculty of Electrical Engineering, Mathematics and Computer Science, Information and Communication Theory Group, Delft University of Technology, Delft, The Netherlands
    Dick de Ridder

Rights and permissions

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Woodward, A., An, D., Lin, Y., Delmas, P., Gimel’farb, G., Morris, J. (2006). An Evaluation of Three Popular Computer Vision Approaches for 3-D Face Synthesis. In: Yeung, DY., Kwok, J.T., Fred, A., Roli, F., de Ridder, D. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2006. Lecture Notes in Computer Science, vol 4109. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11815921\_29

Download citation

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us