Dynamic Scene Reconstruction for 3D Virtual Guidance (original) (raw)

Abstract

In this paper a system is presented able to reproduce the actions of multiple moving objects into a 3D model. A multi-camera system is used for automatically detect, track and classify the objects. Data fusion from multiple sensors allows to get a more precise estimation of the position of detected moving objects and to solve occlusions problem. These data are then used to automatically place and animate objects avatars in a 3D virtual model of the scene, thus allowing users connected to this system to receive a 3D guide into the monitored environment.

Preview

Unable to display preview. Download preview PDF.

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

References

  1. Rodriguez, T., Sturm, P., Gargallo, P., Guilbert, N., Heyden, A., Menendez, J.M., Ronda, J.I.: Photorealistic 3d reconstruction from handheld cameras. Machine Vision and Applications 16(4), 246–257 (2005), Available: http://perception.inrialpes.fr/Publications/2005/RSGGHMR05
    Article Google Scholar
  2. Fiocco, M., Boström, G., Gonçalves, J.G.M., Sequeira, V.: Multisensor fusion for volumetric reconstruction of large outdoor areas. In: 3DIM, pp. 47–54 (2005)
    Google Scholar
  3. Bahadori, S., Iocchi, L.: A stereo vision system for 3d reconstruction and semi-automatic surveillance of museum areas. In: AI*IA 2003: Advances in Artificial Intelligence, 8th Congress of the Italian Association for Artificial Intelligence, Pisa, Italy, Proceedings of Workshop Intelligenza Artificiale per i Beni Cultural, Pisa, Italy, September 23-26 (2003)
    Google Scholar
  4. Sebe, I.O., Hu, J., You, S., Neumann, U.: 3d video surveillance with augmented virtual environments. In: IWVS 2003: First ACM SIGMM international workshop on Video surveillance, pp. 107–112. ACM Press, New York (2003)
    Chapter Google Scholar
  5. Collins, R.T., Biernacki, C., Celeux, G., Lipton, A.J., Govaert, G., Kanade, T.: Introduction to the special section on video surveillance. IEEE Trans. Pattern Anal. Machine Intell. 22(7), 745–746 (2000)
    Article Google Scholar
  6. Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: CVPR, p. 2142 (2000)
    Google Scholar
  7. Collins, R., Lipton, A., Fujiyoshi, H., Kanade, T.: Algorithms for cooperative multisensor surveillance. Proceedings of the IEEE 89(10), 1456–1477 (2001), [Online]. Available: citeseer.ist.psu.edu/collins01algorithms.html
    Article Google Scholar
  8. Reiss, T.H.: The revised fundamental theorem of moment invariants. IEEE Trans. Pattern Anal. Machine Intell. 13(8), 830–834 (1991)
    Article Google Scholar
  9. Piva, S., Calbi, A., Angiati, D., Regazzoni, C.S.: A multi-feature object association framework for overlapped field of view multi-camera video surveillance systems. In: IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS), Como, Italy, September 15-16, pp. 505–510 (2005)
    Google Scholar
  10. Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses, pp. 221–244 (1992)
    Google Scholar
  11. Welch, G., Bishop, G.: An introduction to the kalman filter. Chapel Hill, NC, USA, Tech. Rep (1995)
    Google Scholar
  12. Zhao, Y., Taubin, G.: Real-time median filtering for embedded smart cameras. In: ICVS, p. 55. IEEE Computer Society Press, Los Alamitos (2006)
    Google Scholar
  13. The AutoDesk website. [Online]. Available (2006), http://www.autodesk.com/
  14. The Open Scene Graph website [Online] Available (2006), http://www.openscenegraph.org/
  15. The Cal3D website (2006), [Online] Available http://cal3d.sourceforge.net/
  16. The ReplicantBody website (2006), [Online] Available http://sourceforge.net/projects/replicantbody/

Download references

Author information

Authors and Affiliations

  1. DIBE, University of Genova, 16145, Genova, Italy
    Alessandro Calbi & Carlo S. Regazzoni
  2. TechnoAware S.r.l, Via Greto di Cornigliano 6, 16100, Genova, Italy
    Lucio Marcenaro

Authors

  1. Alessandro Calbi
  2. Lucio Marcenaro
  3. Carlo S. Regazzoni

Editor information

Editors and Affiliations

  1. School of Design, Engineering and Computing, Bournemouth University, UK
    Bogdan Gabrys
  2. Centre for SMART Systems, School of Environment and Technology, University of Brighton, BN2 4GJ, Brighton, UK
    Robert J. Howlett
  3. School of Electrical and Information Engineering, Knowledge Based Intelligent Engineering Systems Centre, University of South Australia, SA, 5095, Mawson Lakes, Australia
    Lakhmi C. Jain

Rights and permissions

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Calbi, A., Marcenaro, L., Regazzoni, C.S. (2006). Dynamic Scene Reconstruction for 3D Virtual Guidance. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4252. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893004\_23

Download citation

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us