3d model matching with viewpoint-invariant patches (vip) (original) (raw)

Abstract

Abstract The robust alignment of images and scenes seen from widely different viewpoints is an important challenge for camera and scene reconstruction. This paper introduces a novel class of viewpoint independent local features for robust registration and novel algorithms to use the rich information of the new features for 3D scene alignment and large scale scene reconstruction. The key point of our approach consists of leveraging local shape information for the extraction of an invariant feature descriptor.

Loading...

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

References (24)

  1. Wall dataset. http://www.robots.ox.ac.uk/ vgg/research/affine/. 5
  2. A. W. Fitzgibbon and A. Zisserman. Automatic camera re- covery for closed or open image sequences. In ECCV, pages 311-326, June 1998. 2
  3. M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz. Multi-view stereo for community photo collections. In ICCV, 2007. 2
  4. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2000. 5
  5. A. Johnson, M., and Hebert. Using spin images for efficient object recognition in cluttered 3Dscenes. TPAMI, 21(5):433- 449, May 1999. 2
  6. B. J. King, T. Malisiewicz, C. V. Stewart, and R. J. Radke. Registration of multiple range scans as a location recogni- tion problem: Hypothesis generation, refinement and verifi- cation. In 3DIM, 2005. 3
  7. K. Koeser and R. Koch. Perspectively invariant normal fea- tures. In in Proc. of Workshop on 3D Representation for Recognition, 2007. 3
  8. L. Liu and I. Stamos. A systematic approach for 2d-image to 3d-range registration in urban environments. In In Proc. of workshop for Virtual Representations and Modeling of Large-scale environments, 2007. 3
  9. L. Liu, I. Stamos, G. Yu, G. Wolberg, and S. Zokai. Mul- tiview Geometry for Texture Mapping 2D Images Onto 3D Range Data. CVPR, 2:2293-2300, 2006. 2
  10. D. Lowe. Distinctive image features from scale-invariant keypoints. In IJCV, volume 20, pages 91-110, 2004. 2, 3, 5
  11. B. Lucas and T. Kanade. An Iterative Image Registration Technique with an Application to Stereo Vision. In Int. Joint Conf. on Artificial Intelligence, pages 674-679, 1981. 7
  12. K. Mikolajczyk and C. Schmid. Scale and affine invariant interest point detectors. IJCV, 60:63-86, 2004. 5
  13. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool. A com- parison of affine region detectors. IJCV, 65:43-72, 2005. 2, 3, 5
  14. M. Pollefeys, D. Nister, J.-M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.-J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch, and H. Towles. Detailed real-time urban 3d reconstruction from video. IJCV, 78(2- 3):143-167, 2008. 1
  15. F. Rothganger, S. Lazebnik, C. Schmid, and J. Ponce. 3d object modeling and recognition using local affine-invariant image descriptors and multi-view spatial constraints. IJCV, 66(3):231-259, 2006. 3
  16. N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: ex- ploring photo collections in 3d. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers, pages 835-846, 2006. 2
  17. I. Stamos and M. Leordeanu. Automated Feature-Based Registration of Urban Scenes of Large Scale. CVPR, 2003. 2
  18. A. Z. T. Kadir and M. Brady. Robust wide baseline stereo from maximally stable extremal regions. In BMVC, pages 384-393, 2002. 6
  19. T. Tuytelaars and L. Van Gool. Matching widely separated views based on affine invariant regions. IJCV, 59:61-85, 2004. 6
  20. S. Umeyama. Least-square estimation of transformation pa- rameters between two point patterns. TPAMI, 13(4):376- 380, 1991. 6
  21. J. Vanden Wyngaerd, , and L. Van Gool. Automatic crude patch registration: Toward automatic 3d model building. CVIU, 87:8-26, 2002. 3
  22. J. Vanden Wyngaerd and L. Van Gool. Combining texture and shape for automatic crude patch registration. In 3DIM, pages 179-186, 2003. 3
  23. J. Vanden Wyngaerd, L. Van Gool, R. Koch, and M. Proes- mans. Invariant-based registration of surface patches. In ICCV, pages 301-306, 1999. 3
  24. W.-Y. Zhao, D. Nistér, and S. C. Hsu. Alignment of contin- uous video onto 3d point clouds. TPAMI, 27(8), 2005. 3