Photogrammetric modeling and image-based rendering for rapid virtual environment creation (original) (raw)
2004
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
Abstract: For realistic simulations, architecture is one of the most important elements to model and render photorealistically. Current techniques of converting architectural plans or survey data to CAD models are labor intensive, and methods for rendering such models are generally not photorealistic. In this work, we present a new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs.
Related papers
Thanks to the advances in integrating photogrammetry and computer vision, as well as in some numeric algorithms and methods, it is possible to aspire to turn 2D (images) into 3D (point clouds) in an automatic, flexible and good-quality way. This article presents a new method through the development of PW (Photogrammetry Workbench) (and how this could be useful for architectural modeling). This tool enables the user to turn images into scale 3D point cloud models, which have a better quality than those of laser systems. Moreover, the point clouds may include the respective orthophotos with photographic texture. The method allows the study of the typology of architecture and has been successfully tested on a sample of ten religious buildings located in the region of Aliste, Zamora (Spain).
Reconstructing polyhedral models of architectural scenes from photographs
1996
This paper presents a new image-based modeling method that facilitates the recovery of accurate polyhedral models of architectural scenes. The method is particularly effective because it exploits many of the constraints that are characteristic of architectural scenes. This work is placed in the context of the Fa��ade project, whose goal is to use images to produce photo-realistic novel views of architectural scenes.
Image-based modeling and rendering
1998
Image-based modeling and rendering differs from traditional graphics in that both the geometry and appearance of the scene are derived from real photographs. The techniques often allow for shorter modeling times, faster rendering speeds, and unprecedented levels of photorealism. In this course we will explain and demonstrate a variety of ways of turning images into models and then back into renderings, including movie maps, panoramas, image warping, photogrammetry, light fields, and 3D scanning.
PhotoBuilder-3D models of architectural scenes from uncalibrated images
Proceedings IEEE International Conference on Multimedia Computing and Systems
We address the problem of recovering 3D models from uncalibrated images of architectural scenes. We propose a simple, geometrically intuitive method which exploits the strong rigidity constraints of parallelism and orthogonality present in indoor and outdoor architectural scenes. We show how these simple constraints can be used to calibrate the cameras and to recover the projection matrices for each viewpoint. The projection matrices are used to recover partial 3D models of the scene and these can be used to visualise new viewpoints. Our approach does not need any a priori information about the cameras being used. A working system called PhotoBuilder had been de-has encouraged others to design interactive systems. In this paper we propose a much simpler approach to construct a 3D model and generate new viewpoint images by exploiting strong constraints present in the scenes to be modelled. In the context of architectural environments, the constraints which can be used are parallelism and orthogonality. These constraints lead to very simple and geometrically intuitive methods to calibrate the intrinsic and extrinsic parameters of the cameras and to recover Euclidean models of the scene from only two images from arbitrary positions. Our approach is similar to another interactive system [19] but exploits vanishing points [a] directly to recover the projection matrices.
Photogrammetric 3D Modeling for Virtual Reality
2018
Photogrammetric 3D modeling technology has progressed with giant leaps during recent years. This technical report goes through the current state of this technology. It provides some examples of practical application areas, describes the workflow of photogrammetric 3D modeling, lists some hardware requirements, provides a sample of software packages available and compares them with each other. It describes the workflow of 3D visualization for virtual reality, provides an example of a project where the technology is utilized and finally lists the challenges of this technology and anticipates its future.
Remote Sensing, 2016
Automated image-based 3D reconstruction methods are more and more flooding our 3D modeling applications. Fully automated solutions give the impression that from a sample of randomly acquired images we can derive quite impressive visual 3D models. Although the level of automation is reaching very high standards, image quality is a fundamental prerequisite to produce successful and photo-realistic 3D products, in particular when dealing with large datasets of images. This article presents an efficient pipeline based on color enhancement, image denoising, color-to-gray conversion and image content enrichment. The pipeline stems from an analysis of various state-of-the-art algorithms and aims to adjust the most promising methods, giving solutions to typical failure causes. The assessment evaluation proves how an effective image pre-processing, which considers the entire image dataset, can improve the automated orientation procedure and dense 3D point cloud reconstruction, even in the case of poor texture scenarios.
Creating Architectural Models from Images
We present methods for creating 3D graphical models of scenes from a limited numbers of images, i.e. one or two, in situations where no scene coordinate measurements are available. The methods employ constraints available from geometric relationships that are common in architectural scenes — such as parallelism and orthogonality — together with constraints available from the camera. In particular, by using the circular points of a plane simple, linear algorithms are given for computing plane rectification, plane orientation and camera calibration from a single image. Examples of image based 3D modelling are given for both single images and image pairs.
Interactively Modeling with Photogrammetry
We describe an interactive system to reconstruct 3D geometry and extract textures from a set of photographs taken with arbitrary camera parameters. The basic idea is to let the user draw 2D geometry on the images and set constraints using these drawings. Because the input comes directly from the user, he can more easily resolve most of the ambiguities and difficulties traditional computer vision algorithms must deal with. A set of geometrical linear constraints formulated as a weighted least-squares problem is efficiently solved for the camera parameters, and then for the 3D geometry. Iterations between these two steps lead to improvements on both results. Once a satisfying 3D model is reconstructed, its color textures are extracted by sampling the projected texels in the corresponding images. All the textures associated with a polygon are then fitted to one another, and the corresponding colors are combined according to a set of criteria in order to form a unique texture. The system produces 3D models and environments more suitable for realistic image synthesis and computer augmented reality.
Recreating Cultural Heritage Environments for VR Using Photogrammetry
ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
In this paper, we propose a workflow for recreating places of cultural heritage in Virtual Reality (VR) using structure from motion (SfM) photogrammetry. The unique texture of heritage places makes them ideal for full photogrammetric capture. An optimized model is created from the photogrammetric data so that it is small enough to render in a real-time environment. The optimized model, combined with mesh maps (texture maps, normal maps, etc.) looks like the original high detail model. The capture of a whole space makes it possible to create a VR experience with six degrees of freedom (6DoF) that allows the user to explore the historic place. Creating these experiences can bring people to cultural heritage that is either endangered or too remote for some people to access. The workflow described in this paper will be demonstrated with the case study of Myin-pya-gu, an 11th century temple in Bagan, Myanmar.
3D Reconstruction of Architectural Objects from Photos
1999
An algorithm of the 3D reconstruction is based on model to image correspondence, which gives possibility to use constraints of a model for calculation of camera and model parameters. Models are assembled from simple ready parametric blocks by modeler. Each block is composed from convex plane faces, described in text form. Blocks are mutually arranged, aligned and constrained to minimize the number of total parameters of a model. Some edges of an object are marked on the images by line segments and on the model simply by pointing them. Procedure of reconstruction minimizes the sum of distances between marked and projected edges on images by variation of model and camera parameters. If input information is sufficient, camera position and orientation with respect to the model, its focal length, and exact dimensions of the model are calculated. Received in such a way model of an object and camera parameters for each image provide the basis for subsequent operations: textures assignment, lighting conditions reconstruction. Finally the model can be exported to external 3D data formats.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.
References (6)
- Paul E. Debevec, Camillo J. Taylor, and Jitendra Malik. Modeling and Rendering Architecture from Photographs. In SIGGRAPH '96, August 1996. Paul E. Debevec, George Borshukov, and Yizhou Yu. Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping. In 9th Eurographics Rendering Workshop, Vienna, Austria, June 1998. Kurt Akeley. Realityengine graphics. In SIGGRAPH '93, pages 109-116, 1993
- Oliver Faugeras and Giorgio Toscani. The calibration problem for stereo. In Proceedings IEEE CVPR 86, pages 15-20, 1986 E.Kruppa. Zur emitlung eines objectes aus zwei perspektiven mit innerer orientierung. Sitz-Ber. Akad. Wiss., Wien, Math. Naturw. Kl., Abt. Ila., 122:1939-1948, 1913
- Leonard McMillan and Gary Bishop, Plenoptic modeling: An image-based rendering system. In SIGGRAPH '95, 1995 R.Szeliski. Image mosaicing for tele-reality applications. In IEEE Computer Graphics and Applications, 1996
- Roger Tsai. A versatile camera calibration technique for high accuracy 3 machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal of Robotics and Automation, 3(4):323-344, August 1987
- W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, and L. McMillan "Image-Based Visual Hulls", SIGGRAPH 2000 , Computer Graphics Proceedings, Annual Conference Series, R. Szeliski, Shape from rotation, IEEE Computer Soci- ety Conference on Computer Vision and Pattern Recognition (CVPR'91), pp. 625-630 (1991).
- Eric N. Mortensen and William A. Barrett. Intelligent scissors for image composition. In SIGGRAPH '95, 1995 CONCLUSION The technique used by Fac ¸ade v2.0, is powerful because it solves directly for the architectural dimensions of the scene: the lengths of walls, the widths of doors, the heights of roofs, rather than multitude of vertex coordinates that a standard photogrammet- ric approach would try to recover. It can recover accurate models using the least amount of human effort of any commercially avail- able photogrammetric modeling system. Moreover, Fac ¸ade v2.0 toolset provides support for importing high-resolution geometry, such as that acquired by time-of-flight LIDAR scanners, thus al- lowing greater accuracy in the resulting virtual environment.
Related papers
Interactive 3D architectural modeling from unordered photo collections
2008
Abstract We present an interactive system for generating photorealistic, textured, piecewise-planar 3D models of architectural structures and urban scenes from unordered sets of photographs. To reconstruct 3D geometry in our system, the user draws outlines overlaid on 2D photographs. The 3D structure is then automatically computed by combining the 2D interaction with the multi-view geometric information recovered by performing structure from motion analysis on the input photographs.
2008 Winter Simulation Conference, 2008
3D models of building components or construction resources have been largely created by computer-aideddesign (CAD) or by proprietary code for virtual reality development. Such 3D modeling methods entail accurate definition of points, lines and their relationships in the spatial coordinate system. Unlike CAD modeling, the surveying technique of photogrammetry takes a completely different approach by deriving metric information about an object through measurements conducted on photographs of the object. The very basic technique of photogrammetry is effective and computationally simple. With much less efforts, digital cameras and photogrammetry software have made possible 3D reconstruction of an object in digital form (coordinates and derived geometric elements). The resultant 3D models may well satisfy application needs in construction simulation visualization. In this paper, we introduce computing algorithms of photogrammetry and present an application of modeling a precast facade in 3D based on digital pictures taken at a building site.
Photo-textured rendering of developable surfaces in architectural photogrammetry
2001
New techniques constantly seek to meet a growing demand for realistic phototextured 3D models in architecture and archaeology. When only visualisation is required, the emphasis lies on visual quality rather than accuracy. But in architectural photogrammetry the primary requirement is mostly to produce accurate mappings under strict specifications. Hence, accuracy comes first; yet visual products can benefit from precise modeling. In this context, a treatment of cylindrical and conic surfaces is presented. The process for developing them onto the plane (the basic way to represent such surfaces) is outlined and illuminated at the example of two large ancient towers in the framework of projects prepared for the Greek Ministry of Culture. But besides their metric utility, these products represent ideal photo-textures for draping the mathematical surface to generate virtual reality effects. The results of such successful photorealistic visualisations are presented and discussed.
A new approach towards image based virtual 3D city modeling by using close range photogrammetry
ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences
3D city model is a digital representation of the Earth's surface and it’s related objects such as building, tree, vegetation, and some manmade feature belonging to urban area. The demand of 3D city modeling is increasing day to day for various engineering and non-engineering applications. Generally three main image based approaches are using for virtual 3D city models generation. In first approach, researchers used Sketch based modeling, second method is Procedural grammar based modeling and third approach is Close range photogrammetry based modeling. Literature study shows that till date, there is no complete solution available to create complete 3D city model by using images. These image based methods also have limitations <br><br> This paper gives a new approach towards image based virtual 3D city modeling by using close range photogrammetry. This approach is divided into three sections. First, data…
Recent methods for image-based modeling and rendering
IEEE Virtual Reality, 2003. Proceedings., 2003
A long standing goal in image-based modeling and rendering is to capture a scene from camera images and construct a sufficient model to allow photo-realistic rendering of new views. With the confluence of computer graphics and vision, the combination of research on recovering geometric structure from un-calibrated cameras with modeling and rendering has yielded numerous new methods. Yet, many challenging issues remain to be addressed before a sufficiently general and robust system could be built to e.g. allow an average user to model their home and garden from cam-corder video. This tutorial aims to give researchers and students in computer graphics a working knowledge of relevant theory and techniques covering the steps from real-time vision for tracking and the capture of scene geometry and appearance, to the efficient representation and real-time rendering of image-based models. It also includes hands-on demos of real-time visual tracking, modeling and rendering systems.
Protocols and Assisted Tools for Effective Image-Based Modeling of Architectural Elements
Lecture Notes in Computer Science, 2012
Domains related to documentation, conservation, restoration and enhancement of heritage objects use more and more digital 3D surveying. Image-based methods, due to their low-cost and accessibility, constitute an interesting alternative to traditional laser scanning surveys. However, these tools, often based on computer vision methods, are either difficult to use or not sufficiently accurate for scientific purposes. Within this context, this paper presents a photogrammetric pipeline in order to prove every heritage agent with a suitable and efficient solution for digitizing architectural and archaeological elements, taking into account the entire process, from the acquisition to the 3D result.