Naturalexplorationof3D massivemodels on large-scalelight field displaysusing the FOX (original) (raw)
Related papers
Computers & Graphics, 2012
ABSTRACT We report on a virtual environment for natural immersive exploration of extremely detailed surface models on multi-projector light field displays, which give multiple, freely moving, naked-eye viewers the illusion of seeing and manipulating 3D objects with continuous horizontal parallax. Our specialized 3D user interface, dubbed FOX (Focus Sliding Surface), allows inexperienced users to inspect 3D objects at various scales, integrating panning, rotating, and zooming controls into a single low-degree-of-freedom operation. At the same time, FOX takes into account the requirements for comfortable viewing on the light field display hardware, which has a limited field-of-view and a variable spatial resolution. Specialized multi-resolution structures, embedding a fine-grained, per-patch spatial index within a coarse-grained patch-based mesh structure, are exploited for fast batched I/O, GPU-accelerated rendering, and user-interaction-system-related geometric queries. The capabilities of the system are demonstrated by the interactive inspection of a giga-triangle dataset on a large-scale, 35 MPixel light field display controlled by wired or vision-based devices. Results of a thorough user evaluation, involving quantitative and subjective measurements, are discussed.
Recent results in rendering massive models on horizontal parallaxonly light field displays
2009
In this contribution, we report on specialized out-of-core multiresolution real-time rendering systems able to render massive surface and volume models on a special class of horizontal parallax-only light field displays. The displays are based on a specially arranged array of projectors emitting light beams onto a holographic screen, which then makes the necessary optical transformation to compose these beams into a continuous 3D view. The rendering methods employ state-ofthe-art out-of-core multiresolution techniques able to correctly project geometries onto the display and to dynamically adapt model resolution by taking into account the particular spatial accuracy characteristics of the display. The programmability of latest generation graphics architectures is exploited to achieve interactive performance. As a result, multiple freely moving naked-eye viewers can inspect and manipulate virtual 3D objects that appear to them floating at fixed physical locations. The approach provides rapid visual understanding of complex multi-gigabyte surface models and volumetric data sets.
0.0: Real-Time Natural 3D Content Displaying with HoloVizio displays
In this paper we present HoloVizio technology as a solution to real time natural content displaying. The presented display technology is capable of reproducing large field of view continuous parallax light fields, providing realistic 3D experience of displayed scenes and objects. In this paper we demonstrate that the system is capable of real time displaying of dense light field streams originating from multiple cameras. We present the results of a real time acquisition -displaying solution using the HoloVizio system and a camera array of 27 cameras. In this paper we summarize the technology, describe the components of the system and show results and measurements on natural scenes.
Visual enhancements for improved interactive rendering on light field displays
2011
abstract={Rendering of complex scenes on a projector-based light field display requires 3D content adaptation in order to provide comfortable viewing experiences in all conditions. In this paper we report about our approach to improve visual experiences while coping with the limitations in the effective field of depth and the angular field of view of the light field display. We present adaptation methods employing non-linear depth mapping and depth of field simulation which leave large parts of the scene unmodified, while modifying the other ...
An interactive 3D medical visualization system based on a light field display
2009
We present a prototype medical data visualization system exploiting a light field display and custom direct volume rendering techniques to enhance understanding of massive volumetric data, such as CT, MRI, and PET scans. The system can be integrated with standard medical image archives and extends the capabilities of current radiology workstations by supporting real-time rendering of volumes of potentially unlimited size on light field displays generating dynamic observer-independent light fields. The system allows multiple untracked naked-eye users in a sufficiently large interaction area to coherently perceive rendered volumes as real objects, with stereo and motion parallax cues. In this way, an effective collaborative analysis of volumetric data can be achieved. Evaluation tests demonstrate the usefulness of the generated depth cues and the improved performance in understanding complex spatial structures with respect to standard techniques.
Advancing Large Interactive Surfaces for Use in the Real World
Advances in Human-Computer Interaction, 2010
Interactive surfaces are only just beginning to break into the market, and they still do not offer the advanced functionality demonstrated with many lab prototypes. The path from a prototype system to a finished product for use in real-world scenarios is a long one, and many obstacles must be overcome. The design of an interactive multitouch table had to address issues like optical recognition, hardware design, and ergonomics. This paper describes in detail the construction of a large, robust multi-touch table called mrT. It will show how to solve major problems of the diffuse illumination technique and other challenges of constructing a large-screen, high-resolution, self-contained interactive multitouch surface that not only serves as a development system but can be deployed in the real-world. Additionally, to further motivate some of the design decisions, especially why the diffuse illumination technology was chosen, this paper will discuss related on-going research projects on the application side.
Prototyping a light field display involving direct observation of a video projector array
2011
Abstract We present a concept for a full-parallax light field display achieved by having users look directly into an array of video projectors. Each projector acts as one angularly-varying pixel, so the display's spatial resolution depends on the number of video projectors and the angular resolution depends on the pixel resolution of any one video projector.
Toward the Light Field Display: Autostereoscopic Rendering via a Cluster of Projectors
IEEE Transactions on Visualization and Computer Graphics, 2000
Ultimately, a display device should be capable of reproducing the visual effects that are produced by reality. In this paper we introduce an autostereoscopic display that uses a scalable array of digital light projectors and a projection screen augmented with microlenses to simulate a light field for a given three-dimensional scene. Physical objects emit or reflect light in all directions to create a light field that can be approximated by the light field display. The display can simultaneously provide many viewers from different viewpoints a stereoscopic effect without head-tracking or special mechanical devices. We present a solution to automatically calibrate the light field display and an efficient algorithm to render the special multi-view images it requires by exploiting their spatial coherence. The effectiveness of our approach is demonstrated with a four-projector prototype that can display dynamic imagery with full parallax.
A survey of large-scale immersive displays
2007
Immersive displays generally fall within three categories: small-scale, single-user displays (head-mounted displays and desktop stereoscopic displays); medium-scale displays designed for small numbers of collaborative users (CAVEs, reality centres and power walls); and large-scale displays designed for group immersion experiences (IMAX, simulator rides, domes). Small-and medium-scale displays have received by far the most attention from researchers, perhaps due to their smaller size, lower cost and easy accessibility. Large-scale immersive displays present unique technical challenges largely met by niche manufacturers offering proprietary solutions. The rapidly growing number of largescale displays in planetariums, science centers and universities worldwide (275 theaters to date), coupled with recent trends towards more open, extensible systems and mature software tools, offer greater accessibility to these environments for research, interactive science/art application development, and visualization of complex databases for both student and public audiences. An industry-wide survey of leading-edge largescale immersive displays and manufacturers is provided with the goal of fostering industry/academic collaborations. Research needs include advancements in immersive display design, real-time spherical rendering, real-time group interactive technologies and applications, and methods for aggregating and navigating extremely large scientific databases with imbedded physical/astrophysical simulations.
Dynamic projection environments for immersive visualization
2010
We present a system for dynamic projection on large, human-scale, moving projection screens and demonstrate this system for immersive visualization applications in several fields. We have designed and implemented efficient, low-cost methods for robust tracking of projection surfaces, and a method to provide high frame rate output for computationally-intensive, low frame rate applications. We present a distributed rendering environment which allows many projectors to work together to illuminate the projection surfaces. This physically immersive visualization environment promotes innovation and creativity in design and analysis applications and facilitates exploration of alternative visualization styles and modes. The system provides for multiple participants to interact in a shared environment in a natural manner. Our new human-scale user interface is intuitive and novice users require essentially no instruction to operate the visualization.