Natural 3D content on glasses-free light-field 3D cinema (original) (raw)

0.0: Real-Time Natural 3D Content Displaying with HoloVizio displays

In this paper we present HoloVizio technology as a solution to real time natural content displaying. The presented display technology is capable of reproducing large field of view continuous parallax light fields, providing realistic 3D experience of displayed scenes and objects. In this paper we demonstrate that the system is capable of real time displaying of dense light field streams originating from multiple cameras. We present the results of a real time acquisition -displaying solution using the HoloVizio system and a camera array of 27 cameras. In this paper we summarize the technology, describe the components of the system and show results and measurements on natural scenes.

Toward the Light Field Display: Autostereoscopic Rendering via a Cluster of Projectors

IEEE Transactions on Visualization and Computer Graphics, 2000

Ultimately, a display device should be capable of reproducing the visual effects that are produced by reality. In this paper we introduce an autostereoscopic display that uses a scalable array of digital light projectors and a projection screen augmented with microlenses to simulate a light field for a given three-dimensional scene. Physical objects emit or reflect light in all directions to create a light field that can be approximated by the light field display. The display can simultaneously provide many viewers from different viewpoints a stereoscopic effect without head-tracking or special mechanical devices. We present a solution to automatically calibrate the light field display and an efficient algorithm to render the special multi-view images it requires by exploiting their spatial coherence. The effectiveness of our approach is demonstrated with a four-projector prototype that can display dynamic imagery with full parallax.

Holovizio 3D Display System

2007 3DTV Conference, 2007

3D displaying can be crucial in many modern applications that use 3D models, volumes or otherwise benefit from 3D information. Also, future visual entertainment can not stop at 2D displaying. In this paper, we describe the HoloVizio true 3D display system. The patented HoloVizio technology uses a specially arranged array of optical modules and a holographic screen. Each point of the holographic screen emits light beams of different color and intensity to various directions. With proper software control, light beams leaving the pixels propagate in multiple directions, as if they were emitted from the points of 3D objects at fixed spatial locations. We show that the direction selective light emission is a general requirement for every 3D system and the advantages of light field reconstruction over the multiview approach. We describe the 10 Mpixel desktop display and the 50Mpixel large-scale system. We cover the real-time control issues at high pixel-count systems with the HoloVizio software environment, give solutions for natural content displaying, and describe concrete 3D applications developed in the frame of European projects.

Rendering multi-view plus depth data on light-field displays

2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2011

This paper presents an approach for rendering heavily extrapolated novel views to be used as input for light-field displays. This view generation method builds on a combination and enhancement of existing methods. The interpolation quality is assured by detecting and keeping the most reliable gap area information from the content using depth layers. Concerning the extrapolation process, which is the most important part of this paper, we implemented an algorithm that prefers isophotes lines in order to reconstruct objects and patterns using gradient filling and Poisson reconstruction. Using the algorithms described, it is possible to generate wide baseline light field data from Multi-View plus Depth (MVD) data of moderate baseline. The approach is demonstrated by generating interpolated and extrapolated views for feeding a HoloVizio large-scale display with captured video data.

3D displays: toward holographic video displays of 3D images

Chinese Optics Letters, 2013

As the flat panel displays (Liquid Crystal Displays, AMOLED, etc.) reach near perfection in their viewing qualities and display areas, it is natural to seek the next level of displays, including 3D displays. There is a strong surge in 3D liquid crystal displays as a result of the successful movie Avatar. Most of these 3D displays involve the employment of special glasses that allow one view perspective for each of the eyes to achieve a depth perception. Such displays are not real 3D displays. In fact, these displays can only provide one viewing perspective for all viewers, regardless of the viewer's position. In addition, a fundamental viewing problem of focusing and accommodation exist that can lead to discomfort and fatigue for many viewers. In this paper, the authors review the current status of stereoscopic 3D displays and their problems. The authors will also discuss the possibility of using flat panels for the display of both phase and intensity of video image information, leading to the ultimate display of 3D holographic video images. Many of the fundamental issues and limitations will be presented and discussed.

Prototyping a light field display involving direct observation of a video projector array

2011

Abstract We present a concept for a full-parallax light field display achieved by having users look directly into an array of video projectors. Each projector acts as one angularly-varying pixel, so the display's spatial resolution depends on the number of video projectors and the angular resolution depends on the pixel resolution of any one video projector.

Visual enhancements for improved interactive rendering on light field displays

2011

abstract={Rendering of complex scenes on a projector-based light field display requires 3D content adaptation in order to provide comfortable viewing experiences in all conditions. In this paper we report about our approach to improve visual experiences while coping with the limitations in the effective field of depth and the angular field of view of the light field display. We present adaptation methods employing non-linear depth mapping and depth of field simulation which leave large parts of the scene unmodified, while modifying the other ...

Optically multilayered light field display for enhancing depth of field

Stereoscopic Displays and Applications XX, 2009

In this paper, we describe a method to combine two integral photography (IP) displays to represent a larger amount of depth while maintaining image quality. We adopt integral videography (IV), which can emit 4D light fields into real space to present full-parallax 3D videos. The two IVs are located at different depths on the same optical axis by using a beam splitter. We present some steps to enhance the quality of our 3D display. First, we remove positional displacements based on an adjustment between the LCD and the lens array of IV. The positional displacements include parallel, rotational, and depth displacement. Next, we strictly adjust the two IVs' positions to right positions. Adjusting geometrical positions is based on optical rotations and shifts. Finally, we run the hidden surface removal to hide surfaces of 3D objects on the background display to prevent viewers from seeing the distracting surface. In conclusion, our optically multilayered light field display is effective for enhancing the depth of field.

D Holoscopic Image Video Content Display on Volumetric Displays : The next generation 3 D TV technology 1

2019

Integral imaging, also known as Holoscopic imaging to be promising approach for glassless 3D and Its methodology uses the principle of “Fly’s eye” and hence allows natural viewing of objects (i.e. fatigue free viewing), In this paper, the main objective is to provide a new plug-in tools for full parallax computer generated 3D Holoscopic content, based mainly on 3D Virtual Reality Modeling Language parser to enable 3D integral images content and rendering to be produced from VRML file format, and displayed on auto-stereoscopic. In the proposed system, the 3D content is either captured by a single camera with a micro lens, cylindrical lens array or computer generated to allow for mixed 3D video generation. Multiprocessor ray tracing system is adapted to be able to generate 3D integral images that containing 3D IIVRML integral images content parser modules; new 3D IIVRML file format is created by uses 3D unidirectional camera parameters in order to import/accept into ray tracer rendere...

A qualitative comparison of MPEG view synthesis and light field rendering

2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2014

Free Viewpoint Television (FTV) is a new modality in next generation television, which provides the viewer free navigation through the scene, using image-based view synthesis from a couple of camera view inputs. The recently developed MPEG reference software technology is, however, restricted to narrow baselines and linear camera arrangements. Its reference software currently implements stereo matching and interpolation techniques, designed mainly to support three camera inputs (middle-left and middleright stereo). Especially in view of future use case scenarios in multi-scopic 3D displays, where hundreds of output views are generated from a limited number (tens) of wide baseline input views, it becomes mandatory to fully exploit all input camera information to its maximal potential. We therefore revisit existing view interpolation techniques to support dozens of camera inputs for better view synthesis performance. In particular, we show that Light Fields yield average PSNR gains of approximately 5 dB over MPEG's existing depth-based multiview video technology, even in the presence of large baselines.