A Hierarchical modified AV1 codec for compression cartesian form of holograms in holo and object planes (original) (raw)
Related papers
2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS), 2021
Holography is a 3D capturing and displaying system. Many formats have been suggested to store holographic images with the highest quality and minimum file size. Here, we suggest combining two AV1 codecs to make a secondary error image and use it in a linear regression block to compensate for the main AV1 compression error. Since the phase part is the most challenging part of holograms, the proposed method addresses the compression problem in phase. The obtained results reveal that the proposed method can outperform the state-of-the-art codecs in terms of PSNR and SSIM criteria. Besides, comparing BD-PSNR and BD-Rate results with usual AV1, confirms the proposed method has an average about 5.04dB, which is-22.1% better Object plane performance, and 4.57dB, which is-20.66% better in Holo plane performance, in terms of BDPSNR and BD-Rate, respectively.
JPEG based Compression of Digital Holograms
2018 7th European Workshop on Visual Information Processing (EUVIP), 2018
Modern holography for 3D imaging allows to reconstruct all the parallaxes that are needed for a truly immersive visualisation. Nevertheless, it represents a huge amount of data which induces higher transmission and storage requirements. To gain more popularity and acceptance, digital holography demands development of efficient coding schemes that provide significant data compression at low computation cost. Another issue that needs to be tackled when designing holography coding algorithms is interoperability with commonly used formats. The upcoming JPEG Pleno standard aims to develop a standard framework for the representation and exchange of new imaging modalities, such as holographic imaging, while maintaining backward compatibility with legacy JPEG decoders. This paper presents a lossy compression method for holographic images that exhibits good coding performance while considering the computation cost and backward compatibility with legacy JPEG standard. To validate our findings, the results of our tests are shown and interpreted.
Multimedia Tools and Applications, 2021
One of the critical challenges facing 3D video systems and images such as holography lies in their compression technique. High-efficiency video coding (HEVC) has emerged as one of the leading schemes to address this challenge. In this article, a novel method based on wavelet transform is presented to improve HEVC, particularly in digital holography systems (object plane). In this regard, wavelet and resizing are included in the coding process, while extra HEVC decoders and encoders are added to predict and decrease errors in the target. Simulation results reveals that the proposed algorithm reduces Bjøntegaard-Delta (BD) bitrate 17.5% (based on average BD-Rate values) compared to the original HEVC (H.265) scheme while maintaining signal fidelity and even enhancing it slightly. We observe an increased BDpeak-signal-to-noise ratio (BD-PSNR) in real and imaginary parts of digital holograms of high rate quantization values up to 1.1 dB.
Compression of 3D Video Using Huffman Coding
With the recent development of 3D display technologies, there is an increasing demand for realistic 3D video. However, efficient transmission and storage of depth data still presents a challenging task to the research community in these applications. Consequently a new method, called 3D Image Warping Based Depth Video Compression (IW-DVC) is proposed for fast and efficient compression of 3D video by using Huffman coding. The IW-DVC method is to exploit the special properties of the depth data to achieve a high compression ratio which preserves the quality of the captured images. This method combines the egomotion estimation and 3D image warping techniques and includes a lossless coding scheme which is capable of adapting to depth data with a high dynamic range. IWDVC operates in high-speed, suitable for real-time applications, and is able to attain an enhanced motion compensation accuracy compared with the conventional approaches. Also, it removes the existing redundant information between the depth frames to further increase compression efficiency without sacrificing image quality.
Efficient Transmission of 3D Video Using MPEG-4 AVC/H.264 Compression Technology
Lecture Notes in Computer Science, 2010
At a receiver terminal, true 3D video provides ability to watch views selected from a large number of available views. Such ability is needed for the forthcoming 3D video applications like free-view television, autostereoscopic displays etc. Delivery of many views through communication channels is a challenging problem that has to be solved in the near future. In this paper, we study delivery of real 3D video using the state-of-the-art compression technology. Considered are the issues related to 3D video data model as well its application for generation of video from arbitrary virtual viewpoint. Included are respective experimental results.
Compression of digital hologram for three-dimensional object using Wavelet-Bandelets transform
Optics Express, 2011
In the transformation based compression algorithms of digital hologram for three-dimensional object, the balance between compression ratio and normalized root mean square (NRMS) error is always the core of algorithm development. The Wavelet transform method is efficient to achieve high compression ratio but NRMS error is also high. In order to solve this issue, we propose a hologram compression method using Wavelet-Bandelets transform. Our simulation and experimental results show that the Wavelet-Bandelets method has a higher compression ratio than Wavelet methods and all the other methods investigated in this paper, while it still maintains low NRMS error.
Novel methods of image compression for 3D reconstruction
2017
Data compression techniques are widely used in the transmission and storage of 2D image, video and 3D data structures. The thesis addresses two aspects of data compression: 2D images and 3D structures by focusing research on solving the problem of compressing structured light images for 3D reconstruction. It is useful then to describe the research by separating the compression of 2D images from the compression of 3D data. Concerning image compression, there are many types of techniques and among the most popular are JPEG and JPEG2000. The thesis addresses different types of discrete transformations (DWT, DCT and DST) thatcombined in particular ways followed by Matrix Minimization algorithm,which is achieved high compression ratio by converting groups of data into a single value. This is an essential step to achieve higher compression ratios reaches to 99%. It is demonstrated that the approach is superior to both JPEG and JPEG2000 for compressing 2D images used in 3D reconstruction. ...
Locally linear embedding-based prediction for 3D holoscopic image coding using HEVC
2014 22nd European Signal Processing Conference (EUSIPCO), 2014
Holoscopic imaging is a prospective acquisition and display solution for providing true 3D content and fatigue-free 3D visualization. However, efficient coding schemes for this particular type of content are needed to enable proper storage and delivery of the large amount of data involved in these systems. Therefore, this paper proposes an alternative HEVC-based coding scheme for efficient representation of holoscopic images. In this scheme, some directional intra prediction modes of the HEVC are replaced by a more efficient prediction framework based on locally linear embedding techniques. Experimental results show the advantage of the proposed prediction for 3D holoscopic image coding, compared to the reference HEVC standard as well as previously presented approaches in this field.
Overview of the Multiview and 3D Extensions of High Efficiency Video Coding
— The High Efficiency Video Coding (HEVC) standard has recently been extended to support efficient representation of multiview video and depth-based 3D video formats. The multiview extension, MV-HEVC, allows efficient coding of multiple camera views and associated auxiliary pictures, and can be implemented by reusing single-layer decoders without changing the block-level processing modules since block-level syntax and decoding processes remain unchanged. Bit rate savings compared with HEVC simulcast are achieved by enabling the use of interview references in motion-compensated prediction. The more advanced 3D video extension, 3D-HEVC, targets a coded representation consisting of multiple views and associated depth maps, as required for generating additional intermediate views in advanced 3D displays. Additional bit rate reduction compared with MV-HEVC is achieved by specifying new block-level video coding tools, which explicitly exploit statistical dependencies between video texture and depth and specifically adapt to the properties of depth maps. The technical concepts and features of both extensions are presented in this paper. Index Terms— 3D High Efficiency Video Coding (3D-HEVC), HEVC, Joint Collaborative Team on 3D Video Coding Extension Development (JCT-3V), Moving Picture Experts Group (MPEG), Multiview HEVC (MV-HEVC), standards, Video Coding Experts Group (VCEG), video compression.
3D video compression by coding of disoccluded regions
2012 19th IEEE International Conference on Image Processing, 2012
In this paper, we present the most efficient coding tools that are used in a new video compression technology for multiple views with the depth maps. This very well performing technology was designed and developed in response to MPEG Call for Proposals on 3D Video Coding Technology. The proposed technology exploits a tool that reduces the side views and the side depth maps to small disoccluded regions. This way only one central view and one depth map are coded in the HEVC syntax while the remaining views and the depth maps are synthesized in the decoder from the small disoccluded regions and from the central-view data. Therefore, the bitrate needed for a side view is mostly below 20% of the bitrate for single-view video.