3D-HEVC Neighboring Block Based Disparity Vector (NBDV) Derivation Architecture: Complexity and Implementation Analysis (original) (raw)

Abstract

HEVC (High Efficiency Video Coding), the state-of-the-art video coding standard has 3D extension known as 3D-HEVC, which is established by JCT-3V. In current design of 3D-HEVC, to exploit the redundancies of the 3D video signal, various tools are integrated. In 3D-HEVC, the neighboring block disparity vector (NBDV) mode is used to replace the original predicted depth map (PDM) for inter-view motion prediction. A new estimated disparity vector depth oriented neighboring block disparity vector (DoNBDV) is used to enhance the accuracy of the NBDV by utilizing the coded depth map. In this paper, the complexity and implementation analysis of the NBDV and DoNBDV architectures are analyzed in terms of performance, complexity, and other design considerations. It is hence concluded that NBDV and DoNBDV for 3D-HEVC video signals provide attractive coding gains with comparable complexity as traditional motion/disparity compensation.

Similar content being viewed by others

References

  1. Tanimoto M (2006) Overview of free viewpoint television. Signal Process Image Commun 21(6):454–461
    Google Scholar
  2. Vetro A, Matusik W, Pfister H, Xin J (2016) Coding approaches for end-to-end 3D TV systems. In: Proceedings of the 23rd picture coding symposium (PCS’04), San Francisco, California, USA, Dec 2004, pp 319–324
    Google Scholar
  3. Urey H, Chellappan KV, Erden E, Surman P (2011) State of the art in stereoscopic and autostereoscopic displays. Proc IEEE 99(4). https://doi.org/10.1109/JPROC.2010.2098351
  4. Dodgson NA (2005) Autostereoscopic 3D displays. IEEE Comput 38(8):31–36
    Article Google Scholar
  5. Fehn C (2004) Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In: Proceedings of SPIE, stereoscopic displays and virtual reality systems XI, vol 5291, May 2004, p 93
    Google Scholar
  6. Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 47(1):7–42
    Article Google Scholar
  7. Foix S, Alenya G, Torras C (2011) Lock-in time-of-flight (ToF) cameras: a survey. IEEE Sensors J 11(9):1917–1926
    Article ADS Google Scholar
  8. Salvi J, Pagès J, Batlle J (2004) Pattern codification strategies in structured light systems. Pattern Recognit 37(4):827–849
    Article Google Scholar
  9. Call for proposals on 3D video coding technology, N12036, MPEG of ISO/IEC JTC1/SC29/WG11, Geneva, Switzerland, Mar 2011
    Google Scholar
  10. Kauff P, Atzpadin N, Fehn C, Müller M, Schreer O, Smolic A, Tanger R (2007) Depth map creation and image based rendering for advanced 3DTV services providing interoperability and scalability. Signal Processing: Image Communication. Special Issue on 3DTV, Feb 2007
    Google Scholar
  11. Advanced video coding for generic audiovisual services, Rec. ITU-T H.264 and ISO/IEC 14496-10 (MPEG-4 AVC), 2012
    Google Scholar
  12. High efficiency video coding, Rec. ITU-T H.265 and ISO/IEC 23008-2, Jan 2013
    Google Scholar
  13. Sullivan GJ, Ohm J-R, Han W-J, Wiegand T (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668
    Article Google Scholar
  14. Hannuksela MM, Chen Y, Suzuki T, Ohm J-R, Sullivan G (2013) 3D-AVC draft text 8. Presented at the 6th meeting joint collaborative team on 3D video coding extension development, Geneva, Switzerland, 25 Oct–1 Nov, 2013, Doc. JCT3V-F1002
    Google Scholar
  15. Tech G, Wegner K, Chen Y, Yea S (2013) 3D-HEVC Draft Text 2. Presented at the 6th meeting joint collaborative team on 3D video coding extension development, Geneva, Switzerland, 25 Oct–1 Nov 2013, Doc. JCT3V-F1001
    Google Scholar
  16. Applications and requirements on 3D video coding, N12035, MPEG of ISO/IEC JTC1/SC29/WG11, Geneva, Switzerland, Mar 2011
    Google Scholar
  17. Schwarz H, Wiegand T (2012) Inter-view prediction of motion data in multiview video coding. In: Proceedings of picture coding symposium, May 2012, pp 101–104
    Google Scholar
  18. Zhang L, Chen Y, Karczewicz M (2012) CE5.h: disparity vector generation results. Presented at the 1st meeting joint collaborative team on 3D video coding extension development, Stockholm, Sweden, 16–20 July 2012, Doc. JCT3V-A0097
    Google Scholar
  19. Zhang L, Chen Y, Karczewicz M (2013) Disparity vector based advanced inter-view prediction in 3D-HEVC. In: Proceedings of IEEE international symposium circuits system, May 2013, pp 1632–1635
    Google Scholar
  20. Tech G, Müller K, Ohm J-R, Vetro A, Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans Circuits Syst Video Technol 26(1)
    Google Scholar
  21. Chen Y et al (2014) Test model 10 of 3D-HEVC and MV-HEVC. Joint collaborative team on 3D video coding extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JCT3V-J1003. 10th meeting, Strasbourg
    Google Scholar
  22. Gerhard Tech et al (2012) 3D-HEVC Test Model 1. Joint collaborative team on 3D video coding extension development of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCT3V-A1005, July 2012, Stockholm
    Google Scholar
  23. Ahmad W et al (2016) High level synthesis based FPGA implementation of H. 264/AVC sub-pixel luma interpolation filters. In: Modelling symposium (EMS), 2016, European. IEEE
    Google Scholar
  24. Ahmad W, Martina M, Masera G (2015) Complexity and implementation analysis of synthesized view distortion estimation architecture in 3D High Efficiency Video Coding. In: 2015 International conference on 3D imaging (IC3D). IEEE
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. University of Engineering and Technology Taxila, Taxila, Pakistan
    Waqar Ahmad, Naveed Khan Baloch, Fawad Hussain & Muhammad Asif Khan
  2. Politecnico di Torino, Turin, Italy
    Maurizio Martina

Authors

  1. Waqar Ahmad
  2. Naveed Khan Baloch
  3. Fawad Hussain
  4. Muhammad Asif Khan
  5. Maurizio Martina

Corresponding author

Correspondence toWaqar Ahmad .

Editor information

Editors and Affiliations

  1. DII, University of Pisa, Pisa, Italy
    Sergio Saponara
  2. DITEN, University of Genoa, Genoa, Italy
    Alessandro De Gloria

Rights and permissions

© 2020 Springer Nature Switzerland AG

About this paper

Cite this paper

Ahmad, W., Baloch, N.K., Hussain, F., Khan, M.A., Martina, M. (2020). 3D-HEVC Neighboring Block Based Disparity Vector (NBDV) Derivation Architecture: Complexity and Implementation Analysis. In: Saponara, S., De Gloria, A. (eds) Applications in Electronics Pervading Industry, Environment and Society. ApplePies 2019. Lecture Notes in Electrical Engineering, vol 627. Springer, Cham. https://doi.org/10.1007/978-3-030-37277-4\_64

Download citation

Publish with us