A new H.264/AVC error resilience model based on Regions of Interest (original) (raw)
Related papers
Region-of-Interest intra prediction for H.264/AVC error resilience
2009 16th IEEE International Conference on Image Processing (ICIP), 2009
Packets in a video bitstream contain data with different levels of importance that yield unequal amounts of quality distortion when lost. In order to avoid sharp quality degradation due to packet loss, we propose in this paper an error resilience method that is applied to the Region of Interest (RoI) of the picture. This method protects the RoI while not yielding significant overhead. We perform an eye tracking test to determine the RoIs of a video sequence and we assess the performance of the proposed model in error-prone environments by means of a subjective quality test. Loss simulation results show that stopping the temporal error propagation in the RoIs of the pictures helps preserving an acceptable visual quality in the presence of packet loss.
Error resilience video coding in H.264 encoder with potential distortion tracking
2004
In this paper, an efficient rate-distortion (RD) model for H.264 video encoder in packet loss environment is presented. The encoder keeps tracking the potential error propagation on a block basis by taking into account the source characteristics, network conditions as well as the error concealment method. The end-to-end distortion invoked in this RD model is estimated according to the potential error-propagated distortion stored in a distortion map. The distortion map in terms of each frame is derived after the frame is encoded, which can be used for the RDbased encoding of the subsequent frames. Since the channel distortion has been considered in the proposed RD model, the new Lagarangian parameter is derived accordingly. The proposed method outperforms the error robust rate-distortion optimization method in H.264 test model better in terms of both transmission efficiency and computational complexity.
Perceptual effects of packet loss on H. 264/AVC encoded videos
2009
Video communication over IP (Internet Protocol) networks has grown significantly in recent years. However, the Quality of Experience (QoE) associated with video over IP can vary dramatically. This is mainly due to bandwidth restrictions and the fluctuating Quality of Service (QoS). Investigating the perceptual effects of packet loss could lead to a better understanding of the QoE experienced by the enduser. In this paper, we present the results obtained from a series of subjective video quality tests that evaluated the quality of H.264/AVC videos distorted by several packet loss patterns. We draw some interesting conclusions concerning the impact on perceptual quality of (1) transmission-related factors such as the loss distribution and the lost pictures percentage; and (2) content-related factors such as the scene cut position in the video sequence and the spatial position of the loss in the picture.
An Optimized and Adaptive Error-Resilient Coding for H. 264 Video
TENCON 2006 - 2006 IEEE Region 10 Conference, 2006
The transmission errors in H.264 may propagate in the temporal direction. Errors in intra-coded picture (I-frame) will propagate into the associated P-B frame if they are in the same Group Of Picture (GOP). Therefore it is important to detect errors in the I-frame rather than in the P-B frame. This paper proposes and demonstrates an effective technique of Error-Resilient Coding based on bit-error detection and Directional Intra-Frame Concealment (DIFC) for H.264 video. The bit error detection is derived from multiblock checksum, chain coverage and remainder coding. DIFC takes advantage of flexible block sizes to deal with detailed movement areas and employs object edge detection to improve the accuracy of spatial interpolation. The results showed that the proposed directional intra-frame concealment has a better performance than the weighted pixel interpolation in H.264 software.
Error tolerance schemes for H.264/AVC: An evaluation
2012
Video transmission is sensitive to losses due to high compression efficiency. To tolerate the quality degradation from losses, Forward Error Correction (FEC) and error resilience schemes are commonly used. In this paper, we evaluate the performance of error tolerance schemes with the latest video coding standard, H.264/AVC. The analysis in three zones of packet loss rates (PLR) shows that no FEC scheme outperforms the others in a wide PLR range. We also compare the equal and unequal FEC schemes with the Flexible Macroblock Ordering (FMO) error resilience mechanism and find that FMO performs well in moving videos while FEC codes are better in rather static videos. Our results and analysis would give insights to design flexible applications which are able to adapt to the network dynamics.
Error-resilient performance evaluation of MPEG-4 and H.264
Visual Communications and Image Processing 2003, 2003
Recent advances in video coding technology have resulted in rapid growth of application in mobile communication. With this explosive growth, reliable transmission and error resilient technique become increasingly necessary to offer high quality multimedia service. This paper discusses the error resilient performances of the MPEG-4 simple profile under the H.324/M and the H.264 baseline under the IP packet networks. MPEG-4 simple profile has error resilient tools such as resynchronization marker insertion, data partitioning, and reversible VLC. H.264 baseline has the flexible macroblock ordering scheme, and others. The objective and subjective quality of decoded video is measured under various random bit and burst error conditions. Keywords: Error resilient tools, MPEG-4, H.264, video coding technology
Improved error concealment of region of interest based on the H. 264/AVC standard
Optical Engineering, 2010
Video transmission over error-prone channels often suffers from inevitable transmission errors, which necessitates proper error concealment ͑EC͒ for acceptable image quality. Furthermore, the region of interest ͑ROI͒ in images usually draws much attention, and so the EC of the ROI receives special treatment during encoding and decoding. We explore a data hiding-based scheme to effectively improve the EC of the ROI in the case of erasures of large continuous regions, which becomes impractical for conventional EC methods. At the encoder side, motion vectors of the ROI are adaptively embedded in the background based on original quantized coefficients of background macroblocks. Considering the limited embedding capacity of the background, we further propose to assign priorities to each ROI macroblock based on a predefined metric of error propagation. Our scheme is applied with the state-of-the-art H.264/ AVC standard in a packet loss scenario, and better video quality can be obtained. Experimental results show that the scheme can improve the EC of the ROI significantly without much loss of coding efficiency.
Evaluation of video quality metrics on transmission distortions in H.264 coded video
2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), 2011
The development of high-speed access networks has enabled a variety of video delivery alternatives over the Internet, for example IPTV and peer-to-peer based video services as Voddler. Consequently, the development of real-time video QoE monitoring methods is receiving large attention in the research community. We believe that the good performing objective metrics using reference information could be used to speed up the development process of real-time video QoE monitoring methods. Thus in this paper we study the accuracy of full-reference objective methods for assessing the quality degradation due to the transmission distortions. We evaluated several well-known publicly-available full-reference objective metrics on the freely available EPFL-PoliMI (Ecole Polytechnique Fédérale de Lausanne and Politecnico di Milano) video quality assessment database, which was specifically designed for the evaluation of transmission distortions. The full-reference metrics are usually evaluated using a reference which is uncompressed. Instead, we study the performance of the metrics when the reference videos are lightly compressed to ensure high quality.
IEEE Transactions on Broadcasting, 2000
Ensuring and maintaining adequate Quality of Experience towards end-users are key objectives for video service providers, not only for increasing customer satisfaction but also as service differentiator. However, in the case of High Definition video streaming over IP-based networks, network impairments such as packet loss can severely degrade the perceived visual quality. Several standard organizations have established a minimum set of performance objectives which should be achieved for obtaining satisfactory quality. Therefore, video service providers should continuously monitor the network and the quality of the received video streams in order to detect visual degradations. Objective video quality metrics enable automatic measurement of perceived quality. Unfortunately, the most reliable metrics require access to both the original and the received video streams which makes them inappropriate for real-time monitoring. In this article, we present a novel no-reference bitstream-based visual quality impairment detector which enables real-time detection of visual degradations caused by network impairments. By only incorporating information extracted from the encoded bitstream, network impairments are classified as visible or invisible to the end-user. Our results show that impairment visibility can be classified with a high accuracy which enables real-time validation of the existing performance objectives.