A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels (original) (raw)
Related papers
2004
For entropy-coded MPEG-2 video frames, a transmission error will not only affect the underlying codeword but also may affect subsequent codewords, resulting in a great degradation of the received video frames. In this study, a hybrid error concealment scheme for MPEG-2 video transmission is proposed. The objective is to recover high-quality MPEG-2 video frames from the corresponding corrupted video frames, without increasing the transmission bit rate. In this study, transmission errors or equivalently corrupted/lost video packets in MPEG-2 video frames are detected and located by the error detection scheme proposed by Shyu and Leou [IEEE Trans. Circuits Syst. Video Technol. 10 , and then the corrupted blocks are concealed by the proposed hybrid error concealment scheme. Based on the fitness function for evaluating the candidate concealed blocks of a corrupted block, a corrupted block in an intra-coded I frame is concealed by either the spatial error concealment algorithm in H.264 or the proposed fast best neighborhood matching (BNM) algorithm. A corrupted block in an inter-coded P or B frame is concealed by the proposed fast motioncompensated BNM algorithm. Based on the simulation results obtained in this study, the proposed scheme can recover high-quality MPEG-2 video frames from the corresponding www.elsevier.com/locate/jvci (J.-J. Leou). corrupted video frames up to a packet loss rate of 20%. The performance of the proposed scheme is better than those of four existing approaches for comparison.
An Efficient Adaptive Boundary Matching Algorithm for Video Error Concealment
2016
Sending compressed video data in error-prone environments (like the Internet and wireless networks) might cause data degradation. Error concealment techniques try to conceal the received data in the decoder side. In this paper, an adaptive boundary matching algorithm is presented for recovering the damaged motion vectors (MVs). This algorithm uses an outer boundary matching or directional temporal boundary matching method to compare every boundary of candidate macroblocks (MBs), adaptively. It gives a specific weight according to the accuracy of each boundary of the damaged MB. Moreover, if each of the adjacent MBs is already concealed, different weights are given to the boundaries. Finally, the MV with minimum adaptive boundary distortion is selected as the MV of the damaged MB. Experimental results show that the proposed algorithm can improve both objective and subjective quality of reconstructed frames without any considerable computational complexity. The average PSNR in some fr...
A new hybrid error concealment scheme for MPEG2 video transmission
2002
For entropy-coded MPEG-2 video frames, a transmission error will not only affect the underlying codeword but also may affect subsequent codewords, resulting in a great degradation of the received video frames. In this study, transmission errors in MPEG-2 video frames are first detected and located by the error detection scheme proposed by Shyu and Leou [1999], and then the corrupted blocks are concealed by the proposed hybrid error concealment scheme. Based on the condition of a corrupted block, a corrupted block in an intracoded I frame is concealed by either the spatial error concealment algorithm in H.26L test model long-term number 9 (TML-9) or the best neighborhood matching (BNM) algorithm followed by the proposed modified spatial anisotropic diffusion (SD) algorithm. A corrupted block in an inter-coded P or B frame is concealed by the proposed motion-compensated BNM algorithm. Based on the simulation results obtained in this study, the proposed scheme can recover high-quality MPEG-2 video frames from the corresponding corrupted video frames up to a bit error rate of 0.5%.
A Novel Boundary Matching Algorithm for Video Temporal Error Concealment
International Journal of Image, Graphics and Signal Processing, 2014
With the fast growth of communication networks, the video data transmission from these networks is extremely vulnerable. Error concealment is a technique to estimate the damaged data by employing the correctly received data at the decoder. In this paper, an efficient boundary matching algorithm for estimating damaged motion vectors (MVs) is proposed. The proposed algorithm performs error concealment for each damaged macro block (MB) according to the list of identified priority of each frame. It then uses a classic boundary matching criterion or the proposed boundary matching criterion adaptively to identify matching distortion in each boundary of candidate MB. Finally, the candidate MV with minimum distortion is selected as an MV of damaged MB and the list of priorities is updated. Experimental results show that the proposed algorithm improves both objective and subjective qualities of reconstructed frames without any significant increase in computational cost. The PSNR for test sequences in some frames is increased about 4.7, 4.5, and 4.4 dB compared to the classic boundary matching, directional boundary matching, and directional temporal boundary matching algorithm, respectively.
Video temporal error concealment using improved directional boundary matching algorithm
TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES, 2016
Nowadays some systems such as multimedia systems try to present a high quality of digital videos every day. Because of the possible errors in communication channels, compressed video data would be damaged in the sending process. Error concealment is a useful technique for concealing the effects of sending errors at the decoder. In this paper, an improved directional boundary matching algorithm is presented, in which by using adjacent macroblocks (MBs) of the damaged MB a direction is identified for each boundary. Then every boundary of candidate MBs is compared to an identified direction. Finally, the candidate motion vector (MV) that has the minimum improved directional matching function is selected as the MV of the damaged MB. Furthermore, to increase the accuracy in damaged MV estimation, a specific weight is given to the boundaries of adjacent MBs. Conforming to the experimental results, the proposed algorithm not only outperforms subjective visual evaluation compared to classic boundary matching, outer boundary matching, and directional boundary matching algorithms, but also it is able to improve the objective quality of reconstructed video frames effectively.
International journal of innovative technology and exploring engineering, 2019
As the demand of video transmission over communication network has grown rapidly, the data compression and error correction in video processing have shown significant improvement day by day. When the error occurs in a single frame, the visual quality of the subsequent frames gets degraded due to error propagation. Thus, the error control techniques are required for the recovery. Concealment of error at the receiver (decoder) side feats the spatial and temporal characteristics of the frame. Without the requirement of the extra bandwidth and retransmission delay, it enhances the quality of the reconstructed video. However, the output of the error concealment may get affected if the error located before is misleading. Thus error detection also plays an important role while reconstructing the video. However, the output of the error concealment may get affected if the error located before is misleading. This paper proposes error detection and concealment approach for the recovery of lost Macro Block (MB) in video. The spatio-temporal techniques has been used for the error detection followed by the MB type decision applied for classifying the damaged macro block .For the concealment method a new method i.e. Modified Spatio-Temporal Boundary Matching Algorithm (MSTBMA) has been proposed. The proposed work is compared with various existing method for spatial and temporal error concealment. The comparison has been done for various types of error such as block error (single, multiple), burst error and random error generated by the software. Performance is improves in terms of PSNR and visual quality by considering the type of lost MB.
2013 21st Iranian Conference on Electrical Engineering (ICEE), 2013
Video transmission over wireless networks becomes a major part of multimedia studies especially after fourthgeneration communication standard has been introduced. There is a growing need to improve video visual quality, while its computational complexity should remain low. A low-complexity Error Concealment (EC) method for missing macroblock (MB) recovery is Boundary Matching Algorithm (BMA). Nevertheless, this method suffers from lack of accuracy. In this paper, we propose a novel modified BMA method by exploiting the correlation of the pixels on the edge of the missing MB. The performance of this method is explained in detail and extra experiment results are given to demonstrate its superiority over BMA method.
Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation
IEEE Transactions on Multimedia, 2008
Error concealment techniques are very important for video communication since compressed video sequences may be corrupted or lost when transmitted over error-prone networks. In this paper, we propose a novel two-stage error concealment scheme for erroneously received video sequences. In the first stage, we propose a novel spatio-temporal boundary matching algorithm (STBMA) to reconstruct the lost motion vectors (MV). A well defined cost function is introduced which exploits both spatial and temporal smoothness properties of video signals. By minimizing the cost function, the MV of each lost macroblock (MB) is recovered and the corresponding reference MB in the reference frame is obtained using this MV. In the second stage, instead of directly copying the reference MB as the final recovered pixel values, we use a novel partial differential equation (PDE) based algorithm to refine the reconstruction. We minimize, in a weighted manner, the difference between the gradient field of the reconstructed MB in current frame and that of the reference MB in the reference frame under given boundary condition. A weighting factor is used to control the regulation level according to the local blockiness degree. With this algorithm, the annoying blocking artifacts are effectively reduced while the structures of the reference MB are well preserved. Compared with the error concealment feature implemented in the H.264 reference software, our algorithm is able to achieve significantly higher PSNR as well as better visual quality.
Error detection and concealment for video transmission using information hiding
Signal Processing: Image Communication, 2008
Video transmission over noisy channels makes error concealment an indispensable job. Utilization of data hiding for this problem provides a reserve information about the content at the receiver, while unchanging the transmitted bit-stream syntax; hence, improves the reconstructed video quality with almost no extra channel utilization. A spatial domain error concealment technique, which hides edge orientation information of a block, and a resynchronization technique, which embeds bit-length of a block into other blocks are composed. The proposed method also exploits these two techniques for detecting errors via some extra parity information. Moreover, the motion vectors between consecutive frames are also embedded into the consecutive frames for better concealment at the receiver. Finally, as a novel approach, the bit-streams are further protected against errors via channel codes and the parity bits of these codes are embedded into other slices. In this manner, implicit utilization of error correction codes improves the reconstruction quality significantly. The simulation results show that the proposed approaches perform quite promising for concealing the errors in any compressed video bitstream.
An error concealment scheme for MPEG-2 coded video sequences
Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97, 1997
Abstract| The problem of errors occurring in MPEG-2 coded video sequences, caused by signal loss during transmission, is examined in this paper and an attempt is made to reconstruct the lost parts at each frame. The proposed error concealment scheme exploits reconstructed temporal information from previously decoded frames in order to conceal bitstream errors in all types of frames: I, P, or B, as long as temporal information is available. Since no such information is available for the rst frame (I-frame) of an MPEG-2 coded sequence, another concealment technique is added to the proposed scheme, which uses spatial information from neighbouring macroblocks (MBs). The simulation results compared with other methods prove to be better judging from both P SN R values and the perceived visual quality of the reconstructed sequence. Its quality ameliorates with time.