基于相关运动矢量外推的视频通信错误掩盖算法
|
摘要
针对视频通信中因数据传输错误引起的视频质量急剧下降的问题,提出一种基于相关运动矢量外推的错误掩盖算法。对于受损图像块,首先将前续图像块、前续相邻图像块映射到三维坐标系,并构造经过前续相邻图像块的一阶平面集,然后计算前续图像块与一阶平面集的距离,选取使得距离最短的一阶平面所代表的前续相邻图像块为相关最强前续相邻图像块,最后将相关最强前续相邻图像块外推到当前帧,通过外推图像块与受损图像块重叠区域加权估算受损运动矢量,并采用边界匹配算法对运动矢量进行优化,进而恢复受损图像块。仿真结果表明,对于不同视频序列,该算法同传统错误掩盖算法相比PSNR值提高了0.5～2.7dB,同时解码视频质量也获得了较好的主观视觉效果。
To overcome the dramatic degradation of video quality caused by transmission errors in video communication, a new temporal error concealment algorithm based on motion extrapolation is proposed. For a damaged image block,the preceding image block and the preceding adjacent image blocks are projected into the three-dimensional coordinate system, and the first-order planar set of the preceding adjacent image block is constructed. Then the distances between the preceding image block and the first-order planar set are calculated, and the image blocks represented by the shortest distance first-order plane are selected as the strongest preceding adjacent image blocks. Finally, the strongest correlation preceding adjacent image blocks are extrapolated to the damaged image frame and the motion vector of the damaged image block is estimated by weighting the overlap area between the extrapolated image blocks and the damaged image block, and then the damaged image block is restored. The simulation results show that for different video sequences, the PSNR value of the proposed algorithm is improved by 0.5～2.7 dB compared with the traditional temporal error concealment algorithm, and the decoded video quality also achieves better subjective visual effect.
To overcome the dramatic degradation of video quality caused by transmission errors in video communication, a new temporal error concealment algorithm based on motion extrapolation is proposed. For a damaged image block,the preceding image block and the preceding adjacent image blocks are projected into the three-dimensional coordinate system, and the first-order planar set of the preceding adjacent image block is constructed. Then the distances between the preceding image block and the first-order planar set are calculated, and the image blocks represented by the shortest distance first-order plane are selected as the strongest preceding adjacent image blocks. Finally, the strongest correlation preceding adjacent image blocks are extrapolated to the damaged image frame and the motion vector of the damaged image block is estimated by weighting the overlap area between the extrapolated image blocks and the damaged image block, and then the damaged image block is restored. The simulation results show that for different video sequences, the PSNR value of the proposed algorithm is improved by 0.5～2.7 dB compared with the traditional temporal error concealment algorithm, and the decoded video quality also achieves better subjective visual effect.
引文
[1]ANDREAS F.M.无线通信[M].北京:电子工业出版社,2015.
[2]高文,赵德斌,马思伟.数字视频编码技术基础[M].北京:科学出版社,2018.
[3]彭强,张蕾.视频传输差错掩盖技术研究现状与发展趋势[J].西南交通大学学报,2009,44(4):473-483.
[4]陈健.基于H.264的视频差错掩盖算法研究[D].成都:西南交通大学,2016:6-7.
[5]ZHENG J.H,CHAU L.P A Motion vector recovery algorithm for digital video using lagrange interpolation[J].IEEETransactions on Broadcasting,2008,49(4):383-389.
[6]姚伟新,杨丹,葛愿.H.264/AVC自适应时空域错误隐藏算法[J].计算机工程,2016,42(2):261-265.
[7]YANG S.H,CHANG C,W,CHAN C.C An Object based error concealment technique for H.264 Coded Video[J].Multimedia Tools and Applications,2015,74(23):10785-10800.
[8]RADMEHR A,GHASEMI A.Error concealment via particle filter by gaussian mixture modeling of motion vectors for H.264/AVC[J].Signal,Image and Video Processing,2016,10(2):311-318.
[9]ZHOU Z.H,DAI M,ZHAO R.Z,et al Video error concealment scheme based on tensor model[J].Multimedia Tools and Applications,2016,76(14):1-17.
[10]H.264/AVC Reference Software JM18.0.Available:http://iphome.hhi.de/suehring/tml/download.
[2]高文,赵德斌,马思伟.数字视频编码技术基础[M].北京:科学出版社,2018.
[3]彭强,张蕾.视频传输差错掩盖技术研究现状与发展趋势[J].西南交通大学学报,2009,44(4):473-483.
[4]陈健.基于H.264的视频差错掩盖算法研究[D].成都:西南交通大学,2016:6-7.
[5]ZHENG J.H,CHAU L.P A Motion vector recovery algorithm for digital video using lagrange interpolation[J].IEEETransactions on Broadcasting,2008,49(4):383-389.
[6]姚伟新,杨丹,葛愿.H.264/AVC自适应时空域错误隐藏算法[J].计算机工程,2016,42(2):261-265.
[7]YANG S.H,CHANG C,W,CHAN C.C An Object based error concealment technique for H.264 Coded Video[J].Multimedia Tools and Applications,2015,74(23):10785-10800.
[8]RADMEHR A,GHASEMI A.Error concealment via particle filter by gaussian mixture modeling of motion vectors for H.264/AVC[J].Signal,Image and Video Processing,2016,10(2):311-318.
[9]ZHOU Z.H,DAI M,ZHAO R.Z,et al Video error concealment scheme based on tensor model[J].Multimedia Tools and Applications,2016,76(14):1-17.
[10]H.264/AVC Reference Software JM18.0.Available:http://iphome.hhi.de/suehring/tml/download.