结合成像几何特征的立体元图像阵列编码
|
摘要
为了解决集成成像系统中立体元图像阵列存储和传输的问题,本文提出了一种结合成像几何特征的立体元图像阵列编解码算法。首先,根据立体元图像阵列采集过程中的相关物理参数确定不同立体元图像中同名像点的偏移量,对立体元图像阵列中每行相邻立体元图像进行分组并确定编码顺序。然后,确定待编码立体元图像的预测图并计算待编码立体元图像与其预测图的残差。最后,对残差进行HEVC编码。实验结果表明,与传统的HEVC帧内预测编码算法,以及与将立体元图像阵列中的所有立体元图像组成一个视频序列进行HEVC编码的算法相比,在相同比特率的情况下,本算法解码图像的质量提高了10~25dB,说明本文提出的算法具有更高效的编码性能。
To solve the problems of storage and transmission of elemental image arrays in the integrated imaging system,an elemental image array coding and decoding algorithm that combines imaging geometry features was proposed.First,the offset of the corresponding image points in different elemental images were determined according to relevant physical parameters in the process of collecting the elemental image arrays.In addition,adjacent elemental images of each row in the element image arrays were grouped,and their coding sequences were determined.Then,the prediction image of the elemental image to be encoded was determined,and the residual between the elemental image and its prediction map was calculated.Finally,the residual was coded using High Efficiency Video Coding(HEVC).The traditional HEVC intra-frame prediction coding algorithm,which was formed by all elemental images in the elemental image array,was compared with the proposed HEVC coding algorithm.The experimental results show that the quality of decoded images using the proposed algorithm improved from 10 dB to25 dB under the same bit rate,demonstrating the efficient coding performance of the proposed algorithm.
To solve the problems of storage and transmission of elemental image arrays in the integrated imaging system,an elemental image array coding and decoding algorithm that combines imaging geometry features was proposed.First,the offset of the corresponding image points in different elemental images were determined according to relevant physical parameters in the process of collecting the elemental image arrays.In addition,adjacent elemental images of each row in the element image arrays were grouped,and their coding sequences were determined.Then,the prediction image of the elemental image to be encoded was determined,and the residual between the elemental image and its prediction map was calculated.Finally,the residual was coded using High Efficiency Video Coding(HEVC).The traditional HEVC intra-frame prediction coding algorithm,which was formed by all elemental images in the elemental image array,was compared with the proposed HEVC coding algorithm.The experimental results show that the quality of decoded images using the proposed algorithm improved from 10 dB to25 dB under the same bit rate,demonstrating the efficient coding performance of the proposed algorithm.
引文
[1]范钧,吴非,吕国皎,等.基于可变孔径针孔阵列的集成成像3D显示[J].红外与激光工程,2018,47(6):38-41.FAN J,WU F,LU G J,et al..Integrated imaging3Ddisplay based on variable aperture pinhole array[J].Infrared and Laser Engineering,2018,47(06):38.(in Chinese)
[2]赵敏,熊召龙,邢妍,等.采用双目立体相机的实时集成成像拍摄系统[J].红外与激光工程,2017,46(11):54-58.ZHAO M,XIONG ZH L,XING Y,et al..Realtime integrated imaging imaging system using binocular stereo camera[J].Infrared and Laser Engineering,2017,46(11):54-58.(in Chinese)
[3]蒋晓瑜,高慧,严志强,等.集成成像三维显示系统的研究进展及优化方法[J].光学与光电技术,2017,15(5):67-74.JIANG X Y,GAO H,YAN ZH Q,et al..Research progress and optimization methods of integrated imaging 3Ddisplay system[J].Optics and Optoelectronics,2017,15(5):67-74.(in Chinese)
[4]焦小雪,赵星,杨勇,等.基于三维集成成像相机阵列获取的元素图像校正[J].中国激光,2012,39(3):208-214.JIAO X X,ZHAO X,YANG Y,et al..Elemental image correction based on three-dimensional integrated imaging camera array[J].Chinese Journal of Lasers,2012,39(3):208-214.(in Chinese)
[5]吕源治,王世刚,金福寿,等.立体元图像阵列的分布式预测编码[J].哈尔滨工业大学学报,2012,44(11):87-91+95.LV Y Z,WANG S G,JIN F S,et al..Distributed predictive coding of three-dimensional elemental image arrays[J].Journal of Harbin Institute of Technology,2012,44(11):87-91+95.(in Chinese)
[6] JIANG X,PENDU M L,GUILLEMOT C.Light field compression using depth image based view synthesis[C].IEEE International Conference on Multimedia&Expo Workshops.IEEE Computer Society,2017:19-24.
[7]MEHANNA A,AGGOUN A,ABDULFATANH O,et al..Adaptive 3D-DCT based compression algorithms for integral images[C].IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.IEEE,2013:1-5.
[8] ADEDOYIN S,FERNANDO W A C,AGGOUN A.A joint motion&disparity motion estimation technique for 3Dintegral video compression using evolutionary strategy[J].IEEE Transactions on Consumer Electronics,2007,53(2):732-739.
[9] MONTEIRO R,LUCAS L,CONTI C,et al..Light field HEVC-based image coding using locally linear embedding and self-similarity compensated prediction[C].IEEE International Conference on Multimedia&Expo Workshops.IEEE Computer Society,2016:1-4.
[10] LIU D,AN P,YANG C,et al..Coding of 3Dholoscopic image by using spatial correlation of rendered view images[C].IEEE International Conference on Acoustics,Speech and Signal Processing.IEEE,2017:2002-2006.
[11] YAN P,XIAN Y Y.Integral image compression based on optical characteristic[J].IET Computer Vision,2011,5(3):164.
[12]袁小聪,徐于萍,杨勇,等.基于相机阵列获取元素图像的集成成像抗串扰参数设计[J].光学精密工程,2011,19(9):2050-2056.YUAN X C,XU Y P,YANG Y,et al..Integrated imaging anti-crosstalk parameter design based on camera array acquisition of elemental images[J].Opt.Precision Eng.,2011,19(9):2050-2056.(in Chinese)
[13]徐于萍.集成成像中基于同名像点变换的三维重构方法的研究[D].天津:南开大学,2012.XU Y P.Research on three-dimensional reconstruction method based on image transformation with the same name in integrated imaging[D].Tianjin:Nankai University,2012.(in Chinese)
[14]武奕楠,李国宁,张柯,等.基于同名点追踪的空间相机成像拼接配准模型[J].红外与激光工程,2016,45(03):288-294.WU Y N,LI G N,ZHANG K,et al..Space camera imaging stitching registration model based on point tracking of same name[J].Infrared and Laser Engineering,2016,45(3):288-294.(in Chinese)
[15] LAINEMA J,HANNUKSELA M M,VADAKITAL V K M,et al..HEVC still image coding and high efficiency image file format[C].IEEE International Conference on Image Processing.IEEE,2016:71-75.
[16]朱秀昌,李欣,陈杰.新一代视频编码标准——HEVC[J].南京邮电大学学报(自然科学版),2013,33(03):1-11.ZHU X C,LI X,CHEN J.A new generation of video coding standard——HEVC[J].Journal of Nanjing University of Posts and Telecommunications(Natural Sciences Edition),2013,33(03):1-11.(in Chinese)
[17] CHEN J,HOU J,CHAU L P.Light field compression with disparity-guided sparse coding based on structural key views[J].IEEE Transactions on Image Processing,2018,27(1):314-324.
[18] YANG W,PI Y.A low-complexity intra prediction mode selection algorithm in HEVC[C].IEEE,Intl Conf on Dependable,Autonomic and Secure Computing,Intl Conf on Pervasive Intelligence and Computing,Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress.IEEE,2016:598-603.
[2]赵敏,熊召龙,邢妍,等.采用双目立体相机的实时集成成像拍摄系统[J].红外与激光工程,2017,46(11):54-58.ZHAO M,XIONG ZH L,XING Y,et al..Realtime integrated imaging imaging system using binocular stereo camera[J].Infrared and Laser Engineering,2017,46(11):54-58.(in Chinese)
[3]蒋晓瑜,高慧,严志强,等.集成成像三维显示系统的研究进展及优化方法[J].光学与光电技术,2017,15(5):67-74.JIANG X Y,GAO H,YAN ZH Q,et al..Research progress and optimization methods of integrated imaging 3Ddisplay system[J].Optics and Optoelectronics,2017,15(5):67-74.(in Chinese)
[4]焦小雪,赵星,杨勇,等.基于三维集成成像相机阵列获取的元素图像校正[J].中国激光,2012,39(3):208-214.JIAO X X,ZHAO X,YANG Y,et al..Elemental image correction based on three-dimensional integrated imaging camera array[J].Chinese Journal of Lasers,2012,39(3):208-214.(in Chinese)
[5]吕源治,王世刚,金福寿,等.立体元图像阵列的分布式预测编码[J].哈尔滨工业大学学报,2012,44(11):87-91+95.LV Y Z,WANG S G,JIN F S,et al..Distributed predictive coding of three-dimensional elemental image arrays[J].Journal of Harbin Institute of Technology,2012,44(11):87-91+95.(in Chinese)
[6] JIANG X,PENDU M L,GUILLEMOT C.Light field compression using depth image based view synthesis[C].IEEE International Conference on Multimedia&Expo Workshops.IEEE Computer Society,2017:19-24.
[7]MEHANNA A,AGGOUN A,ABDULFATANH O,et al..Adaptive 3D-DCT based compression algorithms for integral images[C].IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.IEEE,2013:1-5.
[8] ADEDOYIN S,FERNANDO W A C,AGGOUN A.A joint motion&disparity motion estimation technique for 3Dintegral video compression using evolutionary strategy[J].IEEE Transactions on Consumer Electronics,2007,53(2):732-739.
[9] MONTEIRO R,LUCAS L,CONTI C,et al..Light field HEVC-based image coding using locally linear embedding and self-similarity compensated prediction[C].IEEE International Conference on Multimedia&Expo Workshops.IEEE Computer Society,2016:1-4.
[10] LIU D,AN P,YANG C,et al..Coding of 3Dholoscopic image by using spatial correlation of rendered view images[C].IEEE International Conference on Acoustics,Speech and Signal Processing.IEEE,2017:2002-2006.
[11] YAN P,XIAN Y Y.Integral image compression based on optical characteristic[J].IET Computer Vision,2011,5(3):164.
[12]袁小聪,徐于萍,杨勇,等.基于相机阵列获取元素图像的集成成像抗串扰参数设计[J].光学精密工程,2011,19(9):2050-2056.YUAN X C,XU Y P,YANG Y,et al..Integrated imaging anti-crosstalk parameter design based on camera array acquisition of elemental images[J].Opt.Precision Eng.,2011,19(9):2050-2056.(in Chinese)
[13]徐于萍.集成成像中基于同名像点变换的三维重构方法的研究[D].天津:南开大学,2012.XU Y P.Research on three-dimensional reconstruction method based on image transformation with the same name in integrated imaging[D].Tianjin:Nankai University,2012.(in Chinese)
[14]武奕楠,李国宁,张柯,等.基于同名点追踪的空间相机成像拼接配准模型[J].红外与激光工程,2016,45(03):288-294.WU Y N,LI G N,ZHANG K,et al..Space camera imaging stitching registration model based on point tracking of same name[J].Infrared and Laser Engineering,2016,45(3):288-294.(in Chinese)
[15] LAINEMA J,HANNUKSELA M M,VADAKITAL V K M,et al..HEVC still image coding and high efficiency image file format[C].IEEE International Conference on Image Processing.IEEE,2016:71-75.
[16]朱秀昌,李欣,陈杰.新一代视频编码标准——HEVC[J].南京邮电大学学报(自然科学版),2013,33(03):1-11.ZHU X C,LI X,CHEN J.A new generation of video coding standard——HEVC[J].Journal of Nanjing University of Posts and Telecommunications(Natural Sciences Edition),2013,33(03):1-11.(in Chinese)
[17] CHEN J,HOU J,CHAU L P.Light field compression with disparity-guided sparse coding based on structural key views[J].IEEE Transactions on Image Processing,2018,27(1):314-324.
[18] YANG W,PI Y.A low-complexity intra prediction mode selection algorithm in HEVC[C].IEEE,Intl Conf on Dependable,Autonomic and Secure Computing,Intl Conf on Pervasive Intelligence and Computing,Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress.IEEE,2016:598-603.