高清视频去隔行处理系统的关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着计算机技术、通讯技术以及超大规模集成电路技术的进步和相互融合,电视行业正在经历一场由模拟电视全面向数字电视转换的发展过程。由于数字电视巨大的市场潜力,作为数字电视系统核心的数字视频图像后处理芯片及相关技术的研发,成为了行业关注和竞争的焦点。对于高清晰度数字电视来说,视频后处理技术中最为重要的部分就是视频信号的去隔行处理功能,但已有的去隔行算法已经无法适应高清视频图像处理高性能、低成本的要求,因此本文针对高清数字电视应用进行了去隔行处理关键技术的深入研究。
     本文是天津市重大科技攻关计划项目“视频信号处理芯片的研发”课题的延伸,并与晶宝利公司合作进行高清数字电视后处理芯片的产品化开发。本文提出了结合电影模式处理和图像预降噪的高清视频去隔行处理系统,其主要创新点为去隔行插值、电影模式处理和隔行图像预降噪等三方面关键技术的新型算法研究。
     本文提出了基于全局统计和边缘平滑滤波的新型视频去隔行图像插值技术。该技术采用全局统计运动检测技术获取运动信息,同时结合边缘平滑滤波的场内相关性插值技术,进行高清视频图像自适应插值计算。实验结果表明,该技术的算法复杂度适当,对动态和静止图像都有较好的处理效果。
     文章提出了一种新型全格式电影模式处理技术。该技术利用逐像素的帧、场变化统计以及基于高斯分类的电影模式状态识别对电影模式源进行检测和处理。在实现方法上采用软硬件协同处理的方式,节省硬件资源占用的同时保证了处理模式的可更新性。实验结果表明,该技术可以有效识别各种电影模式序列以及影视混合图像并进行处理,图像还原结果得到有效保证。
     本文还提出了隔行图像自适应预降噪技术。该技术根据去隔行插值处理的数据结构,利用噪声的概率分布特征进行统计和分析,有针对性的采用场内滤波和场间滤波相结合的自适应降噪处理方法,有效的降低了常见高斯噪声和椒盐噪声的影响,提升了图像质量。
     最后,论文给出了高清视频去隔行处理系统的芯片架构和功能模块设计,并且定义了模块间的时序关系。仿真测试结果显示本系统设计满足高清视频处理时序要求,整体系统资源占用适当,适合于高清数字电视视频后处理芯片的实时应用。
As the rapidly growth and combination of computer science, communicating and VLSI technology, TV industry is experiencing the thorough change from analog TV broadcasting system to DTV system. The research and development of digital video image post-processing IC and algorithm, which is the kernel of DTV system, became the main competition field of the huge future market. The most important function of high definition (HD) TV post-processing is the de-interlace processing of interlaced signal. Because the high performance and low cost of HD video can’t be acquired by current de-interlacing method, this dissertation mainly focuses on the deeply research of de-interlacing key technique for HDTV application.
     This thesis is an expansion of the project“Research and Development of Video Signal Processing Chip”which is supported by Tianjin key technologies R&D Program and the product development is cooperated with PowerLayer Microsystems (Beijing) Ltd. This dissertation introduces HD video de-interlace processing system with film mode processing and image pre-denoising. The creative points of this dissertation are three key techniques, included: de-interlacing interpolation, film mode processing and image pre-denoising.
     A novel HD video image de-interlacing interpolation technique which is based on global statistic processing and edge smooth filtering is proposed. In this technique, the exactly motion information is calculated by motion detection with global statistic. The relativity directional filtering with edge smooth is adopted by intra-field interpolation. The compute complexity of this HD video adaptive technique is advisable and the high quality results are achieved from both of motive and stationary object.
     New technique of film mode processing for all film cadences is proposed. The pixel level frame/field difference statistic is used by film mode detection based on gaussian classifier. The design of cooperation with software calculation and hardware operation saves the hardware resource and provides the update ability of the unknown cadences. As the result, all the existing film cadences and Video-on-Film (VoF) cases are correctly detected and processed.
     An interlaced signal adaptive pre-denoising technique is proposed. In this technique, the noise probability statistical characteristic is acquired and analyzed in terms of the data structure of interlaced image. The pixel is selective processed by intra-field filtering and inter-field filtering. This adaptive processing effectively reduced the Gaussian noise and Salt-Pepper noise and improved the video image quality.
     At last this dissertation provides the VLSI architecture of HD video de-interlace processing system and hardware design of functional module and interfaces. The simulation reports show that the HD video timing requirement is satisfied and hardware resource usage of the whole system is reasonable. This system is suitable for real-time application of HDTV post-processing IC.
引文
[1]俞斯乐,电视原理,北京:国防工业出版社,2005。
    [2]余兆明主编,数字电视和高清晰度电视,北京:人民邮电出版社,1997。
    [3] Video Electronics Standards Association, Monitor Timing Specifications, VESA and Industry Standards and Guidelines for Computer Display Monitor Timing Version 1.0, Revision 0.8, Adoption Date: September17, 1998.
    [4] Recommendation ITU-R BT.709-5, Parameter values for the HDTV standards for production and international programme exchange, 2002.
    [5] SMPTE 274M, Television - 1920×1080 Image Sample Structure, Digital Representation and Digital Timing Reference Sequences for Multiple Picture Rates, 2003.
    [6] Recommendation ITU-R BT.601-6, Studio encoding parameters of digital television for standard 4:3 and wide-screen 16:9 aspect ratios, 2007.
    [7]李雄杰,平板电视技术,北京:电子工业出版社,2007年。
    [8]卢官明,宗昉,IPTV技术及应用,北京:人民邮电出版社,2007年。
    [9] B. Zhang, Global TFT LCD Panel and Driver IC Outlook, DisplaySearch, May. 2007.
    [10] Kenny Kim, 2007 FPD Market Outlook, Diaplaybank, 2007.
    [11] Keith Jack, Video Demystified, Englewood Cliffs, Elsevier Inc, 2005.
    [12] E. B. Bellers and G. de Haan, De-Interlacing: A Key Technology for Scan Rate Conversion. Amsterdam, TheNetherlands: Elsevier, 2000.
    [13] G. deHaan, Video Processing for Multimedia Systems. Eindhoven, the Netherlands: University Press, 2000, ch. 5.
    [14] Chulhee Lee, M. Eden and M.Unser, High-quality image resizing using oblique projection operators, IEEE Trans. Image Processing, vol.7, no.5, May 1998. pp. 679 - 692.
    [15] Byung-Tae Choi, Sung-Hee Lee and Sung-Jea Ko, New frame rate up-conversion using bi-directional motion estimation, IEEE Trans. Consumer Electron. vol. 46, no. 3, Jun.2000, pp. 603-609.
    [16] W.Wu, M.J.Wang and C.Liu, Performace Evaluation of Some Noise Reduction Methods, CVGIP: Graphical models and image processing. vol.54, no.2, Mar.1992, pp.134-146.
    [17] H.J. Choi, S.W. Park, G.S. Jang and et.al, Color Transient Improvement, Digest of Technical Papers. International Conf. Consumer Electronics, June 2000.
    [18] C.Hentschel and D.La Hei, Effective peaking filter and its implementation on a programmable architecture, IEEE Trans on Consumer Electronics, vol 47, no.1, Feb. 2001, pp:33-39.
    [19] T.L. Ji, M.K.Sundareshan and H.Roehrig, Adaptive image contrast enhancement based on human visual properties, IEEE Trans. Medical Imaging, vol.13, no. 4, Dec. 1994, pp.573– 586.
    [20] L.Boroczyky,; J.G.W.M. Janssen, Sharpness enhancement for MPEG-2 encoded/ transcoded video sources, Proc. International Conf. Image Processing vol. 2, 2001, pp:407 - 410.
    [21] F. Naccari, S. Battiato, Bruna, A.and et.al, Natural scenes classification for color enhancement, IEEE Trans. Consumer Electronics, vol.51, no.1, Feb. 2005, pp: 234– 239.
    [22] D.R.Tarrant, A new teletext decoder with advanced OSD features for wide screen TV, IEEE Trans. Consumer Electronics, vol.39, no.3, Aug. 1993, pp: 166-174.
    [23] E.W. Engstrom, A study of Television Image Characteristics. Part Two. Determination of Frame Frequency for Television in terms of Flicker Characteristics, Proc. of the I.R.E., vol. 23, no.4, 1935, pp. 295-310.
    [24] Yao Wang, J. Ostermann and Y.Q. Zhang, Video Processing and Communications. Pearson Education, 2003, ch.1.
    [25] A.V. Oppenheim, A.S.Willsky and S.H. Nawab,信号与系统,第二版(刘树棠译),西安:西安交通大学出版社,2002。
    [26] A.V.Oppenheim, R.W.Schafer and J.R.Buck,离散时间信号处理,第二版(刘树棠译),西安:西安交通大学出版社,2001。
    [27] Microsoft, Broadcast-Enabled Computer Hard-ware Requirements, WinHEC'97, Broadcast Techologies White Paper, 1997, pp. 11-12.
    [28] N. Seth-Smith and G. Walker, Flexible Upconversion for High Quality TV and Multimedia Displays, Proc. of the ICCE, Chicago, Jun. 1996, pp.338-339.
    [29] M. Achiha, K. Ishikura and T. Fukinuki, A Motion-Adaptive High-Definition Converter for NTSC Color TV Signals, SMPTE Journal, vol.93, no. 5, May 1984, pp. 470-476.
    [30] R.S. Prodan, Multidimensional Digital Signal Processing for Television Scan Conversion, Philips J. of Research, vol. 41, no. 6, 1986, pp. 576-603.
    [31] A.M. Bock, Motion-Adaptive Standards Conversion between Formats of Similar Field Rates, Signal Processing: Image Communication, vol. 6, no.3, Jun. 1994, pp. 275-280.
    [32] P.D. Filliman, T.J. Christopher and R.T. Keen, Interlace to progressive scan converter for IDTV, IEEE Trans. Consumer Electronics, vol. 38, no. 3, Aug.1992, pp. 135-144.
    [33] B. Martins and S. Forchhammer, A unified approach to restoration, deinterlacing and resolution enhancement in decoding MPEG-2 video, IEEE Trans. Circuits and Systems for Video Technology, vol. 12, no. 9, Sep. 2002, pp. 803–811.
    [34] S.G. Lee and D.H. Lee, A motion-adaptive de-interlacing method using an efficient spatial and temporal interpolation, IEEE Trans. Consumer Electronics, vol. 49, no.4, Nov. 2003, pp. 1266-1271.
    [35] C. Hentschel, Television with increased image quallity; Flicker reduction through an increased picture rate in the receiver, Ph.D. thesis, Institute fur Nachrichtentechnik, Tech. Univ. Braunschweig,Germany, Feb. 1990.
    [36] T. Doyle and M. Looymans, Progressive Scan Conversion using Edge Information, in Signal Processing of HDTV, II, L. Chiariglione, Ed., Elsevier Science Publishers, 1990, pp. 711-721.
    [37] M. Lee, J. Kim, J. Lee, K. Ryu and et.al, A new algorithm for interlaced to progressive scan conversion based on directional correlations and its IC design, IEEE Trans. Consumer Electronics, vol. 40, no. 2, May 1994, pp. 119-129.
    [38] J. Salonen and S. Kalli, Edge Adaptive Interpolation for Scanning Rate Conversion, in Signal Processing of HDTV, IV, E. Dubois and L. Chiariglione, Eds., Elsevier Science Publishers, 1993, pp. 757-764.
    [39] G. de Haan and E.B. Bellers, De-interlacing - an overview, Proceeding of the IEEE, vol.86, no. 9, Sep. 1998, pp. 1839-1857.
    [40] G. de Haan and R. Lodder, De-interlacing of video data using motion vectors and edge information, Digest of the ICCE'02, Jun. 2002, pp.70-71.
    [41] Campbell and J. Jack,“Adaptive diagonal interpolation for image resolution enhancement”, US-patent, no.6133957, Oct.2000, Faroudja Laboratories, Inc.
    [42] C. Hentschel, Comparison between median filtering and vertical edge controlled interpolation for flicker reduction, IEEE Trans. Consumer Electronics, vol. 35, no. 3, Aug.1989, pp.279-289.
    [43] M.J.J.C. Annegarn, T. Doyle, P.H. Frencken and et.al, Video signal processing circuit for processing an interlaced video signal, European Patent Application no. EP-A 0192292, 1988.
    [44] H. Hwang, M.H. Lee and D.I. Song, `Interlaced to progressive scan conversion with double smoothing', IEEE Trans. Consumer Electronics, vol. 39, no. 3, Aug. 1993, pp. 241-246.
    [45] A. Lethonen and M. Renfors, Non-linear Quincunx Interpolation Filtering, Proc. Vis. Comm.and Im. Proc. '90, Lausanne, Oct. 1990, pp. 135-142.
    [46] J. Salo, Y. Nuevo and V. Hameenaho, Improving TV Picture Quality with Linear-median Type operations, IEEE Trans. Consumer Electronics, vol. 34, no.3, Aug. 1988, pp. 373-379.
    [47] P. Haavisto, J. Juhola, and Y. Neuvo, Scan rate up-conversion using adaptive weighted median filtering, in Signal Processing of HDTV, II, L. Chiariglione, Ed., Elsevier Science Publishers, 1990, pp. 703-710.
    [48] R. Simonetti, S. Carrato, G. Ramponi and et.al, 'Deinterlacing of HDTV Images for Multimedia Applications, in Signal Processing of HDTV, IV, E. Dubois and L. Chiariglione, Eds., Elsevier Science Publishers, 1993, pp. 765-772.
    [49] Y. Kim and Y. Cho, Motion Adaptive Deinterlacing Algorithm Based on Wide Vector Correlations and Edge Dependent Motion Switching, Proc. of HDTV Workshop '95, 1995, pp. 8B9 - 8B16.
    [50] S.F. Lin, Y.L. Chang and L.G. Chen, Motion adaptive de-interlacing by horizontal motion detection and enhanced ELA processing, Proc. 2003 IEEE Int. Symp. Circuits and Systems, vol.2, May 2003, pp. 696–699.
    [51] L.J. Yu, J.T. Li, Y.D. Zhang and et.al, Motion Adaptive Deinterlacing with Accurate Motion Detection and Anti-Aliasing Interpolation Filter, IEEE Trans. Consumer Electronics, vol. 52, no. 2, May 2006, pp.712-717.
    [52] W. Bruls, A. van der Werf, R. Kleihorst and et.al, A single chip MPEG-2 encoder for consumer storage applications, Digest of the ICCE, Chicago, 1997, pp.262-263.
    [53] Iain Richardson, H.264 and MPEG-4 Video Compression, Wiley, 2003.
    [54] G. de Haan, J. Kettenis and B. De Loore, IC for motion-compensated 100 Hz TV with natural-motion movie-mode, IEEE Trans. Consumer Electronics, vol.42, no.2, May 1996, pp. 165-174.
    [55] D. Bagni, G. de Haan and V. Riva, Motion compensated post-processing for low bit rate video-conferencing on ISDN lines, IEEE Trans. Consumer Electronics. June. 1997, pp.28-29.
    [56] F.Dufaux, F. Moscherti, Motion Estimation Techniques for Digital TV: A Review and a New Contribution, Proceedings of IEEE, vol.83, no.6, June 1995, pp.858-875.
    [57] P.Anandan, J.R.Bergen, K.J.Hanna and et.al, Hierarchical model-based motion estimation, in Motion Analysis and Image Sequence Processing, 1993.
    [58] H. David and V.Jacques, Bayesian motion estimation and interpolation in interlaced video sequences, IEEE Trans. Image Processing, vol.6, no.5, 1997, pp.764-769.
    [59] S. Geman and D. Geman, Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images, IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 6, Nov. 1984, pp. 721-741.
    [60] J. L. Marroquin, E. Arce, and S. Botello, Markov random measure fields for image analysis, in Proc. IEEE Int. Conf. Image Processing, vol.1, 2002, pp.765–768.
    [61] Min Li and Truong Nguyen, A De-Interlacing Algorithm Using Markov Random Field Model, IEEE Trans. Image Processing, vol. 16, no. 11, Nov. 2007, pp.2633-2648.
    [62] G. de Haan, Progress in Motion Estimation for Consumer Video Format Conversion, IEEE Trans. Consumer Elecrtonics, vol.46, no.3, August 2000, pp.449-459.
    [63] R. Li, B. Zeng and M. L. Liou, A new three-step search algorithm for block motion estimation, IEEE Trans. CSVT, vo1.4, no.4, Aug.1994, pp.438-442.
    [64] S. Zhu and K.K. Ma, A new diamond search algorithm for fast block-matching motion estimation, IEEE Trans. Image Processing, vol.9, no.2, Feb. 2000, pp.287-290.
    [65] J.W. Woods and Soo-Chul Han, Hierarchical Motion Compensated De-interlacing, Proc. of the SPIE, vol. 1605, 1991, pp. 805-810.
    [66] F.M. Wang, D. Anastassiou, and A.N. Netravali, Time-Recursive Deinterlacing for IDTV and Pyramid Coding, Signal processing: Image Communications 2, Elsevier, 1990, pp.365-374.
    [67] G. de Haan and P.W.A.C. Biezen, Time-recursive de-interlacing for high-quality television receivers, Proc. of Int. Workshop on HDTV'95, Nov.1995, pp. 8825-8833.
    [68] J.L. Yen, On Non-uniform Sampling of Bandwidth-Limited Signals, IRE Tr. on Circ.Th., vol. CT-3, Dec. 1956, pp. 251-257.
    [69] P. Delogne, L. Cuvelier, B. Maison and et.al, Improved Interpolation, Motion Estimation and Compensation for Interlaced Pictures, IEEE Trans. Image Processing, vol. 3, no. 5, Sep. 1994, pp. 482-491.
    [70] E.B. Bellers and G. de Haan, Advanced de-interlacing techniques, Proc. of the Pro RISC/IEEE Workshop on Circ., Syst. and Sig. Proc., Nov. 27-28, 1996, pp. 7-17.
    [71] A. Nguyen and E. Dubois, Spatio-temporal adaptive interlaced-to-progressive conversion, in Signal Processing of HDTV, IV, E. Dubois and L.Chiariglione, Eds., Elsevier Science Publishers, 1993, pp. 749-756.
    [72] J. Kovacevic, R.J. Safranek and E.M. Yeh, Deinterlacing by Successive Approximation, IEEE Trans. Image Processing, vol.6, no.2, Feb.1997, pp. 339-344.
    [73] J.S. Kwon, K. Seo, J. Kim and et.al, A Motion-Adaptive De-interlacing Method, IEEE Trans. Consumer Electronics, vol. 38, no. 3, Aug. 1992, pp. 145-150.
    [74] Y. L. Chang, S. F. Lin, C. Y. Chen and et.al, Video de-interlacing by adaptive 4-field global/local motion compensated approach, IEEE Trans. Circuits and Systems for Video Technology, vol. 15, no. 12, Dec.2005, pp.1569-1582.
    [75] A. Eskicioglu and P. Fisher, A survey of quality measures for gray scale image compression, Proceedings of the Space and Earth Science Data Compression Workshop, Apr. 1993, Snowbird, pp.49-61.
    [76] C J. van den Branden Lambrecht and O. Verscheure, Perceptual Quality Measure using a Spatio-Temporal Model of the Human Visual System, Proceedings of the SPIE, vol. 2668, Jan. 1996, pp. 450-461.
    [77] D. Munsil and B. Florian. DVD Benchmark, part 5 - progressive scan DVD, 2005, Internet Article. URL: http://www.hometheaterhifi.com.
    [78] Silicon Optix, HQV Benchmark Version 1.4. Internet Article. URL: http:// www.hqv.com.
    [79] R. J. Schutten and G. de Haan, Real-time 2-3 pull-down elimination applying motion estimation/compensation in a programmable device, IEEE Trans. Consumer Electron. vol. 44, no. 3, pp. 930-938, Aug.1998.
    [80] S. F. Lin, Y. L. Chang, and L. G. Chen, Motion adaptive interpolation with horizontal motion detection for de-interlacing, IEEE Trans. Consumer Electronics, vol. 49, No. 4, pp. 1256-1265, Nov. 2003.
    [81] Swartz and D.Peter, Film source video detection, US-patent, no: 6580463, Feb.2001, Faroudja Laboratories, Inc.
    [82] R. 0. Duda, P. E. Hart and D. G. Stork, Pattern Classification, second Edition. NY: John Wiley and Sons Inc., 2001.
    [83] R.C. Gonzalez and R.E. Woods, "Digital Image Processing", Second Edition. Pearson Education, 2003, ch.5, ch.10.
    [84] Olukayode A .Ojo and Tatiana G. Kwaaitaal-Spassova, An algorithm for integrated noise reduction and sharpness enhancement, IEEE Trans. Consumer Electronics, vol.46, no.3, August 2000.
    [85] Yuli You, D. Kaveh, Fourth-order partial diferential equations for noise removal, IEEE Trans. Image Processing, 2000, pp.1723-1730.
    [86] J.Brailean, R.Kleihorst, S. Efstratiadis and et.al, Noise Reduction Filters for Dynamic Image Sequence: A Review, Proceedings of the IEEE, vol.83, no.9, Sept.1995, pp.1272-1292.
    [87] G. de Haan, TG. Kwaaitaal-Spassova, M.M.Larragy and et.al, Single-chip TV noise reduction, Digest of Technical Papers of ICCE, 1995, pp.390-391.
    [88] A. Bosco and M. Mancuso, Adaptive Filtering For Image Denoising, IEEE Proceedings of ICCE 2001, June. 2001, pp.208-209.
    [89] Andrew F Laine, Xuli Zong. A multiscal sub-octave wavelet transform for de-noising and enhancement, Proceedings of SPIE: Wavelet applications. Orlando, FL. April 8-12, 1996.
    [90] Chien, Shao-Yi Chen and Tse-Wei, Motion Adaptive Spatio-Temporal Gaussian Noise Reduction Filter for Double-Shot Images, IEEE International Conference on Multimedia and Expo, July.2007, pp.1659-1662.
    [91] G. de Haan, TG Kwaaitaal-Spassova and O.A.Ojo, Automatic 2-D and 3-D noise filtering for television receivers, Proc. Int. Workshop on HDTV' 94, Oct.1994.
    [92] A.Murat Tekalp, Digital Video Processing, Prentice Hall/Pearson, 1998.
    [93] Recommendation ITU-R BT.656-4* Interfaces for digital component video signals in 525-line and 625-line television systems operating at the 4:2:2 level of Recommendation ITU-R BT.601, 1998.
    [94] Clifford E. Cummings, Simulation and Synthesis Techniques for Asynchronous FIFO Design, Sunburst Design, Inc., 2002.
    [95] Michael D. Ciletti, Advanced Digital Design with the Verilog HDL, Prentice Hall, 2002.
    [96] J.Bhasker, Verilog HDL Synthesis, A Practical Primer, Star Galaxy Pub, 1998.
    [97] Himanshu Bhatnagar, Advanced ASIC Chip Synthesis, second edition, Kluwer Academic Publishers, 2002.
    [98] Xilinx ISE 8 Software Manuals, Xilinx Inc., 2006.
    [99] ModelSim SE User’s manual, ver. 6.1f, Mentor Graphics Corp., 2006.
    [100]王诚,薛小刚,钟信潮,FPGA/CPLD设计工具:Xilinx ISE使用详解,北京:人民邮电出版社,2005年。
    [101] Virtex-4 User Guide, Xilinx Inc., 2007.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700