数字灯投影拼接系统的研究及应用
|
摘要
无缝拼接系统是对多媒体进行大范围、高分辨率显示的一种有效实现方式。它所带来的超大画面、多屏显示以及清晰逼真的显示效果使得监控、安防、会议、模拟仿真等领域的工作效率得到大幅改善,同时促进了这些行业技术水平的快速进步。国外已有无缝拼接的产品面世,但为了保证技术的保密性,对于开发商所采用的融合函数以及相关处理的报道极少。
针对现有简单的线性函数不便于实时调整参数,本文首先修正现有简单的线性函数关系,引入非线性的融合函数,即通过附加参数p、a修正现有的边缘融合算法并用Gamma算子对亮度像素做进一步校正。针对边缘融合处理所产生的光带效应,本文在进行边缘融合的处理过程中,对重叠像素做淡入淡出处理,将子图中位于边缘重叠区的每个像素都乘以融合函数,从而使得当它被叠加到另一幅字图像中、与其相对应的像素叠加的时候,能得到期望的像素值。鉴于像素信号和亮度之间还应满足Gamma关系,故在处理过程中进行了Gamma校正的设计。并考虑到在投影过程不同投影仪会造成的颜色失真问题,
本文还对颜色/亮度输出匹配做了一定的处理。同时,考虑到投影机投影到特殊的投影屏幕时所引起了几何失真,本文还引入了几何校正技术,用于解决图像几何失真情况。
最后,本文利用所开发数字灯投影拼接系统对多种类型的图像进行模拟测试,将图像质量与传统的算法进行一定的比对,采用多种评价指标,比如像素扭曲度指标、空间连续度指标以及信噪比作为客观评价函数,基于多个角度对不同参数的边缘融合效果进行评价和比对,验证了数字灯投影拼接系统的有效性和实用性。并依据边缘融合概念以及几何校正技术设计了一个可实现软边无缝拼接的数字灯投影系统。
Seamless system for a wide range of multimedia, high-resolution display of an effective implementation. It brings the large screen, more vivid screen display and clear display makes monitoring, security, conference, simulation and other fields have greatly improved work efficiency, while promoting the rapid progress of industry technical standards. Seamless products abroad have been available, but in order to ensure the confidentiality of technology for the integration of functions used by developers and the related reports of minimal processing.
Simple linear function for the current time is not easy to adjust the parameters, this paper amend existing simple linear function, the integration of the introduction of non-linear function, namely, by additional parameters, to amend the existing edge of fusion algorithm with Gamma Operators further correction of the pixel brightness. Against the edge of the light generated by fusion band effect, the edge during this integration process, the pairs of overlapping pixels do fade processing at the edge of the graph in the overlapping area of each pixel is multiplied by the integration of functions, allowing as It is also a word superimposed image, superimposed with the corresponding pixel when the pixel value can be expected.
View of the pixel brightness signal and the relationship between the Gamma should meet, it was in the process design of Gamma Correction. Taking into account the different projectors in the projection process will cause the color distortion problem, the effect of color / brightness output matching to do some processing. At the same time, taking into account the special projectors to the projection screen projection arising from the geometric distortion, the paper also introduces the geometric correction techniques for solving geometric distortion.
Finally, this paper developed by the digital light projection system on various types of mosaic image simulation test, the image quality and the traditional method for some of the comparison, Cai Yong multiple evaluation indexes, such as pixel Niuqu degree index, spatial index continuous degree Yi Ji signal to noise ratio as an objective evaluation function, based on various perspectives on the edge of fusion effect of different parameters to evaluate and to verify the validity of the digital lighting projection splicing system is effective and practical. This article based on the concept of edge integration and geometric correction technology designed to achieve a seamless soft-edge digital light projection system.
针对现有简单的线性函数不便于实时调整参数,本文首先修正现有简单的线性函数关系,引入非线性的融合函数,即通过附加参数p、a修正现有的边缘融合算法并用Gamma算子对亮度像素做进一步校正。针对边缘融合处理所产生的光带效应,本文在进行边缘融合的处理过程中,对重叠像素做淡入淡出处理,将子图中位于边缘重叠区的每个像素都乘以融合函数,从而使得当它被叠加到另一幅字图像中、与其相对应的像素叠加的时候,能得到期望的像素值。鉴于像素信号和亮度之间还应满足Gamma关系,故在处理过程中进行了Gamma校正的设计。并考虑到在投影过程不同投影仪会造成的颜色失真问题,
本文还对颜色/亮度输出匹配做了一定的处理。同时,考虑到投影机投影到特殊的投影屏幕时所引起了几何失真,本文还引入了几何校正技术,用于解决图像几何失真情况。
最后,本文利用所开发数字灯投影拼接系统对多种类型的图像进行模拟测试,将图像质量与传统的算法进行一定的比对,采用多种评价指标,比如像素扭曲度指标、空间连续度指标以及信噪比作为客观评价函数,基于多个角度对不同参数的边缘融合效果进行评价和比对,验证了数字灯投影拼接系统的有效性和实用性。并依据边缘融合概念以及几何校正技术设计了一个可实现软边无缝拼接的数字灯投影系统。
Seamless system for a wide range of multimedia, high-resolution display of an effective implementation. It brings the large screen, more vivid screen display and clear display makes monitoring, security, conference, simulation and other fields have greatly improved work efficiency, while promoting the rapid progress of industry technical standards. Seamless products abroad have been available, but in order to ensure the confidentiality of technology for the integration of functions used by developers and the related reports of minimal processing.
Simple linear function for the current time is not easy to adjust the parameters, this paper amend existing simple linear function, the integration of the introduction of non-linear function, namely, by additional parameters, to amend the existing edge of fusion algorithm with Gamma Operators further correction of the pixel brightness. Against the edge of the light generated by fusion band effect, the edge during this integration process, the pairs of overlapping pixels do fade processing at the edge of the graph in the overlapping area of each pixel is multiplied by the integration of functions, allowing as It is also a word superimposed image, superimposed with the corresponding pixel when the pixel value can be expected.
View of the pixel brightness signal and the relationship between the Gamma should meet, it was in the process design of Gamma Correction. Taking into account the different projectors in the projection process will cause the color distortion problem, the effect of color / brightness output matching to do some processing. At the same time, taking into account the special projectors to the projection screen projection arising from the geometric distortion, the paper also introduces the geometric correction techniques for solving geometric distortion.
Finally, this paper developed by the digital light projection system on various types of mosaic image simulation test, the image quality and the traditional method for some of the comparison, Cai Yong multiple evaluation indexes, such as pixel Niuqu degree index, spatial index continuous degree Yi Ji signal to noise ratio as an objective evaluation function, based on various perspectives on the edge of fusion effect of different parameters to evaluate and to verify the validity of the digital lighting projection splicing system is effective and practical. This article based on the concept of edge integration and geometric correction technology designed to achieve a seamless soft-edge digital light projection system.
引文
[1] A.Majumder,R.Stevens.Lam:Luminance attenuation map for photometric uniformity across a projection based display. In ACM Virtual Reality and Soft- ware Technology,2002
[2] Raskar Ramesh,Brown Michael S,Yang Ruigang, et al.Multi-projector displays using camera-based registration [A].In: Proceedings of IEEE Conference on Visualization[C],San Francisco,CA,USA,1999: 161- 168
[3] Li K,Chen H,Chen Y,et al.Early experiences and challenges in building and using a scalable display wall system[J].IEEE Computer Graphics and Applications, 2000,20(4):671~680
[4] Yang R G,Majumder A,BrownM.Camera based calibration techniques for seamless multi-projector displays [J].IEEE Transactions on Visualization and Computer Graphics, 2005, 11 (2):193~206
[5]Weissig D,Feldmann I,Schussler J,et al. A modular high re-solution multi-projection system [A]. In: Proceedings of International Conference on Optical Display 2005[C]. Berlin,Germany,2005:185~193
[6] Pailthorpe B,Bordes N,Bleha W P,et al,High- resolution display with uniform illumination[A]. In: Proceeding Asia Display Conference[C], Nagoya, Japan, 2001:1295~1298
[7] Moreland J L,Reinsch S,HDD:A Single Light- Source Uniform Tiled Display[M].San Diego, A, USA:San Diego Supercomputer Center(SDSC) White Paper,2003:1~6
[8] Wallace G,Chen H,Li K.Color gamut matching for tiled display walls[A].In: Proceedings of Immersive Projection Technology Symposium[C], Zurich, Switzerland,2003:293~302
[9]吕品,张金芳,王宇心.多投影仪无缝拼接显示中的颜色校正技术比较研究[J].中国图像图形学报.2008,13(7):1272~1280
[10]谢逸群,王慧雅,许华虎.基于视频实时处理的多投影曲面拼接系统的研究[J].中国图像图形学报.2009,14(2):286~29
[11] Li K,Chen Han,etc. Building and Using A Scalable Display Wall System [J]. IEEE Computer Graphics and Applications,2000(7), 29~37
[12] Bin Wei,Claudio Silva.etc,Visualization Research with Large Displays[J].IEEEComputer Graphics and Applications. 2000, 7(8). 51~54
[13] Daniel R.Schikore,Richard A.Fischer,etc.,High- Resolution Multi-projector Display Walls[J].IEEE Computer Graphics and Application.2000(7),38~44
[14] Eisen M B.ScanAlyze. http://rana.stanford.edu/ software for software and documentation,1999
[15] Song P,Cham T J.A theory for photometric self c- alibration of multiple overlapping projectors and cameras[C].Proceedings of the IEEE Computer Society Conference on computer Vision and Pattern Recognition. Washington DC:IEEE Computer Society,2005: 97-104
[16] Liew A W C,Yan H,Yang M.Robust adaptive spot segmentation of DNA microarray image[J].Pattern Recognition,2003;36(5):1251~1254
[17] M C Stone.Color and brightness appearance issues for tiled displays[J].IEEE Computer Graphics and Applications,2001:21(5):58~66
[18] M Hereld,I R Judson,R L Stevens. Introduction to Building Projection based Tiled Display System [J].IEEE Computer Graphics and Applications, 2000: 20(4):22~28
[19] Aditi Majumder,Rick Stevens. Color Nonuniformity in Projection-Based Displays: Analysis and Solutions[J].IEEE Transactions on Visualization and Computer graphics.2004,10(2):177~189
[20] Kurtenbach G, Fitzmaurice G. Applications of large displays [J].IEEE Computer Graphics and Application. 2005, 25 (4) : 22～23.
[21] Funkhouser T, Li K. Large2format displays [J]. IEEE Computer Graphics and Applications, 2000, 20 (4) : 20～21.
[22] Humphreys G, Hanrahan P. A distributed graphics system for large tiled displays[A]. In: Proceedings of IEEE International Conference on Visualization [C] , San Francisco, CA, USA, 1999: 215～223.
[23] Humphreys G, Buck I, EldridgeM, et al. Distributed rendering for scalable displays [A]. In: Proceedings of IEEE International Conference on Supercomputing [C] , Dallas, TX, USA, 2000:30～37.
[24] Humphreys G, Eldridge M, Buck I, et al. A scalable graphics system for clusters[A]. In: Proceedings of ACM SIGGRAPH [C] ,Los Angeles, CA, USA, 2001: 129～140.
[25] Buck I, Humphreys G, Hanrahan P. Tracking graphics state for networked rendering [A]. In:Proceedings of Eurographics/ SIGGRAPH Workshop on Graphics Hardware [C] , Interlaken, Switzerland, 2000: 87～95.
[26] Li C, Lin H, Shi J Y. A survey of multi-projector tiled display wall construction [A]. In: Proceedings of Third International Conference on Image and Graphics[C] , Hong Kong, China, 2004: 452～455.
[27] Yuan G D, Qin K H, Hu W. Geometric calibration for multi-projector tiled display based on vanishing point theory [A]. In: Proceedings of International Conference on Computational Science[C] , Berlin, Germany, 2006: 864～867.
[28] C.Poynton. Gamma and its disguises: The nonlinear mappings of intensity in perception, CRTs, film and video. SMPTE J.vol.102(12):1099~1108,Dec.1993
[29] S.Kang, H.Do,B.Cho,S.Chien. Improvement of low gray-level linearity using perceived luminance of human visual system in PDP-TV. IEEE Trans.Consum.Electron.,vol.51(1):204~209,Feb.2005
[30] S.Hecht. A theory of visual intensity discrimination. J.General Physiol.,Vol 18(5):767~789,1935
[31] J.Kim,B.Choi, and O.Kwon. 1-billion-color TFT-LCD TV with full HD format. IEEE Trans. Consum.Electron. Vol. 51(4):1042~1050, Nov. 2005
[32] E.Kim, S.Jang, S.Lee. Optimal piece linear segments of gamma correction for CMOS image sensors. IEICE Trans. Electron. , vol.E88-C(11):2090~2093. Nov.2005
[33] Ruigang Yang, David Gotz, Justin Hensley, Herman Towles and Michael S.Brown,PixelFlex: A Reconfigurable Multi-Projector Display System, IEEE Visualization 2001,October 2001
[34] B.Pailthorpe, N.Bordes, W.Bleha, S.Reinsch, and J.Moreland, High resolution display with uniform illumination, Proceedings Asia Display IDW, 1295 ~1298,2001
[35] Nicole Bordes, Bernard Pailthorpe, High Resolution Scalable Displays: Manufacturing and Use, Proceedings of the 2004 Australasian symposium on Information Visualization Volume 35(151~156).2004
[36] Grant Wallance, Han Chen and Kai Li, Color Gamut Matching for Tiled Display Walls, Proceeding of International Immersive Projection Technologies Workshop, 2003
[37] Maureen C. Stone. Color balancing experimental projection displays. 9th IS&T/SID Color Imaging Conference, 2001a
[38] Maureen C. Stone. Color and brightness appearance issues in tiled displays, IEEE Computer Graphics and Applications,2001b
[39] Aditi Majumder, Rick Stevens, Color Non-Uniformity in Projection BasedDisplays: Analysis and Solutions, IEEE Transactions on Visualization and Computer Graphics, Vol.10, 2003
[40] Aditi Majumder, Rick Stevens, Perceptual Photometric Seamlessness in Projection-Based Tiled Displays, ACM Transactions on Graphics, Vol.24,No.1, January 2005
[41]李波.一种基于小波和区域的图像拼接方法[J].电子科技,2005,4(2):49~52
[42]刘贵喜,赵曙光,陈文锦.双正交小波变换多分辨率图像融合方法[J].光电工程,2004,31(4):50~53
[43]王海晖,彭嘉雄,吴魏.基于小波包变换的遥感图像融合[J].中国图像图形学报, 2002,7(9):932~937
[44] Guo-sheng Yang, Huan-long Zhang. Optimal image mosaic wavelet method based on fuzzy integral [A]. The 5th international conference on machine learning and cybernetics, 2006, Aug(6):3738-3741
[45] Junli Li, Gang Chen, Zheru Chi and Chenggang Lu, Image Coding Quality Assessment Using Fuzzy Integrals with Three-Component Image Mode[J]. IEEE Transactions on Fuzzy Systems,2004, 12(1):99-106
[2] Raskar Ramesh,Brown Michael S,Yang Ruigang, et al.Multi-projector displays using camera-based registration [A].In: Proceedings of IEEE Conference on Visualization[C],San Francisco,CA,USA,1999: 161- 168
[3] Li K,Chen H,Chen Y,et al.Early experiences and challenges in building and using a scalable display wall system[J].IEEE Computer Graphics and Applications, 2000,20(4):671~680
[4] Yang R G,Majumder A,BrownM.Camera based calibration techniques for seamless multi-projector displays [J].IEEE Transactions on Visualization and Computer Graphics, 2005, 11 (2):193~206
[5]Weissig D,Feldmann I,Schussler J,et al. A modular high re-solution multi-projection system [A]. In: Proceedings of International Conference on Optical Display 2005[C]. Berlin,Germany,2005:185~193
[6] Pailthorpe B,Bordes N,Bleha W P,et al,High- resolution display with uniform illumination[A]. In: Proceeding Asia Display Conference[C], Nagoya, Japan, 2001:1295~1298
[7] Moreland J L,Reinsch S,HDD:A Single Light- Source Uniform Tiled Display[M].San Diego, A, USA:San Diego Supercomputer Center(SDSC) White Paper,2003:1~6
[8] Wallace G,Chen H,Li K.Color gamut matching for tiled display walls[A].In: Proceedings of Immersive Projection Technology Symposium[C], Zurich, Switzerland,2003:293~302
[9]吕品,张金芳,王宇心.多投影仪无缝拼接显示中的颜色校正技术比较研究[J].中国图像图形学报.2008,13(7):1272~1280
[10]谢逸群,王慧雅,许华虎.基于视频实时处理的多投影曲面拼接系统的研究[J].中国图像图形学报.2009,14(2):286~29
[11] Li K,Chen Han,etc. Building and Using A Scalable Display Wall System [J]. IEEE Computer Graphics and Applications,2000(7), 29~37
[12] Bin Wei,Claudio Silva.etc,Visualization Research with Large Displays[J].IEEEComputer Graphics and Applications. 2000, 7(8). 51~54
[13] Daniel R.Schikore,Richard A.Fischer,etc.,High- Resolution Multi-projector Display Walls[J].IEEE Computer Graphics and Application.2000(7),38~44
[14] Eisen M B.ScanAlyze. http://rana.stanford.edu/ software for software and documentation,1999
[15] Song P,Cham T J.A theory for photometric self c- alibration of multiple overlapping projectors and cameras[C].Proceedings of the IEEE Computer Society Conference on computer Vision and Pattern Recognition. Washington DC:IEEE Computer Society,2005: 97-104
[16] Liew A W C,Yan H,Yang M.Robust adaptive spot segmentation of DNA microarray image[J].Pattern Recognition,2003;36(5):1251~1254
[17] M C Stone.Color and brightness appearance issues for tiled displays[J].IEEE Computer Graphics and Applications,2001:21(5):58~66
[18] M Hereld,I R Judson,R L Stevens. Introduction to Building Projection based Tiled Display System [J].IEEE Computer Graphics and Applications, 2000: 20(4):22~28
[19] Aditi Majumder,Rick Stevens. Color Nonuniformity in Projection-Based Displays: Analysis and Solutions[J].IEEE Transactions on Visualization and Computer graphics.2004,10(2):177~189
[20] Kurtenbach G, Fitzmaurice G. Applications of large displays [J].IEEE Computer Graphics and Application. 2005, 25 (4) : 22～23.
[21] Funkhouser T, Li K. Large2format displays [J]. IEEE Computer Graphics and Applications, 2000, 20 (4) : 20～21.
[22] Humphreys G, Hanrahan P. A distributed graphics system for large tiled displays[A]. In: Proceedings of IEEE International Conference on Visualization [C] , San Francisco, CA, USA, 1999: 215～223.
[23] Humphreys G, Buck I, EldridgeM, et al. Distributed rendering for scalable displays [A]. In: Proceedings of IEEE International Conference on Supercomputing [C] , Dallas, TX, USA, 2000:30～37.
[24] Humphreys G, Eldridge M, Buck I, et al. A scalable graphics system for clusters[A]. In: Proceedings of ACM SIGGRAPH [C] ,Los Angeles, CA, USA, 2001: 129～140.
[25] Buck I, Humphreys G, Hanrahan P. Tracking graphics state for networked rendering [A]. In:Proceedings of Eurographics/ SIGGRAPH Workshop on Graphics Hardware [C] , Interlaken, Switzerland, 2000: 87～95.
[26] Li C, Lin H, Shi J Y. A survey of multi-projector tiled display wall construction [A]. In: Proceedings of Third International Conference on Image and Graphics[C] , Hong Kong, China, 2004: 452～455.
[27] Yuan G D, Qin K H, Hu W. Geometric calibration for multi-projector tiled display based on vanishing point theory [A]. In: Proceedings of International Conference on Computational Science[C] , Berlin, Germany, 2006: 864～867.
[28] C.Poynton. Gamma and its disguises: The nonlinear mappings of intensity in perception, CRTs, film and video. SMPTE J.vol.102(12):1099~1108,Dec.1993
[29] S.Kang, H.Do,B.Cho,S.Chien. Improvement of low gray-level linearity using perceived luminance of human visual system in PDP-TV. IEEE Trans.Consum.Electron.,vol.51(1):204~209,Feb.2005
[30] S.Hecht. A theory of visual intensity discrimination. J.General Physiol.,Vol 18(5):767~789,1935
[31] J.Kim,B.Choi, and O.Kwon. 1-billion-color TFT-LCD TV with full HD format. IEEE Trans. Consum.Electron. Vol. 51(4):1042~1050, Nov. 2005
[32] E.Kim, S.Jang, S.Lee. Optimal piece linear segments of gamma correction for CMOS image sensors. IEICE Trans. Electron. , vol.E88-C(11):2090~2093. Nov.2005
[33] Ruigang Yang, David Gotz, Justin Hensley, Herman Towles and Michael S.Brown,PixelFlex: A Reconfigurable Multi-Projector Display System, IEEE Visualization 2001,October 2001
[34] B.Pailthorpe, N.Bordes, W.Bleha, S.Reinsch, and J.Moreland, High resolution display with uniform illumination, Proceedings Asia Display IDW, 1295 ~1298,2001
[35] Nicole Bordes, Bernard Pailthorpe, High Resolution Scalable Displays: Manufacturing and Use, Proceedings of the 2004 Australasian symposium on Information Visualization Volume 35(151~156).2004
[36] Grant Wallance, Han Chen and Kai Li, Color Gamut Matching for Tiled Display Walls, Proceeding of International Immersive Projection Technologies Workshop, 2003
[37] Maureen C. Stone. Color balancing experimental projection displays. 9th IS&T/SID Color Imaging Conference, 2001a
[38] Maureen C. Stone. Color and brightness appearance issues in tiled displays, IEEE Computer Graphics and Applications,2001b
[39] Aditi Majumder, Rick Stevens, Color Non-Uniformity in Projection BasedDisplays: Analysis and Solutions, IEEE Transactions on Visualization and Computer Graphics, Vol.10, 2003
[40] Aditi Majumder, Rick Stevens, Perceptual Photometric Seamlessness in Projection-Based Tiled Displays, ACM Transactions on Graphics, Vol.24,No.1, January 2005
[41]李波.一种基于小波和区域的图像拼接方法[J].电子科技,2005,4(2):49~52
[42]刘贵喜,赵曙光,陈文锦.双正交小波变换多分辨率图像融合方法[J].光电工程,2004,31(4):50~53
[43]王海晖,彭嘉雄,吴魏.基于小波包变换的遥感图像融合[J].中国图像图形学报, 2002,7(9):932~937
[44] Guo-sheng Yang, Huan-long Zhang. Optimal image mosaic wavelet method based on fuzzy integral [A]. The 5th international conference on machine learning and cybernetics, 2006, Aug(6):3738-3741
[45] Junli Li, Gang Chen, Zheru Chi and Chenggang Lu, Image Coding Quality Assessment Using Fuzzy Integrals with Three-Component Image Mode[J]. IEEE Transactions on Fuzzy Systems,2004, 12(1):99-106