基于视觉感知特征的图像融合技术及其质量评价方法的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
虚拟环境下的实时自助照相系统的研制是为了满足体验经济的发展对数字应用系统的需求。该系统主要由人像的采集、提取和融合三部分组成,对前两部分的研究已经取得了较好的成果。
    本文首先从计算机视觉的理论体系和实际应用价值的角度上,分析了对低层次视觉要素的提取与检测的理论及其实际意义。分析了图像融合技术在基于PC的虚拟现实技术应用领域的地位,指出图像融合技术研究的意义;明确了进行本课题的必要性,提出了本课题的主要研究目标,确定了所需完成的研究任务。
     鉴于目前对图像融合技术在娱乐领域的应用缺乏研究,尤其缺乏将虚拟现实技术、自助照相技术、机器视觉技术和图像融合技术综合运用的分析研究,因此我们从分析人类视觉特征入手,运用系统的观念综合平衡图像质量、系统成本等技术指标,在对虚拟实时自助照相系统具体技术指标深入分析的基础上,提出了基于对比度感知特征(Character of Apperceiving Contrast)的图像融合算法。这样,不仅能把信息融合技术(Information Fusion Technology,简称IFT)和人类视觉系统(Human Vision System,简称HVS)的研究成果引入虚拟照相系统中,使系统的“人性化”功能增强;同时,也对解决传统键控技术出现的“硬色键”问题,有一定的理论和实际的参考意义。
    摄像头受外界光学环境的影响,采集的人像经常有颜色失真现象,本文通过对HVS的颜色恒常性特征的分析,提出了基于HVS颜色恒常性的肤色校正算法,可以自动校正和补偿因外界影响而发生变化的人像肤色。
    在分析传统的图像质量评价方法及其缺陷的基础上,指出将HVS特性引入图像计测方法中的必要性;同时,对融合图像质量评价现状进行了深入的研究,鉴于本课题研究的特殊性,建立了一套适合娱乐照相领域融合图像的质量评价方法,并给出实验分析。
    总结本文的工作,文中通过理论分析、实际应用和理论上升加仿真模拟三个阶段的工作对图像融合在虚拟环境自助照相系统中的应用进行了深入的探索。各种实验结果证明了文中相关理论的合理性和正确性,同时验证了文中所提算法是可靠的,具有较强的鲁棒性,并表明了图像融合技术在实际应用中有着广阔的应用空间。
The Self-Control Photo System can meet the higher requirement for Digital Application systems in experience economic booming period. It consists of Image Acquisition Unit, Image Extraction and Image Fusion Unit. The research on the first two units presents satisfying results.
    At the beginning, this paper discusses the Low-level Vision Elements Extraction and Detection theory, especially in Computer Vision systems and its practical meaning. Then the roles and prospects of Image Fusion in Virtual-Reality application based on PC are analyzed. Following the possibility and necessary analysis, the major research missions and expected targets are constructed.
    According to the deficiency of Image Fusion applications in entertainment equipments, such as no special research that combines Virtual Reality, Self-control Photographing, Computer Vision and Image Fusion technologies together, we propose an Image Fusion algorithm base on Character of Apperceiving Contrast, which take system elements into account, e.g. integrity image quality balance and costs. Based on the entire analysis of Self-Control Virtual Real-time Photographing, the algorithm not only introduces the Information Fusion theory and Human Vision System to Virtual Photographing system, but also resolves the hard color-key problem caused by traditional key control method. It reveals humanistic function and good practical value.
    The image probably occurs color distortion that is influenced by optical equipment. In this paper, the HVS color invariance characters is construed, an complexion rectify algorithm based that is proposed, which can automatically adjust and compensate the image quality according to the external environment influence.
    After summarized traditional evaluation methods and research on the Image Fusion trends, it is obvious to adopt HVS method to achieve good results. An image quality evaluation method is proposed, which is entertainment-oriented, appended with experiment results.
    This paper studies the Image-Fusion in Self-control Virtual Photographing through three periods working, which are theory analysis, practical implantation and theory breakthrough with simulation. The experiment results prove that the theory and the algorithms are correct; also it displays good system stability, robust quality. All of above reveals the great application potential of Image Fusion technology.
引文
[1] 马颂德,张正友.计算机视觉.北京.科学出版社.1998.2-6
    [2] 贾云得.机器视觉.北京.科学出版社.2000.2-24
    [3] D.Marr.姚国正,刘磊,汪云九.视觉计算理论.北京.科学出版社,1998
    [4] 汪成为,高文,王行仁著.灵境(虚拟现实)技术的理论、实现及应用.清华大学出版社,1996.9:1-7
    [5] 张茂军.虚拟现实系统.科学出版社2001.9:308-313
    [6] 李祖枢.网上照相吧及操作方法.中国发明专利.IPC.01107322.2001.9.12.P.30
    [7] 邵景莅.虚拟环境下实时照相技术研究及其系统实现.重庆大学硕士学位论文.2000:1-8
    [8] 张华.基于人类视觉特征的实时人像提取及其在虚拟环境照相中的应用.重庆大学硕士学位论文.2002.P.3-P.6
    [9] 刘贵喜,杨万海.一种像素级多算子红外与可见光图像融合方法. 红外与毫米波学报.2001. 20(3):207-210
    [10] 李勤,代彩虹,俞信,王苏生,曹恩华. 图像融合方法在细胞图像处理中的应用.光学学报.1998. 18(12):1658-1662
    [11] StevanM.Vajdic,HenryE.Katz,AndrewR.Downingetal.,AI-based relational matching and multimodal medical image fusion: Generalized 3D approaches.Proc.SPIE,1994.2308:1565-1573
    [12] 张煜,刘哲星,李树祥,江贵平.医学图像信息融合技术的发展.国外医学生物医学工程分册.2000.23(4):202-205
    [13] 王海晖,彭嘉雄,吴巍.基于小波包变换的遥感图像融合.中国图像图形学报. 2002 .Vol.7(A),No.9:932-937
    [14] H.Li,B.S.Manjunath,S.K.Mitra,Multi-sensor image fusion using the wavelet transform. Graphical Models and Image Processing,1995.57(3):235-245
    [15] Xiao yuJiang,Li weiZhou,Zhi yunGao, Multi-spectral image fusion using wavelet transform. Proc.SPIE,1996.2898:35-42
    [16] Alexander Akerman III,Pyramidal techniques for multi-sensor fusion. Proc.SPIE, 1992.1828:124-131
    [17] Wen zhongWei,Zhi yunGao,Shi lingHu,A new algorithm of image registration in image fusion based on wavelet decomposition.Proc.SPIE,1996,2898:28-34
    [18] G.Simone,A.Farina,F.C.Morabito,S.B.Serpico,L.Bruzzone. Image fusion techniques for remote sensing applications. Information Fusion,2002.(3):3-15
    
    
    [19] William E.Glenn,"Digital image compression based on visual perception and scene properties",SMPT Journal,May 1993: 392-397
    [20] 马俊如.高技术研究前沿展望.合肥:中国科技大学出版社,1995
    [21] 姚庆栋.图像编码学基础.北京:人民邮电出版社,1994
    [22] Granrath D.J.,"The role of human visual models in image processing", Proc.of IEEE,1981. 69(5):552-561
    [23] Kim J.T.et al.,"Subband coding using human visual characteristics for image signals ",IEEE J.on Selected Areas in Comm.,1993. 11(1):59-64
    [24] Lee J.et al.,"Temporally adaptic motion interpolation exploiting temporal masking in visual perception",IEEE Trans,on IP,1994. 3(5):513-526
    [25] 沈兰荪.图像编码与异步传输.北京:人民邮电出版社,1998
    [26] T.N.Comsweet, "Visual perception", Academic Press, New York,1970
    [27] Larry N.Thibos,"Image processing by the human eye"SPIE Vol.1199,1989
    [28] C.H.Graham et al.,"Vision and visual perception",Wiley,New York,1965
    [29] V.D.Glezer,et al.,"Investigation of complex and hypercomplex receptive fields of visual cortex of the cut as spatial frequency filters",Vision Res.Oct,1973. 13(10):1875-1904
    [30] F.w.Campbell,et al.,"Neurosciences",IIId,1974: 95-104
    [31] F.w.Campbell,et al.,"Visibility of aperiodic patterns compared with cortical cell compared with sinusoidal gratings",J.Physiol.1969. (204):283-298
    [32] F.w.Campbell and D.Green,"Optical and retina factors affecting visual resolution",J.Physiol,1965. (181):576-593
    [33] J.Kulikowski and P.king-Smith,"Orientation selectivity of grating and line detectors in human vision",Vis.Res.1973. (13):1455-1478
    [34] W.K.Pratt,"Digital image processing ",Wiley,1978
    [35] Zhang Y J,Yao Y R,He Y.Automatic Face Segmentation Using Color Cues for Coding Typical Videophone Scenes.SPIE-VCIP'97.San Jose 1997.pp.468-497
    [36] 唐传尧.图像电子学基础.电子工业出版社,1995
    [37] William E.Glen et al.,"Image system based on psychophysical data ",SID.16/1, 1985:71-78
    [38] 毕厚杰等.图像通信工程.人民邮电出版社,1991
    [39] 吴立德.计算机视觉.上海:复旦大学出版社,1993
    [40] Mastui,Toshikazu.New objective performance evaluation criteria for imaging systems based on a human vision model and their fundamental characteristics. Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers v 52 Apr.1998:583-593
    
    
    [41] 罗晓晖.双高斯差模型的低层次视觉尺度要素检测研究.重庆大学博士论文.2002
    [42] 陈众.在虚拟影像环境中实时人像提取及应用.重庆大学硕士学位论文.2000:47-67
    [43] Kenneth R C.数字图像处理.朱志刚,林学,石定机等译.北京:电子工业出版社,1998:301-302
    [44] Swami M. Advances in Volume Graphics. Computer & Graphics,1999.23:73-84
    [45] 李勤,代彩虹,俞信.图像融合方法在细胞图像处理中的应用.光学学报,1998.18(12):1658-1662
    [46] J K Aggarwal. Multisensor Fusion for computer Vision.Springer Verlag,Berlin,Germany,
    1993
    [47] DLHall,JLlinas.An introduction to multisensor data fusion.Proc.IEEE,1997,85(1):6-23.
    [48] P K Varshney. Multisensor data fusion.Electron.Commun.Eng.J.,1997.9(12):224-253
    [49] C Phol.Multisensor image fusion in remote sensing:concepts,methods and applications.Int.J.Remote Sensing,1998.9(5):823-854
    [50] Polh C. Multi-sensor image fusion in remote sensing: Concepts, methods and applications. International Journal of Remote Sensing,1988.9(5):823~854
    [51] Hall D L, Llinas J. An introduction to multi-sensor data fusion. Proceedings of the IEEE,1997.85(1):6~23
    [52] Burt P T,Adelson E H.The laplacian pyramid as a compact image code.IEEE Transactions on Communications.,1983.31(4):532-540
    [53] 朱述龙,张占睦编著.遥感图像获取与分析.北京:科学出版社,2000
    [54] Mallat S G. A Theory for multi-resolution signal decomposition: The wavelet representation. IEEE Transactions Pattern Analysis Machine. Intelligence,1989.11(7):674~693
    [55] Scheunders P, De Backer S. Fusion and merging of multi-spectral images using multi-scale fundamental forms.Journal of the Optical Society of America A,2001.18(10):2468~2477
    [56] 李亨.颜色技术原理及应用.北京:科技出版社,1997
    [57] 田民波等,薄膜科学与技术手册.北京:机械工业出版社,1991
    [58] 林平.彩色摄像机白平衡调整技术的应用.海南大学学报(自然科学版),1996,14(2):110~114
    [59] 胡波,林青,陈光梦,张立明. 基于先验知识的自动白平衡.电路与系统学报,2001.6(2):25~28
    [60] 焦书兰,荆其成,张武田.不同时相日光下颜色的恒常性.心理学报.1984.(1):55-61
    [61] Wald G. The Receptors for Human Color Vision.Science.1964.145(3636):1007~1017
    [62] Helson H, Judd D B, Warren M H. Object-color changes from daylight to incandescent filament illumination. Illum. Eng.,1952,(47):221-233
    
    
    [63] Land E H, McCann J J. Lightness and retinex theory.J.Opt.Soc.Amer,1977.(61):1-11
    [64] ]Maloney L T. Evaluation of linear models of surface spectral reflectance with small numbers of parameters.J.Opt.Soc.Amer,1986.A,(3):1673-1683
    [65] Craven B J,Davod H F. Foster H an operational approach to color constancy.Vision Research.1992.32(7):1359-1366
    [66] Jules D. Cognition through color. Color research and application.1992.17(4):295.
    [67] Tiplitz B K,Buchsbaun G. Quantitative studies of color constancy.J.Opt.Soc.Amer,1988.A,
    (5):1772-1780
    [68] Yang J.Waibel A.Tracking human faces in real-time. CMU,Carnegie Mellon Universtiy,CA :Technical Report CMU-CS-95-210,1995
    [69] Aaron C Shumale,Hui Li. Color Balancing in Digital Cameras.
    http://ise.stanford.edu/class/psych221/00/trek
    [70] Rowley H A,Baluja S,Kanade T.Neural network-based face detection.IEEE Trans Pattern Analysis and Machine Intelligence ,1998.20(1):23-38
    [71] Miao J,Yin B C,Wang K Q et al.A hierarchical multi-scale and multi-angle system for human face detection in a complex background using gravity-center template.Pattern Recognition ,1999.32(7):1237-1248
    [72] 李祖枢.仿人智能控制研究20年.中国智能自动化学术会议论文集.重庆.1999.北京:清华大学出版社.1999:20-32
    [73] Oliver N,Pentland A,Berard F..Lips and face real time tracker with facial expression recognition.Proc IEEE on CVPR,1997:123-129
    [74] Feng Maosen. Re-mode Sensing Digital Image Processing .Beijing:Geological Publishing House,1992.[丰茂森.遥感图像数字处理.北京:地质出版社,1992.]
    [75] 唐常青等编著.数学形态学及其应用.科学出版社.1990.8:1-32
    [76] Rock I. The perceptual world. New York: W H Freeman and Company,1990
    [77] Ranch in T ,Wald L. Efficient data fusion using wavelet transform: the case of SPOT satellite images. SPIE Mathematical Imaging,1993.2034:171-176
    [78] 胡昌华,张军波等编著.基于MATLAB的系统分析与设计——小波分析.西安电子科技大学出版社,1992.12:1-3
    [79] T.W.Barnard,"A literature survey on image quality evaluation",The Perking Elmer Corporation,Engineering Report ER-177,June 1971
    [80] B.R.Frienden,"Image evaluation by use of the sampling theorem",J.Opt.Soc.Am,Oct.1966. 56(10)
    [81] J.L.Harris,Sr,"Image evaluation and restoration",J.Opt.Soc.Am,May 1966. 56(5)
    
    
    [82] J.L.Harris,Sr,"Resolving power and decision theory",J.Opt.Soc.Am,May 1964. 54(5)
    [83] S.Comes et al."Human visual quality criterion",SPIE,Vol.1360.Visual Communication and Image Processing,pp.1990:2-13
    [84] G.Beakley et al.,"Video compression:The need for testing",SMPTE Journal, November 1995:742-750
    [85] Norman B.Nill et al.,"Objective image quality measure derived from digital image power spectra",Opt,Eng, April 1992. 31(4):813-825
    [86] Rennee L.J.Martens et al."Evaluation of order statistic filters using a modified signal to
    noise ratio",SPIE,Vol.1199,Visual Communication and image Processing IV.1990:92-103
    [87] Makoto Mjyahraet al.,"Objective picture quality scale(PQS)for image coding",IEEE Trans.On Communication, September 1998.46(9):1215-1225
    [88] Scott Daly,"The visible difference predictor:An algorithm for the assessment of image fidelity",SPIE Vol.1666 Human Vision,Visual Processing ,and Digital Display III.1992:2-15
    [89] A.P.Bradley,"A wavelet visible difference predictor",IEEE Trans,on Image Processing,May 1999. 8(5)
    [90] A.B.Watson et al."Image quality and entropy masking ",in Proc.SPIE Human Vision,Visual Processing,and Digital Display VIII,San Jose,CA,1997
    [91] Eskiciogln A M,et al.Image Quality measure and their performance.IEEE Trans.Comm,1995,43(12):2959-2965
    [92] Karunaseka S A,et al. A distortion measure for blocking artifacts in image based on human visual sensitivity. IEEE Trans.IP,1995,4(6):713-724
    [93] Wen Xu,et al. Picture quality evaluation based on error segmentation.SPIE,1994:1454-1465
    [94] Jayant NJ,et al. Signal Compression based on models of human perception.Proc.IEEE,1993,
    81:1385-1422
    [95] 周建鹏等.一种图像质量的感知测量方法.中国图像图形学报,1998,3(3):200-204
    [96] Talluri R,et al. A robust ,scalable object based video compression technique for very low bit-rate coding.IEEE Trans.Circ.Syst.Video Tech,1997,7(1):221-233
    [97] 汪孔桥,沈兰荪,邢昕.一种基于视觉兴趣性的图像质量评价方法.
    [98] 栗振风,丁艺芳,张文俊.一种基于视觉加权处理的图像质量评价方法.上海大学学报,1998.4(6):645-652
    [99] 韦志辉,程军.基于小波变换的一种新的图像质量评价方法.南京理工大学学报,1998.22(6):552-555
    [100] R.L.格列高里.彭冉龄,杨昊.视觉心理学.北京.北京师范大学出版社.1985:122-145

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700