基于FPGA的影像监测系统的设计与实现
|
摘要
随着产业工艺进化,元件微型化趋势不断推进,AOI在SMT业内蓬勃发展,新的元件规格对原有的AOI系统的处理精度及速度提出了挑战,而另一种AOI系统架构更显优势:阵列影像侦测系统。现阶段的目标是完成一个适用这种架构、具备完整功能的子影像系统,包括影像输入、存储、传输、处理和输出五大模块。
本设计的主要工作是进行影像输入模块和影像处理模块的设计。
影像获取模块的设计参考影像获取的主要芯片——感光芯片的器件数据手册,进行芯片驱动,对从芯片获取的原始数据进行相应处理得到系统需要的影像数据。这部分设计是给系统输入能达到的最清晰并且正确的原始影像数据。
影像处理模块的设计主要是:以数据流为中心设计了模块的架构,包括数据存取和数据处理两部分;提出一种新的快速图像识别方法,阐述了它的原理、验证、设计方法,并最终实现了这个新的图像识别方法。
整个系统的主控芯片是Xilinx公司的Spartan3E系列1200E,使用VHDL语言设计开发,实现整个系统的驱动、控制。涉及到:300W像素CMOS感光芯片的开发(同步时序、RGB处理、I2C总线协议), SDRAM的开发(SDRAM内部控制系统和DMA控制),Gigabit Ethernet通讯系统的建立(包括芯片IP1000A的开发和UDP协议的FPGA实现),影像处理技术。
系统各个功能模块均经过测试,达到了预期结果。实践证明,本文的研究成果和文中所描述的设计思路和实现方法是合理的、切实可行的,对于类似的影像系统开发具有一定的参考价值。
With the development of the industry techniques, AOI is flourished and progressing quickly. Facing the challenge, which from the new part specification, another AOI system architecture is brought forward, that is Array, arranged Image System. Recently, the goal is to complete a child system of entire function, and suit for this architecture, including image input, storage, transmission, process, and output module.
The image input and process module is the main subject of the paper.
The image input module is developed based on the datasheet of the CMOS sensor, which is the main chip for image input module. The job is mainly done on the driver of the chip, and what should be done for the transformation from the raw data obtained from the chip to image data. The design is aimed at the most and accurate original image data of system’s highest ability.
The design of image process module is mainly discussed on: the structure of the module is based on the data flow, includes data access and data process; and a new and specialized image recognizing method, the principle and implement, veryfication of which is discussed.
The system is mainly in the charge of Spartan 3E 1200E, which is produced by Xilinx, corporation, using VHDL language describing the driver and control of the entire system. The development of the CMOS sensor (including timing synchronization, RGB raw data process), 32M SDRAM chip (the inner coding system and DMA control design), gigabit Ethernet communication system set-up (chip IP1000A and implement of UDP protocol based on FPGA), and image process techniques is involved.
Experiment proved that, all the function is done in the rough, and the new image process technology is testified. It is reasonable and practical to design ideas and methods showed in this thesis. And these are valuable for developing similar systems.
本设计的主要工作是进行影像输入模块和影像处理模块的设计。
影像获取模块的设计参考影像获取的主要芯片——感光芯片的器件数据手册,进行芯片驱动,对从芯片获取的原始数据进行相应处理得到系统需要的影像数据。这部分设计是给系统输入能达到的最清晰并且正确的原始影像数据。
影像处理模块的设计主要是:以数据流为中心设计了模块的架构,包括数据存取和数据处理两部分;提出一种新的快速图像识别方法,阐述了它的原理、验证、设计方法,并最终实现了这个新的图像识别方法。
整个系统的主控芯片是Xilinx公司的Spartan3E系列1200E,使用VHDL语言设计开发,实现整个系统的驱动、控制。涉及到:300W像素CMOS感光芯片的开发(同步时序、RGB处理、I2C总线协议), SDRAM的开发(SDRAM内部控制系统和DMA控制),Gigabit Ethernet通讯系统的建立(包括芯片IP1000A的开发和UDP协议的FPGA实现),影像处理技术。
系统各个功能模块均经过测试,达到了预期结果。实践证明,本文的研究成果和文中所描述的设计思路和实现方法是合理的、切实可行的,对于类似的影像系统开发具有一定的参考价值。
With the development of the industry techniques, AOI is flourished and progressing quickly. Facing the challenge, which from the new part specification, another AOI system architecture is brought forward, that is Array, arranged Image System. Recently, the goal is to complete a child system of entire function, and suit for this architecture, including image input, storage, transmission, process, and output module.
The image input and process module is the main subject of the paper.
The image input module is developed based on the datasheet of the CMOS sensor, which is the main chip for image input module. The job is mainly done on the driver of the chip, and what should be done for the transformation from the raw data obtained from the chip to image data. The design is aimed at the most and accurate original image data of system’s highest ability.
The design of image process module is mainly discussed on: the structure of the module is based on the data flow, includes data access and data process; and a new and specialized image recognizing method, the principle and implement, veryfication of which is discussed.
The system is mainly in the charge of Spartan 3E 1200E, which is produced by Xilinx, corporation, using VHDL language describing the driver and control of the entire system. The development of the CMOS sensor (including timing synchronization, RGB raw data process), 32M SDRAM chip (the inner coding system and DMA control design), gigabit Ethernet communication system set-up (chip IP1000A and implement of UDP protocol based on FPGA), and image process techniques is involved.
Experiment proved that, all the function is done in the rough, and the new image process technology is testified. It is reasonable and practical to design ideas and methods showed in this thesis. And these are valuable for developing similar systems.
引文
[1]华嘉桢. IC封装基板和精细线路PCB对AOI检查的挑战.印制电路信息2005, (7):38~40
[2]白木,周洁. AOI系统在SMT生产线上的应用.电子机械工程电子机械工程2003, (3):10~13
[3]祝长青. AOI在研究所型SMT生产线上的一机两用实践.电子工业技术, 2005, (5):147~149
[4]侯一雪.应用AOI控制制造工艺质量.电子工业专用设备. 2002, (2):92~95
[5]鲜飞.自动光学测试实现生产效益最大化.电气时代, 2004, (1)122~123
[6]杨建生,陈建军. A0I与SPC的结合使PCB组装最佳化.电子质量, 2003, (9):36~38
[7]周德俭,黄春跃,吴兆华.基于焊点虚拟成形技术的SMT焊点质量保证技术研究.计算机集成制造系统, 2001, (2):56~59
[8] J. W. Foster, P. Griffin, J. D. Korry .Automated visual inspection of bare printed circuit boards using parallel processor hardware.The International Journal of Advanced Manufacturing Technology.1987(5):Volume 2, Number 2
[9]周德俭. SMT组装质量检测中的AOI技术与系统.电子工业专用设备, 2002, (6):87~95
[10]胡跃明,谭颖.自动光学检测在中国的应用现状和发展.微计算机信息, 2006 (4):143~146
[11]王庆有. CCD应用技术.天津:天津大学出版社, 2000
[12]宋勇,郝群,王涌天,王占和. CMOS图像传感器与CCD的比较及发展现状.仪器仪表学报, 2001, 21(增刊):387～389
[13]胡隽,杨平,何辅云.一阶灰色系统模型在图像处理中的应用.上海电力学院学报, 2004, (20):1~4
[14]张凤林,孙学珠.工程光学.天津:天津大学出版社, 1996
[15]柯丽,黄廉卿. DSP芯片在实时图像处理系统中的应用.光机电信息2005, (1):17~23
[16]吴继华.将低成本FPGA用于视频和图像处理.电子设计应用. 2007, (1):26~26,28~30
[17] Zhang Guilin, Zhang Liuyang. Design and Implementation of Digital Image Processing Algorithm Evaluation System Based on DSP + FPGA + USB2.0 Architecture. Computer and Digital Engineering.2005, (12):88~91
[18] A. A. Krasnobaev, A. K. Platonov.A method of parallel-sequential detection of image features in computer vision systems.Journal of Computer and Systems Sciences International.2007 (8): Volume 46, Number 4
[19]罗兵,曾歆懿,季秀霞. SMT产品缺陷及相应的AOI检测方法.电子质量, 2006, (6):35~37
[20]陆国权.世界电子元件现状与发展趋势.世界产品与技术.2003, (12):34~41
[21]王可东,孙道虎,晏磊.低成本CMOS阵列式高速成像系统.半导体光电. 2005, (2):146~150
[22]马军.高速高性能数据采集系统的实现方法.现代电子技术, 2007, (9):130~131
[23]林长青,孙胜利.基于FPGA的多路高速数据采集系统.电测与仪表, 2005, (5):52~54
[24]朱明,鲁剑锋.基于DSP+FPGA结构图像处理系统设计与实现.计算机测量与控制, 2004, (9):866~869
[25]高春甫,杨前进,冯礼萍.基于FPGA+DSP的CCD实时图像采集处理系统.山西大学学报(自然科学版), 2007, (1):36~39
[26]徐大鹏.实时图像采集系统的DMA通道设计.计算机测量与控制, 2006, (5):683~685
[27]魏长城,吴芝路.基于PCI总线控制器的DMA方式传输数据的实现.国外电子测量技术, 2005, (2):43~45
[28]李深,吴淑泉,刘喜英.基于FPGA和ISA总线的图像数据采集系统.微电子技术, 2002, (4):36~37
[29] Kohtaro Ohba, JesusCarlosPedraza Ortega, Kazuo Tanie.Microscopic vision system with all-in-focus and depth images.Machine Vision and Applications.Volume15, Number 2, 2003, (12)
[30] Jacky Baltes.Efficient Image Processing for Increased Resolution and ColorCorrectness of CMOS Image Sensors.Lecture Notes in Computer Science Volume 2377/2002.Robot Soccer World Cup V.2001
[31] Edward_abellera.OV3620_DS (1.7). fm.March 16, 2005
[32] SUN Fei, YAN Da-yuan, YUAN Jie. Measuring sensitive range of CMOS sensor and light auto-adjusting design based on general programmable interface.Optical Technique 2005, (4):592~594
[33]李玉山,来新泉,饶睿坚. CMOS图像传感芯片的成像技术.微电子学, 2001, (04):272~275
[34]白喆,张伯珩,边川平.基于FPGA的CMOS图像敏感器驱动电路设计.科学技术与工程, 2005, (19):1317~1320
[35] Yu Liu, Guoyu Wang.Design and implementation of CMOS image sensor.Journal of Electronics (China).Volume 24, Number1, 2007, (1)
[36] Winbond.Datasheet of W9825G6CHa.June, 21.2005
[37]蔡菲娜,曹祁.利用FPGA实现DMA方式的高速数据采集.微电子学与计算机, 2005, (3):239~241
[38]徐大鹏.实时图像采集系统的DMA通道设计.计算机测量与控制, 2006, (5):683~685
[39] Kenneth.R.Castleman.Digital Image Processing.北京电子工业出版社, 1999
[40]刘中合,王瑞雪,王锋德.数字图像处理技术现状与展望.计算机时代, 2005, (09):6~8
[41]张崇,于晓琳,邓长军. FPGA在图像处理中的应用.电子质量, 2004, (3):13~15
[42] Udi Efrat.光学检测系统的优化和评估的新方法.电子工业专用设备, 2004. (1):71~77
[43] Holger Flatt, Sebastian Hesselbarth, Sebastian Flügel, Peter.A Modular Coprocessor Architecture for Embedded Real-Time Image and Video Signal Processing.Embedded Computer Systems: Architectures, Modeling, and Simulation.Lecture Notes in Computer Science.2007.Volume 4599
[44] Xilinx DS312 Spartan-3E FPGA Family Complete Data Sheet. DS312-3 (v1.0) March 1, 2005
[45] WANG Jun, HU Yue-li, WU Yu-si.An Image Processing Software Platform Based onEmbedded System. Instrumentation Technology.2006, (2):10~12
[46] Texas Instruments.Msp430F11X1 datasheet
[47]唐佩忠. VHDL与数位逻辑设计.高立图书, 1999
[48]单宝堂,沈庭芝,赵鹏. CMOS图像数据转换方法的研究与实现.仪器仪表学报, 2006, (z3,Volume27):2193~2195
[49] Bayer.B. Color Imaging Array.U.S.Patent. No.3.971.065(1976)
[50]张静,李玉山,侯彦宾.基于TMS320c6711b浮点DSP的自动白平衡的实现.电子科技, 2006, (2):9~12
[51]崔巍,汶德胜,马涛. Bayer图像无损压缩算法及其FPGA实现.科学技术与工程, 2006, (9):1208~1212
[52] Xilinx XAPP463 Using Block RAM in Spartan-3 Generation FPGAs, Application Note. XAPP463 (v2.0) March 1, 2005
[53] Ali Zakerolhosseini, Peter Lee, Ed Horne.An FPGA-based object recognition machine.Field-Programmable Logic and Applications From FPGAs to Computing Paradigm.Lecture Notes in Computer Science.Volume 1482/1998
[54] Torp, H.; Lai, X.M.; Kristoffersen, K.Comparison between cross-correlation and auto-correlation technique in color flow maging.Ultrasonics Symposium, 1993. Proceedings, IEEE 1993.31 Oct.-3 Nov. 1993 Page(s):1039~1042 vol.2
[55] Yamaguchi, A.; Komuro, O.Characterization of line edge roughness in resist patterns by Fourier analysis and auto-correlation function.Microprocesses and Nanotechnology Conference, 2002. Digest of Papers.Microprocesses and Nanotechnology.International.6-8 Nov.2002:80~81
[2]白木,周洁. AOI系统在SMT生产线上的应用.电子机械工程电子机械工程2003, (3):10~13
[3]祝长青. AOI在研究所型SMT生产线上的一机两用实践.电子工业技术, 2005, (5):147~149
[4]侯一雪.应用AOI控制制造工艺质量.电子工业专用设备. 2002, (2):92~95
[5]鲜飞.自动光学测试实现生产效益最大化.电气时代, 2004, (1)122~123
[6]杨建生,陈建军. A0I与SPC的结合使PCB组装最佳化.电子质量, 2003, (9):36~38
[7]周德俭,黄春跃,吴兆华.基于焊点虚拟成形技术的SMT焊点质量保证技术研究.计算机集成制造系统, 2001, (2):56~59
[8] J. W. Foster, P. Griffin, J. D. Korry .Automated visual inspection of bare printed circuit boards using parallel processor hardware.The International Journal of Advanced Manufacturing Technology.1987(5):Volume 2, Number 2
[9]周德俭. SMT组装质量检测中的AOI技术与系统.电子工业专用设备, 2002, (6):87~95
[10]胡跃明,谭颖.自动光学检测在中国的应用现状和发展.微计算机信息, 2006 (4):143~146
[11]王庆有. CCD应用技术.天津:天津大学出版社, 2000
[12]宋勇,郝群,王涌天,王占和. CMOS图像传感器与CCD的比较及发展现状.仪器仪表学报, 2001, 21(增刊):387～389
[13]胡隽,杨平,何辅云.一阶灰色系统模型在图像处理中的应用.上海电力学院学报, 2004, (20):1~4
[14]张凤林,孙学珠.工程光学.天津:天津大学出版社, 1996
[15]柯丽,黄廉卿. DSP芯片在实时图像处理系统中的应用.光机电信息2005, (1):17~23
[16]吴继华.将低成本FPGA用于视频和图像处理.电子设计应用. 2007, (1):26~26,28~30
[17] Zhang Guilin, Zhang Liuyang. Design and Implementation of Digital Image Processing Algorithm Evaluation System Based on DSP + FPGA + USB2.0 Architecture. Computer and Digital Engineering.2005, (12):88~91
[18] A. A. Krasnobaev, A. K. Platonov.A method of parallel-sequential detection of image features in computer vision systems.Journal of Computer and Systems Sciences International.2007 (8): Volume 46, Number 4
[19]罗兵,曾歆懿,季秀霞. SMT产品缺陷及相应的AOI检测方法.电子质量, 2006, (6):35~37
[20]陆国权.世界电子元件现状与发展趋势.世界产品与技术.2003, (12):34~41
[21]王可东,孙道虎,晏磊.低成本CMOS阵列式高速成像系统.半导体光电. 2005, (2):146~150
[22]马军.高速高性能数据采集系统的实现方法.现代电子技术, 2007, (9):130~131
[23]林长青,孙胜利.基于FPGA的多路高速数据采集系统.电测与仪表, 2005, (5):52~54
[24]朱明,鲁剑锋.基于DSP+FPGA结构图像处理系统设计与实现.计算机测量与控制, 2004, (9):866~869
[25]高春甫,杨前进,冯礼萍.基于FPGA+DSP的CCD实时图像采集处理系统.山西大学学报(自然科学版), 2007, (1):36~39
[26]徐大鹏.实时图像采集系统的DMA通道设计.计算机测量与控制, 2006, (5):683~685
[27]魏长城,吴芝路.基于PCI总线控制器的DMA方式传输数据的实现.国外电子测量技术, 2005, (2):43~45
[28]李深,吴淑泉,刘喜英.基于FPGA和ISA总线的图像数据采集系统.微电子技术, 2002, (4):36~37
[29] Kohtaro Ohba, JesusCarlosPedraza Ortega, Kazuo Tanie.Microscopic vision system with all-in-focus and depth images.Machine Vision and Applications.Volume15, Number 2, 2003, (12)
[30] Jacky Baltes.Efficient Image Processing for Increased Resolution and ColorCorrectness of CMOS Image Sensors.Lecture Notes in Computer Science Volume 2377/2002.Robot Soccer World Cup V.2001
[31] Edward_abellera.OV3620_DS (1.7). fm.March 16, 2005
[32] SUN Fei, YAN Da-yuan, YUAN Jie. Measuring sensitive range of CMOS sensor and light auto-adjusting design based on general programmable interface.Optical Technique 2005, (4):592~594
[33]李玉山,来新泉,饶睿坚. CMOS图像传感芯片的成像技术.微电子学, 2001, (04):272~275
[34]白喆,张伯珩,边川平.基于FPGA的CMOS图像敏感器驱动电路设计.科学技术与工程, 2005, (19):1317~1320
[35] Yu Liu, Guoyu Wang.Design and implementation of CMOS image sensor.Journal of Electronics (China).Volume 24, Number1, 2007, (1)
[36] Winbond.Datasheet of W9825G6CHa.June, 21.2005
[37]蔡菲娜,曹祁.利用FPGA实现DMA方式的高速数据采集.微电子学与计算机, 2005, (3):239~241
[38]徐大鹏.实时图像采集系统的DMA通道设计.计算机测量与控制, 2006, (5):683~685
[39] Kenneth.R.Castleman.Digital Image Processing.北京电子工业出版社, 1999
[40]刘中合,王瑞雪,王锋德.数字图像处理技术现状与展望.计算机时代, 2005, (09):6~8
[41]张崇,于晓琳,邓长军. FPGA在图像处理中的应用.电子质量, 2004, (3):13~15
[42] Udi Efrat.光学检测系统的优化和评估的新方法.电子工业专用设备, 2004. (1):71~77
[43] Holger Flatt, Sebastian Hesselbarth, Sebastian Flügel, Peter.A Modular Coprocessor Architecture for Embedded Real-Time Image and Video Signal Processing.Embedded Computer Systems: Architectures, Modeling, and Simulation.Lecture Notes in Computer Science.2007.Volume 4599
[44] Xilinx DS312 Spartan-3E FPGA Family Complete Data Sheet. DS312-3 (v1.0) March 1, 2005
[45] WANG Jun, HU Yue-li, WU Yu-si.An Image Processing Software Platform Based onEmbedded System. Instrumentation Technology.2006, (2):10~12
[46] Texas Instruments.Msp430F11X1 datasheet
[47]唐佩忠. VHDL与数位逻辑设计.高立图书, 1999
[48]单宝堂,沈庭芝,赵鹏. CMOS图像数据转换方法的研究与实现.仪器仪表学报, 2006, (z3,Volume27):2193~2195
[49] Bayer.B. Color Imaging Array.U.S.Patent. No.3.971.065(1976)
[50]张静,李玉山,侯彦宾.基于TMS320c6711b浮点DSP的自动白平衡的实现.电子科技, 2006, (2):9~12
[51]崔巍,汶德胜,马涛. Bayer图像无损压缩算法及其FPGA实现.科学技术与工程, 2006, (9):1208~1212
[52] Xilinx XAPP463 Using Block RAM in Spartan-3 Generation FPGAs, Application Note. XAPP463 (v2.0) March 1, 2005
[53] Ali Zakerolhosseini, Peter Lee, Ed Horne.An FPGA-based object recognition machine.Field-Programmable Logic and Applications From FPGAs to Computing Paradigm.Lecture Notes in Computer Science.Volume 1482/1998
[54] Torp, H.; Lai, X.M.; Kristoffersen, K.Comparison between cross-correlation and auto-correlation technique in color flow maging.Ultrasonics Symposium, 1993. Proceedings, IEEE 1993.31 Oct.-3 Nov. 1993 Page(s):1039~1042 vol.2
[55] Yamaguchi, A.; Komuro, O.Characterization of line edge roughness in resist patterns by Fourier analysis and auto-correlation function.Microprocesses and Nanotechnology Conference, 2002. Digest of Papers.Microprocesses and Nanotechnology.International.6-8 Nov.2002:80~81