基于FPGA的嵌入式图像采集卡的研究
|
摘要
图像采集和处理技术在机器视觉和图像分析等诸多领域应用十分广泛，大部分情况下，采集卡只需将前端相机捕获的图像信息正确地传回计算机即可。但是在要求较高的应用场合需要采集卡能准确控制外部光源和相机，完成图像采集，预处理，数据传输。只有这样，用户才可以根据不同的兴趣和需求对特定的某些图像进行采集、传输以及处理，以达到某种分析目的。
本文根据国家985二期项目“三维粒子图像测速系统”的图像采集与处理需要，设计开发了一款以FPGA为核心控制芯片的嵌入式图像采集卡。采集卡以FPGA为逻辑和算法实现的核心器件，不仅实现了传统意义上的图像采集，而且实现了CCD相机控制和激光器同步曝光功能，打破了以往单纯靠增加硬件设备实现同步控制的方法，简化了系统硬件结构并节约系统成本。此外，在系统中嵌入了图像增强算法和采用PCI接口与计算机连接满足了高速采集的要求。同时，采用市场上广泛应用的Camera Link作为采集卡的图像输入接口，提高了系统的通用性、传输速率和抗干扰能力，简化图像获取设备和模拟摄像头之间需要视频解码等连接。具有嵌入式处理功能，光源同步和相机控制的采集卡将使机器视觉系统，图像测速等诸多领域的图像采集应用变得更为便捷。
论文首先对图像采集卡系统的组成、整体方案和可行性进行了论证。然后给出了图像采集卡的硬件设计。在此部分结合整体设计方案，讨论芯片的选型问题。根据所选芯片的本身特点，分模块地对图像采集卡的硬件设计原理进行了详细的阐述。接下来是图像采集卡的软件设计部分。用VHDL和原理图结合的方法对FPGA进行编程，实现了图像采集系统的各个功能模块。根据图像采集系统的要求用DriverWorks软件设计了图像采集卡的WDM底层驱动程序和上层应用程序。最后是用FPGA实现了带修改参数的硬件嵌入式图像处理算法——图像增强。论文中使用QUARTUS软件嵌入的逻辑分析仪SignalTap对FPGA设计的模块进行了硬件调试，给出了调试的时序图和调试结果，经测试分析该采集卡满足“三维粒子图像测速系统”的要求，达到了预期目标。
The application of image acquisition and processing technology in many fields such as machine vision and image analysis is very wide. In most circumstances, frame grabber is only responsible for transmitting the image data captured by the front-end cameras to the computer. In other special circumstances, frame grabber must accurately control cameras and synchronize external light source, in order to implement image capturing, pre-processing and image data transmitting. In this way, users can, depending on the various needs, deal with and analyze the sent-back data, so as to achieve certain purposes.
According to the image processing needs of the three-dimensional particle image velocimetry system, whichi is a 2~(nd) project of 985 SCHEME, an embedded image frame grabber, the heart of which is FPGA, is designed and developed. The logic and algorithms are realized by programming the FPGA chip, in order to achieve both the image acquisition in traditional sense and the control of CCD camera and LASER synchronization exposure function. This breaks the traditional synchronized control methods which is simply relied on increased hardware devices, correspondingly simplify the structure of the hardware system and save the total cost. In addition, the image enhancement algorithm is embedded in the system ,the requirements of high-speed acquisition is met using PCI interface, the widely used Camera-Link is adopted as the image input interface, all these methods enhances the versatility, the transmission rate and anti-jamming capabilities of the system, also simplify the connectivity between the image acquisition equipment and the analog camera. The frame grabber, which is capable of embedded processing, camera control and light source synchronization, will make the image acquisition in many areas such as machine vision systems, image velocimetry become more convenient.
First the paper not only proves the makeup and the scheme of the image acquisition system but also the feasibility of the system. Then the hardware design is given. The problem of selecting chip is referred when masterminding the architecture of the system. According to the characteristic of the chip, the card's hardware design theory is expatiated in models. The following is the part of the software of the image acquisition card. The every model of the image acquisition system is implemented by programming the FPGA in VHDL and schematic. Based on the requirements of the image acquisition system, the WDM driver is designed by DriverWorks and application program is also given. The IP core is implemented in FPGA at last. And the function of the IP care is hardware embedded graphic arithmetic--image enhance, in which the parameter can be changed. By using the QUARTUS' logic analyzer (SignalTap), the modules for FPGA design is debugged in hardware, and the timing map and the debug results is given.After tested and analyzed, the acquisition card meet the requirements of "three-dimensional particle image velocimetry system" and the planned targets is achieved.
本文根据国家985二期项目“三维粒子图像测速系统”的图像采集与处理需要，设计开发了一款以FPGA为核心控制芯片的嵌入式图像采集卡。采集卡以FPGA为逻辑和算法实现的核心器件，不仅实现了传统意义上的图像采集，而且实现了CCD相机控制和激光器同步曝光功能，打破了以往单纯靠增加硬件设备实现同步控制的方法，简化了系统硬件结构并节约系统成本。此外，在系统中嵌入了图像增强算法和采用PCI接口与计算机连接满足了高速采集的要求。同时，采用市场上广泛应用的Camera Link作为采集卡的图像输入接口，提高了系统的通用性、传输速率和抗干扰能力，简化图像获取设备和模拟摄像头之间需要视频解码等连接。具有嵌入式处理功能，光源同步和相机控制的采集卡将使机器视觉系统，图像测速等诸多领域的图像采集应用变得更为便捷。
论文首先对图像采集卡系统的组成、整体方案和可行性进行了论证。然后给出了图像采集卡的硬件设计。在此部分结合整体设计方案，讨论芯片的选型问题。根据所选芯片的本身特点，分模块地对图像采集卡的硬件设计原理进行了详细的阐述。接下来是图像采集卡的软件设计部分。用VHDL和原理图结合的方法对FPGA进行编程，实现了图像采集系统的各个功能模块。根据图像采集系统的要求用DriverWorks软件设计了图像采集卡的WDM底层驱动程序和上层应用程序。最后是用FPGA实现了带修改参数的硬件嵌入式图像处理算法——图像增强。论文中使用QUARTUS软件嵌入的逻辑分析仪SignalTap对FPGA设计的模块进行了硬件调试，给出了调试的时序图和调试结果，经测试分析该采集卡满足“三维粒子图像测速系统”的要求，达到了预期目标。
The application of image acquisition and processing technology in many fields such as machine vision and image analysis is very wide. In most circumstances, frame grabber is only responsible for transmitting the image data captured by the front-end cameras to the computer. In other special circumstances, frame grabber must accurately control cameras and synchronize external light source, in order to implement image capturing, pre-processing and image data transmitting. In this way, users can, depending on the various needs, deal with and analyze the sent-back data, so as to achieve certain purposes.
According to the image processing needs of the three-dimensional particle image velocimetry system, whichi is a 2~(nd) project of 985 SCHEME, an embedded image frame grabber, the heart of which is FPGA, is designed and developed. The logic and algorithms are realized by programming the FPGA chip, in order to achieve both the image acquisition in traditional sense and the control of CCD camera and LASER synchronization exposure function. This breaks the traditional synchronized control methods which is simply relied on increased hardware devices, correspondingly simplify the structure of the hardware system and save the total cost. In addition, the image enhancement algorithm is embedded in the system ,the requirements of high-speed acquisition is met using PCI interface, the widely used Camera-Link is adopted as the image input interface, all these methods enhances the versatility, the transmission rate and anti-jamming capabilities of the system, also simplify the connectivity between the image acquisition equipment and the analog camera. The frame grabber, which is capable of embedded processing, camera control and light source synchronization, will make the image acquisition in many areas such as machine vision systems, image velocimetry become more convenient.
First the paper not only proves the makeup and the scheme of the image acquisition system but also the feasibility of the system. Then the hardware design is given. The problem of selecting chip is referred when masterminding the architecture of the system. According to the characteristic of the chip, the card's hardware design theory is expatiated in models. The following is the part of the software of the image acquisition card. The every model of the image acquisition system is implemented by programming the FPGA in VHDL and schematic. Based on the requirements of the image acquisition system, the WDM driver is designed by DriverWorks and application program is also given. The IP core is implemented in FPGA at last. And the function of the IP care is hardware embedded graphic arithmetic--image enhance, in which the parameter can be changed. By using the QUARTUS' logic analyzer (SignalTap), the modules for FPGA design is debugged in hardware, and the timing map and the debug results is given.After tested and analyzed, the acquisition card meet the requirements of "three-dimensional particle image velocimetry system" and the planned targets is achieved.
引文
[1] 崔恒．流体二维图像测速系统的研究：(硕士学位论文)．大连：大连理工大学，2006．
[2] Toshihito Fujiwara, Kenji Fujimoto, Tsutomu Maruyama. A Real-Time Visualization System for PIV[J].Lecture Notes in Computer Science, 2003, Volume 2778:437-447.
[3] 章丽萍，周凤星．基于EP1C3T144的最小系统开发板的设计[J]．武汉科技大学学报， 2007，30(3)：293-295．
[4] 任爱峰，初秀琴．基于FPGA的嵌入式系统设计[M]．西安：西安电子科技大学出版社，2005：17-26，333-354．
[5] National Semiconductor Corporation. LM1085 3A Low Dropout Positive Regulators[EB]. August 2001.
[6] 吴继华，王诚．Altera FPGA／CPLD设计[M]．北京：人民邮电出版社，2005：66-69．
[7] 房磊，张焕春，经亚枝．FPGA的配置及接口电路[J]．电子质量，2004，(01)：2-3
[8] Altera corporation. Byterblaster parallel port down cable data sheet[EB].1988, ver. 2.01:299-313
[9] 陈东，余松煜．PCI总线规范及接口[J]．微型机及应用，1996-8．
[10] PCI Local Bus Specification Revision 2.1[EB].June 1995:4-6.
[11] PCI Local Bus Specification Revision 2.2[EB].December 1998:7-20.
[12] 吴业进，刘锋．PCI9052总线接口芯片及其ISA模式应用[J]．电子工程师，2003，(04)：24-26
[13] PLX Technology, Inc. PCI 9054 Data Book [EB]. V2.1, January 2000.
[14] 黄身锞．PCI总线接口芯片9054及其应用[J]．世界电子元器件，2006，(10)：57-59．
[15] PLX Technology, Inc. PCI SDK SOFTWARE DEVELOPMENT KIT User's Manual[EB].Version 4.10, May, 2003:57-69.
[16] PLX Technology, Inc .PCI SDK SOFTWARE DEVELOPMENT KIT Programmer's Reference Manual[EB].Version 4.10, May, 2003.
[17] 李宁，汪骏发．基于Camera Link的高速数据采集系统[J]．红外，2005，(07)：31-37．
[18] Basler Vision Technologies. Camera Link Technology Brief[EB]. March 2001:6-20.
[19] 张涛，舒林锋，郑冬军等．LVDS接口原理和标准及在平板显示系统中的应用[J]．计算机与数字工程，2007，(09)：184-186．
[20] National Semiconductor Corporation. DS90CR281/DS90CR282 28-Bit Channel Link[EB]. November 1996:1-15.
[21] LYNX Inc..LYNX User's Manual RAO4[EB].August 2005.
[22] 陈炳权．基于FPGA器件的RS232—C接口设计及其扩展[J]．攀枝花学院学报，2006，23(05)：106-109
[23] National Semiconductor Corporation. DS90LVO47A 3V LVDS Quad CMOS Differential Line Driver[EB], July 1999.
[24] National Semiconductor Corporation. DS90LVO48A 3V LVDS Quad CMOS Differential Line Driver[EB], July 1999.
[25] Texas Instruments Incorporated. MAX232 dual EIA-232 driver/receiver datasheet, 2004.
[26] Hynix Semiconductor Inc. HY57V283220(L)T(P)/ HY5V22(L)F(P) 4 Banks x 1M x 32Bit Synchronous DRAM Rev. 0.9[EB],July 2004.
[27] 李贵山，陈金鹏．PCI局部总线及应用[M]．西安：西安电子科技大学出版社，2003：8-16．
[28] 崔玮．Protel 99SE电路原理图与电路板设计教程[M]．北京：海洋出版社，2005．
[29] 张伟，王力．Protel 99SE基础教程[M]．北京：人民邮电出版社，2006．
[30] 尹勇，李宇．PCI总线设备开发宝典[M]．北京：北京航空航天大学出版社，2005：25-26，130-138．
[31] 武安河．Windows 2000／XP WDM 设备驱动程序开发[M]．北京：电子工业出版社，2005：5-7，323-352．
[32] 刘蓬，张培仁．用DDK开发WDM驱动程序[J]．计算机应用，2003，23(S2)：248-250．
[33] 游南林．用DDK开发Windows NT下的设备驱动程序[J]．微型机与应用，1999，(08)：8-11．
[34] 张增辉，沈激，陈子瑜．基于WinDriver工具的PCI卡驱动程序开发[J]．核电子学与探测技术，2006，26(3)：267-369．
[35] 宋玉贵，王世凯，李海．基于Windriver Kernel PlugIn的驱动程序设计[J]．西安工业学院学报，2005，25(4)：311-314．
[36] Compuware Corporation. Using DriverStudio Development Tools Release 3.1[EB].2003.
[37] 孟华．用DriverWorks开发PCI设备的WDM驱动程序[J]，电子与信息工程，2006-4(2)：121-124．
[38] 陈富章，李伟光，高严松等．基于PCI总线运动控制卡WDM驱动程序设计[J]，微计算机信息， 2007-23(7-1)：213-215．
[39] 司玉美，申会民，耿爱辉等．基于PCI总线数据通信卡WDM驱动程序设计[J]．计算机测量与控制，2006，14(2)：259-261．
[40] 邰铭，武安河．WINDOWS下PCI接口卡WDM驱动程序的DMA编程技术[J]．微计算机信息，2003，19(10)：79-80．
[41] Chris Cant著．Writing Windows WDM Device Drivers．孙义，马莉波，国雪飞等译．Windows WDM 设备驱动程序开发指南[M]．北京：机械工业出版社，2000：179-203．
[42] 龚建伟，熊光明．Visual C++／Turbo C串口通信编程实践[M]．北京：电子工业出版社，2004．4-12
[43] 童鹏，吴新建．PCI9054芯片接口设计中若干问题的深入研究[J]．电子技术应用，2005， (10)：64-66．
[44] Altera Corporation. SDR SDRAM Controller White Paper ver1.1[EB],August 2002:1-16.
[45] 田丰，邓建国，李巍等．SDRAM控制的设计与VHDL语言实现[J]．电子技术应用，2005(12)：74-77．
[46] 胡振华．VHDL与FPGA设计[M]．北京：中国铁道出版社，2002：157-175．
[47] Micron Technology, Inc. SYNCHRONOUS DRAM data sheet[EB].2002.
[48] 刘韬，楼兴华．FPGA数字电子系统设计与开发实例导航[M]．北京：人民邮电出版社，2005：134-178．
[49] 郭佳佳，胡晓菁．使用SignalTapⅡ逻辑分析仪调试FPGA[J]，今日电子，2005，(5)：45-47．
[50] 俞诗鲲，郑建生，曾欣．用CPLD实现嵌入式平台上的实时图像增强[J]．电子技术应用，2003，(12)：10-12．
[51] 韩娟娟，邓文怡，娄小平．基于FPGA的图像增强处理系统的设计与实现[J]．微计算机信息， 2007-23(9-2)：229-230．
[52] 何东建．数字图像处理[M]．西安：西安电子科技大学出版社，2003：54-63．
[53] 章毓晋．图象处理与分析[M]．北京：清华大学出版社，1999：72-80．
[2] Toshihito Fujiwara, Kenji Fujimoto, Tsutomu Maruyama. A Real-Time Visualization System for PIV[J].Lecture Notes in Computer Science, 2003, Volume 2778:437-447.
[3] 章丽萍，周凤星．基于EP1C3T144的最小系统开发板的设计[J]．武汉科技大学学报， 2007，30(3)：293-295．
[4] 任爱峰，初秀琴．基于FPGA的嵌入式系统设计[M]．西安：西安电子科技大学出版社，2005：17-26，333-354．
[5] National Semiconductor Corporation. LM1085 3A Low Dropout Positive Regulators[EB]. August 2001.
[6] 吴继华，王诚．Altera FPGA／CPLD设计[M]．北京：人民邮电出版社，2005：66-69．
[7] 房磊，张焕春，经亚枝．FPGA的配置及接口电路[J]．电子质量，2004，(01)：2-3
[8] Altera corporation. Byterblaster parallel port down cable data sheet[EB].1988, ver. 2.01:299-313
[9] 陈东，余松煜．PCI总线规范及接口[J]．微型机及应用，1996-8．
[10] PCI Local Bus Specification Revision 2.1[EB].June 1995:4-6.
[11] PCI Local Bus Specification Revision 2.2[EB].December 1998:7-20.
[12] 吴业进，刘锋．PCI9052总线接口芯片及其ISA模式应用[J]．电子工程师，2003，(04)：24-26
[13] PLX Technology, Inc. PCI 9054 Data Book [EB]. V2.1, January 2000.
[14] 黄身锞．PCI总线接口芯片9054及其应用[J]．世界电子元器件，2006，(10)：57-59．
[15] PLX Technology, Inc. PCI SDK SOFTWARE DEVELOPMENT KIT User's Manual[EB].Version 4.10, May, 2003:57-69.
[16] PLX Technology, Inc .PCI SDK SOFTWARE DEVELOPMENT KIT Programmer's Reference Manual[EB].Version 4.10, May, 2003.
[17] 李宁，汪骏发．基于Camera Link的高速数据采集系统[J]．红外，2005，(07)：31-37．
[18] Basler Vision Technologies. Camera Link Technology Brief[EB]. March 2001:6-20.
[19] 张涛，舒林锋，郑冬军等．LVDS接口原理和标准及在平板显示系统中的应用[J]．计算机与数字工程，2007，(09)：184-186．
[20] National Semiconductor Corporation. DS90CR281/DS90CR282 28-Bit Channel Link[EB]. November 1996:1-15.
[21] LYNX Inc..LYNX User's Manual RAO4[EB].August 2005.
[22] 陈炳权．基于FPGA器件的RS232—C接口设计及其扩展[J]．攀枝花学院学报，2006，23(05)：106-109
[23] National Semiconductor Corporation. DS90LVO47A 3V LVDS Quad CMOS Differential Line Driver[EB], July 1999.
[24] National Semiconductor Corporation. DS90LVO48A 3V LVDS Quad CMOS Differential Line Driver[EB], July 1999.
[25] Texas Instruments Incorporated. MAX232 dual EIA-232 driver/receiver datasheet, 2004.
[26] Hynix Semiconductor Inc. HY57V283220(L)T(P)/ HY5V22(L)F(P) 4 Banks x 1M x 32Bit Synchronous DRAM Rev. 0.9[EB],July 2004.
[27] 李贵山，陈金鹏．PCI局部总线及应用[M]．西安：西安电子科技大学出版社，2003：8-16．
[28] 崔玮．Protel 99SE电路原理图与电路板设计教程[M]．北京：海洋出版社，2005．
[29] 张伟，王力．Protel 99SE基础教程[M]．北京：人民邮电出版社，2006．
[30] 尹勇，李宇．PCI总线设备开发宝典[M]．北京：北京航空航天大学出版社，2005：25-26，130-138．
[31] 武安河．Windows 2000／XP WDM 设备驱动程序开发[M]．北京：电子工业出版社，2005：5-7，323-352．
[32] 刘蓬，张培仁．用DDK开发WDM驱动程序[J]．计算机应用，2003，23(S2)：248-250．
[33] 游南林．用DDK开发Windows NT下的设备驱动程序[J]．微型机与应用，1999，(08)：8-11．
[34] 张增辉，沈激，陈子瑜．基于WinDriver工具的PCI卡驱动程序开发[J]．核电子学与探测技术，2006，26(3)：267-369．
[35] 宋玉贵，王世凯，李海．基于Windriver Kernel PlugIn的驱动程序设计[J]．西安工业学院学报，2005，25(4)：311-314．
[36] Compuware Corporation. Using DriverStudio Development Tools Release 3.1[EB].2003.
[37] 孟华．用DriverWorks开发PCI设备的WDM驱动程序[J]，电子与信息工程，2006-4(2)：121-124．
[38] 陈富章，李伟光，高严松等．基于PCI总线运动控制卡WDM驱动程序设计[J]，微计算机信息， 2007-23(7-1)：213-215．
[39] 司玉美，申会民，耿爱辉等．基于PCI总线数据通信卡WDM驱动程序设计[J]．计算机测量与控制，2006，14(2)：259-261．
[40] 邰铭，武安河．WINDOWS下PCI接口卡WDM驱动程序的DMA编程技术[J]．微计算机信息，2003，19(10)：79-80．
[41] Chris Cant著．Writing Windows WDM Device Drivers．孙义，马莉波，国雪飞等译．Windows WDM 设备驱动程序开发指南[M]．北京：机械工业出版社，2000：179-203．
[42] 龚建伟，熊光明．Visual C++／Turbo C串口通信编程实践[M]．北京：电子工业出版社，2004．4-12
[43] 童鹏，吴新建．PCI9054芯片接口设计中若干问题的深入研究[J]．电子技术应用，2005， (10)：64-66．
[44] Altera Corporation. SDR SDRAM Controller White Paper ver1.1[EB],August 2002:1-16.
[45] 田丰，邓建国，李巍等．SDRAM控制的设计与VHDL语言实现[J]．电子技术应用，2005(12)：74-77．
[46] 胡振华．VHDL与FPGA设计[M]．北京：中国铁道出版社，2002：157-175．
[47] Micron Technology, Inc. SYNCHRONOUS DRAM data sheet[EB].2002.
[48] 刘韬，楼兴华．FPGA数字电子系统设计与开发实例导航[M]．北京：人民邮电出版社，2005：134-178．
[49] 郭佳佳，胡晓菁．使用SignalTapⅡ逻辑分析仪调试FPGA[J]，今日电子，2005，(5)：45-47．
[50] 俞诗鲲，郑建生，曾欣．用CPLD实现嵌入式平台上的实时图像增强[J]．电子技术应用，2003，(12)：10-12．
[51] 韩娟娟，邓文怡，娄小平．基于FPGA的图像增强处理系统的设计与实现[J]．微计算机信息， 2007-23(9-2)：229-230．
[52] 何东建．数字图像处理[M]．西安：西安电子科技大学出版社，2003：54-63．
[53] 章毓晋．图象处理与分析[M]．北京：清华大学出版社，1999：72-80．