基于FPGA的视频图像传输的设计与实现
|
摘要
随着电子产品向着小型化、轻量化和便携式方向发展,各种电子元件的集成度也越来越高,这就给传统的表面贴装技术(SMT)生产线上的产品检测技术带来了挑战,因此,高速、高解析度的自动光学检测系统已成为必不可少的关键设备。
项目的研究内容是富士康SMT技术委员会设备研发部在开发阵列式影像侦测模组的过程中提出来的,为了使自动光学检测系统中图像处理结果具有实时性,必须要求影像资料传输具有高速性,因而如何实现高速的传输成为研发中急需解决的问题。
在整个项目研发过程中,提出使用千兆网络传输芯片(IP1000A)作为影像数据的传输芯片,并使用网络传输协议对数据进行传送。主要包括两个方面的研究:一是SDRAM、IP1000A芯片的驱动设计;二是网络传输协议UDP/IP的实现。在芯片的驱动设计中,使用FPGA(Field Programmable Gate Array)实现对SDRAM与IP1000A芯片的驱动,包括对SDRAM芯片的初始化、读写操作、自动刷新等操作,对IP1000A芯片的寄存器读写操作、DMA(Direct Memory Access)接收与传输操作等。网络传输协议方面采用MSP430单片机实现UDP/IP传输协议,其中主要包括对ARP(Address Resolution Protocol)、UDP(User Datagram Protocol)、IP(Internet Protocol)等协议的实现。
实验表明,存储在SDRAM中的影像数据能够以UDP/IP数据包格式成功的传输给计算机,研究成果和文中所描述的设计思想和实现方法是合理的、切实可行的,对于类似的AOI系统开发具有一定的参考价值。
With the rapid development of the electronic industry, the electronic products have tended to become smaller, lighter and handier. Various electronic components of integration are higher and higher, which has challenged the detection technology used to detect products of traditional SMT product line. Therefore, the high-speed, high-resolution AOI (Automated Optical Inspection) systems have become the key equipment.
The content of paper is raised by equipment research and development department of the Foxconn SMT Technical Committee during the process of the development of image-array detection module. In order to make sure that the results of image processing in AOI system are real-time, we must require a high-speed image data transmission. Thus how to achieve high-speed transmission is the urgent problem to be solved in the course of research and development.
So,We use Gigabit network transmission chip (IP1000A) as image data transmission chips, which incorporates a 32-bit PCI interface with bus master support in this project, and use network transmission protocol for transmitting data .There are two major aspects of the study in this project: First, SDRAM, IP1000A chip-driven design, which implemented by FPGA (Field Programmable Gate Array), include SDRAM initialization, reading and writing, and automatically refresh, IP1000A registers read and write, DMA (Direct Memory Access) receiving and transmitting and so on; Second, the implementation of the network transmission protocol UDP / IP, which is based on MSP430. Experiments show that the storage of image data in SDRAM will be able to transmit to the computer successfully by using UDP / IP packets, and the design ideas and methods in this thesis are reasonable and practicable. It is also valuable for the development of similar AOI system.
项目的研究内容是富士康SMT技术委员会设备研发部在开发阵列式影像侦测模组的过程中提出来的,为了使自动光学检测系统中图像处理结果具有实时性,必须要求影像资料传输具有高速性,因而如何实现高速的传输成为研发中急需解决的问题。
在整个项目研发过程中,提出使用千兆网络传输芯片(IP1000A)作为影像数据的传输芯片,并使用网络传输协议对数据进行传送。主要包括两个方面的研究:一是SDRAM、IP1000A芯片的驱动设计;二是网络传输协议UDP/IP的实现。在芯片的驱动设计中,使用FPGA(Field Programmable Gate Array)实现对SDRAM与IP1000A芯片的驱动,包括对SDRAM芯片的初始化、读写操作、自动刷新等操作,对IP1000A芯片的寄存器读写操作、DMA(Direct Memory Access)接收与传输操作等。网络传输协议方面采用MSP430单片机实现UDP/IP传输协议,其中主要包括对ARP(Address Resolution Protocol)、UDP(User Datagram Protocol)、IP(Internet Protocol)等协议的实现。
实验表明,存储在SDRAM中的影像数据能够以UDP/IP数据包格式成功的传输给计算机,研究成果和文中所描述的设计思想和实现方法是合理的、切实可行的,对于类似的AOI系统开发具有一定的参考价值。
With the rapid development of the electronic industry, the electronic products have tended to become smaller, lighter and handier. Various electronic components of integration are higher and higher, which has challenged the detection technology used to detect products of traditional SMT product line. Therefore, the high-speed, high-resolution AOI (Automated Optical Inspection) systems have become the key equipment.
The content of paper is raised by equipment research and development department of the Foxconn SMT Technical Committee during the process of the development of image-array detection module. In order to make sure that the results of image processing in AOI system are real-time, we must require a high-speed image data transmission. Thus how to achieve high-speed transmission is the urgent problem to be solved in the course of research and development.
So,We use Gigabit network transmission chip (IP1000A) as image data transmission chips, which incorporates a 32-bit PCI interface with bus master support in this project, and use network transmission protocol for transmitting data .There are two major aspects of the study in this project: First, SDRAM, IP1000A chip-driven design, which implemented by FPGA (Field Programmable Gate Array), include SDRAM initialization, reading and writing, and automatically refresh, IP1000A registers read and write, DMA (Direct Memory Access) receiving and transmitting and so on; Second, the implementation of the network transmission protocol UDP / IP, which is based on MSP430. Experiments show that the storage of image data in SDRAM will be able to transmit to the computer successfully by using UDP / IP packets, and the design ideas and methods in this thesis are reasonable and practicable. It is also valuable for the development of similar AOI system.
引文
[1]方志斌.贴片机视觉自动标定技术研究: [硕士学位论文].上海交通大学图书馆, 2003: 2-6
[2]魏志凌. SMT模板关键技术规范的科学界定及其控制方法概论. 2007中国高端SMT学术会义论文集, 2007: 1-6
[3]尹纪兵. SMT工艺中常见元器件的焊盘与钢网的可制造性设计. 2007中国高端SMT学术会义论文集, 2007: 123-126
[4]鲜飞. AOI技术在SMT生产上的实施技巧与策略. SMT工艺与设备, 2006(5): 2-4
[5]周德俭. SMT组装质量检测中的AOI技术与系统.电子工业专用设备, 2002(31): 87-92
[6]白木,周洁. AOI系统在SMT生产线上的应用.电子机械工程, 2003(3): 1-3
[7] J Arena. Machine-vision and inspection test report. SMT China, 2003(5): 56-58
[8]罗兵,章云. SMT焊膏印刷质量自动光学检测.电子质量, 2005(12): 4-6
[9]伍绍贤. AOI技术应用、市场及发展状况. 2007中国高端SMT学术会义论文集, 2007: 451-453
[10]李磊,宗成,祝长青. AOI在实际生产中的应用、不足及对策. 2007中国高端SMT学术会义论文集, 2007: 454-456
[11]陆峰,范兆周. SMT设备的发展现状及趋势.世界电子元器件, 2002(4): 35-39
[12] Don Anderson, Tomshanley. PCI System Architeture Fourth Edition. Mindshare Inc, 2002: 1-400
[13] Cunningham, D. G. Gigabit Ethernet Networking. Macmillam Technical Publishing, 1999: 36-41
[14]薛兆玉,谭桂珍. PCI总线.微计算机应用, 1997(3): 56-60
[15]潘泓. PCI局部总线.电脑技术, 1995(5): 4-10
[16]尚朝轩,刘利民. PCI总线及其特点.测控技术, 1998(3): 13-17
[17] Bell, P. R., et al. Review of Point-to-Point Network Routing Algotithms. IEEE Commun. Magazine, 1986: 1-20
[18]谢希仁.计算机网络.第4版.北京:电子工业出版社, 2003
[19]李志超,孟相如.浅谈软交换网络及其发展前景.计算机与信息技术, 2007(8): 3-10
[20] Moy, J. T. Anatomy of an Internet Routing Protocol. Addison-Wesley, 1998: 23-54
[21] W. Richard Stevens著,范建华等译. TCP/IP详解卷1:协议.北京:机械工业出版社, 2000
[22] Collins, D.. Carrier Grade Voice over IP. McGraw-Hill, 2001: 98-101
[23]沈鑫剡等.多媒体传输网络与VoIP系统设计.北京:人民邮电出版社, 2005: 18-30
[24] Rich Seifert. Ethernet: technology and applications for high-speed LANs, 2003: 31-49
[25]陈曦,刘俊峰,付少波.工业以太网传输延时特性分析.计算机与信息技术, 2007(4): 3-9
[26] Douglas E. Comer. Internetworking With TCP/IP Vol I: Principles, Protocols, and Architectures Fourth Edition.北京:电子工业出版社, 2004
[27]王军.多媒体网络传输的研究与实现.国防科技大学: [硕士学位论文], 2002: 3-42
[28] ITU-T Recommendations H. 323v5, Packed-based multimedia communications systems, 2003: 5-11
[29]黄智伟. FPGA系统设计与实践.北京:电子工业出版社. 2005: 4-120
[30]薛萍,陈海燕,裴树军.基于ISP芯片的可编程数字频率计的设计.电测与仪表, 2002: 4-9
[31]侯伯亨,顾新. VHDL硬件描述语言与数字逻辑电路设计修订版.西安:西安电子科技大学出版社, 2001: 18-47
[32]姜雪松,刘东升.硬件描述语言VHDL教程.西安:西安交通大学出版社, 2004: 89-106
[33]秦龙. MSP430单片机应用系统开发典型实例.北京:电子工业出版社, 2005: 4-33
[34]胡大可. MSP430系列FLASH型超低功耗16位单片机.北京:北京航空航天出版社, 2001
[35] SEIFERT, R. Gigabit Ethernet. Addison-Wesley, 1998: 1-59
[36] Stallings, W., High-Speed Networks and Internets: Performance and quality of service, and ED., Macmillan, 1998: 5-39
[37]卢毅,赖杰. VHDL与数字电路设计.北京:科学出版社, 2001
[38] Kevin Skahill编,孙普译.可编程逻辑系统的VHDL设计技术.南京:东南大学出版社, 1998: 4-33
[39] The Programmable Logic Data Book. Xilinx company, 1999: 3-20
[40]赵曙光.可编程逻辑器件原理、开发与应用.西安:西安电子科技大学出版社, 2000: 11-69
[41]潘松. VHDL实用教程.成都:电子科技大学出版社, 2000: 78-83
[42]张智江,张云勇,刘韵洁. SIP协议及其应用.北京:电子工业出版社, 2006: 43-87
[43]沙燕萍曾烈光. SDRAM接口的VHDL设计.电子技术应用, 2000(6): 4-9
[44]施周渊戴庆元. DDR SDRAM控制器的FPGA实现.电子技术应用, 2003(11): 30-38
[45]宋振宇. SDRAM在图像采集中的应用.电子技术, 2001(4): 34-39
[46]姜立冬等. VHDL语言程序设计及应用.北京:北京邮电大学出版社, 2001:47-60
[47] Stig Oresjo. Test and Inspection as part of the lead-free manufacturing process. Anaheim, Calif, 2005: 512-520
[48] Comer, D. Internetworking with TCP/IP, 4th Ed., Prentice-Hall, 2000, 1: 9-25
[49]王小军. VHDL简明教程.北京:清华大学出版社, 1997: 89-93
[50]廖雷等. Java程序设计教程.北京:中国电力出版社, 2003: 66-121
[51] William Stallings. High-Speed Networks TCP/IP and ATM Design principles. Prentice hall press, 1999: 78-90
[2]魏志凌. SMT模板关键技术规范的科学界定及其控制方法概论. 2007中国高端SMT学术会义论文集, 2007: 1-6
[3]尹纪兵. SMT工艺中常见元器件的焊盘与钢网的可制造性设计. 2007中国高端SMT学术会义论文集, 2007: 123-126
[4]鲜飞. AOI技术在SMT生产上的实施技巧与策略. SMT工艺与设备, 2006(5): 2-4
[5]周德俭. SMT组装质量检测中的AOI技术与系统.电子工业专用设备, 2002(31): 87-92
[6]白木,周洁. AOI系统在SMT生产线上的应用.电子机械工程, 2003(3): 1-3
[7] J Arena. Machine-vision and inspection test report. SMT China, 2003(5): 56-58
[8]罗兵,章云. SMT焊膏印刷质量自动光学检测.电子质量, 2005(12): 4-6
[9]伍绍贤. AOI技术应用、市场及发展状况. 2007中国高端SMT学术会义论文集, 2007: 451-453
[10]李磊,宗成,祝长青. AOI在实际生产中的应用、不足及对策. 2007中国高端SMT学术会义论文集, 2007: 454-456
[11]陆峰,范兆周. SMT设备的发展现状及趋势.世界电子元器件, 2002(4): 35-39
[12] Don Anderson, Tomshanley. PCI System Architeture Fourth Edition. Mindshare Inc, 2002: 1-400
[13] Cunningham, D. G. Gigabit Ethernet Networking. Macmillam Technical Publishing, 1999: 36-41
[14]薛兆玉,谭桂珍. PCI总线.微计算机应用, 1997(3): 56-60
[15]潘泓. PCI局部总线.电脑技术, 1995(5): 4-10
[16]尚朝轩,刘利民. PCI总线及其特点.测控技术, 1998(3): 13-17
[17] Bell, P. R., et al. Review of Point-to-Point Network Routing Algotithms. IEEE Commun. Magazine, 1986: 1-20
[18]谢希仁.计算机网络.第4版.北京:电子工业出版社, 2003
[19]李志超,孟相如.浅谈软交换网络及其发展前景.计算机与信息技术, 2007(8): 3-10
[20] Moy, J. T. Anatomy of an Internet Routing Protocol. Addison-Wesley, 1998: 23-54
[21] W. Richard Stevens著,范建华等译. TCP/IP详解卷1:协议.北京:机械工业出版社, 2000
[22] Collins, D.. Carrier Grade Voice over IP. McGraw-Hill, 2001: 98-101
[23]沈鑫剡等.多媒体传输网络与VoIP系统设计.北京:人民邮电出版社, 2005: 18-30
[24] Rich Seifert. Ethernet: technology and applications for high-speed LANs, 2003: 31-49
[25]陈曦,刘俊峰,付少波.工业以太网传输延时特性分析.计算机与信息技术, 2007(4): 3-9
[26] Douglas E. Comer. Internetworking With TCP/IP Vol I: Principles, Protocols, and Architectures Fourth Edition.北京:电子工业出版社, 2004
[27]王军.多媒体网络传输的研究与实现.国防科技大学: [硕士学位论文], 2002: 3-42
[28] ITU-T Recommendations H. 323v5, Packed-based multimedia communications systems, 2003: 5-11
[29]黄智伟. FPGA系统设计与实践.北京:电子工业出版社. 2005: 4-120
[30]薛萍,陈海燕,裴树军.基于ISP芯片的可编程数字频率计的设计.电测与仪表, 2002: 4-9
[31]侯伯亨,顾新. VHDL硬件描述语言与数字逻辑电路设计修订版.西安:西安电子科技大学出版社, 2001: 18-47
[32]姜雪松,刘东升.硬件描述语言VHDL教程.西安:西安交通大学出版社, 2004: 89-106
[33]秦龙. MSP430单片机应用系统开发典型实例.北京:电子工业出版社, 2005: 4-33
[34]胡大可. MSP430系列FLASH型超低功耗16位单片机.北京:北京航空航天出版社, 2001
[35] SEIFERT, R. Gigabit Ethernet. Addison-Wesley, 1998: 1-59
[36] Stallings, W., High-Speed Networks and Internets: Performance and quality of service, and ED., Macmillan, 1998: 5-39
[37]卢毅,赖杰. VHDL与数字电路设计.北京:科学出版社, 2001
[38] Kevin Skahill编,孙普译.可编程逻辑系统的VHDL设计技术.南京:东南大学出版社, 1998: 4-33
[39] The Programmable Logic Data Book. Xilinx company, 1999: 3-20
[40]赵曙光.可编程逻辑器件原理、开发与应用.西安:西安电子科技大学出版社, 2000: 11-69
[41]潘松. VHDL实用教程.成都:电子科技大学出版社, 2000: 78-83
[42]张智江,张云勇,刘韵洁. SIP协议及其应用.北京:电子工业出版社, 2006: 43-87
[43]沙燕萍曾烈光. SDRAM接口的VHDL设计.电子技术应用, 2000(6): 4-9
[44]施周渊戴庆元. DDR SDRAM控制器的FPGA实现.电子技术应用, 2003(11): 30-38
[45]宋振宇. SDRAM在图像采集中的应用.电子技术, 2001(4): 34-39
[46]姜立冬等. VHDL语言程序设计及应用.北京:北京邮电大学出版社, 2001:47-60
[47] Stig Oresjo. Test and Inspection as part of the lead-free manufacturing process. Anaheim, Calif, 2005: 512-520
[48] Comer, D. Internetworking with TCP/IP, 4th Ed., Prentice-Hall, 2000, 1: 9-25
[49]王小军. VHDL简明教程.北京:清华大学出版社, 1997: 89-93
[50]廖雷等. Java程序设计教程.北京:中国电力出版社, 2003: 66-121
[51] William Stallings. High-Speed Networks TCP/IP and ATM Design principles. Prentice hall press, 1999: 78-90