基于FPGA和DSP的图像采集处理系统的研究与实现
摘要
随着信息化技术的不断发展,图像采集处理技术越来越广泛的应用在国民经济生活的各个领域。传统的图像采集处理大多基于计算机,受计算机体积与功耗的限制,图像采集处理技术的应用不能进一步得到普及和推广
基于FPGA和DSP的图像采集处理系统具有体积小,功耗低,可扩展,利于实现便携式设计等特点,因此采用FPGA和DSP进行图像采集处理逐渐成为一种趋势。
本文提出一种基于FPGA和DSP的图像采集处理系统的设计方法,采用FPGA内嵌NiosⅡ软核处理器作为协处理器,负责进行图像采集与部分图像预处理工作,采用DSP作为主处理器进行图像处理,FPGA与DSP之间通过FIFO视频缓冲芯片进行图像数据的传递。文章首先介绍了系统的整体设计方案,阐明了系统硬件和软件设计思路；接着详述了在FPGA内构建SOPC系统的方法以及若干外设控制器的设计方法；然后介绍了DSP图像处理部分的硬件设计及功能模块驱动设计方法；最后对OSD输出部分的硬件、软件设计做了详细说明。
本文设计的图像采集处理系统发挥了FPGA和DSP各自的优势,具备良好的便携性和通用性,为采用FPGA和DSP构建图像采集处理系统提供了一些有价值的参考。
With the development of the information technology, image collecting and processing technology is used more and more popular in our lives. As most traditionary systems of image collecting and processing depends on computers, the further application of image collecting and processing technology is obstructed.
Now the new systems of image collecting and processing based on FPGA and DSP, which have the advantage of smaller volume, lower power dissipation, easy to carry and building block design, are becoming the popular research subject.
The scheme is given in this thesis for the design of image collecting and processing system base on FPGA and DSP. This system uses NiosⅡbased on FPGA as the coprocessor to collect image and DSP as the master controller to process image.The image data is transmitted by the application of data buffer which is consisted of FIFO component.Firstly, this thesis introduces the entirety design of the system, including hardware and software; Secondly, not only the method about building the SOPC system on FPGA base on NiosⅡprocessor, but also the design way of the controller for some peripheral devices is given. Thirdly, it illustrates the design method of DSP in hardware and software. Finally, it clarifies the issues about designing the OSD including hardware and software.
The system of image collecting and processing, which designed in this thesis, takes full advantage of FPGA and DSP. It is portable and universal because of its flexible structure.And this thesis offers some valuable references for the design of image collecting and processing system based on FPGA and DSP.
基于FPGA和DSP的图像采集处理系统具有体积小,功耗低,可扩展,利于实现便携式设计等特点,因此采用FPGA和DSP进行图像采集处理逐渐成为一种趋势。
本文提出一种基于FPGA和DSP的图像采集处理系统的设计方法,采用FPGA内嵌NiosⅡ软核处理器作为协处理器,负责进行图像采集与部分图像预处理工作,采用DSP作为主处理器进行图像处理,FPGA与DSP之间通过FIFO视频缓冲芯片进行图像数据的传递。文章首先介绍了系统的整体设计方案,阐明了系统硬件和软件设计思路；接着详述了在FPGA内构建SOPC系统的方法以及若干外设控制器的设计方法；然后介绍了DSP图像处理部分的硬件设计及功能模块驱动设计方法；最后对OSD输出部分的硬件、软件设计做了详细说明。
本文设计的图像采集处理系统发挥了FPGA和DSP各自的优势,具备良好的便携性和通用性,为采用FPGA和DSP构建图像采集处理系统提供了一些有价值的参考。
With the development of the information technology, image collecting and processing technology is used more and more popular in our lives. As most traditionary systems of image collecting and processing depends on computers, the further application of image collecting and processing technology is obstructed.
Now the new systems of image collecting and processing based on FPGA and DSP, which have the advantage of smaller volume, lower power dissipation, easy to carry and building block design, are becoming the popular research subject.
The scheme is given in this thesis for the design of image collecting and processing system base on FPGA and DSP. This system uses NiosⅡbased on FPGA as the coprocessor to collect image and DSP as the master controller to process image.The image data is transmitted by the application of data buffer which is consisted of FIFO component.Firstly, this thesis introduces the entirety design of the system, including hardware and software; Secondly, not only the method about building the SOPC system on FPGA base on NiosⅡprocessor, but also the design way of the controller for some peripheral devices is given. Thirdly, it illustrates the design method of DSP in hardware and software. Finally, it clarifies the issues about designing the OSD including hardware and software.
The system of image collecting and processing, which designed in this thesis, takes full advantage of FPGA and DSP. It is portable and universal because of its flexible structure.And this thesis offers some valuable references for the design of image collecting and processing system based on FPGA and DSP.
引文
[1]王庆有.图像传感器应用技术[M].北京：电子工业出版社,2003,9：245-255
[2]张建荣.基于SOPC的图像采集和处理系统的设计与研究[D].赣州：江西理工大学,2008
[3]姜华.基于FPGA的图像采集处理系统设计与实现[D].大连：大连海事大学,2009
[4]宋宜良.基于FPGA和DSP的实时图像处理系统设计[D].大连：大连理工大学,2009
[5]陈丽.基于Nios Ⅱ的视频图像处理系统设计[D].北京：北京交通大学,2006
[6]唐垚,曹剑中,李变侠,等.高分辨率图像采集与压缩系统的设计实现[J].科学技术与工程,2007,5(20)：1510-1523
[7]盛磊,徐科军.基于DSP和FPGA的实时视频处理平台的设计与实现[J].中国科学技术大学学报,2006,36(3)：304-309
[8]阎世梁.基于FPGA和双DSP的实时图像处理器设计[J].PLD CPLD FPGA应用,2008.4(24)：207-209
[9]高迎慧,候忠霞,马艳南.基于DSP+FPGA的数字视频信号处理系统[J].沈阳：沈阳航空工业学院学报,2007,24(3)：69-71
[10]BramovicM,StroudC, EmmerM. Using embedded FPGAs for SoC yield improvement[A]. 39th Design Automation conf[C],2002:10-14
[11]杨恒,卢成飞.FPGA/VHDL快速工程实践与提高[M].北京：北京航空航天大学出版社,2003：45
[12]徐宁仪,周祖成.Avalon总线与SOPC系统架构实例[J].半导体技术,2003,2：17-20
[13]潘松,黄继业,曾毓.SOPC技术实用教程[M].北京：清华大学出版社,2005,9：1-7
[14]Altera公司第二代软核嵌入式处理器Nios Ⅱ [J].单片机与嵌入式系统应用,2004,7：82
[15]Cyclone Ⅱ Device Handbook[Z].Altera Corporation.2008
[16]黄素贞.一种基于DSP和CPLD的图像采集处理系统研究[D].山东：山东大学,2005
[17]刘迪博.基于BF531处理器的嵌入式系统平台的研究与实现[D].浙江：浙江大学,2007
[18]王志宇.基于ADSP-BF532的嵌入式网络视频服务器的研究与实现[D].武汉：武汉大学,2004
[19]覃海明,饶建华,荣振宇.基于OV7660的图像采集系统设计,新特器件应用,2007,9(1)：23-28
[20]SST39VF1601 Dtasheet[Z].Silicon Storge Technology Corporation.2003
[21]AT45DB161 Dtasheet[Z].Atmel Corporation.2005
[22]HY57V641620HG Dtasheet[Z].Hynix.2003
[23]AL422B Dtasheet[Z].AVERLOGIC.1999
[24]孙泓波,顾红,苏为民.视频字符叠加技术的发展及四种实现方案,电子技术应用,2000(11)：44-46
[25]刘宇.车载可视倒车雷达图像采集系统研究[D].长春：长春理工大学,2009
[26]MAX7456 Dtasheet[Z].MAXIM.2007
[27]郭振林.基于Nios Ⅱ和USB2.0的高清视频图像采集系统的研究与实现[D].广州：华南理工大学,2009
[28]Nios Ⅱ Processor Reference Handbook[Z].Altera Corporation.2008
[29]Avalon Interface Specifications Version 1.2[Z].Altera Corporation.2009
[30]杨鑫,徐伟俊,陈先勇等.Avalon总线最新接口标准综述[J].中国集成电路,2007,11：24-29
[31]Phase-Locked Loop(ALT) Megafunction User Guide [Z].Altera Corporation.2009
[32]陈曦,黄毅.片上系统设计思想与源代码分析[M].北京：电子工业出版社,2008,10：98-99
[33]Altera Embedded Peripherals Handbook[Z].Altera Corporation.2005
[34]Quartus II Handbook Version 9.1 [Z].Altera Corporation.2009
[35]OV7660 Dtasheet[Z].Omnivision Corporation.2005
[36]Blackfin Embedded Processor ADSP-BF532 [Z].Anolog Device.2006
[37]Blackfin Embedded Processor ADSP-BF531/532/533[Z].Anolog Device.2008
[38]C0283QGLD-T Product Specification[Z].奇晶光电.2007
[39]用于MAX7456随屏显示器SPI接口的C程序.MAXIM官方网站http://www.maxim-ic.com
[40]MAX7456 EV kit document[Z].MAXIM.2007
[2]张建荣.基于SOPC的图像采集和处理系统的设计与研究[D].赣州：江西理工大学,2008
[3]姜华.基于FPGA的图像采集处理系统设计与实现[D].大连：大连海事大学,2009
[4]宋宜良.基于FPGA和DSP的实时图像处理系统设计[D].大连：大连理工大学,2009
[5]陈丽.基于Nios Ⅱ的视频图像处理系统设计[D].北京：北京交通大学,2006
[6]唐垚,曹剑中,李变侠,等.高分辨率图像采集与压缩系统的设计实现[J].科学技术与工程,2007,5(20)：1510-1523
[7]盛磊,徐科军.基于DSP和FPGA的实时视频处理平台的设计与实现[J].中国科学技术大学学报,2006,36(3)：304-309
[8]阎世梁.基于FPGA和双DSP的实时图像处理器设计[J].PLD CPLD FPGA应用,2008.4(24)：207-209
[9]高迎慧,候忠霞,马艳南.基于DSP+FPGA的数字视频信号处理系统[J].沈阳：沈阳航空工业学院学报,2007,24(3)：69-71
[10]BramovicM,StroudC, EmmerM. Using embedded FPGAs for SoC yield improvement[A]. 39th Design Automation conf[C],2002:10-14
[11]杨恒,卢成飞.FPGA/VHDL快速工程实践与提高[M].北京：北京航空航天大学出版社,2003：45
[12]徐宁仪,周祖成.Avalon总线与SOPC系统架构实例[J].半导体技术,2003,2：17-20
[13]潘松,黄继业,曾毓.SOPC技术实用教程[M].北京：清华大学出版社,2005,9：1-7
[14]Altera公司第二代软核嵌入式处理器Nios Ⅱ [J].单片机与嵌入式系统应用,2004,7：82
[15]Cyclone Ⅱ Device Handbook[Z].Altera Corporation.2008
[16]黄素贞.一种基于DSP和CPLD的图像采集处理系统研究[D].山东：山东大学,2005
[17]刘迪博.基于BF531处理器的嵌入式系统平台的研究与实现[D].浙江：浙江大学,2007
[18]王志宇.基于ADSP-BF532的嵌入式网络视频服务器的研究与实现[D].武汉：武汉大学,2004
[19]覃海明,饶建华,荣振宇.基于OV7660的图像采集系统设计,新特器件应用,2007,9(1)：23-28
[20]SST39VF1601 Dtasheet[Z].Silicon Storge Technology Corporation.2003
[21]AT45DB161 Dtasheet[Z].Atmel Corporation.2005
[22]HY57V641620HG Dtasheet[Z].Hynix.2003
[23]AL422B Dtasheet[Z].AVERLOGIC.1999
[24]孙泓波,顾红,苏为民.视频字符叠加技术的发展及四种实现方案,电子技术应用,2000(11)：44-46
[25]刘宇.车载可视倒车雷达图像采集系统研究[D].长春：长春理工大学,2009
[26]MAX7456 Dtasheet[Z].MAXIM.2007
[27]郭振林.基于Nios Ⅱ和USB2.0的高清视频图像采集系统的研究与实现[D].广州：华南理工大学,2009
[28]Nios Ⅱ Processor Reference Handbook[Z].Altera Corporation.2008
[29]Avalon Interface Specifications Version 1.2[Z].Altera Corporation.2009
[30]杨鑫,徐伟俊,陈先勇等.Avalon总线最新接口标准综述[J].中国集成电路,2007,11：24-29
[31]Phase-Locked Loop(ALT) Megafunction User Guide [Z].Altera Corporation.2009
[32]陈曦,黄毅.片上系统设计思想与源代码分析[M].北京：电子工业出版社,2008,10：98-99
[33]Altera Embedded Peripherals Handbook[Z].Altera Corporation.2005
[34]Quartus II Handbook Version 9.1 [Z].Altera Corporation.2009
[35]OV7660 Dtasheet[Z].Omnivision Corporation.2005
[36]Blackfin Embedded Processor ADSP-BF532 [Z].Anolog Device.2006
[37]Blackfin Embedded Processor ADSP-BF531/532/533[Z].Anolog Device.2008
[38]C0283QGLD-T Product Specification[Z].奇晶光电.2007
[39]用于MAX7456随屏显示器SPI接口的C程序.MAXIM官方网站http://www.maxim-ic.com
[40]MAX7456 EV kit document[Z].MAXIM.2007