基于FPGA的嵌入式图像监控系统设计
摘要
传统的数字视频监控系统大多基于PC平台,采用的是专用采集卡和存储设备,导致整机价格昂贵,体积庞大,往往局限于特定领域的应用。而嵌入式图像监控系统以其价格低、便携式等特点在普通家居安防、临时性作业等场所得到了越来越广泛的应用。
本文针对基于FPGA的嵌入式图像监控系统进行研究,重点研究了动体检测和图像存储的开发方法。通过将开运算方法应用于动体检测,并结合人体信号检测,有效降低了检测的误判率。另外还针对FPGA平台研究了将采集数据转换成图像文件并保存到SD卡的方法。
硬件板载电路采用FPGA作为主控制器,负责系统的调度控制。外接图像传感器、热释电红外传感器、SDRAM、SD卡、环境光亮检测器、RS232等器件,实现了图像的自动采集、检测、配置和存储。FPGA内部逻辑电路采用Verilog语言和原理图混合设计的方法,采用了结构化模块设计,包括图像采集和转换模块、帧缓存模块、动体检测模块、Nios系统模块以及显示模块。最后通过嵌入式C语言实现系统的Nios系统软件控制,并完成SD卡的驱动程序以及图像文件生成程序的设计。本文利用quartusⅡ和modelsim对逻辑电路进行仿真,调试过程中利用在线逻辑分析仪Signaltap系统进行了严格的测试,保证了系统的可靠性。
本系统采集速度达到60帧/秒,SD存储速度为3.7秒/帧,检测响应的仿真时间为120ms,检测的拒真率小于1%。由于采用FPGA单芯片控制方案,系统具有高集成度、可靠性及灵活性的特点。同时由于体积小、功耗低,可在很多应用场合替代传统基于PC的图像监控方案。
Most of digital surveillance systems are on the basis of on PC platforms,and due to adopting specific acquirisiton card as well as storage device,the whole system has high price and large size. So it is only applied to small district,bank,and supermarket. Compared with PC-based image surveillance system,the embeded image surveillance system has already obtained the more and more widespread application in domains such as common home security,temporary circumstance because of its cheapness and portability.
This thesis presents a solution of embeded image surveillance system, especially focus on method of motion detection and image saving.The possibility of motion detection misjudgement can be reduced by adopting the body detection and open operation to the method.For the FPGA platform,the method of conversion of data to image and image saving to SD card is developed.
FPGA is adopted as the main controller in the handware circuit and is responsible for maintaining of the whole system .The board is connected to CIS ,PIR,SD card,RS232,and light detect device.The function is realized of image collecting and conversion,motion detection and image saving.All circuits is designed by in both Verilog language code and schematic diagram.This sytem consists of image acquirisiton module,frame buffer,motion detection,body signal detection,sd card ,Nios system and display module.At last the control of NIOS and the driver of SD card as well as image creating program are realized in c language.The logic circuits can be simulated in quartus II and modelsim, the test is resorted to signaltap to ensure the robustness of the system.
The rate of acquisition can reach to 60 frames by per second,The rate of SD storage can reach to 3.7 frames by per second,The simulation response time of motion detecion can reach at 120ms.the percent of detection refusal is smaller than 1%.Due to the main circuit being integrated into a FPGA chip, the system is characteristic of high integration, robustness and flexibility .Because of its low power dissipation ans small size,it can replace the conventional PC-baseed surveillance solution in many field.
本文针对基于FPGA的嵌入式图像监控系统进行研究,重点研究了动体检测和图像存储的开发方法。通过将开运算方法应用于动体检测,并结合人体信号检测,有效降低了检测的误判率。另外还针对FPGA平台研究了将采集数据转换成图像文件并保存到SD卡的方法。
硬件板载电路采用FPGA作为主控制器,负责系统的调度控制。外接图像传感器、热释电红外传感器、SDRAM、SD卡、环境光亮检测器、RS232等器件,实现了图像的自动采集、检测、配置和存储。FPGA内部逻辑电路采用Verilog语言和原理图混合设计的方法,采用了结构化模块设计,包括图像采集和转换模块、帧缓存模块、动体检测模块、Nios系统模块以及显示模块。最后通过嵌入式C语言实现系统的Nios系统软件控制,并完成SD卡的驱动程序以及图像文件生成程序的设计。本文利用quartusⅡ和modelsim对逻辑电路进行仿真,调试过程中利用在线逻辑分析仪Signaltap系统进行了严格的测试,保证了系统的可靠性。
本系统采集速度达到60帧/秒,SD存储速度为3.7秒/帧,检测响应的仿真时间为120ms,检测的拒真率小于1%。由于采用FPGA单芯片控制方案,系统具有高集成度、可靠性及灵活性的特点。同时由于体积小、功耗低,可在很多应用场合替代传统基于PC的图像监控方案。
Most of digital surveillance systems are on the basis of on PC platforms,and due to adopting specific acquirisiton card as well as storage device,the whole system has high price and large size. So it is only applied to small district,bank,and supermarket. Compared with PC-based image surveillance system,the embeded image surveillance system has already obtained the more and more widespread application in domains such as common home security,temporary circumstance because of its cheapness and portability.
This thesis presents a solution of embeded image surveillance system, especially focus on method of motion detection and image saving.The possibility of motion detection misjudgement can be reduced by adopting the body detection and open operation to the method.For the FPGA platform,the method of conversion of data to image and image saving to SD card is developed.
FPGA is adopted as the main controller in the handware circuit and is responsible for maintaining of the whole system .The board is connected to CIS ,PIR,SD card,RS232,and light detect device.The function is realized of image collecting and conversion,motion detection and image saving.All circuits is designed by in both Verilog language code and schematic diagram.This sytem consists of image acquirisiton module,frame buffer,motion detection,body signal detection,sd card ,Nios system and display module.At last the control of NIOS and the driver of SD card as well as image creating program are realized in c language.The logic circuits can be simulated in quartus II and modelsim, the test is resorted to signaltap to ensure the robustness of the system.
The rate of acquisition can reach to 60 frames by per second,The rate of SD storage can reach to 3.7 frames by per second,The simulation response time of motion detecion can reach at 120ms.the percent of detection refusal is smaller than 1%.Due to the main circuit being integrated into a FPGA chip, the system is characteristic of high integration, robustness and flexibility .Because of its low power dissipation ans small size,it can replace the conventional PC-baseed surveillance solution in many field.
引文
[1]李明.基于SOPC的网络视频监控系统的设计与实现.硕士学位论文.大连:大连理工大学,2006
[2]于枫,张丽英,廖宗建.ALTERA可编程逻辑器件应用技术.北京:科学出版社,2004.
[3]Gomes L,Cost A.Teaching formal methods within system-on-a-programmable-chip dsign.Microelectronic Systems Education,2005.(MSE' 05).Proceedings.2005 IEEE International Conference on 12-14 June,2005,(5):105-106
[4]肖儿良.可编程视频输入处理芯片SAA7111及其在图象多媒体中的应用.电子技术应用,1999,8(4):71-72
[5]彭启琼,李玉柏,管庆.DSP技术的发展与应用.北京:高等教育出版社,2002
[6]潘松,黄继业.SOPC技术实用教程.北京:清华大学出版社,2005
[7]杨小川.Protel DXP设计指导教程.北京:清华大学出版社,2003.
[8]Altera Corporation.QuartusⅡ Developoent Software Handbook,2005
[9]王力,张伟.电路设计与制板Protel DXP库元器件手册.北京:人民邮电出版社,2003.
[10]王俊雄.基于FPGA及Nios的嵌入式系统应用研究:〔硕士学位论文〕.成都:西南交通大学,2006.
[11]P Chalimbaud,F Berry.Design of an imaging system based on FPGA technology.and CMOS imager,Proceedings.2004 IEEE International Conference on Field-Programmable Technology,2004:407-411
[12]段晓晨.实时视频SDRAM控制器的FPGA设计与实现.太原理工大学学报,2006,12(5):6-8
[13]苏吉文.基于SOPC的一种数码相机的设计方案,(硕士学位论文).重庆:重庆大学,2005
[14]J.E.Adams.Design of practical color filter array interpolation algorithms for digital cameras.Proc.SPIE,Real Time Imaging.1997:117-125
[15]Collins Retal."A system for video surveillance and monitoring",VSAM final report.Carnegie Melton University,Technical Report.2000,1-25
[16]刘杰,周建华.基于SDRAM的视频处理器设计与实现.电子元器件应用.2006,14(7):51-54
[17]吴皓,刘鹏.视频采集系统SDRAM控制器的FPGA实现.中国有线电视.2003,28(22):57-60
[18]徐红,叶丰,孟利民.基于图像处理的SDRAM通用接口设计.现代电子技术.2006,29(16):67-69
[19]刘斌兵,刘云海.用FPGA实现高速大图像采集系统.电子技术.2006,2(1):60-63
[20]唐跃平,韩存兵。双口RAM与FIFO芯片在数据处理系统中应用的比较.微机与应用,2000,8(9):27-28.
[21]Panos G.Michalopoulos."Vehicle detection video through image processing".The Autoscope system IEEE Transaction on Vehicular technology.2001,14(1):21-29
[22]刘虹,黄涛.基于FPGA的高速图像采集系统的研究与实现.工业控制计算机.2004,12(8):18-19
[23]黄爱民,安向京.数字图像处理与分析基础.北京:中国水利水电出版社.2005
[24]RafaelC.Gonzalez,数字图像处理,阮秋琦译.北京:电子工业出版社.2004
[25]PChalimbaud,F Berry.Design of an imaging system based on FPGA technology and CMOS imager.Proceedings-2004 IEEE International Conference on Field-Programmable Technology,2004,9(3):407-411
[26]Dalay B.Accelerating system performance using SOPC builder.System-on-Chip,2003.Proceedings.International Symposium on 19-21 Nov.2003,22(4):3-5
[27]方茁,彭澄廉.基于Nios的SOPC设计.计算机工程与设计,2004,25(4):504-507
[28]张攀登,李小强,吴效明.基于Nios Ⅱ软核处理器和USB2.0的医学图像压缩和传输.中国医学物理学杂志,2008,(2):582-585
[29]袁海林.基于Nios Ⅱ的高速图像采集系统的设计.电子器件,2007,30(4):1330-1336
[30]方苗,陈泽文,彭橙廉.SOPC设计中的用户自定义逻挥,计算机工程,2004,6(9):142-147
[31]Ghozzi F,Nottel P,Marchegay P.Video acquisition and memorisation on Excalibursystem.Electrical and Computer Engineering,2003.IEEE CCECE 2003.Canadian Conference on Volume 2,4-7 May 2003,5(15):1275-1278
[32]SD Group.SD memory card specifications,2001.
[33]吴作勇,韩新洁,孟宪尧.基于FPGA和ARM的彩色图像处理系统.自动化技术与应用,2007,26(4):67-69
[34]D.Seguine.Just add sensor-Integrating analog and digital signal conditioning in a programmable system on a chip,Proc.IEEE Sensors,2002,7(6):665-668
[35]Stephane Simard,Rachid Beguenane,Fric Larouche,Luc Morin.A 2005 review of FPGA arithmetic.ACM/S IGDA Thirteenth ACM International Symposium on Field Programmable Gate Arrays-FPGi,2005,16(7):276-288
[36]王建国,吴书铭.基于SOPC技术的硬盘扇区读写.微计算机信息,2007,15(102):100-101
[37]D.Seguine.Just add sensor-Integrating analog and digital signal conditioning in a programmable system on a chip,Proc.IEEE Sensors,2002,20(6):665-668
[2]于枫,张丽英,廖宗建.ALTERA可编程逻辑器件应用技术.北京:科学出版社,2004.
[3]Gomes L,Cost A.Teaching formal methods within system-on-a-programmable-chip dsign.Microelectronic Systems Education,2005.(MSE' 05).Proceedings.2005 IEEE International Conference on 12-14 June,2005,(5):105-106
[4]肖儿良.可编程视频输入处理芯片SAA7111及其在图象多媒体中的应用.电子技术应用,1999,8(4):71-72
[5]彭启琼,李玉柏,管庆.DSP技术的发展与应用.北京:高等教育出版社,2002
[6]潘松,黄继业.SOPC技术实用教程.北京:清华大学出版社,2005
[7]杨小川.Protel DXP设计指导教程.北京:清华大学出版社,2003.
[8]Altera Corporation.QuartusⅡ Developoent Software Handbook,2005
[9]王力,张伟.电路设计与制板Protel DXP库元器件手册.北京:人民邮电出版社,2003.
[10]王俊雄.基于FPGA及Nios的嵌入式系统应用研究:〔硕士学位论文〕.成都:西南交通大学,2006.
[11]P Chalimbaud,F Berry.Design of an imaging system based on FPGA technology.and CMOS imager,Proceedings.2004 IEEE International Conference on Field-Programmable Technology,2004:407-411
[12]段晓晨.实时视频SDRAM控制器的FPGA设计与实现.太原理工大学学报,2006,12(5):6-8
[13]苏吉文.基于SOPC的一种数码相机的设计方案,(硕士学位论文).重庆:重庆大学,2005
[14]J.E.Adams.Design of practical color filter array interpolation algorithms for digital cameras.Proc.SPIE,Real Time Imaging.1997:117-125
[15]Collins Retal."A system for video surveillance and monitoring",VSAM final report.Carnegie Melton University,Technical Report.2000,1-25
[16]刘杰,周建华.基于SDRAM的视频处理器设计与实现.电子元器件应用.2006,14(7):51-54
[17]吴皓,刘鹏.视频采集系统SDRAM控制器的FPGA实现.中国有线电视.2003,28(22):57-60
[18]徐红,叶丰,孟利民.基于图像处理的SDRAM通用接口设计.现代电子技术.2006,29(16):67-69
[19]刘斌兵,刘云海.用FPGA实现高速大图像采集系统.电子技术.2006,2(1):60-63
[20]唐跃平,韩存兵。双口RAM与FIFO芯片在数据处理系统中应用的比较.微机与应用,2000,8(9):27-28.
[21]Panos G.Michalopoulos."Vehicle detection video through image processing".The Autoscope system IEEE Transaction on Vehicular technology.2001,14(1):21-29
[22]刘虹,黄涛.基于FPGA的高速图像采集系统的研究与实现.工业控制计算机.2004,12(8):18-19
[23]黄爱民,安向京.数字图像处理与分析基础.北京:中国水利水电出版社.2005
[24]RafaelC.Gonzalez,数字图像处理,阮秋琦译.北京:电子工业出版社.2004
[25]PChalimbaud,F Berry.Design of an imaging system based on FPGA technology and CMOS imager.Proceedings-2004 IEEE International Conference on Field-Programmable Technology,2004,9(3):407-411
[26]Dalay B.Accelerating system performance using SOPC builder.System-on-Chip,2003.Proceedings.International Symposium on 19-21 Nov.2003,22(4):3-5
[27]方茁,彭澄廉.基于Nios的SOPC设计.计算机工程与设计,2004,25(4):504-507
[28]张攀登,李小强,吴效明.基于Nios Ⅱ软核处理器和USB2.0的医学图像压缩和传输.中国医学物理学杂志,2008,(2):582-585
[29]袁海林.基于Nios Ⅱ的高速图像采集系统的设计.电子器件,2007,30(4):1330-1336
[30]方苗,陈泽文,彭橙廉.SOPC设计中的用户自定义逻挥,计算机工程,2004,6(9):142-147
[31]Ghozzi F,Nottel P,Marchegay P.Video acquisition and memorisation on Excalibursystem.Electrical and Computer Engineering,2003.IEEE CCECE 2003.Canadian Conference on Volume 2,4-7 May 2003,5(15):1275-1278
[32]SD Group.SD memory card specifications,2001.
[33]吴作勇,韩新洁,孟宪尧.基于FPGA和ARM的彩色图像处理系统.自动化技术与应用,2007,26(4):67-69
[34]D.Seguine.Just add sensor-Integrating analog and digital signal conditioning in a programmable system on a chip,Proc.IEEE Sensors,2002,7(6):665-668
[35]Stephane Simard,Rachid Beguenane,Fric Larouche,Luc Morin.A 2005 review of FPGA arithmetic.ACM/S IGDA Thirteenth ACM International Symposium on Field Programmable Gate Arrays-FPGi,2005,16(7):276-288
[36]王建国,吴书铭.基于SOPC技术的硬盘扇区读写.微计算机信息,2007,15(102):100-101
[37]D.Seguine.Just add sensor-Integrating analog and digital signal conditioning in a programmable system on a chip,Proc.IEEE Sensors,2002,20(6):665-668