机载SAR图像的动态金字塔实时显示技术
|
摘要
目的随着机载SAR(合成孔径雷达)图像分辨率越来越高,幅宽越来越大,传统雷达显控系统将整幅图像放入内存、抽样显示的现有方法存在内存资源紧张、显示图像的等待时间过长等问题,为解决此类问题,提出一种动态金字塔实时显示技术。方法机载SAR图像实时显示软件包括动态金字塔构建和显示技术。动态金字塔构建技术包括:当接收到一个瓦片的图像数据时,输出第0层级的金字塔瓦片;分6种情况,生成高层级瓦片,随着接收数据不断增多,逐步补全金字塔文件。动态金字塔显示技术是指在瓦片数据不全的情况下,采用递归算法,读取较低层级瓦片,合成、显示当前显示层级图像的技术。这两种技术分属两个独立线程,以硬盘文件(瓦片)为接口,实时交互,协同工作。结果机载SAR图像实时显示软件仅仅占用30 MB内存,且与图像大小无关;显示第1块SAR图像瓦片的时延小于1 s,与传统显控系统对比,减少约一帧图像的传输时延;显示整帧图像的时延因存储介质读写文件的速率存在差异较大,固态硬盘的时延比较稳定,显示1 GB图像的时延为12. 55 s;机械盘的时延受读写速度的影响,当发送时间间隔大于6 ms时,显示1 GB图像的时延仅比传输时延多1. 47 s。结论机载SAR图像实时显示软件能实时向用户呈现接收中的SAR图像,提高了机载SAR图像的显示时效性,降低了机载雷达显控终端的内存需求,改善了机载雷达显控终端的用户体验。
Objective With the increasing resolution of airborne SAR( synthetic aperture radar) images and large swath width,the conventional radar display and control system directly store the entire image in memory for sampling and displaying. The problems of conventional methods are resource-intensive and time-consuming,among others. The image pyramid method can effectively allocate and use memory when displaying large images. Previous studies required an entire image as input for display,which cannot meet the requirement of real-time display in application. Develop real-time display software for airborne SAR images with little memory consumption and independent of image size. When the received image size islarger than one tile,the image will be displayed to the user in real time,and will zoom to the original resolution. Methods The real-time display techniques proposed in this study include dynamic pyramid construction and display techniques. The processes of dynamic pyramid construction in detail are as follows: outputting the 0 th-level pyramid tiles when receiving tile data; then,six cases are used to generate higher-level tiles. With the increasing numbers of received data,the pyramid file is gradually completed. The dynamic pyramid display technology uses a recursive algorithm to read low-level tiles and synthesizes and displays the current display hierarchy images when the tile data is incomplete. These two technologies run in two threads,interact with hard disk files( tiles) as interfaces,and work together. Result In the real-time display software,we add a separate thread to read 64 MB( 8 192 × 8 192 pixels),256 MB( 16 384 × 16 384 pixels),and 1 GB( 32 768 ×32 768 pixels) test image files and send a data block of 256 × 256 pixels to the pyramid module. The time intervals for data transfer vary from 10 ms to 1 ms. The display software runs on solid state hard( SSD) and mechanical disks. The time delay of displaying the first tile and the complete frame of the image is counted. the SAR image real-time display software occupies only 30 MB of memory and is independent of image size. The results show that the use of the SAR image real-time display technology results in a time delay of less than 1 s for displaying the first SAR image tile. Compared with the traditional display control system,the transmission delay of one frame image can be reduced. The delay of an entire frame image display varies greatly due to the access rate of the storage media. The time delay of SSDs is relatively stable,which is related to the size of the image. The larger the image,the greater the delay and the larger the difference between the delay and transmission delay( delay difference). The display delay differences for 64 MB,256 MB,and 1 GB images are 0. 76 s,3. 06 s,and 12. 55 s,respectively. The delay of the mechanical disk is divided into two cases: at a sending interval of less than 6 ms,the time delay is relatively stable due to the limitation of hard disks' read/write speed,which is the time required to construct the pyramid for the entire image. The building pyramid time of the 64 MB,256 MB and 1 GB images is approximately 5. 779 s,23. 55 s,and 104. 202 s,respectively. At the time interval of more than 6 ms for sending images,the time delay of displaying a frame of image is increased and accompanied by a decrease in transmission rate. Thus,the size of the delay is positively correlated with the size of the image. The delay differences for the 64 MB,256 MB,and 1 GB images are approximately 0. 01 s,0. 15 s,and 1. 47 s,respectively. Conclusion The technique developed in this study can present received SAR images to users in real time,improve the display time effectiveness of airborne SAR images,reduce the memory requirements of the airborne radar display and control terminals,and improve user experience in terms of airborne radar display and control terminals.
Objective With the increasing resolution of airborne SAR( synthetic aperture radar) images and large swath width,the conventional radar display and control system directly store the entire image in memory for sampling and displaying. The problems of conventional methods are resource-intensive and time-consuming,among others. The image pyramid method can effectively allocate and use memory when displaying large images. Previous studies required an entire image as input for display,which cannot meet the requirement of real-time display in application. Develop real-time display software for airborne SAR images with little memory consumption and independent of image size. When the received image size islarger than one tile,the image will be displayed to the user in real time,and will zoom to the original resolution. Methods The real-time display techniques proposed in this study include dynamic pyramid construction and display techniques. The processes of dynamic pyramid construction in detail are as follows: outputting the 0 th-level pyramid tiles when receiving tile data; then,six cases are used to generate higher-level tiles. With the increasing numbers of received data,the pyramid file is gradually completed. The dynamic pyramid display technology uses a recursive algorithm to read low-level tiles and synthesizes and displays the current display hierarchy images when the tile data is incomplete. These two technologies run in two threads,interact with hard disk files( tiles) as interfaces,and work together. Result In the real-time display software,we add a separate thread to read 64 MB( 8 192 × 8 192 pixels),256 MB( 16 384 × 16 384 pixels),and 1 GB( 32 768 ×32 768 pixels) test image files and send a data block of 256 × 256 pixels to the pyramid module. The time intervals for data transfer vary from 10 ms to 1 ms. The display software runs on solid state hard( SSD) and mechanical disks. The time delay of displaying the first tile and the complete frame of the image is counted. the SAR image real-time display software occupies only 30 MB of memory and is independent of image size. The results show that the use of the SAR image real-time display technology results in a time delay of less than 1 s for displaying the first SAR image tile. Compared with the traditional display control system,the transmission delay of one frame image can be reduced. The delay of an entire frame image display varies greatly due to the access rate of the storage media. The time delay of SSDs is relatively stable,which is related to the size of the image. The larger the image,the greater the delay and the larger the difference between the delay and transmission delay( delay difference). The display delay differences for 64 MB,256 MB,and 1 GB images are 0. 76 s,3. 06 s,and 12. 55 s,respectively. The delay of the mechanical disk is divided into two cases: at a sending interval of less than 6 ms,the time delay is relatively stable due to the limitation of hard disks' read/write speed,which is the time required to construct the pyramid for the entire image. The building pyramid time of the 64 MB,256 MB and 1 GB images is approximately 5. 779 s,23. 55 s,and 104. 202 s,respectively. At the time interval of more than 6 ms for sending images,the time delay of displaying a frame of image is increased and accompanied by a decrease in transmission rate. Thus,the size of the delay is positively correlated with the size of the image. The delay differences for the 64 MB,256 MB,and 1 GB images are approximately 0. 01 s,0. 15 s,and 1. 47 s,respectively. Conclusion The technique developed in this study can present received SAR images to users in real time,improve the display time effectiveness of airborne SAR images,reduce the memory requirements of the airborne radar display and control terminals,and improve user experience in terms of airborne radar display and control terminals.
引文
[1]Cui R H,Niu L.The design of radar display and control system for UAV airborne SAR[J].Aerospace Electronic Warfare,2012,28(2):32-33,40.[崔荣华,牛蕾.无人机载SAR一体化显控系统的设计研究[J].航天电子对抗,2012,28(2):32-33,40.][DOI:10.3969/j.issn.1673-2421.2012.02.010]
[2]Liu W J,Meng Y,Qu H C,et al.Remote sensing image realtime progressive transmission based on multi-threads[J].Journal of Image and Graphics,2014,19(8):1237-1246.[刘万军,孟煜,曲海成,等.多线程遥感影像实时渐进传输[J].中国图象图形学报,2014,19(8):1237-1246.][DOI:10.11834/jig.20140816]
[3]Li Y M,He X,Wei Z H,et al.Design and implement of realtime display and storage system of infrared image based on PCI-e interface[J].Opto Electronic Technology,2013,33(1):9-12,35.[李一芒,何昕,魏仲慧,等.基于PCI-e接口的红外图像实时显示与存储系统设计与实现[J].光电子技术,2013,33(1):9-12,35.][DOI:10.3969/j.issn.1005-488X.2013.01.003]
[4]Yao Y D.An oversized images real-time displaying system based on camera link[J].Journal of Xi'an University of Posts and Telecommunications,2015,20(4):54-57.[姚引娣.基于相机连接接口的大图像实时显示系统[J].西安邮电大学学报,2015,20(4):54-57.][DOI:10.13682/j.issn.2095-6533.2015.04.011]
[5]Zhao Y L,An L,Sun Y L.SAR image real-time display by direct draw[J].Computer CD Software and Applications,2012,(8):22-23.[赵艳丽,安良,孙永良.基于Direct Draw的雷达图像实时显示[J].计算机光盘软件与应用,2012,(8):22-23.]
[6]Zhang J,Liu G X,Chen G H.OpenGL based SAR real-time image display[J].Modern Electronics Technique,2015,38(13):7-9.[张娟,刘国霞,陈光辉.基于OpenGL的SAR实时图像显示[J].现代电子技术,2015,38(13):7-9.][DOI:10.3969/j.issn.1004-373X.2015.13.002]
[7]Williams L.Pyramidal parametrics[C]//Proceedings of the 10th Annual Conference on Computer Graphics and Interactive Techniques.Detroit,Michigan,USA:ACM Press,1983:1-11.[DOI:10.1145/800059.801126]
[8]Li M L.GDAL Soure Code Analysis and Development Guide[M].Beijing:Posts&Telecom Press,2014:15-18.[李民录.GDAL源码剖析与开发指南[M].北京:人民邮电出版社,2014:15-18.]
[9]Yang X,Xu D Q,Zhao L.Real-time viewing of large images based on multi-core[J].Journal of Image and Graphics,2011,16(2):152-160.[杨鑫,许端清,赵磊.基于多核架构的大图像实时浏览技术[J].中国图象图形学报,2011,16(2):152-160.][DOI:10.11834/jig.20110216]
[10]Lin F.Research on the pyramid construction and storage technology of image data based on HDFS[D].Harbin:Northeast Forestry University,2016.[林峰.基于HDFS的影像数据金字塔构建及存储技术研究[D].哈尔滨:东北林业大学,2016.]
[11]Liu Y,Chen L,Jing N,et al.Parallel batch-building remote sensing images tile pyramid with MapReduce[J].Geomatics and Information Science of Wuhan University,2013,38(3):278-282.[刘义,陈荦,景宁,等.利用MapReduce进行批量遥感影像瓦片金字塔构建[J].武汉大学学报:信息科学版,2013,38(3):278-282.][DOI:10.13203/j.whugis2013.03.006]
[12]Huang D M,Yang Y H,Mei H B,et al.A parallel construction method of remote sensing image pyramid model for spark[J].Computer Applications and Software,2017,34(5):175-181.[黄冬梅,杨雨浩,梅海彬,等.面向Spark的遥感影像金字塔模型的并行构建方法[J].计算机应用与软件,2017,34(5):175-181.][DOI:10.3969/j.issn.1000-386x.2017.05.031]
[13]Hao G J,Xiong W,Chen L,et al.An MPI-based parallel pyramid building algorithm for large-scale RS image[J].Journal of Geo-Information Science,2015,17(5):515-522.[郝高进,熊伟,陈荤,等.基于MPI的大规模遥感影像金字塔并行构建方法[J].地球信息科学学报,2015,17(5):515-522.][DOI:10.3724/SP.J.1047.2015.00515]
[14]Gao Z.Research and development of fast pyramid generation algorithm of massive remote sensing image[D].Shanghai:East China Normal University,2012.[高峥.海量遥感影像快速生成金字塔算法的研究与实现[D].上海:华东师范大学,2012.]
[15]Xie Y H,Tang X A,Sun M Y.Image Pyramid structures without truncation and data expansion[J].Journal of Image and Graphics,2009,14(6):1070-1074.[谢耀华,汤晓安,孙茂印.不产生精度截断及数据膨胀的图像金字塔[J].中国图象图形学报,2009,14(6):1070-1074.][DOI:10.11834/jig.20090609]
[16]Zhang Y Z,Zhang M,Wang J N,et al.TDFA:a generation method of spatial image pyramid[J].Journal of Image and Graphics,2016,21(7):959-966.[张云舟,张陌,王晋年,等.TDFA:一种生成空间影像金字塔的方法[J].中国图象图形学报,2016,21(7):959-966.][DOI:10.11834/jig.20160714]
[17]Jiang H C,Zhao Z M,Zhu H Q.Fast view mass strip SAR image using block replacement algorithm[J].Computer Engineering and Applications,2004,40(28):50-51,194.[蒋红成,赵忠明,朱海青.用分块调度置换算法快速浏览SAR带状海量影像[J].计算机工程与应用,2004,40(28):50-51,194.][DOI:10.3321/j.issn:1002-8331.2004.28.015]
[18]Li J X,Shen B,Jiang R G,et al.Quadtree spatial index algorithm oriented to image pyramid[J].Computer Engineering,2011,37(10):11-13.[李建勋,沈冰,姜仁贵,等.面向影像金字塔的四叉树空间索引算法[J].计算机工程,2011,37(10):11-13.][DOI:10.3969/j.issn.1000-3428.2011.10.003]
[19]Nie Y F,Zhou W S,Shu J,et al.Spatial index for tile map service based on Z curve[J].Journal of Image and Graphics,2012,17(2):286-292.[聂云峰,周文生,舒坚,等.基于Z曲线的瓦片地图服务空间索引[J].中国图象图形学报,2012,17(2):286-292.][DOI:10.11834/jig.20120219]
[20]Jiang D H.Application of dynamic Roaming algorithm in GISmap based on image pyramid[J].Computer Engineering and Design,2013,34(5):1711-1715.[姜代红.基于影像金字塔的GIS地图动态漫游算法[J].计算机工程与设计,2013,34(5):1711-1715.][DOI:10.3969/j.issn.1000-7024.2013.05.037]
[21]Zhang H W,Tong H J,Zuo B X,et al.Quick browsing of massive remote sensing image based on GDAL[J].Computer Engineering and Applications,2012,48(13):159-162.[张宏伟,童恒建,左博新,等.基于GDAL大于2G遥感图像的快速浏览[J].计算机工程与应用,2012,48(13):159-162.][DOI:10.3778/j.issn.1002-8331.2012.13.034]
[22]Cline D,Egbert K E.Interactive display of very large textures[C]//Proceedings of the Conference on Visualization.Research Triangle Park,NC,USA,USA:IEEE,1998:343-350.
[23]Zhang X C,Huang Z C,Chen G,et al.Rapid display technique of massive remote sensing image[J].Journal of Image and Graphics,2002,7A(10):1021-1026.[章孝灿,黄智才,陈刚,等.海量遥感图象快速显示技术[J].中国图象图形学报,2002,7A(10):1021-1026.][DOI:10.11834/jig.2002010316]
[24]Shi J.Strategy of image rapid loading and display[J].Forest Inventory and Planning,2017,42(3):1-3,35.[师静.一种影像快速加载及显示策略[J].林业调查规划,2017,42(3):1-3,35.][DOI:10.3969/j.issn.1671-3168.2017.03.001]
[25]Cai P,Wu X H,He X H,et al.Browse of the high-resolution core image based on tiled pyramid model[J].Journal of Terahertz Science and Electronic Information Technology,2014,1(1):97-102.[蔡坪,吴晓红,何小海,等.基于瓦片金字塔模型的高分辨力岩心图像浏览[J].太赫兹科学与电子信息学报,2014,1(1):97-102.][DOI:10.11805/TKY-DA201401.0097]
[2]Liu W J,Meng Y,Qu H C,et al.Remote sensing image realtime progressive transmission based on multi-threads[J].Journal of Image and Graphics,2014,19(8):1237-1246.[刘万军,孟煜,曲海成,等.多线程遥感影像实时渐进传输[J].中国图象图形学报,2014,19(8):1237-1246.][DOI:10.11834/jig.20140816]
[3]Li Y M,He X,Wei Z H,et al.Design and implement of realtime display and storage system of infrared image based on PCI-e interface[J].Opto Electronic Technology,2013,33(1):9-12,35.[李一芒,何昕,魏仲慧,等.基于PCI-e接口的红外图像实时显示与存储系统设计与实现[J].光电子技术,2013,33(1):9-12,35.][DOI:10.3969/j.issn.1005-488X.2013.01.003]
[4]Yao Y D.An oversized images real-time displaying system based on camera link[J].Journal of Xi'an University of Posts and Telecommunications,2015,20(4):54-57.[姚引娣.基于相机连接接口的大图像实时显示系统[J].西安邮电大学学报,2015,20(4):54-57.][DOI:10.13682/j.issn.2095-6533.2015.04.011]
[5]Zhao Y L,An L,Sun Y L.SAR image real-time display by direct draw[J].Computer CD Software and Applications,2012,(8):22-23.[赵艳丽,安良,孙永良.基于Direct Draw的雷达图像实时显示[J].计算机光盘软件与应用,2012,(8):22-23.]
[6]Zhang J,Liu G X,Chen G H.OpenGL based SAR real-time image display[J].Modern Electronics Technique,2015,38(13):7-9.[张娟,刘国霞,陈光辉.基于OpenGL的SAR实时图像显示[J].现代电子技术,2015,38(13):7-9.][DOI:10.3969/j.issn.1004-373X.2015.13.002]
[7]Williams L.Pyramidal parametrics[C]//Proceedings of the 10th Annual Conference on Computer Graphics and Interactive Techniques.Detroit,Michigan,USA:ACM Press,1983:1-11.[DOI:10.1145/800059.801126]
[8]Li M L.GDAL Soure Code Analysis and Development Guide[M].Beijing:Posts&Telecom Press,2014:15-18.[李民录.GDAL源码剖析与开发指南[M].北京:人民邮电出版社,2014:15-18.]
[9]Yang X,Xu D Q,Zhao L.Real-time viewing of large images based on multi-core[J].Journal of Image and Graphics,2011,16(2):152-160.[杨鑫,许端清,赵磊.基于多核架构的大图像实时浏览技术[J].中国图象图形学报,2011,16(2):152-160.][DOI:10.11834/jig.20110216]
[10]Lin F.Research on the pyramid construction and storage technology of image data based on HDFS[D].Harbin:Northeast Forestry University,2016.[林峰.基于HDFS的影像数据金字塔构建及存储技术研究[D].哈尔滨:东北林业大学,2016.]
[11]Liu Y,Chen L,Jing N,et al.Parallel batch-building remote sensing images tile pyramid with MapReduce[J].Geomatics and Information Science of Wuhan University,2013,38(3):278-282.[刘义,陈荦,景宁,等.利用MapReduce进行批量遥感影像瓦片金字塔构建[J].武汉大学学报:信息科学版,2013,38(3):278-282.][DOI:10.13203/j.whugis2013.03.006]
[12]Huang D M,Yang Y H,Mei H B,et al.A parallel construction method of remote sensing image pyramid model for spark[J].Computer Applications and Software,2017,34(5):175-181.[黄冬梅,杨雨浩,梅海彬,等.面向Spark的遥感影像金字塔模型的并行构建方法[J].计算机应用与软件,2017,34(5):175-181.][DOI:10.3969/j.issn.1000-386x.2017.05.031]
[13]Hao G J,Xiong W,Chen L,et al.An MPI-based parallel pyramid building algorithm for large-scale RS image[J].Journal of Geo-Information Science,2015,17(5):515-522.[郝高进,熊伟,陈荤,等.基于MPI的大规模遥感影像金字塔并行构建方法[J].地球信息科学学报,2015,17(5):515-522.][DOI:10.3724/SP.J.1047.2015.00515]
[14]Gao Z.Research and development of fast pyramid generation algorithm of massive remote sensing image[D].Shanghai:East China Normal University,2012.[高峥.海量遥感影像快速生成金字塔算法的研究与实现[D].上海:华东师范大学,2012.]
[15]Xie Y H,Tang X A,Sun M Y.Image Pyramid structures without truncation and data expansion[J].Journal of Image and Graphics,2009,14(6):1070-1074.[谢耀华,汤晓安,孙茂印.不产生精度截断及数据膨胀的图像金字塔[J].中国图象图形学报,2009,14(6):1070-1074.][DOI:10.11834/jig.20090609]
[16]Zhang Y Z,Zhang M,Wang J N,et al.TDFA:a generation method of spatial image pyramid[J].Journal of Image and Graphics,2016,21(7):959-966.[张云舟,张陌,王晋年,等.TDFA:一种生成空间影像金字塔的方法[J].中国图象图形学报,2016,21(7):959-966.][DOI:10.11834/jig.20160714]
[17]Jiang H C,Zhao Z M,Zhu H Q.Fast view mass strip SAR image using block replacement algorithm[J].Computer Engineering and Applications,2004,40(28):50-51,194.[蒋红成,赵忠明,朱海青.用分块调度置换算法快速浏览SAR带状海量影像[J].计算机工程与应用,2004,40(28):50-51,194.][DOI:10.3321/j.issn:1002-8331.2004.28.015]
[18]Li J X,Shen B,Jiang R G,et al.Quadtree spatial index algorithm oriented to image pyramid[J].Computer Engineering,2011,37(10):11-13.[李建勋,沈冰,姜仁贵,等.面向影像金字塔的四叉树空间索引算法[J].计算机工程,2011,37(10):11-13.][DOI:10.3969/j.issn.1000-3428.2011.10.003]
[19]Nie Y F,Zhou W S,Shu J,et al.Spatial index for tile map service based on Z curve[J].Journal of Image and Graphics,2012,17(2):286-292.[聂云峰,周文生,舒坚,等.基于Z曲线的瓦片地图服务空间索引[J].中国图象图形学报,2012,17(2):286-292.][DOI:10.11834/jig.20120219]
[20]Jiang D H.Application of dynamic Roaming algorithm in GISmap based on image pyramid[J].Computer Engineering and Design,2013,34(5):1711-1715.[姜代红.基于影像金字塔的GIS地图动态漫游算法[J].计算机工程与设计,2013,34(5):1711-1715.][DOI:10.3969/j.issn.1000-7024.2013.05.037]
[21]Zhang H W,Tong H J,Zuo B X,et al.Quick browsing of massive remote sensing image based on GDAL[J].Computer Engineering and Applications,2012,48(13):159-162.[张宏伟,童恒建,左博新,等.基于GDAL大于2G遥感图像的快速浏览[J].计算机工程与应用,2012,48(13):159-162.][DOI:10.3778/j.issn.1002-8331.2012.13.034]
[22]Cline D,Egbert K E.Interactive display of very large textures[C]//Proceedings of the Conference on Visualization.Research Triangle Park,NC,USA,USA:IEEE,1998:343-350.
[23]Zhang X C,Huang Z C,Chen G,et al.Rapid display technique of massive remote sensing image[J].Journal of Image and Graphics,2002,7A(10):1021-1026.[章孝灿,黄智才,陈刚,等.海量遥感图象快速显示技术[J].中国图象图形学报,2002,7A(10):1021-1026.][DOI:10.11834/jig.2002010316]
[24]Shi J.Strategy of image rapid loading and display[J].Forest Inventory and Planning,2017,42(3):1-3,35.[师静.一种影像快速加载及显示策略[J].林业调查规划,2017,42(3):1-3,35.][DOI:10.3969/j.issn.1671-3168.2017.03.001]
[25]Cai P,Wu X H,He X H,et al.Browse of the high-resolution core image based on tiled pyramid model[J].Journal of Terahertz Science and Electronic Information Technology,2014,1(1):97-102.[蔡坪,吴晓红,何小海,等.基于瓦片金字塔模型的高分辨力岩心图像浏览[J].太赫兹科学与电子信息学报,2014,1(1):97-102.][DOI:10.11805/TKY-DA201401.0097]