管道漏磁检测实时数据压缩算法的实现
|
摘要
漏磁检测是长距离油气输送管道进行在线检测的主要方法。应用管道漏磁在线检测装置可以及时检测出管道的缺陷,预防管道泄漏事故的发生。由于存储漏磁检测数据所用电子硬盘存储数据量少,因此需要有实时的数据采集、压缩、存储系统。本文开发了基于ARM(Advanced RISC Machines,高级精简指令集计算机)的嵌入式为核心的处理器平台,用于实现管道漏磁检测数据的实时采集、压缩与存储。
论文提出了一种新型的以ARM处理器为核心的系统设计方案。针对漏磁检测无损压缩的目的、应用及漏磁检测原理和漏磁检测数据特征的研究,利用了LZW算法和Hash表的理论,提出了对漏磁检测数据进行实时无损压缩的算法。实时无损压缩算法采用了LZW算法对漏磁检测数据进行无损压缩,Hash表算法管理LZW算法的字符串表的方法。最后基于ARM硬件平台嵌入Linux操作系统,开发了基于Linux的采集设备驱动程序,并应用嵌入式技术实现了系统应用软件完成漏磁数据的采集、压缩与存储。
利用嵌入式ARM处理器的优势,进行软硬协同设计;利用ARM处理器的数据采集模块,提高了系统的运算能力和可靠性,Linux操作系统的使用提高了前端数据的采集精度,简化了与外围设备的通信,进一步缩短了开发周期,降低了开发成本,同时漏磁检测数据实时压缩算法满足2倍以上的压缩比,实时压缩数据。针对系统设计实现的各功能模块,分别给出了验证方法及结果。实验表明:各功能模块运行稳定、性能良好,可以应用于管道漏磁检测数据压缩系统中。
Magnetic Flux Leakage (MFL) inspection is the main method of on-line inspecting long distance oil-gas transportation pipeline. Pipeline MFL inspection device is applied to detect defects of pipeline in time in order to prevent pipeline leakage accident. Because of MFL data storage used in electronic data storage hard disk volume, it has required real-time data acquisition, compression, storage systems In this paper, an embedded system based on ARM (Advanced RISC Machines) is developed with Linux embedded technology, the system is used to realize the real-time acquisition, compression and storage of pipeline MFL inspection data.
First, the defects of current MFL inspection system aiming at the defects, a new system design scheme which applys FPGA is presented, and the hardware system based on a single ARM is designed according to system requirements. The aim and application of diagnostically lossless compression and the data compression method for magnetic flux leakage (MFL) inspection of pipelines is introduced. By analyzing the principle of MFL and the character of the MFL inspection data, uses the LZW algorithm to magnetic flux leakage data in real-time lossless compression. In order to accelerating the speed of data compression, the algorithm also uses Hash method to manage the string table of LZW algorithm. Based on Linux, the drive program of acquisition device is developed and the system software implementing data acquisition, compression and storage is designed with multithreads technology.
Utilizing ARM technology, hardware & software co-design can be employed freely; In the same time, reliability and operation power of the system are improved greatly via applying ARM to control data acquisition module; Besides, the utilization of Linux operating system enhances the acquisition precision of frontal data, simplify the communication between ARM and peripheral equipment, shortens further system development time and reduced design cost. The algorithm can realized more than 2 times the data compression. The real-time of the program is better, and the program realized 2 times more data compression. And the realization of magnetic flux leakage data acquisition, compression, storage. Aiming at each functional module designed in the system, testing methods and corresponding results are presented respectively in the paper. Experiments indicate that each functional module can run stably with good performance, and they can be used in the pipeline MFL inspection device with no problems.
论文提出了一种新型的以ARM处理器为核心的系统设计方案。针对漏磁检测无损压缩的目的、应用及漏磁检测原理和漏磁检测数据特征的研究,利用了LZW算法和Hash表的理论,提出了对漏磁检测数据进行实时无损压缩的算法。实时无损压缩算法采用了LZW算法对漏磁检测数据进行无损压缩,Hash表算法管理LZW算法的字符串表的方法。最后基于ARM硬件平台嵌入Linux操作系统,开发了基于Linux的采集设备驱动程序,并应用嵌入式技术实现了系统应用软件完成漏磁数据的采集、压缩与存储。
利用嵌入式ARM处理器的优势,进行软硬协同设计;利用ARM处理器的数据采集模块,提高了系统的运算能力和可靠性,Linux操作系统的使用提高了前端数据的采集精度,简化了与外围设备的通信,进一步缩短了开发周期,降低了开发成本,同时漏磁检测数据实时压缩算法满足2倍以上的压缩比,实时压缩数据。针对系统设计实现的各功能模块,分别给出了验证方法及结果。实验表明:各功能模块运行稳定、性能良好,可以应用于管道漏磁检测数据压缩系统中。
Magnetic Flux Leakage (MFL) inspection is the main method of on-line inspecting long distance oil-gas transportation pipeline. Pipeline MFL inspection device is applied to detect defects of pipeline in time in order to prevent pipeline leakage accident. Because of MFL data storage used in electronic data storage hard disk volume, it has required real-time data acquisition, compression, storage systems In this paper, an embedded system based on ARM (Advanced RISC Machines) is developed with Linux embedded technology, the system is used to realize the real-time acquisition, compression and storage of pipeline MFL inspection data.
First, the defects of current MFL inspection system aiming at the defects, a new system design scheme which applys FPGA is presented, and the hardware system based on a single ARM is designed according to system requirements. The aim and application of diagnostically lossless compression and the data compression method for magnetic flux leakage (MFL) inspection of pipelines is introduced. By analyzing the principle of MFL and the character of the MFL inspection data, uses the LZW algorithm to magnetic flux leakage data in real-time lossless compression. In order to accelerating the speed of data compression, the algorithm also uses Hash method to manage the string table of LZW algorithm. Based on Linux, the drive program of acquisition device is developed and the system software implementing data acquisition, compression and storage is designed with multithreads technology.
Utilizing ARM technology, hardware & software co-design can be employed freely; In the same time, reliability and operation power of the system are improved greatly via applying ARM to control data acquisition module; Besides, the utilization of Linux operating system enhances the acquisition precision of frontal data, simplify the communication between ARM and peripheral equipment, shortens further system development time and reduced design cost. The algorithm can realized more than 2 times the data compression. The real-time of the program is better, and the program realized 2 times more data compression. And the realization of magnetic flux leakage data acquisition, compression, storage. Aiming at each functional module designed in the system, testing methods and corresponding results are presented respectively in the paper. Experiments indicate that each functional module can run stably with good performance, and they can be used in the pipeline MFL inspection device with no problems.
引文
[1]马凤铭.基于FPGA的管道漏磁检测控制系统的研究与设计:(硕士学位论文).沈阳:沈阳工业大学,2004.
[2]王玉忠,陈建兰.漏磁检测技术在我国管道中的应用.化学清洗,1998,41(5):24-27.
[3]Tham W,Wooley S.The detection and segmentation of pipeline inspection features for diagnostically lossless data compression.Proceedings of SPIE Vol.4301(2001),IST/SPIE Electronic Imaging,January 2001,San Jose,California,USA:21-26.
[4]Mandayam S,Udpa L,Udpa S,et al.Invariance transformations for magnetic flux leakagesignals.IEEE Transactions on Magnetics,1996,32(3):1577-1580.
[5]杨理践,葛岷,高松巍.测磁法管道在线检测计算机系统,沈阳工业大学学报,1999,(3):227-229.
[6]杨理践,冯海英.基于双正交样条小波的管道漏磁信号的去噪和数据压缩技术.沈阳工业大学学报,2001,23(6):479-482.
[7]杨理践,张华良,高松巍.检测无损压缩在管道漏磁检测数据压缩中的应用.无损检测,2003,25(3):146-150.
[8]Wei Mao-an,Jin Shijiu,Wang Likun,etal.Study on MFL Defect Inspection and Defect Image Process Technology.Proceedings of the 5th World Congress on Intelligent Control and Automation,June,2004,Hangzhou,P.R.China:3830-3833.
[9]杨理践.智能化管道漏磁检测装置的研究.无损检测,2002,24(3):100-102.
[10]杨理践.管道漏磁在线检测技术.沈阳工业大学学报,2005,27(5):522-525.
[11]W.Tham,S.Wooley.The detection and segmentation of pipeline insPection features for diagnostically lossless data compression IST/SPIE Electronic Imaging 2001 21-26 January2001,San Jose,California,USA.
[12]杨理践,王大为,高松巍.管道漏磁检测数据压缩算法的研究.沈阳工业大学学报,2006,28(6):628-631.
[13]杜冠.基于ARM嵌入式Linux系统移植的研究:(硕士学位论文).武汉:华中科技大学,2006.
[14]颜庭柏.基于ARM_Linux的嵌入式数据采集和发布系统:(硕士学位论文).南京:南京信息工程大学,2007.
[15]徐军.基于ARM处理器Linux开发平台的发动机振动测量仪的研究与实现:(硕士学位论文).南京:南京航空航天大学.2007.
[16]王广丰.基于ARM微处理器的嵌入式数控系统的设计与实现:(硕士学位论文).南京:南京航空航天大学.2006.
[17]张鹏,邵惠鹤.基于ARM嵌入式系统的软测量应用,控制工程,2008(01),36-38.
[18]何波.基于ARM的嵌入式运动控制器研究:(硕士学位论文).上海:上海交通大学,2008.
[19]刘淼.嵌入式系统接口设计与Linux驱动程序开发.北京:北京航空航天大学出版社,2006.
[20]Karim Yagbmour.构建嵌入式linux系统.北京:中国电力出版社,2004,12.
[21]沈沙,苏佳宁,田骏骅.uClinux操作系统在嵌入式SOC平台上的移植.计算机工程与应用,2004,26:104-108.
[22]李晓明,王进祥.基于可复用IP方法的32位嵌入式处理器结构设计.微处理机,2002,(3):34-36.
[23]郭勇.基于ARM Linux的嵌入式多媒体系统设计与开发(硕士学位论文).成都:成都理工大学.2008.
[24]张凯.基于嵌入式系统的通用电子测量仪器关键技术的研究(硕士学位论文).西安:西安电子科技大学,2005.
[25]张琼声,苏卫,侯波.一种基于虚拟机技术的嵌入式操作系统移植方案.微计算机应用.2007,(02):108-111.
[26]吴锐,朱君,王余旺,林勇.基于UP-NETARM3000平台的uCLinux的移植.计算技术与自动化,2006,(S2).
[27]陈亮,杜尚丰,王煦莹.基于ARM9的数据采集器的设计.仪器仪表学报,2006,27(6):118-119.
[28]陈峰,李滨滔,戈志华.基于S3C2410的嵌入式Linux系统构建.现代电子技术,2007,24(263):55-58.
[29]王培东,黄凌碧.基于LKM的嵌入式Linux内核调试模型及实现.计算机工程,2007,33(5):65-67.
[30]畅卫功,丁忠林.嵌入式Linux系统中触摸屏驱动的研究.微计算机信息,2007,23(1-2):103-105.
[31]李颉思,李春萍.嵌入式Linux系统中移动存储的研究与实现.计算机应用与软件,2007,24(1):185-187.
[32]Shannon C E.A Mathematical Theory of Communication.The Bell System Technical Journal,1948,(27):10,379-423,623-656.
[33]刘榴娣,刘明奇,党长民.实用数字图像处理.北京:北京理工大学出版社,2001,135-176.
[34]王平.LZW无损压缩算法的实现与研究.计算机工程,2002,28(7):98-100.
[35]Wiseman,Yair.The relative efficiency of data compression by LZW and LZSS.Data Science Journal,2007,6(48),1-6.
[36]Kida Takuya,Takeda Masayuk.Multiple pattern matching in LZW compressed text.J.of Discrete Algorithms,2000,1(1),133-158.
[37]MAGNETIC FLUX PIPE INSPECTION APPARATUS FOR ANALYZING ANOMALIES IN A PIPELINE WALL.United States Patent,Patent Number 5,864,232.
[38]Hwang W J,Derin H Multi-resolution multi-resource progressive image transmission.IEEETrans.On Image Processing,1995,4(8):1128-1139.
[39]Mallat S.A theory for multi-resolution signal decomposition:The wavelet representation.IEEE Trans.Pattern Analysis and machine Intelligence,1989,11(7):674-693.
[40]Wiseman,Yair.The relative efficiency of data compression by LZW and LZSS.Data Science Journal,2007,6(48),1-6.
[41]Kida Takuya,Takeda Masayuk.Multiple pattern matching in LZW compressed text.J.of Discrete Algorithms,2000,1(1),133-158.
[42]Alessandro Rubini,Jonathan Corbet.Linux Device Drivers,Second Edition[M].OReilly,2004.
[43]孙海燕,于海勋,胡良君.基于ARM-Linux平台的机载数据采集记录装置设计.宇航计测技术.2006,26(3):59-62.
[44]邹思轶.嵌入式Linux设计与应用.北京:清华大学出版社,2002.
[45]吴宇新,余松煌.对LZW算法的改进及其在图像无损压缩中的应用.上海交通大学学报,1998,3(29):110-113.
[46]卓越,杨长生,宋广华.一种基于自适应字典的通用无损压缩算法.计算机工程.2001,27(2):149-151.
[47]林小竹,籍俊伟.一种改进的LZW压缩算法.计算机工程.2005,31(14):199-201.
[48]卓越,杨长生,宋广华.一种基于自适应字典的通用无损压缩算法.计算机工程,2001,27(2):149-151.
[49]李雷定,马铁华.利用FPGA实现LZW算法的研究.电子测量技术,2008,31(10):170-172.
[2]王玉忠,陈建兰.漏磁检测技术在我国管道中的应用.化学清洗,1998,41(5):24-27.
[3]Tham W,Wooley S.The detection and segmentation of pipeline inspection features for diagnostically lossless data compression.Proceedings of SPIE Vol.4301(2001),IST/SPIE Electronic Imaging,January 2001,San Jose,California,USA:21-26.
[4]Mandayam S,Udpa L,Udpa S,et al.Invariance transformations for magnetic flux leakagesignals.IEEE Transactions on Magnetics,1996,32(3):1577-1580.
[5]杨理践,葛岷,高松巍.测磁法管道在线检测计算机系统,沈阳工业大学学报,1999,(3):227-229.
[6]杨理践,冯海英.基于双正交样条小波的管道漏磁信号的去噪和数据压缩技术.沈阳工业大学学报,2001,23(6):479-482.
[7]杨理践,张华良,高松巍.检测无损压缩在管道漏磁检测数据压缩中的应用.无损检测,2003,25(3):146-150.
[8]Wei Mao-an,Jin Shijiu,Wang Likun,etal.Study on MFL Defect Inspection and Defect Image Process Technology.Proceedings of the 5th World Congress on Intelligent Control and Automation,June,2004,Hangzhou,P.R.China:3830-3833.
[9]杨理践.智能化管道漏磁检测装置的研究.无损检测,2002,24(3):100-102.
[10]杨理践.管道漏磁在线检测技术.沈阳工业大学学报,2005,27(5):522-525.
[11]W.Tham,S.Wooley.The detection and segmentation of pipeline insPection features for diagnostically lossless data compression IST/SPIE Electronic Imaging 2001 21-26 January2001,San Jose,California,USA.
[12]杨理践,王大为,高松巍.管道漏磁检测数据压缩算法的研究.沈阳工业大学学报,2006,28(6):628-631.
[13]杜冠.基于ARM嵌入式Linux系统移植的研究:(硕士学位论文).武汉:华中科技大学,2006.
[14]颜庭柏.基于ARM_Linux的嵌入式数据采集和发布系统:(硕士学位论文).南京:南京信息工程大学,2007.
[15]徐军.基于ARM处理器Linux开发平台的发动机振动测量仪的研究与实现:(硕士学位论文).南京:南京航空航天大学.2007.
[16]王广丰.基于ARM微处理器的嵌入式数控系统的设计与实现:(硕士学位论文).南京:南京航空航天大学.2006.
[17]张鹏,邵惠鹤.基于ARM嵌入式系统的软测量应用,控制工程,2008(01),36-38.
[18]何波.基于ARM的嵌入式运动控制器研究:(硕士学位论文).上海:上海交通大学,2008.
[19]刘淼.嵌入式系统接口设计与Linux驱动程序开发.北京:北京航空航天大学出版社,2006.
[20]Karim Yagbmour.构建嵌入式linux系统.北京:中国电力出版社,2004,12.
[21]沈沙,苏佳宁,田骏骅.uClinux操作系统在嵌入式SOC平台上的移植.计算机工程与应用,2004,26:104-108.
[22]李晓明,王进祥.基于可复用IP方法的32位嵌入式处理器结构设计.微处理机,2002,(3):34-36.
[23]郭勇.基于ARM Linux的嵌入式多媒体系统设计与开发(硕士学位论文).成都:成都理工大学.2008.
[24]张凯.基于嵌入式系统的通用电子测量仪器关键技术的研究(硕士学位论文).西安:西安电子科技大学,2005.
[25]张琼声,苏卫,侯波.一种基于虚拟机技术的嵌入式操作系统移植方案.微计算机应用.2007,(02):108-111.
[26]吴锐,朱君,王余旺,林勇.基于UP-NETARM3000平台的uCLinux的移植.计算技术与自动化,2006,(S2).
[27]陈亮,杜尚丰,王煦莹.基于ARM9的数据采集器的设计.仪器仪表学报,2006,27(6):118-119.
[28]陈峰,李滨滔,戈志华.基于S3C2410的嵌入式Linux系统构建.现代电子技术,2007,24(263):55-58.
[29]王培东,黄凌碧.基于LKM的嵌入式Linux内核调试模型及实现.计算机工程,2007,33(5):65-67.
[30]畅卫功,丁忠林.嵌入式Linux系统中触摸屏驱动的研究.微计算机信息,2007,23(1-2):103-105.
[31]李颉思,李春萍.嵌入式Linux系统中移动存储的研究与实现.计算机应用与软件,2007,24(1):185-187.
[32]Shannon C E.A Mathematical Theory of Communication.The Bell System Technical Journal,1948,(27):10,379-423,623-656.
[33]刘榴娣,刘明奇,党长民.实用数字图像处理.北京:北京理工大学出版社,2001,135-176.
[34]王平.LZW无损压缩算法的实现与研究.计算机工程,2002,28(7):98-100.
[35]Wiseman,Yair.The relative efficiency of data compression by LZW and LZSS.Data Science Journal,2007,6(48),1-6.
[36]Kida Takuya,Takeda Masayuk.Multiple pattern matching in LZW compressed text.J.of Discrete Algorithms,2000,1(1),133-158.
[37]MAGNETIC FLUX PIPE INSPECTION APPARATUS FOR ANALYZING ANOMALIES IN A PIPELINE WALL.United States Patent,Patent Number 5,864,232.
[38]Hwang W J,Derin H Multi-resolution multi-resource progressive image transmission.IEEETrans.On Image Processing,1995,4(8):1128-1139.
[39]Mallat S.A theory for multi-resolution signal decomposition:The wavelet representation.IEEE Trans.Pattern Analysis and machine Intelligence,1989,11(7):674-693.
[40]Wiseman,Yair.The relative efficiency of data compression by LZW and LZSS.Data Science Journal,2007,6(48),1-6.
[41]Kida Takuya,Takeda Masayuk.Multiple pattern matching in LZW compressed text.J.of Discrete Algorithms,2000,1(1),133-158.
[42]Alessandro Rubini,Jonathan Corbet.Linux Device Drivers,Second Edition[M].OReilly,2004.
[43]孙海燕,于海勋,胡良君.基于ARM-Linux平台的机载数据采集记录装置设计.宇航计测技术.2006,26(3):59-62.
[44]邹思轶.嵌入式Linux设计与应用.北京:清华大学出版社,2002.
[45]吴宇新,余松煌.对LZW算法的改进及其在图像无损压缩中的应用.上海交通大学学报,1998,3(29):110-113.
[46]卓越,杨长生,宋广华.一种基于自适应字典的通用无损压缩算法.计算机工程.2001,27(2):149-151.
[47]林小竹,籍俊伟.一种改进的LZW压缩算法.计算机工程.2005,31(14):199-201.
[48]卓越,杨长生,宋广华.一种基于自适应字典的通用无损压缩算法.计算机工程,2001,27(2):149-151.
[49]李雷定,马铁华.利用FPGA实现LZW算法的研究.电子测量技术,2008,31(10):170-172.