电力数据压缩传输及解压算法的研究与实现
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着变电站自动化技术的不断进步,巨量数据的传输与存储已成为电力系统中一个非常重要且亟待解决的问题,而解决这一难题的最为有效的方法就是对监测数据进行压缩。鉴于小波变换优良的时频特性,近年来提出的基于小波变换的数据压缩算法不仅获得了较高压缩倍数,而且还能精确地重构原始信号,但目前来说,该类算法仍存在一些理论和技术上的问题影响了实际应用,如一代小波压缩算法计算量大、不利于硬件和实时实现,二代小波Euclidean分解不唯一、运算量减小有限且提升过程存在破坏小波滤波器正交性的问题等。
     针对这一现状,本文对基于小波变换的电力数据压缩解压算法及压缩数据的远程传输技术进行了深入地理论研究和实验验证。主要工作如下:
     1、首先整体介绍了数据压缩技术在电力系统中的应用方法,阐述了数据压缩的原理,引入了压缩算法的评价标准,完成了电力信号数学模型的建立,并采用Matlab编程对信号模型加以实现。
     2、对现有的阈值压缩算法进行了改进,首次提出了一种纪录非零小波系数的位图压缩新算法,相比传统方法,该法在同等大小的均方误差下,获得了更高的压缩倍数。
     3、深入研究了一代小波滤波器组的整数提升过程,在此基础上,首次将整数小波变换与改进的阈值压缩算法相结合,提出了整数小波阈值压缩算法,有效解决了一代小波压缩算法实现复杂、运算速度慢、变换结果为浮点数等问题,使算法在重构信号的能量恢复系数和均方误差以及压缩算法的实时性三方面都要优于一代小波压缩算法。
     4、针对电力数据特点,将Ray-Period无损压缩算法引入到整数小波阈值压缩算法中,提出了一种高效的基于整数小波变换的Ray-Period压缩算法,该算法对小波变换得到的低频系数采用Ray-Period压缩,在不增加均方误差的条件下,使整数小波阈值压缩算法压缩倍数进一步提升。
     5、对一代小波滤波器结构和系数进行优化,提出了一种高效的整数算法小波变换的构造及实现方案,并将其应用于电力系统数据的压缩,从根本上解决了一代及二代小波应用于电力数据压缩时存在的浮点运算问题,大大提高了压缩算法的实时性,并尝试将该压缩算法扩展应用到图像数据的压缩领域,初步探讨了灰度及真彩色图像的压缩方法。
     6、分析比较当前远程传输的方式,选用了GPRS无线通信网络来传输电力系统监测数据,大大提高了数据传输的灵活性。设计了基于GPRS技术的远程数据传输方案,并从GPRS通信模块选择、网络接入方式及网络传输协议等方面详细阐述了该方案,在此基础上还完成了数据传输协议上层应用协议的设计,进一步增强了数据传输的可靠性。
     7、完成了基于GPRS的远程数据传输系统的软硬件开发平台的搭建。其中监测终端采用基于ARM920T内核的S3C2410A型开发板,并经开发板串口与MC55 GPRS通信模块相连,操作系统选用Windows CE。应用EVC4.0开发工具C/C++编程语言设计开发了具有友好图形界面的数据压缩、解压及GPRS数据传输程序,其中GPRS数据传输采用多线程编程技术实现,并进行了大量的网络传输测试,结果证实了本文传输程序的可靠性和稳定性。
     数据的解压缩主要是对接收到的数据进行小波反变换重构出原始信号,这一部分没有单独讲述,其原理和流程图在讨论数据压缩时一并列出。文中大量的实验结果证实了本文算法的正确性和有效性。
With the advancement of transformer substation automatization technology, the amount of data gathered by such monitoring devices has become huge in size. Hence tremendous amount of data transmission and storage has become an issue of utmost importance and need to be solved urgently in power system. The most effective method to resolve this problem is to compress the monitored data. Considering the excellent features of wavelet transform in the time and frequency domain, the data compression algorithm based on wavelet transform was proposed in recent years. This algorithm could not only obtain high compression multiple, but also reconstruct original signal accurately. But according to the present research, there were still some theoretical and technical problems that limited the practical applications of this algorithm. For instance, the compression algrithm based on first generational wavelet transform demanded large amount of computation, which made it not feasible to hardware and real-time implementation; when using second generational wavelet transform, the Euclidean decomposition was not one and only, the reduce of computation was limited and the orthogonality of wavelet filter bank was weakened during the process of lifting.
     Considering the problems above, the electric power data compression and decompression algrithms based on wavelet transform and the remote transmission technology of compressed data were deeply researched in theory and tested with mass experiments in this paper, the main tasks are below:
     1、Firstly, the method to apply data compression technology in electric power system was introduced. The principle of compression and the evaluation criteria of compression algorithms were discussed. And the mathematical models of electric power signals were established.
     2、A novel bitmap compression algorithm to record nonzero wavelet coefficients was proposed for the first time. Compared with traditional threshold value algorithm, the proposed algorithm can obtain higher compression multiple when the reconstructive signal with the same mean square error.
     3、On the basis of analyzing integer lifting process in depth, an improved integer wavelet threshold compression algorithm was proposed for the first time. It can effectively settle the problems, such as the complex realization, the low speed and the floating-point resulting filtered outputs, which are brought by the compression algrithm based on first generational wavelet transform. Compared with first generational wavelet compression, the performance of new approach is enhanced at three aspects, which are the energy recovery coefficient, the mean square error of reconstructive signal, and real-time property of compression algorithm.
     4、Considering the features of power system data, a Ray-Period compression algorithm based on integer wavelet transform was proposed, where the low-frequency data was processed by lossless Ray-Period algorithm. The algorithm further increases the compression multiple of integer wavelet threshold compression with the same mean square error.
     5、An efficient algorithm to build integer arithmetic wavelet transform (IAWT) was proposed by improving the traditional wavelet filter structure and coefficients, which solves the problem of the floating-point computations essentially. By applying IAWT to compress data in power system, the computing speed of algrithm is greatly increased. Then the compression method of gray and true color image was researched preliminaryly.
     6、Through compared the present ways of remote transmission, GPRS was chosen to transmit the monitoring data in power system, which greatly increased the flexibility of data transmission. Then the remote transmission scheme based on GPRS was proposed and demonstrated in detail from the selection of GPRS module, network access and transmission protocol. Based on the above, the application level protocol was designed, which further enhances the reliability of transmission.
     7、The software and hardware development platform of remote data transmission scheme based on GPRS was built, among which the monitoring terminal was an embedded development board using S3C2410A processor with ARM920T kernel and Windows CE operation system, the MC55 module was connected to the board via serial communication interface. Using EVC4.0 and C/C++, the programs that consist of data compression, decompression and GPRS data transmission were designed and realized, a friendly graphical interface was given and multithreading technology was adopted in GPRS transmission. Mass of network transmission testing result confirms the reliability and stability of our transmission programs.
     The compressed data receiving could be reconstructed with the aid of inverse wavelet transform. So the section of data decompression wasn't discussed solely in this paper, its principles and flow charts had been introduced together with data compression. The experimental results prove that the algorithms proposed in this paper are correct and effective.
引文
[1]晏凯.电力参数监测系统中的数据压缩技术应用研究[D].广东:中山大学,2002
    [2]Khalid Sayood.Huffman Coding[J].Introduction to Data Compression(Third Edition),2006:41-80
    [3]Zhang Yi,Pei Zhili,Yang Jinhui,et al.Canonical Huffinan Code Based Full-text Index[J].Progress in Natural Science,2008,18(3):325-330
    [4]苗世洪,王少荣,刘沛,等.数据压缩技术在电力系统通信中的应用[J].电力自动化设备,1999,19(3):32-33
    [5]卓越,杨长生,宋广华.一种基于自适应字典的通用无损压缩算法[J].计算机工程,2001,27(2):149-151
    [6]张超,房若季.改进的LZSS压缩算法在故障信息文件远传中的应用[J].电网技术,2003,27(6):42-44
    [7]广东电网公司.大客户负荷管理系统数据通信传输压缩算法[S].2005
    [8]王学伟,戴紫微.Ray-Period压缩算法的研究与实现[J].电测与仪表,2006,43(10):26-29
    [9]苗世洪,孙扬声,吴小辰.基于电力系统故障信息远程通信的高效数据压缩与解压技术研究[J].电力系统自动化,1996,20(5):53-55
    [10]Santoso S(The Univ of Texas at Austin),Powers EJ,Grady WM.Power Quality Disturbance Data Compression Using Wavelet Transform Methods[J].IEEE Transactions on Power Delivery,1997,12(3):1250-1257
    [11]Littler TB(Leading Edge Research Ltd),Morrow DJ.Wavelets for the analysis and compression of power system disturbances[J].IEEE Transactions on Power Delivery,1999,14(2):358-364
    [12]陈海宴,崔东艳,聂辉哲.小波变换在电力系统应用中的发展前景研究[J].仪器仪表学报,2004,25(4):627-629
    [13]Yang Xiaoyuan,Ren Hui,Li Bo.Embedded zerotree wavelets coding based on adaptive fuzzy clustering for image compression[J].Image and Vision Computing,2008,26(6):812-819
    [14]Hsieh Cheng-Tao(Natl Cheng-Kung Univ),Huang Shyh-Jier,Huang Ching-Lien.Data reduction of power quality disturbances-a wavelet transform approach[J].Electric Power Systems Research,1998,47(2):79-86
    [15]Omer Nezih Gereka,Do,an Gokhan Ece.Compression of power quality event data using 2D representation[J].Electric Power Systems Research,2008,78(6):1047-1052
    [16]张吴,刘沛.基于双正交小波的电力系统故障录波数据压缩[J].电网技术,2000,24(11):41-43,64
    [17]黄险峰,钱路江,付立军.电力系统故障录波信号压缩[J].电力自动化设备,2001,21(11):18-2l
    [18]G Panda,P K Dash,A K Pradhan,et al.Data compression of power quality events using slantlet transform[J].IEEE Trans.Power Delivery,2002,17(2):662-667
    [19]欧阳森,宋政湘,陈德桂,等.基于小波原理的电能质量检测数据实时压缩方法[J].电网技术,2003,27(2):37-40
    [20]刘应梅,白晓民,易俗,等.基于最小极大法的电力扰动信号压缩[J].电网技术,2004,28(3):33-37
    [21]李鹏,杨洪耕.基于DWT的自适应电能质量信号压缩及消噪[J].继电器,2004,32(20):5-9
    [22]GEREK O N,ECE D G.2-D analysis and compression of power-quality event data[J].IEEE Trans on Power Delivery,2004,19(2):791-798
    [23]林震宇,李智勇,吴为麟.基于嵌入式零树编码的电力系统数据压缩[J].浙江大学学报(工学版),2007,41(02):101-103,124
    [24]费铭薇,乐全明,张沛超,等.电力系统故障录波数据压缩与重构小波基选择[J].电力系统自动化,2005,29(17):64-67
    [25]何正友,钱清泉.电力系统暂态信号分析中小波基的选择原则[J].电力系统自动化,2003,27(10):45-48
    [26]徐凌,喻文焕.一种基于正交小波包变换的数据压缩方法[J].信号处理,2001,17(5):459-462
    [27]任震,何建军,黄雯莹,等.基于小波包算法的电机故障信号的压缩和重构[J].中国电机工程学报,2001,21(1):25-29
    [28]张兆宁,郁惟镛,张毅刚.基于小波包变换和矢量量化的电力系统故障数据压缩[J].电力系统自动化,2003,27(01):45-48
    [29]胡国胜,任震.基于半正交三角样条小波包的电机故障信号处理方法[J].电力自动化设备,2003,23(4):12-15
    [30]成敬周,张举.基于小波包分析的录波数据压缩原理[J].电力自动化设备,2004,24(7):53-56
    [31]郭彬彬,黄纯.基于小波包变换的电能质量扰动数据压缩[J].电力系统自动化,2005,25(11):34-37
    [32]Effrina Yanti Hamid,Zen-Ichiro Kawasaki,Member IEEE.Wavelet-Based Data Compression of Power System Disturbances Using the Minimum Description Length Criterion[J].IEEE TRANSACTIONS ON POWER DELIVERY,2002,17(2):460-466
    [33]何正友,钱清泉,王晓茹.基于优化小波基的电力故障暂态数据压缩研究[J].西南交通大学学报,2000,35(5):526-530
    [34]何正友,钱清泉,刘志刚.一种基于优化小波基的电力系统故障暂态数据压缩方法[J].中国电机工程学报,2002,22(6):1-5
    [35]潘文霞,李春林,史林军.基于最佳小波包基的电能质量暂态数据压缩[J].电力系统及其自动化学报,2005,17(3):50-54
    [36]Hsieh C T,Huang S J.Disturbance data compression of a power system using the huffman coding approach with wavelet transform enhancement[J].IEE Proc-Gener.Transm Distrib,2003,150(1):7-14
    [37]林震宇,吴为麟.嵌入式零树图像编码在故障信号压缩中的应用[J].电力系统及其自动化学报,2006,18(02):22-25
    [38]丁泽京,谢胜曙,曹志瑞,等.基于B样条小波的电力系统故障录波信号的数据压缩技术[J].电气应用,2005,25(8):31-34
    [39]王成山,王继东.基于能量阈值和自适应算术编码的数据压缩方法[J].电力系统自动化,2004,28(24):56-60
    [40]Huang Shyh-Jier,Senior Member IEEE,Jou Ming-Jong.Application of Arithmetic Coding for Electric Power Disturbance Data Compression With Wavelet Packet Enhancement[J]. IEEE TRANSACTIONS ON POWER SYSTEMS,2004,19(3):1334-1341
    [41]任明明,张彦斌,贾立新.一种基于提升小波和零树编码的录波数据压缩算法[J].西安交通大学学报,2006,40(4):494-496
    [42]乐全明,郁惟墉,柏传军,等.基于提升算法的电力系统故障录波数据压缩新方案[J].电力系统自动化,2005,29(5):74-78
    [43]闰常友,杨奇逊,刘万顺.基于提升格式的实时数据压缩和重构算法[J].中国电机工程学报,2005,25(9):6-10
    [44]黄天戍,汪阳,吴迪,等.基于第二代小波变换的电力系统故障录波数据压缩方法[J].电力自动化设备,2004,24(3):59-62
    [45]CALDERBANK R,DAUBECHIES I,SWELDENS W,et al.Wavelet transforms that map integers to integers.Princeton[R].USA:Princeton University,1996
    [46]刘志刚,张友刚,钱清泉.小波网络在电力系统故障信号处理中的应用研究[J].电网技术,2003,27(4):7-10
    [47]S K Meher,A K Pradhan,G Panda.An integrated data compression scheme for power quality events using spline wavelet and neural network[J].Electric Power Systems Research,2004,69:213-220
    [48]刘志刚,钱清泉.基于多小波的电力系统故障暂态数据压缩研究[J].中国电机工程学报,2003,23(10):22-26
    [49]曾怡达,刘志刚,钱清泉.CL多小波预处理方法在故障数据压缩中的应用[J].电网技术,2004,28(7):10-14
    [50]刘志刚,何正友,钱清泉.基于最优预处理方法的多小波故障数据压缩方案[J].电网技术,2005,29(11):40-43
    [51]孙延奎.小波分析及其应用[M].北京:机械工业出版社,2005.100-113
    [52]任雁铭.变电站计算机通信网络和系统的研究[D].河北:华北电力大学,2000
    [53]敬东,滕福生.电力系统数据传输策略[J].电力系统自动化,1997,21(9):65-68
    [54]曹惠彬.新环境下电力通信的发展[J].电力系统通信,2003,1:3-7
    [55]康恩婷,侯思祖,高宇,等.配网自动化无线通信方案的探讨[J].电力系统通信,2005,26(148):29-32
    [56]张春荣.GPRS在电力系统设备运行监测中应用的研究[D].河北:华北电力大学,2006
    [57]雷宇凌,雷宇壮,聂芳.GPRS技术在配电白动化中应用研究[J].供用电,2006,23(1):31-32
    [58]赵羡龙,王金芝.基于GPRS的用电管理系统及其智能终端介绍[J].华中电力,2005,18(4):28-30
    [59]姚远,易本顺.基于GPRS网络的电力负荷智能监控系统设计[J].湖南电力,2005,25(4):1-3
    [60]饶克明,张红先.GPRS技术在电力系统状态监测中的应用[J].湖南电力,2005,25(1):38-40,49
    [61]刘争芳.利用CDMA技术传输用电监视数据及图片的研究[D].河北:华北电力大学,2007
    [62]张迎华,赵刚,孙建明,等.GPRS无线业务的研究及应用[J].计算机与信息技术,2007,(7):59-62
    [63]黄战华,魏凯.基于GPRS和Socket机制实现多媒体消息传输的研究[J].通信技术,2007,40(11):376-378
    [64]随慧斌,王红红,王宏伟,等.基于GPRS网络的变电站远程抄表系统[J].电力系统通 信,2007,28(171):57-59,65
    [65]夏晓玲,崔永红,沈昱明.GPRS技术在配电网通信中的应用[J].自动化仪表,2007,26(1):38-41
    [66]牛斗,曲广强,曲洁,等.基于GPRS的电力系统远程监控设计与研究[J].电子测量技术,2006,29(5):167-169,173
    [67]李冬.基于嵌入式系统的GPRS电力参数无线传输系统[D].山东:山东大学,2007
    [68]赵宏波,宋杨,陈希.GPRS在电力光缆在线监测与管理系统中的应用[J].电力系统通信,2008,29(183):46-49
    [69]陈晓晨.铁路GPRS远程监视系统的应用分析与设计[D].北京:北京交通大学,2007
    [70]匡国防,吴良杰,丛会智.油田GPRS远程数据监测系统[J].计算机工程,2007,33(13):266-267,27 1
    [71]卢新波,杜瑞红.基于GPRS的配网自动化系统组网方案的探讨[J].继电器,2006,34(1):76-78
    [72]杨军.数传电台和GPRS通信技术特点[J].电力需求侧管理,2007,19(2):77-78
    [73]孙妙平.电力系统测量数据的压缩、传输及解压研究[D].四川:西南交通大学,2000
    [74]石敏,吴正国,尹为民.基于双小波的短时电压波动信号检测[J].电网技术,2005,29(6):17-21
    [75]陈祥训.采用小波技术的几种电能质量扰动的测量与分类方法[J].中国电机工程学报,2002,22(10):1-6
    [76]刘守亮,肖先勇,杨红耕.基于S变换模时频矩阵相似度的短时电能质量扰动分类[J].电网技术,2006,30(5):67-71
    [78]刘安定.基于局部余弦变换和小波变换的短时电能质量扰动检测[D].四川:四川大学,2005
    [79]周厚奎.基于小波和神经网络的电能质量扰动信号数据压缩[J].电力自动化设备,2007,27(3):38-40,56
    [80]黄宽.基于GPRS的用电现场管理系统的研究[D].山东:山东大学,2005
    [81]孙海翠,张金波.低压电力线载波通信技术研究与应用[J],电测与仪表,2006,43(488):54-57,43
    [82]樊建学,盛新富.低压电力线载波集中抄表系统的研究[J].继电器,2005,23(17):49-52
    [83]张健.基于低压电力线载波的自动抄表与负荷管理系统[D].河北:华北电力大学,2005
    [84]陈波.电力微波通信网分布式监测系统的研究[D].四川:四川大学,2001
    [85]王强,董平,张昌.华中电力光纤通信网的建设策略[J].华中电力,2003,16(2):37-40
    [86]陈红新.基于提升小波的嵌入式图像与视频编码算法研究[D].天津:天津大学,2006
    [87]MC55/56 Hardware Interface Description[M].Siemens公司:Version 01.05,2004
    [88]Lin Chin E,LI Chih-Ching,Wu Chh-Chen,et aI_A Real Time GPRS Surveillance System using the Embedded System[J].IEEE,2003:1227-1234
    [89]赵亮.基于GPRS的变压器监控系统的研究与实现[D].山东:山东大学,2005
    [90]杨延双,张建标,王全民.TCP/IP协议分析及应用[M].北京:机械工业出版社,2007.
    [91]刘鲁新,权进国,林孝康.ARM9处理器与ARM7处理器比较[J].电子技术应用,2004,30(11):13-15
    [92]周毓林,宁杨,陆贵强,等.WINDOWS CE.NET内核定制及应用开发[M].北京:电子工业出版社.2005.100-120
    [93]汪兵,李存斌,陈鹏,等.EVC高级编程及其应用开发[M].北京:中国水利水电出版社,2005.290-332
    [94]MC55 AT Command Set[M].Siemens公司:Version 04.00,2006
    [95]秦业,鄢锋.Visual C++通信编程工程实例精解[M].北京:机械工业出版社,2007.220-268

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700