传感数据通信协议及高并发服务的设计与实现——以微环境监测平台为例
|
摘要
为了满足人们对于限定区域监测的需求,解决异构数据的表示、传输以及高并发问题,分析了传统物联网平台在传感数据采集以及传输方面的不足,通过功能模块设计,开发了微环境监测平台。针对平台传感层数据采集工作,设计通信协议,统一数据格式,减少数据传输量和能耗,并制定协议通信流程,利用LoRa技术完成终端到网关之间数据的远程传输;针对平台网络层,设计高并发数据接口实现服务端程序接收并处理数据,最终完成系统的研发和测试。结果表明:设计的通信协议可以完成异构数据格式的统一工作,降低了数据传输量和能耗;验证了数据从终端采集设备到网关,并经过上位机最后到服务器整套传输方案的可行性与可靠性、低延迟性以及高并发数据接口的处理性能。微环境监测平台能够稳定运行,为跨行业物联网应用提供了一套数据采集和传输的解决方案。
In order to meet people's needs for limited area monitoring and solve the heterogeneous data representation,transmission and high concurrency issues,the deficiency of traditional Internet platform in sensor data acquisition and transmission is analyzed,and a micro environmental monitoring platform is realized through function module design.As for sensing layer data acquisition work,the communication protocol is designed,the data format is unified to reduce the amount of data trans-mission and energy consumption,and the communication protocol process is determined.LoRa technology is used to complete the remote transmission of data between the terminal and the gateway.As for the platform network layer,the high concurrency data interface is designed,using the server program to receive and process data.Finally the development and testing of the system is completed.The results show that the designed communication protocol can help unifying heterogeneous data format and reducing the quantity of data transmission and energy consumption.The feasibility,reliability and low latency of the whole transmission plan of the data collected from the terminal equipment to the gateway,through the whole PC to server are verified,as well as the processing performance of the high concurrent data interface.The stable operation of the micro-environment monitoring platform proves it is a set of data collection and transmission solution for the applications of cross-industry Internet.
In order to meet people's needs for limited area monitoring and solve the heterogeneous data representation,transmission and high concurrency issues,the deficiency of traditional Internet platform in sensor data acquisition and transmission is analyzed,and a micro environmental monitoring platform is realized through function module design.As for sensing layer data acquisition work,the communication protocol is designed,the data format is unified to reduce the amount of data trans-mission and energy consumption,and the communication protocol process is determined.LoRa technology is used to complete the remote transmission of data between the terminal and the gateway.As for the platform network layer,the high concurrency data interface is designed,using the server program to receive and process data.Finally the development and testing of the system is completed.The results show that the designed communication protocol can help unifying heterogeneous data format and reducing the quantity of data transmission and energy consumption.The feasibility,reliability and low latency of the whole transmission plan of the data collected from the terminal equipment to the gateway,through the whole PC to server are verified,as well as the processing performance of the high concurrent data interface.The stable operation of the micro-environment monitoring platform proves it is a set of data collection and transmission solution for the applications of cross-industry Internet.
引文
[1]SINHA R S,WEI Y Q,HWANG S H.A survey on LPWA technology:LoRa and NB-IoT[J].ICT Express,2017,3(1):14-21.
[2]杨旸.智能物联网技术和应用的发展趋势[J].中兴通讯技术,2018(2):1-7.YANG Yang.Trends of intelligent IoT technologies and applications[J].ZTE Technology Journal,2018(2):1-7.
[3]叶许红.一个基于物联网的动力和环境监控系统的设计实例[J].计算机科学,2012,39(sup1):210-211.YE Xuhong.Design case of power and environment monitoring system based on internet of things[J].Computer Science,2012,39(sup1):210-211.
[4]张海阔,陆忠华,刘芳,等.面向海量告警数据的并行处理系统设计与实现[J].计算机工程与设计,2018,39(2):407-413.ZHANG Haikuo,LU Zhonghua,LIU Fang,et al.Design and implementation of mass alarm data oriented parallel processing system[J].Computer Engineering and Design,2018,39(2):407-413.
[5]俞姝颖,吴小兵,陈贵海,等.无线传感器网络在桥梁健康监测中的应用[J].软件学报,2015,26(6):1486-1498.YU Shuying,WU Xiaobing,CHEN Guihai,et al.Wireless sensor networks for bridge structural health monitoring[J].Journal of Software,2015,26(6):1486-1498.
[6]黄靓.基于智能实验室管理系统的自动化数据采集[J].电子技术与软件工程,2018(6):182.
[7]李贡湘,郭忠文,迟晓晨.面向即插即用的物联网传感设备数据采集系统[J].中国海洋大学学报,2013,43(5):112-119.LI Gongxiang,GUO Zhongwen,CHI Xiaochen.Plug-and-play data acquisition system for sensing equipment of internet of things[J].Periodical of of Ocean University of China,2013,43(5):112-119.
[8]邓昀,李朝庆,程小辉.基于物联网的智能家居远程无线监控系统设计[J].计算机应用,2017,37(1):159-165.DENG Yun,LI Chaoqing,CHENG Xiaohui.Design of remote wireless monitoring system for smart home based on internet of things[J].Journal of Computer Applications,2017,37(1):159-165.
[9]张希伟,戴海鹏,徐力杰,等.无线传感器网络中移动协助的数据收集策略[J].软件学报,2013,24(2):198-214.ZHANG Xiwei,DAI Haipeng,XU Lijie,et al.Mobility-assisted data gathering strategies in WSNs[J].Journal of Software,2013,24(2):198-214.
[10]左黎明,胡凯雨,张梦丽,等.铁路桥梁中基于短签名方案的监测数据传输协议[J].计算机应用,2018:2018010272.ZUO Liming,HU Kaiyu,ZHANG Mengli,et al.Monitoring data transmission protocol based on short signature scheme in railway bridges[J].Journal of Computer Applications,2018:2018010272.
[11]韩牟,华蕾,王良民,等.车载自组网中高效的群组协商通信协议[J].通信学报,2018,39(1):34-45.HAN Mu,HUA Lei,WANG Liangmin,et al.Efficient communication protocol of group negotiation in VANET[J].Journal of Communications,2018,39(1):34-45.
[12]梁烨,洪卫军,张鸿洲.公安专用视频监控系统前端布点研究综述[J].科学技术与工程,2018,18(3):142-152.LIANG Ye,HONG Weijun,ZHANG Hongzhou.A review of research on front-end distribution of public security video surveillance system[J].Science Technology and Engineering,2018,18(3):142-152.
[13]王彩芬,陈丽.基于格的用户匿名三方口令认证密钥协商协议[J].通信学报,2018,39(2):21-30.WANG Caifen,CHEN Li.Three-party password authenticated key agreement protocol with user anonymity based on lattice[J].Journal of Communications,2018,39(2):21-30.
[14]许东,操文元,孙茜.基于CC2530的环境监测无线传感器网络节点设计[J].计算机应用,2013,33(sup2):17-20.XU Dong,CAO Wenyuan,SUN Qian.Design of wireless sensor network node for environment monitoring based on CC2530[J].Journal of Computer Applications,2013,33(sup2):17-20.
[15]张为,李亮.多传感器数据采集技术在物联网的应用研究[J].广州大学学报(自然科学版),2012,11(3):75-80.ZHANG Wei,LI Liang.The application research of multisensor’s data collection technology within the internet of things[J].Journal of Guangzhou University(Natural Science Edition),2012,11(3):75-80.
[16]张晓玲,梁炜,于海斌,等.无线传感器网络传输调度方法综述[J].通信学报,2012,33(5):143-157.ZHANG Xiaoling,LIANG Wei,YU Haibin,et al.Survey of transmission scheduling methods in wireless sensor networks[J].Journal of Communications,2012,33(5):143-157.
[17]张炜森,陈涛,李康.Nginx高并发负载均衡原理与策略比较研究[J].工业控制计算机,2018,31(1):85-86.ZHANG Weisen,CHEN Tao,LI Kang.Comparative study on principle and strategy of Nginx high concurrent load balancing[J].Industrial Control Computer,2018,31(1):85-86.
[18]杨开杰,刘秋菊,徐汀荣.线程池的多线程并发控制技术研究[J].计算机应用与软件,2010,27(1):168-170.YANG Kaijie,LIU Qiuju,XU Tingrong.On multi-threaded concurrent control technology for thread pool[J].Computer Applications and Software,2010,27(1):168-170.
[19]周超,李冬,张宝贤,等.一种面向无线传感网节点的中间件架构设计与实现[J].铁道学报,2014,36(8):63-69.ZHOU Chao,LI Dong,ZHANG Baoxian,et al.Design and implementation of middleware framework for wireless sensor network[J].Journal of the China Railway Society,2014,36(8):63-69.
[20]王冰,王红胜,张剑炜,等.异构网络环境中点对点通信架构研究[J].河北工业科技,2009,26(5):321-324.WANG Bing,WANG Hongsheng,ZHANG Jianwei,et al.Research of peer to peer communication architecture in heterogeneous network[J].Hebei Journal of Industrial Science and Technology,2009,26(5):321-324.
[21]焦东来,蒋贺,张索非,等.面向空间信息的数据通信协议的设计与实现[J].计算机工程与设计,2017,38(2):550-556.JIAO Donglai,JIANG He,ZHANG Suofei,et al.Design and implementation of data communication protocol for spatial information[J].Computer Engineering and Design,2017,38(2):550-556.
[22]VINKOVIC S,OJSTERSK M.The internet of things communication protocol for devices with low memory footprint[J].International Journal of Ad Hoc and Ubiqutious Computing,2014,24(4):10001131.
[2]杨旸.智能物联网技术和应用的发展趋势[J].中兴通讯技术,2018(2):1-7.YANG Yang.Trends of intelligent IoT technologies and applications[J].ZTE Technology Journal,2018(2):1-7.
[3]叶许红.一个基于物联网的动力和环境监控系统的设计实例[J].计算机科学,2012,39(sup1):210-211.YE Xuhong.Design case of power and environment monitoring system based on internet of things[J].Computer Science,2012,39(sup1):210-211.
[4]张海阔,陆忠华,刘芳,等.面向海量告警数据的并行处理系统设计与实现[J].计算机工程与设计,2018,39(2):407-413.ZHANG Haikuo,LU Zhonghua,LIU Fang,et al.Design and implementation of mass alarm data oriented parallel processing system[J].Computer Engineering and Design,2018,39(2):407-413.
[5]俞姝颖,吴小兵,陈贵海,等.无线传感器网络在桥梁健康监测中的应用[J].软件学报,2015,26(6):1486-1498.YU Shuying,WU Xiaobing,CHEN Guihai,et al.Wireless sensor networks for bridge structural health monitoring[J].Journal of Software,2015,26(6):1486-1498.
[6]黄靓.基于智能实验室管理系统的自动化数据采集[J].电子技术与软件工程,2018(6):182.
[7]李贡湘,郭忠文,迟晓晨.面向即插即用的物联网传感设备数据采集系统[J].中国海洋大学学报,2013,43(5):112-119.LI Gongxiang,GUO Zhongwen,CHI Xiaochen.Plug-and-play data acquisition system for sensing equipment of internet of things[J].Periodical of of Ocean University of China,2013,43(5):112-119.
[8]邓昀,李朝庆,程小辉.基于物联网的智能家居远程无线监控系统设计[J].计算机应用,2017,37(1):159-165.DENG Yun,LI Chaoqing,CHENG Xiaohui.Design of remote wireless monitoring system for smart home based on internet of things[J].Journal of Computer Applications,2017,37(1):159-165.
[9]张希伟,戴海鹏,徐力杰,等.无线传感器网络中移动协助的数据收集策略[J].软件学报,2013,24(2):198-214.ZHANG Xiwei,DAI Haipeng,XU Lijie,et al.Mobility-assisted data gathering strategies in WSNs[J].Journal of Software,2013,24(2):198-214.
[10]左黎明,胡凯雨,张梦丽,等.铁路桥梁中基于短签名方案的监测数据传输协议[J].计算机应用,2018:2018010272.ZUO Liming,HU Kaiyu,ZHANG Mengli,et al.Monitoring data transmission protocol based on short signature scheme in railway bridges[J].Journal of Computer Applications,2018:2018010272.
[11]韩牟,华蕾,王良民,等.车载自组网中高效的群组协商通信协议[J].通信学报,2018,39(1):34-45.HAN Mu,HUA Lei,WANG Liangmin,et al.Efficient communication protocol of group negotiation in VANET[J].Journal of Communications,2018,39(1):34-45.
[12]梁烨,洪卫军,张鸿洲.公安专用视频监控系统前端布点研究综述[J].科学技术与工程,2018,18(3):142-152.LIANG Ye,HONG Weijun,ZHANG Hongzhou.A review of research on front-end distribution of public security video surveillance system[J].Science Technology and Engineering,2018,18(3):142-152.
[13]王彩芬,陈丽.基于格的用户匿名三方口令认证密钥协商协议[J].通信学报,2018,39(2):21-30.WANG Caifen,CHEN Li.Three-party password authenticated key agreement protocol with user anonymity based on lattice[J].Journal of Communications,2018,39(2):21-30.
[14]许东,操文元,孙茜.基于CC2530的环境监测无线传感器网络节点设计[J].计算机应用,2013,33(sup2):17-20.XU Dong,CAO Wenyuan,SUN Qian.Design of wireless sensor network node for environment monitoring based on CC2530[J].Journal of Computer Applications,2013,33(sup2):17-20.
[15]张为,李亮.多传感器数据采集技术在物联网的应用研究[J].广州大学学报(自然科学版),2012,11(3):75-80.ZHANG Wei,LI Liang.The application research of multisensor’s data collection technology within the internet of things[J].Journal of Guangzhou University(Natural Science Edition),2012,11(3):75-80.
[16]张晓玲,梁炜,于海斌,等.无线传感器网络传输调度方法综述[J].通信学报,2012,33(5):143-157.ZHANG Xiaoling,LIANG Wei,YU Haibin,et al.Survey of transmission scheduling methods in wireless sensor networks[J].Journal of Communications,2012,33(5):143-157.
[17]张炜森,陈涛,李康.Nginx高并发负载均衡原理与策略比较研究[J].工业控制计算机,2018,31(1):85-86.ZHANG Weisen,CHEN Tao,LI Kang.Comparative study on principle and strategy of Nginx high concurrent load balancing[J].Industrial Control Computer,2018,31(1):85-86.
[18]杨开杰,刘秋菊,徐汀荣.线程池的多线程并发控制技术研究[J].计算机应用与软件,2010,27(1):168-170.YANG Kaijie,LIU Qiuju,XU Tingrong.On multi-threaded concurrent control technology for thread pool[J].Computer Applications and Software,2010,27(1):168-170.
[19]周超,李冬,张宝贤,等.一种面向无线传感网节点的中间件架构设计与实现[J].铁道学报,2014,36(8):63-69.ZHOU Chao,LI Dong,ZHANG Baoxian,et al.Design and implementation of middleware framework for wireless sensor network[J].Journal of the China Railway Society,2014,36(8):63-69.
[20]王冰,王红胜,张剑炜,等.异构网络环境中点对点通信架构研究[J].河北工业科技,2009,26(5):321-324.WANG Bing,WANG Hongsheng,ZHANG Jianwei,et al.Research of peer to peer communication architecture in heterogeneous network[J].Hebei Journal of Industrial Science and Technology,2009,26(5):321-324.
[21]焦东来,蒋贺,张索非,等.面向空间信息的数据通信协议的设计与实现[J].计算机工程与设计,2017,38(2):550-556.JIAO Donglai,JIANG He,ZHANG Suofei,et al.Design and implementation of data communication protocol for spatial information[J].Computer Engineering and Design,2017,38(2):550-556.
[22]VINKOVIC S,OJSTERSK M.The internet of things communication protocol for devices with low memory footprint[J].International Journal of Ad Hoc and Ubiqutious Computing,2014,24(4):10001131.