网络协议栈下TCP队列管理研究
|
摘要
广域网文件传输速度慢是目前各大网络公司面临的问题,针对这些情况,探讨了采用重复数据消除技术减少数据传输量,从而提高网络传输速度。
在实现重复数据消除的网络节点,探讨了队列管理、重复数据消除技术、排队论等相关技术的基本概念及研究现状,提出了基于TCP透明代理的队列管理模型。针对网络节点产生的队列A和队列B建立了两个排队模型,模型一为单服务台排队模型,即队列A和队列B共享给定的内存空间;模型二为两级串联排队网络模型,即队列A和队列B平分给定的内存空间。在理论上推导出模型一和模型二在零丢包率时所需的内存空间。根据网络节点用户连接数与内存需求的正比关系,建立并实现了动态队列管理模型,其核心是在网络节点中根据用户连接数的大小动态调整队列管理方式,使网络丢包率、队列长度和排队时延达到平衡。在实际研发过程中,构建了广域网TCP透明代理平台,分别调整给定的队列空间,利用模型一和模型二进行验证。实验结果表明,在内存空间较大的情况下,模型二优于模型一,但在内存空间不够的情况下,模型一优于模型二。
将排队论的相关理论用于网络节点中队列管理中,能够在内存有限同时实际用户连接数不断变化时,采用动态队列管理模型,使丢包率、队列长度和排队时延达到平衡。
The low speed of transmission in Wide Area Network (WAN) is a problem that every internet company wants to solve currently. According to the situation, the paper study on reducing the amount of data transmission by eliminating duplicated data to improve the network transmission speed.
It is in the network node which implements elimination duplicate data. The paper discuss the basic concepts and research status of queue management, data redundancy elimination, queuing theory and other related technology, propose the queue management model based on the TCP transparent proxy. It establish two queue models for queue A and B, one of the models is a single server queue model that queue A and B share the given memory space and another is a two stages tandem queue model that queue A and B bisect the given memory space, we name them model 1 and model 2.It derive the size of memory space needed that zero packet loss rate in theory. The establishment and the implementation of the dynamic queue management model is according to the proportional relationship of the number of user connections and memory requirements. Its core is dynamic adjust queue management mode according to the number of user connections size, so that the packet loss rate, queue length, queue delay keep balance. In the process of practical project development, construct the WAN TCP transparent proxy platform, verify the two models by adjusting the given space. The experimental results show that in the case of large memory space, model 2 is better than the model 1, but model 1 is superior to model 2 in the case of the memory space is not enough.
Apply queuing theory to queue management in the network node can make the packet loss rate, queue length ,queue delay achieve a balance by dynamic adjust queue management models when the memory is limited and the actual number of user connections is constantly changing.
在实现重复数据消除的网络节点,探讨了队列管理、重复数据消除技术、排队论等相关技术的基本概念及研究现状,提出了基于TCP透明代理的队列管理模型。针对网络节点产生的队列A和队列B建立了两个排队模型,模型一为单服务台排队模型,即队列A和队列B共享给定的内存空间;模型二为两级串联排队网络模型,即队列A和队列B平分给定的内存空间。在理论上推导出模型一和模型二在零丢包率时所需的内存空间。根据网络节点用户连接数与内存需求的正比关系,建立并实现了动态队列管理模型,其核心是在网络节点中根据用户连接数的大小动态调整队列管理方式,使网络丢包率、队列长度和排队时延达到平衡。在实际研发过程中,构建了广域网TCP透明代理平台,分别调整给定的队列空间,利用模型一和模型二进行验证。实验结果表明,在内存空间较大的情况下,模型二优于模型一,但在内存空间不够的情况下,模型一优于模型二。
将排队论的相关理论用于网络节点中队列管理中,能够在内存有限同时实际用户连接数不断变化时,采用动态队列管理模型,使丢包率、队列长度和排队时延达到平衡。
The low speed of transmission in Wide Area Network (WAN) is a problem that every internet company wants to solve currently. According to the situation, the paper study on reducing the amount of data transmission by eliminating duplicated data to improve the network transmission speed.
It is in the network node which implements elimination duplicate data. The paper discuss the basic concepts and research status of queue management, data redundancy elimination, queuing theory and other related technology, propose the queue management model based on the TCP transparent proxy. It establish two queue models for queue A and B, one of the models is a single server queue model that queue A and B share the given memory space and another is a two stages tandem queue model that queue A and B bisect the given memory space, we name them model 1 and model 2.It derive the size of memory space needed that zero packet loss rate in theory. The establishment and the implementation of the dynamic queue management model is according to the proportional relationship of the number of user connections and memory requirements. Its core is dynamic adjust queue management mode according to the number of user connections size, so that the packet loss rate, queue length, queue delay keep balance. In the process of practical project development, construct the WAN TCP transparent proxy platform, verify the two models by adjusting the given space. The experimental results show that in the case of large memory space, model 2 is better than the model 1, but model 1 is superior to model 2 in the case of the memory space is not enough.
Apply queuing theory to queue management in the network node can make the packet loss rate, queue length ,queue delay achieve a balance by dynamic adjust queue management models when the memory is limited and the actual number of user connections is constantly changing.
引文
[1]敖莉,舒继武,李明强.重复数据删除技术[J].软件学报,2010,21(5):916-929.
[2]段梦博,蔡兴旺.基于内容的重复数据删除技术的研究[J].电脑知识与技术,2010,6(22): 6275-6277.
[3]谭明宝,王宝生,张锦玉.面向TCP透明代理截获技术的研究与实现[J].微计算机信息(管控一体化),2008,24(10-3):182-184.
[4] de Santi J,Fonseca N L S,Lima M M A E.Active Queue Management Controller for the High Speed TCP Protocol. Communications, 2008. ICC '08. IEEE International Conference. 2008:6- 11.
[5]李雪,徐昌彪. TCP丢包检测技术分析[J].中国新通信,2007:52-54.
[6]张远翼,杨祥,司海平.基于路由器技术的队列管理算法[J].电脑与电信, 2006,11:11-14.
[7]王建新,彭娜.广域网加速技术研究综述[J].电信快报,2009,5:11-14.
[8]Mingwei Gong,Qian Wu,Williamson C.Queue Management Strategies to Improve TCP .IEEE. 2006.
[9]张远翼,杨祥,司海平.基于路由器技术的队列管理算法[J].电脑与电信, 2006,11:11-14.
[11] Carofiglio G,Muscariello L.On the impact of TCP and per-flow scheduling on Internet performance. INFOCOM, 2010 Proceedings IEEE.2010:1-9.
[12] Lin W.W.K,Wong A.K.Y,Dillon T.S.A Protocol Independent Technique for Eliminating Redundant Network Traffic. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on. 2006: 397-410.
[13]包优祥.透明代理的构架及应用[J].湖州职业技术学院学报.2005,1:89-91.
[14] Wang X,Liang F.TFBR: A NEW QUEUE MANAGEMENT GUARANTEEING TCP FAIRNESS BASED ON TCP ADVERTISED RECEIVING WINDOWS OVER WLAN. Mobile Technology, Applications and Systems, 2005 2nd International Conference on.2005:1-7.
[15] Ikeda T,Hirabaru M,Harai H,Kitamura Y. Impact of queue size at bottleneck point on TCP protocol over 10G-bps networks. Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops, 2009:1-6.
[16] Martin J,Nilsson A,and Rhee I. Delay-based congestion avoidance for TCP. IEEE/ACM Transactions on Networking,2003,11(3):356-369.
[17]陆传赉.排队论(第2版)[M].北京:北京邮电大学出版社,2009.
[18]唐应辉,唐小我.排队论基础与分析技术[M].北京:科学出版社,2006.
[19]贾波,周家良.PH型N级串联反馈排队系统网络系统分析[J].系统科学与数学,1996, 12(4):317-325.
[20]W.Richard Stevens.TCP/IP详解(卷1:协议)[M].北京:机械工业出版社,2000.
[21] Comer.用TCP/IP进行网际互联[M].北京:电子工业出版社,2005.
[22] Robert Love.Linux Kernel Development[M].北京:机械工业出版社,2005.
[23] Andrew Tandenbaum.计算机网络[M].北京:清华大学出版社,2008.
[24]谢希仁.计算机网络(第5版)[M].北京:电子工业出版社,2008.
[25]Tom Adelstein等.Linux System Management[M].南京:东南大学出版社,2008.
[26] Luryo Peterson.计算机网络系统方法[M].北京:机械工业出版社,2009.
[27]宿宝臣.透明代理机制分析及其linux实现[J].山东理工大学学报(自然科学版),2003, 17(4):71-74.
[28]汪青青,卢祖英译.Linux网络体系架构[M].北京:清华大学出版社,2006.
[29]倪瑾,宋中山.基于Linux网络协议栈实现及应用[J].中南民族大学学报(自然科学版), 2005,24(4):79-81.
[30]何文华,梁竟敏.Linux下传统代理、IP伪装与透明代理的设计与实现[J].计算机系统与应用,2004,10:60-62.
[31]王凌云,王辉.TCP性能增强代理包处理策略的研究[J].计算机工程与设计,2009,30(4): 858-861.
[32]叶宏帅,武兴悦,贾治国.代理服务器的特点与使用[J].内蒙古科技与经济,2005,19:39-40.
[33]赵鲲,王宝生.基于I/O模型的双机TCP代理的研究与实现[J].电脑知识与技术,2008,4(6):1329-1331.
[34]谢钧,俞璐,金凤林.基于排队时延和丢包率的拥塞控制[J].电子与信息学报,2010,32(9):2058-2064.
[35]姜国庆,马莉,黄永忠.高宽带广域网中的高性能数据传输[J].航空电子技术,2004,35(4):39-42.
[36]翟鸿雁.广域网优化技术及其应用[J].计算机与现代化,2007,5:69-71.
[37]陈芯怡.广域网重复数据删除技术:数据中心的必备技术[J].电脑与电信,2011(6):8-9.
[38]廖海生,赵跃龙.基于MD5算法的重复数据删除技术的研究与改进[J].计算机测量与控制, 2010,18(3):635-638.
[39]薛建.如何改善广域网上实时应用的传输质量.信息技术与信息化,2008,5:8-11.
[40]蒋文贤.数据压缩对广域网传输时延的影响[J].东华大学学报(自然科学版),2008,34(4): 467-470.
[41] de Santi J,Fonseca N L S,Lima M M A E.Active Queue Management Controller for the High Speed TCP Protocol. Communications, 2008. ICC '08. IEEE International Conference. 2008:6-11.
[42] http://www.cisco.com/web/CN/products/products_netsol/datacenter/products/wafs/wafs_data_8.html
[43] Mingwei Gong,Qian Wu,Williamson C.Queue Management Strategies to Improve TCP Fairness in IEEE 802.11 Wireless LANs. Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks, 2006 4th International Symposium on. 2006:1-8.
[44] Lin W.W.K, Wong A.K.Y, Dillon T.S.A Protocol Independent Technique for Eliminating Redundant Network Traffic. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on. 2006: 397-410.
[45] Wang X,Liang F.TFBR: A NEW QUEUE MANAGEMENT GUARANTEEING TCP FAIRNESS BASED ON TCP ADVERTISED RECEIVING WINDOWS OVER WLAN. Mobile Technology, Applications and Systems, 2005 2nd International Conference on.2005:1-7.
[46]周家良,贾波.有阻塞的多级串联排队系统分析[J].系统科学与数学,1998,18(1):96-100.
[47]徐光辉,袁学明.有容量两级串联排队系统的平稳性.系统科学与数学,1992,12(4):317-325.
[48]赵跃华,徐胜芹.排队论在ATM网络传输中的应用[J].计算机工程与设计,2008,29(15): 3870-3871.
[49]谭宏远.两个服务员的串联排队系统的模拟和实现[J].桂航学术研究,1997,1:64-66.
[50]孙薇,王勇.简单串联服务系统的分析及应用[J].哈尔滨工业大学学报,2006,38(5):808- 810.
[51]张柏生,任剑锋,孟相如.基于排队论的网络通信系统的建模与分析[J].空军工程大学学报(自然科学版),2002,3(3):59-61.
[52]董婧,乐美龙.基于串联排队网络的集装箱码头系统分析[J].中国水运,2006,6(12):40-42.
[53]杨旭超,任家富,乔楠楠.带反馈两节点串联排队模型的仿真[J].仪器仪表用户,2011,18(4): 73-75.
[54]张润彤,朱晓敏.串联排队网络顾客准入的模糊控制[J].自动化学报,2000,26(2):192-198.
[55]迟学芬,赵莹莹.串联排队RED/ERED网络分析模型[J].通信学报,2011,32(9):174-181.
[56]聂盼红,刘力维.串联开排队网络系统[J].河北理工大学学报(自然科学版),2007,29(4): 126-128.
[57]郭志芳.N级串联休假开排队网络系统分析[D].南京:南京理工大学,2007.
[58]王松建.N级串联开排队网络系统分析[D].南京:南京理工大学,2008.
[59]聂盼红.串联开排队网络系统分析[D].南京:南京理工大学,2004.
[60]姜文刚,孙金生,王执铨.N次弃头的被动队列管理算法[J].小型微型计算机系统.2011, 32(9):1849-1853.
[61]盛友招.排队论及其在现代通信中的应用[M].北京:人民邮电出版社,2007.
[62]苏维.基于区分服务的路由器调度与排队建模分析[D].重庆:重庆师范大学,2008.
[63]严敬,邱智亮,杨君刚.IRSDRR:一种异步的基于输入排队的Crossbar交换结构的调度算法[J],计算机工程与应用,2005,11:135-138.
[64]Floyd S,Jacobson V.Random early detection gateways for congestion avoidance.IEEE/ACM Trans.on Networking 1999,1320-1328.
[65]代丽娴,黄宏本.TCP拥塞控制算法研究[J].计算机仿真,2010,27(10):124-127.
[66]谭明君.网络隔离系统TCP透明代理的连接管理技术的研究与实现[D].北京:国防科技大学,2007.
[67]李金东.基于主动队列管理的IP网络拥塞研究[D].北京:国防科技大学,2007.
[2]段梦博,蔡兴旺.基于内容的重复数据删除技术的研究[J].电脑知识与技术,2010,6(22): 6275-6277.
[3]谭明宝,王宝生,张锦玉.面向TCP透明代理截获技术的研究与实现[J].微计算机信息(管控一体化),2008,24(10-3):182-184.
[4] de Santi J,Fonseca N L S,Lima M M A E.Active Queue Management Controller for the High Speed TCP Protocol. Communications, 2008. ICC '08. IEEE International Conference. 2008:6- 11.
[5]李雪,徐昌彪. TCP丢包检测技术分析[J].中国新通信,2007:52-54.
[6]张远翼,杨祥,司海平.基于路由器技术的队列管理算法[J].电脑与电信, 2006,11:11-14.
[7]王建新,彭娜.广域网加速技术研究综述[J].电信快报,2009,5:11-14.
[8]Mingwei Gong,Qian Wu,Williamson C.Queue Management Strategies to Improve TCP .IEEE. 2006.
[9]张远翼,杨祥,司海平.基于路由器技术的队列管理算法[J].电脑与电信, 2006,11:11-14.
[11] Carofiglio G,Muscariello L.On the impact of TCP and per-flow scheduling on Internet performance. INFOCOM, 2010 Proceedings IEEE.2010:1-9.
[12] Lin W.W.K,Wong A.K.Y,Dillon T.S.A Protocol Independent Technique for Eliminating Redundant Network Traffic. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on. 2006: 397-410.
[13]包优祥.透明代理的构架及应用[J].湖州职业技术学院学报.2005,1:89-91.
[14] Wang X,Liang F.TFBR: A NEW QUEUE MANAGEMENT GUARANTEEING TCP FAIRNESS BASED ON TCP ADVERTISED RECEIVING WINDOWS OVER WLAN. Mobile Technology, Applications and Systems, 2005 2nd International Conference on.2005:1-7.
[15] Ikeda T,Hirabaru M,Harai H,Kitamura Y. Impact of queue size at bottleneck point on TCP protocol over 10G-bps networks. Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops, 2009:1-6.
[16] Martin J,Nilsson A,and Rhee I. Delay-based congestion avoidance for TCP. IEEE/ACM Transactions on Networking,2003,11(3):356-369.
[17]陆传赉.排队论(第2版)[M].北京:北京邮电大学出版社,2009.
[18]唐应辉,唐小我.排队论基础与分析技术[M].北京:科学出版社,2006.
[19]贾波,周家良.PH型N级串联反馈排队系统网络系统分析[J].系统科学与数学,1996, 12(4):317-325.
[20]W.Richard Stevens.TCP/IP详解(卷1:协议)[M].北京:机械工业出版社,2000.
[21] Comer.用TCP/IP进行网际互联[M].北京:电子工业出版社,2005.
[22] Robert Love.Linux Kernel Development[M].北京:机械工业出版社,2005.
[23] Andrew Tandenbaum.计算机网络[M].北京:清华大学出版社,2008.
[24]谢希仁.计算机网络(第5版)[M].北京:电子工业出版社,2008.
[25]Tom Adelstein等.Linux System Management[M].南京:东南大学出版社,2008.
[26] Luryo Peterson.计算机网络系统方法[M].北京:机械工业出版社,2009.
[27]宿宝臣.透明代理机制分析及其linux实现[J].山东理工大学学报(自然科学版),2003, 17(4):71-74.
[28]汪青青,卢祖英译.Linux网络体系架构[M].北京:清华大学出版社,2006.
[29]倪瑾,宋中山.基于Linux网络协议栈实现及应用[J].中南民族大学学报(自然科学版), 2005,24(4):79-81.
[30]何文华,梁竟敏.Linux下传统代理、IP伪装与透明代理的设计与实现[J].计算机系统与应用,2004,10:60-62.
[31]王凌云,王辉.TCP性能增强代理包处理策略的研究[J].计算机工程与设计,2009,30(4): 858-861.
[32]叶宏帅,武兴悦,贾治国.代理服务器的特点与使用[J].内蒙古科技与经济,2005,19:39-40.
[33]赵鲲,王宝生.基于I/O模型的双机TCP代理的研究与实现[J].电脑知识与技术,2008,4(6):1329-1331.
[34]谢钧,俞璐,金凤林.基于排队时延和丢包率的拥塞控制[J].电子与信息学报,2010,32(9):2058-2064.
[35]姜国庆,马莉,黄永忠.高宽带广域网中的高性能数据传输[J].航空电子技术,2004,35(4):39-42.
[36]翟鸿雁.广域网优化技术及其应用[J].计算机与现代化,2007,5:69-71.
[37]陈芯怡.广域网重复数据删除技术:数据中心的必备技术[J].电脑与电信,2011(6):8-9.
[38]廖海生,赵跃龙.基于MD5算法的重复数据删除技术的研究与改进[J].计算机测量与控制, 2010,18(3):635-638.
[39]薛建.如何改善广域网上实时应用的传输质量.信息技术与信息化,2008,5:8-11.
[40]蒋文贤.数据压缩对广域网传输时延的影响[J].东华大学学报(自然科学版),2008,34(4): 467-470.
[41] de Santi J,Fonseca N L S,Lima M M A E.Active Queue Management Controller for the High Speed TCP Protocol. Communications, 2008. ICC '08. IEEE International Conference. 2008:6-11.
[42] http://www.cisco.com/web/CN/products/products_netsol/datacenter/products/wafs/wafs_data_8.html
[43] Mingwei Gong,Qian Wu,Williamson C.Queue Management Strategies to Improve TCP Fairness in IEEE 802.11 Wireless LANs. Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks, 2006 4th International Symposium on. 2006:1-8.
[44] Lin W.W.K, Wong A.K.Y, Dillon T.S.A Protocol Independent Technique for Eliminating Redundant Network Traffic. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on. 2006: 397-410.
[45] Wang X,Liang F.TFBR: A NEW QUEUE MANAGEMENT GUARANTEEING TCP FAIRNESS BASED ON TCP ADVERTISED RECEIVING WINDOWS OVER WLAN. Mobile Technology, Applications and Systems, 2005 2nd International Conference on.2005:1-7.
[46]周家良,贾波.有阻塞的多级串联排队系统分析[J].系统科学与数学,1998,18(1):96-100.
[47]徐光辉,袁学明.有容量两级串联排队系统的平稳性.系统科学与数学,1992,12(4):317-325.
[48]赵跃华,徐胜芹.排队论在ATM网络传输中的应用[J].计算机工程与设计,2008,29(15): 3870-3871.
[49]谭宏远.两个服务员的串联排队系统的模拟和实现[J].桂航学术研究,1997,1:64-66.
[50]孙薇,王勇.简单串联服务系统的分析及应用[J].哈尔滨工业大学学报,2006,38(5):808- 810.
[51]张柏生,任剑锋,孟相如.基于排队论的网络通信系统的建模与分析[J].空军工程大学学报(自然科学版),2002,3(3):59-61.
[52]董婧,乐美龙.基于串联排队网络的集装箱码头系统分析[J].中国水运,2006,6(12):40-42.
[53]杨旭超,任家富,乔楠楠.带反馈两节点串联排队模型的仿真[J].仪器仪表用户,2011,18(4): 73-75.
[54]张润彤,朱晓敏.串联排队网络顾客准入的模糊控制[J].自动化学报,2000,26(2):192-198.
[55]迟学芬,赵莹莹.串联排队RED/ERED网络分析模型[J].通信学报,2011,32(9):174-181.
[56]聂盼红,刘力维.串联开排队网络系统[J].河北理工大学学报(自然科学版),2007,29(4): 126-128.
[57]郭志芳.N级串联休假开排队网络系统分析[D].南京:南京理工大学,2007.
[58]王松建.N级串联开排队网络系统分析[D].南京:南京理工大学,2008.
[59]聂盼红.串联开排队网络系统分析[D].南京:南京理工大学,2004.
[60]姜文刚,孙金生,王执铨.N次弃头的被动队列管理算法[J].小型微型计算机系统.2011, 32(9):1849-1853.
[61]盛友招.排队论及其在现代通信中的应用[M].北京:人民邮电出版社,2007.
[62]苏维.基于区分服务的路由器调度与排队建模分析[D].重庆:重庆师范大学,2008.
[63]严敬,邱智亮,杨君刚.IRSDRR:一种异步的基于输入排队的Crossbar交换结构的调度算法[J],计算机工程与应用,2005,11:135-138.
[64]Floyd S,Jacobson V.Random early detection gateways for congestion avoidance.IEEE/ACM Trans.on Networking 1999,1320-1328.
[65]代丽娴,黄宏本.TCP拥塞控制算法研究[J].计算机仿真,2010,27(10):124-127.
[66]谭明君.网络隔离系统TCP透明代理的连接管理技术的研究与实现[D].北京:国防科技大学,2007.
[67]李金东.基于主动队列管理的IP网络拥塞研究[D].北京:国防科技大学,2007.