网络业务与WWW缓存技术的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
以HTTP协议为基础的Web信息发布系统采用客户机/服务器模式进行信息发布。这种工作方式在处理信息发布时,极大地浪费了网络资源(带宽、计算能力等)。缓存技术是克服Web业务瓶颈的最有效方法,是当前Web业务性能研究的一个热点。本文深入研究了利用缓存技术提高Web业务性能的方法,在以下方面作出贡献:
     ◆ 提出MMBP模型的新的统计复用分析方法。业务源模型对于网络设计及分析都有很重要的实际意义。在概括了当前网络业务建模的常见方法后,我们用MMBP模型对复用器建模,并用距阵分析方法分析了它的性能(队列长度分布和截尾概率),克服了以往方法因为矩阵奇异性导致队长分布夸大的缺点,并用数值实验检验了我们的结论。
     ◆ 提出缓存管理的自适应替换策略。替换策略是缓存管理的主要内容之一。在分析轨迹文件的基础上,提出了自适应缓存替换策略—最少正规化费用替换算法(LNC)。自适应替换策略除了考虑Web文档的平均引用时间、最近流逝时间、文档大小和单位大小价值外,还考虑了Web业务的访问率动态改变的特征。实验结果表明LNC能取得更好的性能。
     ◆ 提出基于集中管理的缓存系统。针对代理协作问题,提出一种基于集中管理的缓存系统。通过将HTTP请求均匀分散到系统各个代理,有效地将各个代理组织成一个虚拟的大缓存器,与以往技术相比,解决了代理的死机与恢复、代理间的通信开销和代理冗余度高等问题。
     ◆ 提出层次一致性策略。缓存内容一致性机制是缓存管理的重要内容之一。提出集中管理层次缓存系统的两种一致性机制:改进TTL机制及卷租期更新机制。改进TTL机制通过返回请求的一系列版本网页、改进失效时间计算以及允许客户指定请求满足的陈旧度克服TTL机制的缺点。卷租期机制通过长租期(文档)和短租期(网络)分别处理文档更新和网络失效两种情况。
     ◆ 提出新的服务器和客户之间的预取技术。改进部分匹配预报技术预报
The World Wide Web is based on Hypertext Transfer Protocol, which works as Client/Server model. When it is used for information distribution, the C/S model is not adaptable to scalability and the bandwidth is wasted greatly. Caching popular objects is the key technology to alleviate Web server bottleneck, reduce traffic over the Internet and reduce response time. A lot of work has been done in this area since Web appears. This paper discusses in depth the key technology of web caching to improve WWW performance.
    The main contributions of this paper are as follows.
     A statistical multiplexing method of MMBP source inputs is presented. We summarize the currently often used traffic models. Using MMBP inputs, we analyze the performance of multiplexer, which can be applied to voice and data modeling. The singularity of matrix is avoided with the matrix analysis method, which exaggerates the queue average length as in literatures. Experiment verifies this point.
     Based on the analysis of Web traces, we present an adaptive replacement policy. The policy considers each important aspect that affects replacement effectivity, including reference, recent access time, document size, cost and user access pattern. The experiment shows the new replacement policy is better than current policies in literatures.
     A new cooperative caching system is presented. By distributing URL space evenly and randomly, heavy overhead caused by communication between proxies is avoided. Using proxy manager to distribute URL requests, the system really becomes a virtual, large cache as a whole. The new system also overcomes the defect of high redundancy among proxies.
     A content consistency strategy of the hierarchical cooperative web caching system is provided. The function of the existing Time-to-Live method and Lease method is extended and applied to our system.
引文
[Abd98] haleb Abdulla. Analysis and Modeling of World Wide Web Traffic. PhD thesis, Computer Science Department, Virginia Tech., 1998.
    [ASA95] Marc Abrams, Charles R. Standridge, Ghaleb Abdulla, Stephen Williams, and Edward A. Fox. Caching proxies: Limitations and potentials. In Proceedings of the Fourth International World Wide Web Conference, pages 119-133, Boston, MA, December 1995.
    [AW97] Martin F. Arlitt and Catty L. Williamson. Internet Web servers: Workload characterization and implications IEEE/ACM Transactions on Networking, 5: 631-644, October 1997.
    [BBM97] Michael Baentsch, L. Baum, Georg Molter, S. Rothkugel, and P. Sturm. World-Wide Web caching: The application-level view of the Internet. IEEE Communications, June 1997.
    [BCF99] Lee Breslau, Pei Cao, Li Fan, Graham Phillips, and Scott Shenker. Web Caching and Zipf-like Distributions: Evidence and Implications. In Proceedings of INFOCOM' 99, 1999.
    [BDH94] C. Mic Bowman, Peter B. Danzig, Darren R. Hardy, Udi Manber, and Michael F. Schwartz. The Harvest information discovery and access system. In Proceedings of 2thWWW Conference, pages 763-771, October 1994.
    [BGM98] Eric A. Brewer, Paul Gauthier, and Dennis McEvoy. The long-term viability of large-scale caching. In Third International WWW Caching Workshop, Manchester, Engl and, June 1998.
    [BLFF96] Tim Berners-Lee, R. Fielding, and H. Frystyk. Hypertext Transfer Protocol—HTTP/1.0. RFC 1945, May 1996.
    [Blo70] Burton Bloom. Space/time trade-offs in hash coding with allowable errors. Communication of ACM, pages 13(7): 422-426, July 1970.
    [Cat92] V. Care. Alex—A global filesystem. In Proceedings of the USENIX File System Workshop, pages 1-12, Ann Arbor, MI, May 1992.
    [CB96] Mark Crovella and Azer Bestavros. Sell-Similarity in World Wide Web Traffic: Evidence and Possible Causes. In SIGMETRICS '96, Philadelphia, PA, May 1996.
    [CB97] Mark E. Crovella and Azer Bestavros.Self-similarity in World Wide Web traffic: evidence and possible causes IEEE/ACM Transactions on Net Networking. 5(6): 835-846, December 1997.
    [CB98] Mark Crovella and Paul Barford. The Network Effects of Prefetching. In Proceedings of IEEE Infocom'98, San Francisco, CA, 1998
    [CDN96] Anawat Chankhunthod, Peter B. Danzig, Chuck Neerdaels, Michael F. Schwartz, and Kurt J. Worrell. A Hierarchical Internet Object Cache. In Proceedings of the USENIX Technical Conference, San Diego, CA, January 1996.
    [ChEE97] Ng. Chee Hock et. al, Queue length solutions for an ATM buffer with MMBP arrivals. Computer Communication, 20(1997), 878-883
    [CI97] Pei Cao and Sandy Irani. Cost-Aware WWW Proxy Caching Algorithms. In Proceedings of the USENIX Symposium on Internet Technoloy and, Systems, pages 193-206, December 1997.
    [CJ97] Carlos R. Cunha and Carlos F. B. Jaccoud. Determining WWW User's Next Access and Its Application to Prefetching In Proceedings of Second IEEE Symposium on Computers and Communications (ISCC'97), Alexandria, Egypt, July 1997.
    [CKV93] Kenneth M. Curewitz, P. Krishnan, and Jeffrey Scott Vitter. Practical Prefetching via Compression. In ACM SIGMOD International conference, pages 257-266, Washington, DC, USA, June 1993
    [CY97] Ken-ichi Chinen and Suguru Yamaguchi. An interactive prefetching proxy server for improvement of WWW latency: In Proceedings of the Seventh Annual Conference of the Internet Society(INET'97), Kuala Lumpur, June 1997
    [CZB98] Pei Cao, Jin Zhang, and Kevin Beach. Active Cache: Caching Dynamic Contents on the Web. In Proceedings of IFIP International Conference on Distributed Systems Platforms and Open Distributed Processing (Middleware '98), 1998.
    [DHS93] Peter B. Danzig, Richard S. Hall, and Michael F. Schwartz. A case for caching file objects inside internetworks. Computer and Communications Reviews, 23(4): 239-248, October 1993.
    [DP96] Adam Dingle and Tomas Partl. Web cache coherence. Computer Networks and ISDN Systems, 28(7-11): 907-920, May 1996.
    [FCAB98] Li Fan, Pei Cao, Jussara Almeida, and Andrei Z. Broder. Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol. In Proceedings of ACM SIGCOMM, September 1998.
    [FGM97] R. Fielding, J. Gettys, Jeffrey C. Mogul, H, Frystyk, and Tim BernersLee. Hypertext Transfer Protocol—HTTP/1.1. RFC 2068, January 1997.
    [FJCL99] Li Fan, Quinn Jacobson, Pei Cao. and Wei Lin. Web Prefetching Between Low-Bandwidth Clients and Proxies: Potential and Performance. In Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS '99), Atlanta, GA, May 1999.
    [GCR98] Syam Gadde, Jeff Chase, and Michael Rabinovich. A taste of crispy squid. In Workshop on Internet Server Performance (WISP'98), Madison, WI, June 1998.
    [Gla94] Steven Glassman. A Caching Relay for the World Wide Web. In Proceedings of the First International Conference on the WWW, 1994.
    [GPB98] rthur Goldberg, Hya Pevzner, and Robert Buff. Characteristics of Internet and Intranet Web Proxy Traces. In Computer Measurement Group Conference CMG98, Anaheim, CA, December 1998.
    [GRC97] Syam Gadde, Michael Rabinovich, and Jeff Chase. Reduce, Reuse, Recycle: An Approach to Building Large Internet Caches. In The Sixth Workshop on Hot Topics in Operating Systems (HotOS-Ⅵ), pages 93-98, May 1997.
    [Gri97] Steven D. Gribblc. UC Berkcly home IP HTTP traces. Available at: http://www.acm.org/sigcomm/ITA/,July 1997.
    [GS96] James Gwertzman and Margo Seltzer; World-Wide Web Cache Consi stency. In Proceedings of the USENIX Technical Conference, San Diego, CA, January 1996.
    [GS97] James Gwertzman and Margo Seltzer. An analysis of geographical push-caching. Available at http://www.eecs.harvard.edu/vino/web/server.cache/icdcs.ps, 1997.
    [HC96] S. Hosseini and J. R. Cox. Optimal solution of off-line and on-line generalized caching. Techical Report WUCS-96-20, Washington University in St. Louis, 1996
    [IKY97] Hiroyuki Inoue, Kanchana Kanchanasut, and Suguru Yamaguchi. An adaptive WWW cache mechanism in the AI3 network. In Proceedings of the Seventh Annual Conference of the Internet Society (INET'97), Kuala Lumpur, June 1997.
    [JK97] Zhimei Jiang and Leonard Keinrock. Prcfetching Links on the WWW. In ICC'97, pages 483-489, Montreal, Canada, June 1997
    [JK98] Zhimei Jiang and Leonard Kleinrock. An adaptive network prefetch scheme. IEEE Journal on Selected Areas in Communications, 16(3): 358-368, April 1998.
    [KLM97] Thomas M. Kroeger, Darrell D. E. Long, and Jeffrey C. Mogul. Exploring the bounds of web latency reduction from caching and prefetching. In Proceedings of the USENIX Symposium on Internet Technologies and Systems (USITS '97), December 1997
    [KW97] Balachander Krishnamurthy and Craig E. Wills. Study of piggyback cache validation for proxy caches in the world wide web. In Proceedings of the USENIX Symposium on Internet Technologies and Systems (USITS '97). USENIX Associ(?)tion, December 1997.
    [KW98] Balachander Krishnamurthy and Craig E. Wills. Piggyback server invalidation for proxy cache coherency. Computer Networks and ISDN Systems, 30, 1998. Also in Proceedings of the Seventh International World Wide Web Conference, pages 185-193, Brisbane, Australia, April 1998.
    [LC98] Chengjie Liu and Pei Cao. Maintaining strong cache consistency for the world-wide web. IEEE Transactions on Computers, April 1998.
    [LTWW94] W. E. Leland, M. S. Taqqu, W. Willianger, and D. Wilson. On the selfsimilar nature of Ethernet Traffic (Extended Version), ACM/IEEE Transactions on Networking, 2(1): 1-15, Feb. 1994.
    [MB97] J. Marais and K. Bharat. Supporting cooperative and personal surfing with a desktop assistant. In Proceedings of ACM UIST'97, October 1997.
    [MC98] Evangelos P. Markatos and Catherine E. Chronaki. A top-10 approach for prefetching the web. In Proceedings of the Eighth Annual Conference of the Internet Society (INET'98), Geneva, Switzerland, July 1998. Also available as ICS-FORTH Technical Report 173.
    [NLN98] Nicolas Niclausse, Zhen Liu, and Philippe Nain. A new and efficient caching policy for the world wide web. In Workshop on Internet Server Performance (WISP'98), Madison, WI, June 1998,
    [Pit98] James E. Pitkow. Summary of WWW characterizations. In Proceedings of the Seventh International World Wide Web Conference, Brisbane, Australia, April 1998.
    [PM96] VenkataN. Padmanabhan and Jeffrey C. Mogul. Using predictive prefetching to improve world wide web latency. Computer Communication Review, 26(3): 22-36, July 1996.
    [RV98] Luigi Rizzo and Lorenzo Vicisano. Replacement policies for a proxy cache. Research Note RN/98/13, Department of Computer Science, University College London, 1998.
    [RW98] Alex Rousskov and Duane Wessels. Cache digests. In Third International WWW Caching, Workshop, Manchester, England, June 1998.
    [SSV99] Junho Shim, Peter Scheuermann, and Radek Vingralek. Proxy Cache Design: Algorithms. Implementation and Performance. IEEE Transactions on Knowledge and Data Engineering, 1999. To appear.
    [Vix98] Paul Vixie, Hypcr Text Caching Protocol—HTCP/0.0. Internet Draft, March 1998.
    [WA97] R. Wooster and M. Abrams. Proxy caching that estimates page load dalays. In Proceedings of the sixth World Wide Web Conference, Santa Clara, California, 1997
    [WAS96] Stephen Williams, Marc Abrams, Charles R. Standridge, Ghaleb Abdulla, and Edward A. Fox. Removal Policies in Network Caches for World-Wide Web Documents. In Proceedings of ACMSIGCOMM, pages 293-305, Stanford, CA, 1996. Revised March 1997.
    [WC97a] Duane Wessels and Kimberly Claffy. Application of Internet Cache Protocol (ICP), version 2. RFC 2187, September 1997.
    [WC97b] Duane Wessels and Kimberly Claffy. Internet Cache Protocol (ICP), version 2.RFC 2186, September 1997
    [WS97] Craig E. Wills and Joel Sommers. Prefetching on the web through merger of client and server profiles. Available at http://www.cs,wpi.edu/~cew/papers/webprofile.ps.gz, June 1997.
    [ZFM97] Lixia Zhang, Sally Floyd, and Van Jacobson. Adaptive web caching. In NLANR Web Cache Workshop., Boulder, CO, June 1997.
    [ZLM98] Lixia Zhang, Scott Michel, Khoi Nguyen, Sally Floyd, and Van Jacobson. Adaptive web caching: Towards a new global caching architecture. In Third International WWW Caching; Workshop, Manchester, England, June 1998.
    [冯涛98] 冯涛,ATM网络的业务源模型和流量管理,博士论文,Jul.1998.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700