数字视频服务关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着计算机性能的提高和网络带宽的增加,以及视频压缩编码技术的进步,使得数字视频服务成为可能。本文主要讨论提供数字视频服务需要解决的几个关键技术,并实现一个原型系统。具体研究内容如下:
     1 给出了一个基于通用PC服务器和非实时操作系统构建实时视频服务器的方法。通过对通用服务器进行软硬件扩展,使其能够输出符合DVB-C协议的视频流,针对有线电视传输网络,实现了一种MPEG-2传输流实时软复用算法和一种实时视频数据输出的流量控制策略。
     2 给出了视频服务器服务质量保证的若干基本策略,包括:基于推拉结合的流量控制策略、基于丢包重传的差错控制策略、以及用于限制视频服务器负载量的接入控制策略。
     3 基于机群结构的大规模视频服务器,提出了一种带宽控制策略,解决了机群内部数据调度通道与数据实时输出通道在存储系统上的带宽争用问题,从而满足输出数据的时限要求。另外,比较了多种内部负载调度和数据调度策略,提出了一种被动的第二级存储器命中优先法作为视频服务器的调度策略。
     4 提出了一个视频服务器的高可用机制,即基于资源的多对多备份机制。一个主份资源由r个后备资源备份,同时一个后备资源也为多个主份资源提供备份,在任意不超过r个节点失效的情况下,失效节点的负载全部可由既定后备资源接管,并且接管后系统中没有节点过载。将资源的备份关系以r备份图(二部图)、资源图和失效图的形式表达出来,通过构造任意失效图都存在完全匹配的r备份图的方法,给出并证明了后备资源在任意分布和规则分布时,资源分配需要满足的充分条件,同时给出了一种在机群视频服务器中实现该机制的负载分配调度算法。
It has become feasible to provide digital video service with improved performance of computers, enlarged bandwidth of networks, and progress in compressing technology of video data. In this dissertation, the relevant key technology is studied, and a prototype system is implemented. The results are as follows:
    1 An approach to establish real-time video server system with normal PC servers and unreal-time operation system is provided. The normal server is expanded in software and hardware to make output video streams satisfying DVB-C standard, and to provide video service by cable TV. The real-time soft multiplex of MPEG-2 transport stream and the flow control policies of real-time video data output are also implemented.
    2 The approaches to guarantee quality of service of video server are provided, including flow control, error control, and admission control policies of video server.
    3 The bandwidth control approach of the storage system is provided to deal with the competition between the internal data scheduling and the real-time data output in order to satisfy the deadline limitation of the data output. Furthermore, the load scheduling policy and cache disk scheduling policy are compared and the passive cache-hit priority approach is provided as the scheduling policy of the video server.
    4 A mechanism of high availability of video server is proposed. The mechanism is based on more to more resource backup. One resource has r backup resources and any reserve resource could backup for more other r esources. The load o f the failed nodes could be taken o ver by reserve resource and no overload arise in the system with the condition of no more than r failed nodes. The backup relationship is represented by r backup graph (bipartite graph), resource graph and failure graph. By making the complete matching r backup graph for the failure graph, the sufficient conditions of resource distribution are proposed and proved respectively with arbitrary distribution and regular distribution of reserve resource. The load distributing and scheduling algorithm to implement the mechanism in the cluster system is given.
引文
Agg01 Cham C. Aggarwal, Joel L. Wolf, and Philip S. Yu: The maximum factor queue length batching scheme for video-on-demand Systems. In IEEE Transactions On Computers,Vol. 50, No. 2, 2001, pp. 97-110."
    Agg96 C. C. Aggarwal, J.L. Wolf, and P.S. Yu. A Permutation-based Pyramid Broadcasting scheme for Video-on-Demand Systems. In Proc. the IEEE ICMCS'96., Hiroshima,Japan, June 1996, pp.118-126.
    Aki00 Cuneyt Akinlar and Sarit Mukherjee: A scalable distributed multimedia file system using network attached autonomous disks. MASCOTS 2000: San Francisco,California, USA.
    Alv97 G. A. Alvarez, W. A. Burkhard and F. Cristian: Tolerating multiple failures in RAID architectures with optimal storage and uniform declustering. Proceedings of the 24th Annual A CM/IEEE International Symposium on Computer Architecture, pp. 62-72,1997.
    And92 D. P. Anderson, Yoshitomo Osawa and Ramesh Govindan: A file system for continuous media. ACM Transactions on Computer Systems, Vol. 10, No.4, Nov.1992, pp. 311-337.
    Ank97 T. Anker, G. Chockler, I. Keidar, M. Rozman, and J. Wexler: Exploiting group communication for highly available video-on-demand services. In Proceedings of the 13th International Conference on Advanced Science and Technology (ICAST97) and the 2nd International Conference on Multimedia Information Systems (ICMIS 97),April 1997. http://citeseer.ist.psu.edu/anker97exploiting.html.
    Bar98 Scott A. Barnett, Gary J. Anido: Performability of Disk-Array-Based Video Servers. Multimedia Systems, 1998, Vol. 6, pp. 60-74.
    Ber95 S. Berson, L. Golubchik and R.R. Muntz: Fault tolerant design of multimedia servers. Proc. of the ACM SIGMOD Conf. on Management of Data, San Jose, CA, May 1995,pp. 364-375.
    Bil97 Manuel Billot, Valerie Issarny, Isabelle Puaut and Michel Banatre: Improving reliability of distributed vod servers. Proceedings of the 1997 International Conference on Multimedia Computing and Systems (ICMCS'97) 1997, IEEE.
    Bol96 W. J. Bolosky, J. S. Barrera, III, R. P. Draves and others: The tiger video fileserver. Proc. 6th Int. Workshop Network and Operating System Support for Digital Audio and Video(NOSSDAV'96), Zushi, Japan, Apr. 1996.
    Cha94 E.Chang and A.Zakhor: Admission control and data placement for VBR video server. IEEE International Conference on Image Processing, Austin, pp. 128-282, November 1994.
    Cha96 E.Chang and A.Zakhor: Cost analyses for VBR video server. IEEE Multimedia, Vol.3,No.4,1996,pp. 56-71.
    Che93 Mon-Song Chen, Dilip D. Kandlur and Philip S. Yu: Optimization of the grouped sweeping scheduling(GSS) heterogeneous multimedia streams. ACM Multimedia'93.
    Che96a Huang-Jen Chen and Thomas D. C. Little: Storage allocation policies for time-dependent multimedia data. IEEE Trans, on Knowledge and Data Engineering,Vol. 8,No. 5, Oct. 1996.
    Che96b Shenze Chen and Don Towsley: A performance evaluation of raid architectures. IEEE Transactions on Computers, Vol. 45, No. 10, October 1996, pp. 1116-1130.
    Che98 Cheng Chun Kong: CSIS 6922: Fundamentals of Parallel Computing, Term Project: A survey of media servers. http://www.csis.hku.hk/~ckcheng/papers/video.ps, 1998.
    Chi98 Tzi-cker Chiueh, Michael Vernick: An empirical study of admission control strategies in video servers. International Conference on Parallel Processing August 10 -14, 1998 Minneapolis, Minnesota.
    Chu96 T.S. Chua, J. Li, B.C. Ooi and K.L. Tan: Disk Striping Strategies for Large Video-on-Demand Servers. Proceedings of ACM Multimedia'96, Boston, November 1996, pp. 297-306.
    Cis00 Cisco white paper: Statistical multiplexing: increased efficiency, flexibility, and quality for MPEG-2 Video Applications. http://www.cisco.com/warp/public/cc/pd/mxsv/rmux/prodlit/smva_wp.pdf. 2000.
    Coh01 A. Cohen and W. A. Burkhard: Segmented information dispersal(SID) data layouts for digital video servers. IEEE Trans. on Knowledge and Data Engineering. Vol. 13, No.4, Jul./Aug. 2001
    Coh96 A. Cohen: Segmented Information Dispersal. PhD dissertation, Dept. of Computer Science and Eng., Univ. of Calif, San Diego, 1996.
    Cow95 Crispin Cowan, Shanwei Cen, Jonathan Walpole and Calton Pu: Adaptive Methods for Distributed Video Presentation. ACM Computing Surveys 27(4): 580-583 (1995).
    
    Dan94 A.Dan, D.Sitaram and P.Shahabuddin: Scheduling policies for an on-Demand video server with bathing. In Proceedings of ACM Multimedia Conference, ACM, 1994,pp.15-24.
    Den67 P. J. Denning: Effects of scheduling on file memory operation. AFIPS Sprint Joint Computer Conference, April 1967, pp. 9-21.
    Dig98 Digital Video Broadcasting(DVB); Specification for Service Information(SI) in DVB systems. EN 300 468 VI.3.1 (1998-02), ETSI.
    Du00 Du Jianghong, Xu Zhongyang, Chen Hao, and Ding Hui: Scheduling Algorithm for Mpeg-2 TS Multiplexers in CATV Networks. IEEE Transaction on broadcasting, Vol.46, No.4,12, 2000.
    Fer90 D. Ferrari and D. Verma: A scheme for real-time channel establishment in wide-area networks. IEEE Journal on Selected Areas in Communications, page 386, Apr 1990.
    
    Fu00 傅锡天,施可为等:视频服务器中变比特变率汉的I/O调度,计算机学报, Vol.23,2000, No. 4, pp. 398-403。
    Gaf99a Jamel Gafsi: Design and performance of large scale video servers. PhD thesis, ENST Paris, Institute Eurecom, November 1999.
    Gaf99b Jamel Gafsi and Ernst W. Biersack: Performance and cost comparison of mirroring- and parity-based reliability schemes for video servers. In Proceedings of KiVS'99, Darmstadt, Germany, March 1999
    Gao01 高文:服务器聚集系统中的高可用性分析与设计方法。中国科学院计算技术研究所博士论文,2001年。
    Gem95 D.J. Gemmell, H. M. Vin, D. D. Kandlur, P. V. Rangan and L. A. Rowe: Multimedia storage servers: a tutorial. IEEE Computer, Vol. 28, No. 5, May 1995, pp. 40-49.
    Gol01 Leana Golubchik, Richard R. Muntz, Cheng-Fu Chou and Steven Berson: Design of fault-tolerant large-scale VoD servers: with emphasis on high-performance and low-cost. IEEE Transactions on Parallel and Distributed systems, Vol. 12, No. 4, April 2001, pp. 363-386.
    Gol96 Leana Golubchik, John C.S. Lui and Richard R. Muntz: Adaptive piggybacking: a novel technique for data sharing in video-on-demand storage servers. ACM Multimedia Systems, Vol. 4, No. 3, 1996, pp. 140-155.
    Gol98 Leana Golubchik, John C. S. Lui and Maria Papadopouli: A survey of approaches to fault tolerant design of vod servers: techniques, analysis and comparison. Parallel Computing 24(1998), pp. 123-155.
    Han98 Shueng-Han, Gary Chan and Fouad A. Tobagi: Scalable services for video-on-demand. Technical Report No. CSL-TR-98-773. Dec. 1998, Stanford University.
    Ha004 郝敏:视频点播服务器设计关键技术研究。北京科技大学硕士论文,2004。
    Has98 Roger L. Haskin: Tiger Shark-a scalable file system for multimedia. IBM Journal of Research and Development, 42(2), pp. 185-197, March 1998.
    Hu02 胡飞,朱耀庭,朱光喜:Internet视频点播差错控制。计算机研究与发展,Jan.2002,39(1)。
    Hua00 黄铠,徐志伟:可扩展并行计算技术、结构与编程。机械工业出版社,2000。
    Hua97 K.A. Hua and S.Sheu: Skyscraper broadcasting: A new broadcasting scheme for metropolitan video-on-demand systems. Proc. SIGCOMM'97, Sept. 1997,, pp.89-100.
    Hwa02 Kai Hwang, Hai. Jin and Roy S. C. Ho: Orthogonal Striping and Mirroring in Distributed RAID for I/O-Centric Cluster Computing. IEEE Transactions on Parallel and Distributed Systems, Vol. 13, No. 1, January 2002, pp. 26-44.
    Ibma IBM white paper: IBM Ultrastar 18ES Hard Disk Drive. http://www.hitachigst.com.
    Jai91 Raj Jain: The Art of Computer Systems Performance Analysis, chapter 30. John Wiley & Sons, INC, 1991.
    Jck01 Jckwon: Mpeg trace: http://viscom.kaist.ac.kr/video-trace.html. 2001.7.1.
    Jef91 K. Jeffay, D. F. Stanat and C. U. Martel: On nonpreemptive scheduling of periodic and sporadic tasks. Proc. of Read-time Systems Symp., Dec. 1991, pp. 129-139.
    Jin03 Hai Jin, Guang Tan and Song Wu: Clustered multimedia servers: architectures and storage systems. Annula Review of Scalable Computing, Vol.t, Singapore University Press and World Scientific Publishing Co., 2003, 00.92-132.
    Kam94 M. Kamath, D. Towsley and K. Ramamritham: Buffer management for continuous media sharing in multimedia database systems. Technical Report 94-11, Department of Computer Science, University of Massachusetts, February 1994.
    Kan94 Dilip D. Kandlur, Mon-Song Chen, Zon-Yin Shae: Design o fa multimedia storage server. SPIE Vol. 2188, pp. 164-178.
    Kim97 Moon Kim: Implementing IBM VideoCharger. In IBM Redbooks. http://www.redbooks.ibm.com. 1997
    Kim99 In-Hwan Kim, Jeong-Won Kim, Seung-Won Lee and Ki-Dong Chung: VBR video data scheduling using window-based prefetching. ICMCS, Vol. 1 1999:159-164.
    Kon03 A. Konrad and A. D. Joseph: Choosing an accurate network path model. Technical Report UCB//CSD-03-1236, UC Berkeley, 2003. http://www.cs.berkeley.edu/~adj/publications/paper-files/CSD-03-1236.pdf
    Kun93 H.T. Kung and A. Chapman: The FCVC (flow controlled virtual channel) proposal for ATM networks," in Proc. Int. Conf. Network Protocols, San Francisco, CA, Oct. 1993, pp. 116-127.
    Lap90 J.C. Laprie, C. Beounes, M. Kaaniche and K. Kanoun: The transformation approach to the modeling and evaluation of the reliability and availability growth of systems in operation. 20th IEEE Annual International Symposium on Fault-Tolerant Computing (FTCS-20), 26-28 July 1990, pp.364-371.
    Lee00 Y.B. Lee and P. C. Wong: Performance analysis of a pull-Based parallel video server. IEEE T.ransactions on Parallel and Distributed systems, Vol. 11, No. 12, December 2000.
    Lee01 Jack Y. B. Lee: Supporting server-level fault tolerance in concurrent-push-based parallel video servers. IEEE Transactions on Circuits And Systems for Video Technology, Vol. 11, No. 1, January 2001 25.
    Lee95 Y.B. Lee and P. C. Wong: Viola—video on local-area network. In Proceeding of the 2nd IASTED/ISMM International Conference on Distributed Multimedia Systems, (Stanford, CA), 1995.
    Lee96 Y.B. Lee and P. C. Wong: A server array approach for video-on-demand service on local area networks. IEEE INFOCOM '96, San Francisco, USA, March 25-28.
    Lee99a KyungOh Lee and Heon Yo Yeom: An effective admission control mechanism for variable-bit-rate video streams. Multimedia Systems 7:305-311 (1999).
    Lee99b Y.B. Lee: Concurrent P ush—A scheduling algorithm for p ush-based parallel video servers. IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 3, April 1999.
    Li00 李勇,彭宇行,陈福接:大规模视频点播磁盘cache替换算法。计算机研究与发展,第37卷,第2期,2000年2月,pp.207-212。
    Li97 黎洪松:数字视频技术及其应用。清华大学出版社,1997年5月。
    Li98 Weiping Li: Fine granularity scalability using bit-plane coding of DCT coefficients. MPEG98/m4204, 1998.
    Lin98 Frank Yeong-Sung Lin: Optimal real-time admission control algorithms for the video-on-demand(VOD) service. IEEE Transactions on Broadcasting, Vol. 44, No. 4, Dec. 1998, pp. 402-408
    Lit95 Thomas D. C. Little and D. Venkatesh: Popularity-based assignment of movies to storage devices in a video-on-demand system. Multimedia System(1995) 2, pp. 280-287.
    Liu73 C. L. Liu and J. W. Layland: Scheduling algorithms for multiprogramming in a hard real-time environment. Journal of ACM, 1973, pp. 46-61
    Liu99 Jonathan Chien-Liang Liu, David H. C. Du., Simon S. Y. Shim and others: Design and evaluation of a generic software architecture for on-demand video servers. IEEE Transactions on Knowledge and Data Engineering, Vol. 11, No. 3, May/June 1999.
    Lui00 J. C. S. Lui and X. Q. Wang: An admission control algorithm for providing quality-of-service guarantee for individual connection in a video-on-demand system. Proceedings of the Fifth IEEE Symposium on Computers & Communications(ISCC'00). 2000.
    Ma02 Huadong Ma and Kang G. Shin: Multicast video-on-demand services. ACM Computer Communication Review, vol. 32, no. 1, January, 2002.
    Muk99 S. Mukherjee, C. Akinlar, W. Aref, and I. Kamel: A scalable high-bandwidth distributed file system for multimedia applications. Technical Report
    
    PINTL-TR-211-99, Panasonic Information and Networking Technologies Lab, December 1999.
    nCu00 nCube white paper: MediaCUBE 4 Description, 2000. http://www.weblearn.hs-bremen.de/risse/RST/docs/nCUBE/White_Paper_MediaCUBE_4.pdf
    Ner97 Guido Nerjes, Peter Muth and Gerhard Weikum: Stochastic service guarantees for continuous data on multi-zone disks. In Proceedings of the 16th Symposium on Principles of Database Systems(PODS'97), Tucson, Arizona, May 1997.
    Nus95 J. Nussbaumer, B. Patel, F. Schaffa, and J. GSterbenz: Networking requirement for interactive video on demand. IEEE Journal of Selected Areas in Communication, Vol.13, No. 5, June 1995, pp. 779-787.
    Ora98 Oracle white paper: Introducing Oracle Video Server, Release 3.0, Part No. A53956-02. Oracle Corporation, 1998. http://vodka.lfcia.org/oracle/ovs/docs/intro.pdf.
    Ozd96 B. Ozden, R. Rastogi and A. Silberschatz: Buffer replacement algorithms for multimedia databases. IEEE International Conference on Multimedia Computing and Systems, June 1996.
    Pat88 D. A. Patterson, G Gibson and R. H. Katz: A case for redundant arrays of inexpensive disks(RAID). Proc.of the 1988 ACM SIGMOD Conf. on Management of Data,Chicago, IL, June 1988, pp. 109-116.
    Paw94 B. Pawlowski, C. Juszczak, and others : NFS version 3 design and implementation.In Proceedings of the Summer USENIX Technical Conference, pages 137-152, June 1994.
    Per95 M. Perkins and D. Arnestein: Statistical multiplexing of multiple MPEG-2 video programs in a single channel. SMPTE Journal, Sept. 1995.
    Pre89 F. Preparata: Holographic dispersal and recovery of information. IEEE Transactions on Information Theory, 35(5): 1123-4, September 1989.
    Rab89 M. Rabin: Efficient dispersal of information for security, load balancing, and fault tolerance. Journal of the ACM, 36(2): 335-48, April 1989.
    Red93 A.L. Narasimha Reddy and James Wyllie: Disk scheduling in a multimedia I/O system. In Proceedings of the ACM International Multimedia Conference (ACM MM), Anaheim, CA, USA, August 1993, pp. 225-233.
    Rsv97 RFC 2205: Resource reservation protocol(RSVP) Version 1 Functional Specification, 1997.
    Rtp03 RTP: A transport protocol for real-time applications, RFC3550. http://www.ietf.org/rfc/rfc3550.txt, 2003.
    Rue94 Chris Ruemmler and John Wilkes, An introduction to disk modeling. IEEE Computer, 27(3), pp. 17-28, March 1994.
    Sea01 Seagate white paper: Cheetah 36ES Family(ST336706LW/LC and ST318406LW/LC) Product Manual, Volume 1. Publication number: 100141982, Rev. B, October 2001, http://www.seagate.com/support/disc/manuals/scsi/100141982b.pdf
    Sea66 P.H. Seaman, R. A. Lind, T. L. Wilson: An analysis of auxiliary-storage activity. IBM System Journal, Vol. 5, No.3, 1966, pp. 158-170
    Sea91 Seagate white paper: http://www.seagate.corn/support/disc/specs/mfm/st124.html. 1991.
    She95 盛骤,谢式千,潘承毅:概率论与数理统计,高等教育出版社,1995。
    Shi97 Weifeng Shi and Shahram Ghandeharizadeh: Buffer Sharing in Video-On-Demand Servers. ACM SIGMETRICS Bulletin, Performance Evaluation Review 25(2), September 1997, pp. 13-20.
    Sol95 Valery Soloviev and Alex Rousskov: The candid. video-on-demand servers. Tech. Report NDSU-CSOR-TR-9507, November 1995.
    Tew96 R. Tewari, D. M. Dias, R. Mukherjee, and H. M. Vin: High availability in clustered multimedia servers," in Proc. 12th Int. Conf. Data Engineering, 1996, pp. 645—654.
    Tob93 Fouad A. Tobagi, J. Pang, R. Balrd and M. Gang: Streaming RAID—A disk array management system for video files. ACM Multimedia Conference, 1993, pp.393-399.
    Ton98 Sheau-Ru Tong, Yee-Foon Huang and Jonathan C. L. Liu: Study on disk zoning for video servers. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems. 86-95, ICMCS'98.
    Veg98 Werner Vegels,..Dan Dumirtun and Ken Birman: The design and architecture of the Microsoft cluster service. IEEE FTCS(Int'l Symposium on Fault Tolerant Computing System), 1998.
    Vin94 H.M. Vin, Pawan Goyal, Alok Goyal and Anshuman Goyal: A statistical admission control algorithm for multimedia servers. In Proceedings of the A CM International Conference on Multimedia (Multimedia'94), San Francisco, October 1994.
    Vis95 S. Viswanathan and T. Imielinski: Pyramid broadcasting for video-on-demand service. In Proc. the SPIE Multimedia Computing and Networking Conference. 2417, pp.66-77, San Jose, CA, 1995.
    Wan02 王曜:视频点播。北京邮电大学出版社,2002年。
    Won96 Youjip Won and Jaideep Srivastava: Minimizing blocking probability in a hierarchical storage based vod server. Proceedings of the 1996 International Workshop on Multi-Media Database Management Systems(IW-MMDMS '96) 1996 IEEE.
    Won97 P.C. Wong and Y. B. Lee: Redundant Array of Inexpensive Servers(RAIS) for on-demand multimedia services. Proc. ICC '97 Workshop Information Infrastructure, June 1997.
    Wor94 B.L. Worthington, G. R. Ganger and Y. N. Patt: Scheduling algorithm for modem disk drivers. Proceedings of the ACM S igmetrics Conference, May, pp. 241-251, 1994.
    Wu00 伍海桑等:IPv6原理与实践。人民邮电出版社,2000。
    Xia93 肖位枢:图论及其算法。航空工业出版社,1993。
    Xia94 肖云茹:概率统计计算方法。南开大学出版社,1994年。
    Yan04 杨晓君,苗彦超,郭黎利,孙凝晖:一种基于非实时操作系统的数字视频传输方法,投稿待发表,2004。
    Yu93 E S. Yu, M.-S. Chen, D. D. Kandlur: Design and analysis of a grouped sweeping scheme for multimedia storage management. Third International Workshop on Network and Operating System Support for Digital Audio and Video, Nov. 1992, San Diego, California.
    Zha00 张文生:多节点机群系统的高可用管理软件的设计与实现。中国科学院计算技术研究所硕士论文,2000。
    Zhe04 郑翔、叶志远等:JVT草案中的核心技术综述。软件学报,Vol.15,No.1,2004。
    Zh001 周知予:基于交叉开关的新型互连网络的高效通信。中国科学院计算技术研究所博士论文,2001。
    Zh003 钟玉琢,向哲,沈洪:流媒体和视频服务器。清华大学出版社,2003。
    Zh096 钟玉琢,乔秉新,祁卫:运动图像及其伴音通用编码国际标准——MPEG-2。清华大学出版社,1996。
    Zou85 邹海明,余祥宣:计算机算法基础,华中理工大学出版社,1985年9月。

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700