面向无线环境的交互式多媒体系统设计与实现
|
摘要
日新月异的计算机科学和网络技术的迅速发展为未来多媒体应用技术的发展带来了无穷的活力。伴随着微电子技术、光电子技术以及无线网络技术的不断发展，计算机的发展已经进入了移动时代，以掌上电脑(PDA)、便携式电脑(Notebook PC)和穿戴设备(Wearable-Device)为代表的移动式计算系统日益普及，在移动中使用计算机、无线袖珍设备、将移动的主体通过网络与庞大的数字空间无缝地结合在一起，已经不再是梦想。
本论文的研究目的是研究开发一套面向无线环境的交互式多媒体系统。本系统设计主要是通过802.11b无线网络环境来构建一个无线交互平台，使移动终端(如：PDA、Laptop)与数据服务中心，或者移动终端与移动终端之间通过上述平台来进行多媒体数据的传输以及信息的交互等。另外在系统设计和实现基础之上，对无线交互多媒体系统进行了测试，给出了系统运行的实验结果，并对系统性能加以分析。本系统主要有以下特色：第一、面向无线环境的无线交互式系统是一个移动的系统，它能够使得持有无线移动设备的用户可以在无线网络信号覆盖区域内享受移动式的服务MS(Mobile Services)，第二、持有移动终端的用户可以根据自身的需要向服务系统提出简单的交互请求(Simple Interactive Request)，从而满足用户的一些简单性的应用需求，实现简单的交互功能。
论文首先分析了有线网络环境下进行多媒体音视频数据信息传输的研究现状、技术背景、流媒体数据信息的特点、在未来发展过程中用户对网络的需求，以及无线环境下交互式系统研究与设计的必要性、可行性和整个系统设计开发的技术基础。第二部分介绍了音视频编码的基本理论，对各种编码标准作了比较和分析，选择了适合无线环境下交互式多媒体系统的编码标准。第三部分在分析了无线网络传输特性之后，阐述了针对无线环境音视频数据编码及传输的设计方案。第四部分对无线环境的交互式系统进行了完整的逻辑设计，并详细阐述了各具体模块的功能。第五部分在交互式系统设计基础之上，对系统各个功能模块进行了实现，并给出了整个系统的实验结果和相关试验数据。文章末尾对无线交互多媒体设计进行了总结和展望。另外本文还对无线网络环境中，进行音视频数据传输时出现的声音延迟、动态带宽自适应以及音视频不同步等问题在相关章节中进行了一定的分析，并给出了可能的解决方案。
With the rapid development of the network technologies multimedia applications based ontransmission have been motivated greatly. The fast developments of micro-electronic andphoto-electronic technologies, combining the network technology, gestate a new computing era.Mobile computing system based on personal digital assistant (PDA), laptop and wearabledevices has been used widely. It is not a dream for mobile users to operate computer whenmoving. They can connect to network to send and receive data anywhere at any time bydifferent ways. The cyberspace and physical space will be integrated into one whole space.
In this context this paper intends to develop an interactive multimedia system based onwireless environment. The designed system mainly consists of a wireless interactive platformvia IEEE802.11b wireless network, which can allow the transmission of a large amount ofmultimedia data and interactive communication between mobile devices(PDA, Laptop), thecenter of data service, and mobile devices. In addition, we do some simulations to evaluate thedesigned system. According to the experiment results the system performances are analyzed.The designed system has the following characteristics. First, it is a mobile system supportinginteractive multimedia communication based on wireless environment, which can enable usersto enjoy mobile multimedia services anywhere at any time. Second, mobile users holdingwireless devices can send simple interactive requests to service system according to theirservice demands. This can gratify the interactive need of mobile users by providing thefunction of simple interactive commands.
The first chapter analyses the status quo of multimedia transmission, its technologybackground, characteristics of streaming multimedia and the requirements of the possiblefuture development of the cable network. Furthermore, the feasibility and the technicalfoundation for the design of the interactive system based on wireless network are analyzed. Inthe second chapter the technological details of Audio and Video Codec are introduced.Comparing between several Audio and Video Coding Standards, we choose H.264 videocoding standard as a best choice for the interactive multimedia system working in wirelessenvironment. In the third chapter after analyzing the characteristics of wireless transmissionstandards, we present the transmission protocols RTP/RTCP and wireless standards 802.11b, which will be used in the proposed interactive multimedia system. Then we analyze thetransmission-related problems in wireless network, such as delay, self-adaptive bandwidth andsynchronization between audio and video. In the fourth chapter, we propose and design awireless interactive multimedia system, and its corresponding architecture, logical frame, andthe basic functions of each module are given in details. In the fifth chapter the functionmodules are implemented and some experiments are performed to test the efficiency of theproposed system. Finally the works are concluded and some future works are given.
本论文的研究目的是研究开发一套面向无线环境的交互式多媒体系统。本系统设计主要是通过802.11b无线网络环境来构建一个无线交互平台，使移动终端(如：PDA、Laptop)与数据服务中心，或者移动终端与移动终端之间通过上述平台来进行多媒体数据的传输以及信息的交互等。另外在系统设计和实现基础之上，对无线交互多媒体系统进行了测试，给出了系统运行的实验结果，并对系统性能加以分析。本系统主要有以下特色：第一、面向无线环境的无线交互式系统是一个移动的系统，它能够使得持有无线移动设备的用户可以在无线网络信号覆盖区域内享受移动式的服务MS(Mobile Services)，第二、持有移动终端的用户可以根据自身的需要向服务系统提出简单的交互请求(Simple Interactive Request)，从而满足用户的一些简单性的应用需求，实现简单的交互功能。
论文首先分析了有线网络环境下进行多媒体音视频数据信息传输的研究现状、技术背景、流媒体数据信息的特点、在未来发展过程中用户对网络的需求，以及无线环境下交互式系统研究与设计的必要性、可行性和整个系统设计开发的技术基础。第二部分介绍了音视频编码的基本理论，对各种编码标准作了比较和分析，选择了适合无线环境下交互式多媒体系统的编码标准。第三部分在分析了无线网络传输特性之后，阐述了针对无线环境音视频数据编码及传输的设计方案。第四部分对无线环境的交互式系统进行了完整的逻辑设计，并详细阐述了各具体模块的功能。第五部分在交互式系统设计基础之上，对系统各个功能模块进行了实现，并给出了整个系统的实验结果和相关试验数据。文章末尾对无线交互多媒体设计进行了总结和展望。另外本文还对无线网络环境中，进行音视频数据传输时出现的声音延迟、动态带宽自适应以及音视频不同步等问题在相关章节中进行了一定的分析，并给出了可能的解决方案。
With the rapid development of the network technologies multimedia applications based ontransmission have been motivated greatly. The fast developments of micro-electronic andphoto-electronic technologies, combining the network technology, gestate a new computing era.Mobile computing system based on personal digital assistant (PDA), laptop and wearabledevices has been used widely. It is not a dream for mobile users to operate computer whenmoving. They can connect to network to send and receive data anywhere at any time bydifferent ways. The cyberspace and physical space will be integrated into one whole space.
In this context this paper intends to develop an interactive multimedia system based onwireless environment. The designed system mainly consists of a wireless interactive platformvia IEEE802.11b wireless network, which can allow the transmission of a large amount ofmultimedia data and interactive communication between mobile devices(PDA, Laptop), thecenter of data service, and mobile devices. In addition, we do some simulations to evaluate thedesigned system. According to the experiment results the system performances are analyzed.The designed system has the following characteristics. First, it is a mobile system supportinginteractive multimedia communication based on wireless environment, which can enable usersto enjoy mobile multimedia services anywhere at any time. Second, mobile users holdingwireless devices can send simple interactive requests to service system according to theirservice demands. This can gratify the interactive need of mobile users by providing thefunction of simple interactive commands.
The first chapter analyses the status quo of multimedia transmission, its technologybackground, characteristics of streaming multimedia and the requirements of the possiblefuture development of the cable network. Furthermore, the feasibility and the technicalfoundation for the design of the interactive system based on wireless network are analyzed. Inthe second chapter the technological details of Audio and Video Codec are introduced.Comparing between several Audio and Video Coding Standards, we choose H.264 videocoding standard as a best choice for the interactive multimedia system working in wirelessenvironment. In the third chapter after analyzing the characteristics of wireless transmissionstandards, we present the transmission protocols RTP/RTCP and wireless standards 802.11b, which will be used in the proposed interactive multimedia system. Then we analyze thetransmission-related problems in wireless network, such as delay, self-adaptive bandwidth andsynchronization between audio and video. In the fourth chapter, we propose and design awireless interactive multimedia system, and its corresponding architecture, logical frame, andthe basic functions of each module are given in details. In the fifth chapter the functionmodules are implemented and some experiments are performed to test the efficiency of theproposed system. Finally the works are concluded and some future works are given.
引文
1. Wiegand T, Simllivan GJ, Bjontegaard G. Overview of the H.264/AVC video coding Standard [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003,13(7).
2. Cali F, Conti M, Gregori E. Dynamic Tuning of the IEEE802.11 Protocol to Achieve a Theoretical Throughput Limit [J]. IEEE/ACM Transactions on Networking,2000,8(6):785-799.
3. Tham Y, Ranganath S, Ranganath M. A novel unrestricted center-based diamod search algorithm for block motion estimation [J]. IEEE Trans Circuits Syst Video Technol, 1998,8(1):369-377.
4. Tamhanker A. An Overview of H.264/MPEG-4 Part 10[J]. Video/Image Processing and Multimedia Communication, 2003, 2(1):2-5.
5. Bianchi G. Performance Analysis of the IEEE802.il Distributed Coordination Function [J]. IEEE Journal on Selected Areas in Communication, 2000,18(3):535-547.
6. Wiegand T, Schwarz H, Joch A. Rate-constrained coder control and comparison of video coding standards [J]. IEEE Transactions on Circuits and Systems forVideo Technology,2003,13 (7).
7. S. Zhu and K. K. Ma, A new diamond search algorithm for fast block-matching motion estimation [J]. IEEE Trans Image Processing, 2000,9(1):287-290
8. Jain J, lain A, Displacement measurement and its application in interframe image coding [J]. IEEE Trans Commun,1981,29(1):169-180.
9. S. Wenger.H.264/AVC over IP [J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(2):645-656.
10. T. Stockhammer.M. M. Hannuksela, and T. Wiegand, H.264/AVC in wireless environments [J]. IEEE Trans. Circuits Syst Video Technol, 2003,13(2):657-673.
11. T.Wedi.Motion compensation in H.264/AVC [J]. IEEE Trans Circuits Syst Video Technol,2003,13(1):577-586.
12. T.Wiegand, X. Zhang, and B. Girod.Long-term memory motion-compensated prediction [J]. IEEE Trans Circuits Syst Video Technol, 1999,9(1):70-84.
13. T.Wiegand and B. Girod, Multi-Frame.Motion-Compensated Prediction for Video Transmission [M]. Holand: Kluwer, 2001:12-18.
14. Detlev M, Heiko Schw arz, Thomas Wiegand. Context-Based Adaptive Binary Arithmetic Coding in the H1264/AVC Video Compression Standdard [J]. IEEE Trans Circuits Syst Video Yechnol, 2003, 13 (7): 620-636.
15. T. Wiegand, H. Schwarz, A. Joch, F. Kossentini, and G. J. Sullivan.Rate-constrained coder control and comparison of video coding standards[J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(2):88-703.
16. S. Wenger. H.264/AVC over IP[J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(2): 645-656.
17. M. Karczewicz and R. Kurceren.The SP and SI frames design for H.264/AVC [J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(1):637-644.
18. D. Marpe, H. Schwarz, and T. Wiegand.Context-adaptive binary arithmetic coding in the H.264/AVC video compression standard [J]. IEEE Trans Circuits Syst Video Technol, 2003,13 (2):620-636.
19. H. Malvar, A. Hallapuro, M. Karczewicz, and L. Kerofsky.Low-Complexity transform and quantization in H.264/AVC [J]. IEEE Trans. Circuits Syst. Video Technol, 2003, 13(2): 598-603.
20. P. List, A. Joch, J. Lainema, G. Bjφntegaard, and M. Karczewicz.Adaptive deblocking filter [J]. IEEE Trans. Circuits Syst. Video Technol, 2003, 13(1): 614-619.
21. J. Ribas-Corbera, P. A. Chou, and S. Regunathan. A generalized hypothetical reference decoder for H.264/AVC [J]. IEEE Trans Circuits Syst Video Technol, 2003,13(1): 674—687.
22．Guofu Huang, Alex Chen, Celina Gao. IPTV Quality Management Research[J]．UT斯达康研究工程与实践，2006，12(1)：32-35．
23．徐巧枝．一种用于P2P网络的访问控制模型[J]．计算机工程与应用，2005，17(2)
24．房胜，钟玉琢．基于蓝牙技术的家庭网络系统的设计和实现[J]．小型微型计算机系统，2004，25(11)
25．韩旭东，曹建海．无线局域网标准IEEE802.11g的技术优势[J]．世界电子元器件，2004，(8)
26．余兆名，查日勇，黄磊．图像编码标准H.264技术[M]．北京：人民邮电出版社，2006：13-42
27．黄国富，房胜，刘香兰．基于区分服务网络的H.263+可扩展性研究[J]．系统仿真学报，2006，18(1)：433-435．
28．丁贵广，计文平，郭宝龙等．Visual C++6.0数字图像编码[M]．北京：机械工业出版社， 2004，：26-38．12
29．王嵩，薛全，张颖等．H．264视频编码新标准及性能分析[J]．北京：电视技术，2003，(6)：25-27．
30．毕厚杰，陈启美，方晖．IP宽带通信网络技术[M]．北京：北京邮电大学出版社，2004：12-38．
31．钟玉琢等．基于对象的多媒体数据压缩编码国际标准MPEG-4及校验模型[M]．北京：科学技术出版社，2000：18-46
32．钟玉琢，乔秉新，祁卫译．运动图象及伴音通用编码国际标准—MPEG-2[M]．北京：清华大学出版社，1997：12-36
33．陈庆余，朱光喜．一种MPEG-2 Over RTP的实现方法[M]．北京：电视技术，2001：32-57
34．黄永峰等．IP网络多媒体通信技术[M]．北京：人民邮电出版社，2003：45-86
35．宋军，顾冠群．多媒体通信媒体间同步技术综述[M]．北京：电信科学，1996：22-45
36．孙飞．流媒体网络传输的技术瓶颈[J]．多媒体视讯，2004，4(2)
37．杨明川，谢冲锋．宽带网络流媒体技术和应用[M]．北京：电信科学，2003：28-39
38．倪伟，郭宝龙，陈龙潭等．H．264变换编码和量化算法的研究[J]．计算机工程和应用，2004，40(3)：33-36
39．郭峰等编著．无线局域网[M]．北京：电子工业出版社，1997：15-28
40．罗明宇，陶孜谨等．RTP在网络视频传输中的实现研究[J]．计算机工程，2000，26(9)：29-32
41．孙翔．无线网卡设计与实现[J]．西安电子科技大学学报，2000，6(1)．
42．赵力强，张海林．IEEE802.11无线局域网的TCP性能分析和改进[J]．计算机学报，2005，2(11)
2. Cali F, Conti M, Gregori E. Dynamic Tuning of the IEEE802.11 Protocol to Achieve a Theoretical Throughput Limit [J]. IEEE/ACM Transactions on Networking,2000,8(6):785-799.
3. Tham Y, Ranganath S, Ranganath M. A novel unrestricted center-based diamod search algorithm for block motion estimation [J]. IEEE Trans Circuits Syst Video Technol, 1998,8(1):369-377.
4. Tamhanker A. An Overview of H.264/MPEG-4 Part 10[J]. Video/Image Processing and Multimedia Communication, 2003, 2(1):2-5.
5. Bianchi G. Performance Analysis of the IEEE802.il Distributed Coordination Function [J]. IEEE Journal on Selected Areas in Communication, 2000,18(3):535-547.
6. Wiegand T, Schwarz H, Joch A. Rate-constrained coder control and comparison of video coding standards [J]. IEEE Transactions on Circuits and Systems forVideo Technology,2003,13 (7).
7. S. Zhu and K. K. Ma, A new diamond search algorithm for fast block-matching motion estimation [J]. IEEE Trans Image Processing, 2000,9(1):287-290
8. Jain J, lain A, Displacement measurement and its application in interframe image coding [J]. IEEE Trans Commun,1981,29(1):169-180.
9. S. Wenger.H.264/AVC over IP [J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(2):645-656.
10. T. Stockhammer.M. M. Hannuksela, and T. Wiegand, H.264/AVC in wireless environments [J]. IEEE Trans. Circuits Syst Video Technol, 2003,13(2):657-673.
11. T.Wedi.Motion compensation in H.264/AVC [J]. IEEE Trans Circuits Syst Video Technol,2003,13(1):577-586.
12. T.Wiegand, X. Zhang, and B. Girod.Long-term memory motion-compensated prediction [J]. IEEE Trans Circuits Syst Video Technol, 1999,9(1):70-84.
13. T.Wiegand and B. Girod, Multi-Frame.Motion-Compensated Prediction for Video Transmission [M]. Holand: Kluwer, 2001:12-18.
14. Detlev M, Heiko Schw arz, Thomas Wiegand. Context-Based Adaptive Binary Arithmetic Coding in the H1264/AVC Video Compression Standdard [J]. IEEE Trans Circuits Syst Video Yechnol, 2003, 13 (7): 620-636.
15. T. Wiegand, H. Schwarz, A. Joch, F. Kossentini, and G. J. Sullivan.Rate-constrained coder control and comparison of video coding standards[J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(2):88-703.
16. S. Wenger. H.264/AVC over IP[J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(2): 645-656.
17. M. Karczewicz and R. Kurceren.The SP and SI frames design for H.264/AVC [J]. IEEE Trans Circuits Syst Video Technol, 2003, 13(1):637-644.
18. D. Marpe, H. Schwarz, and T. Wiegand.Context-adaptive binary arithmetic coding in the H.264/AVC video compression standard [J]. IEEE Trans Circuits Syst Video Technol, 2003,13 (2):620-636.
19. H. Malvar, A. Hallapuro, M. Karczewicz, and L. Kerofsky.Low-Complexity transform and quantization in H.264/AVC [J]. IEEE Trans. Circuits Syst. Video Technol, 2003, 13(2): 598-603.
20. P. List, A. Joch, J. Lainema, G. Bjφntegaard, and M. Karczewicz.Adaptive deblocking filter [J]. IEEE Trans. Circuits Syst. Video Technol, 2003, 13(1): 614-619.
21. J. Ribas-Corbera, P. A. Chou, and S. Regunathan. A generalized hypothetical reference decoder for H.264/AVC [J]. IEEE Trans Circuits Syst Video Technol, 2003,13(1): 674—687.
22．Guofu Huang, Alex Chen, Celina Gao. IPTV Quality Management Research[J]．UT斯达康研究工程与实践，2006，12(1)：32-35．
23．徐巧枝．一种用于P2P网络的访问控制模型[J]．计算机工程与应用，2005，17(2)
24．房胜，钟玉琢．基于蓝牙技术的家庭网络系统的设计和实现[J]．小型微型计算机系统，2004，25(11)
25．韩旭东，曹建海．无线局域网标准IEEE802.11g的技术优势[J]．世界电子元器件，2004，(8)
26．余兆名，查日勇，黄磊．图像编码标准H.264技术[M]．北京：人民邮电出版社，2006：13-42
27．黄国富，房胜，刘香兰．基于区分服务网络的H.263+可扩展性研究[J]．系统仿真学报，2006，18(1)：433-435．
28．丁贵广，计文平，郭宝龙等．Visual C++6.0数字图像编码[M]．北京：机械工业出版社， 2004，：26-38．12
29．王嵩，薛全，张颖等．H．264视频编码新标准及性能分析[J]．北京：电视技术，2003，(6)：25-27．
30．毕厚杰，陈启美，方晖．IP宽带通信网络技术[M]．北京：北京邮电大学出版社，2004：12-38．
31．钟玉琢等．基于对象的多媒体数据压缩编码国际标准MPEG-4及校验模型[M]．北京：科学技术出版社，2000：18-46
32．钟玉琢，乔秉新，祁卫译．运动图象及伴音通用编码国际标准—MPEG-2[M]．北京：清华大学出版社，1997：12-36
33．陈庆余，朱光喜．一种MPEG-2 Over RTP的实现方法[M]．北京：电视技术，2001：32-57
34．黄永峰等．IP网络多媒体通信技术[M]．北京：人民邮电出版社，2003：45-86
35．宋军，顾冠群．多媒体通信媒体间同步技术综述[M]．北京：电信科学，1996：22-45
36．孙飞．流媒体网络传输的技术瓶颈[J]．多媒体视讯，2004，4(2)
37．杨明川，谢冲锋．宽带网络流媒体技术和应用[M]．北京：电信科学，2003：28-39
38．倪伟，郭宝龙，陈龙潭等．H．264变换编码和量化算法的研究[J]．计算机工程和应用，2004，40(3)：33-36
39．郭峰等编著．无线局域网[M]．北京：电子工业出版社，1997：15-28
40．罗明宇，陶孜谨等．RTP在网络视频传输中的实现研究[J]．计算机工程，2000，26(9)：29-32
41．孙翔．无线网卡设计与实现[J]．西安电子科技大学学报，2000，6(1)．
42．赵力强，张海林．IEEE802.11无线局域网的TCP性能分析和改进[J]．计算机学报，2005，2(11)