基于RTP协议的视频流媒体实时传输
摘要
多媒体技术和计算机网络技术的不断进步使网络多媒体应用日益普及和快速发展。视频会议，视频点播，远程教育，IPTV等多媒体应用在人们的日常生活中发挥着越来越重要的作用。
本文正是在这样的前提下，对多媒体技术和网络协议进行深入研究的基础上，提出了基于RTP协议的视频流媒体实时传输系统的设计与实现。论文首先在对各个视频压缩技术进行比较后，选择MPEG-4运动图像压缩编码标准作为本系统的视频压缩技术，并详细研究了MPEG-4标准的内容和优势，它广泛应用于低码率传输。如何在网络上实时传输MPEG-4码流是当前的一个研究热门，也是未来网络多媒体的一个重要的研究方向。接着对网络传输协议进行分析比较，选用RTP／RTCP协议作为本系统传输层协议，并深入分析了RTP／RTCP的特点、内容。最后给出了本系统的总体结构和系统各个模块的解决方案，包括网络传输模块，网络接收模块，视频编码控制模块和视频播放模块等。
本系统具有视频采集、播放、网络传输、网络接收、解压等功能，达到了MPEG-4网络组播的基本要求，能实时传输视频图像。除视频采集功能外均采用软件实现，有较强的可移植性和易于升级，同时硬件投资也不高。
The steady advancement of technology in the field of multimedia and computer networks has become a strong impetus to the development and popularization of the networked multimedia applications. Distributed multimedia applications such as videoconference, video on demand, long-distance education, IPTV etc. are more and more important to people's life.
Accordiong to these, and based on the in-depth research of the basic theory of multimedia technology and networks protocol, the research project of the thesis is to research an RTP-based streaming media real-time transmission syatem design and implementation. The thesis includes the following parts: Firstly, after comparisons of the various video compression technology, MPEG-4 video coding standards is chosen, and content and advantages of the MPEG-4 is detailedly studied. It is a very popular multimedia codec, which used in the low bit-rate transport in the network, how to transport MPEG-4 bit-stream in the network real-time is a hotspot of research. And then this thesis lucubrates the contents and characters of RTP and believes that RTP is well suitable for the video transmission. Finally, The thesis introduces the whole design project of this system and details research process of every program source produce module, which including network transmission module, network receiver module, video coding control module, playing back module for video and so on.
The system comprises functions of video data collecting, playback, netwok transmission, network receiver, decoding. The test result shows that the system can real-time transport MPEG-4 video Multicast and playback the video well. The most of the functions are archived by software, except video data collecting. the system costs low In hardware investment and can be updated easily.
本文正是在这样的前提下，对多媒体技术和网络协议进行深入研究的基础上，提出了基于RTP协议的视频流媒体实时传输系统的设计与实现。论文首先在对各个视频压缩技术进行比较后，选择MPEG-4运动图像压缩编码标准作为本系统的视频压缩技术，并详细研究了MPEG-4标准的内容和优势，它广泛应用于低码率传输。如何在网络上实时传输MPEG-4码流是当前的一个研究热门，也是未来网络多媒体的一个重要的研究方向。接着对网络传输协议进行分析比较，选用RTP／RTCP协议作为本系统传输层协议，并深入分析了RTP／RTCP的特点、内容。最后给出了本系统的总体结构和系统各个模块的解决方案，包括网络传输模块，网络接收模块，视频编码控制模块和视频播放模块等。
本系统具有视频采集、播放、网络传输、网络接收、解压等功能，达到了MPEG-4网络组播的基本要求，能实时传输视频图像。除视频采集功能外均采用软件实现，有较强的可移植性和易于升级，同时硬件投资也不高。
The steady advancement of technology in the field of multimedia and computer networks has become a strong impetus to the development and popularization of the networked multimedia applications. Distributed multimedia applications such as videoconference, video on demand, long-distance education, IPTV etc. are more and more important to people's life.
Accordiong to these, and based on the in-depth research of the basic theory of multimedia technology and networks protocol, the research project of the thesis is to research an RTP-based streaming media real-time transmission syatem design and implementation. The thesis includes the following parts: Firstly, after comparisons of the various video compression technology, MPEG-4 video coding standards is chosen, and content and advantages of the MPEG-4 is detailedly studied. It is a very popular multimedia codec, which used in the low bit-rate transport in the network, how to transport MPEG-4 bit-stream in the network real-time is a hotspot of research. And then this thesis lucubrates the contents and characters of RTP and believes that RTP is well suitable for the video transmission. Finally, The thesis introduces the whole design project of this system and details research process of every program source produce module, which including network transmission module, network receiver module, video coding control module, playing back module for video and so on.
The system comprises functions of video data collecting, playback, netwok transmission, network receiver, decoding. The test result shows that the system can real-time transport MPEG-4 video Multicast and playback the video well. The most of the functions are archived by software, except video data collecting. the system costs low In hardware investment and can be updated easily.
引文
[1] LIU Dacheng, ZHENG Yong, CHENG Lihui, et al. Monitor effective information method and its application. Manufacturing Technology & Machine Tool, 2004, 504(7):15-19 (in Chinese)
[2] 林福宗．多媒体技术基础．北京：清华大学出版社，2000
[3] D. Wu, Y. T. Hou, Y. Q. Zhang. Streaming video over the Internet: approaches and directions. IEEE Trans on Circuits and Systems For Video Technology, 2001, 11(1): 1-20
[4] 詹慧静．MPEG-4编码特性剖析及应用研究．武汉理工大学学报，2005，(6)：102-105
[5] 薛文通，宋建社，袁礼海．图像压缩技术的现状与发展．计算机工程与应用，2003，39(2)：65-67
[6] 钟玉琢，王琪，贺玉文．基于对象的多媒体数据压缩编码国际标准MPEG-4及校验模型．北京：科学出版社，2000
[7] ISO/IEC JTC1/SC29/WG11 Document N2501. Information Technology-Generic Coding of Audio-Visual Objects, Part 2: Systems. ISO/IEC 14496-1,Final Draft International Standard, Nov, 1998
[8] ISO/IEC JTC1/SC29/WG11 Document N2501. Information Technology-Generic Coding of Audio-Visual Objects, Part 2: Visual. ISO/IEC 14496-2,Final Draft International Standard, Nov, 1998
[9] 李太君，吴泽晖．流媒体传输协议及其应用开发．计算机工程与应用，2004，40(3)：138-141．
[10] RTP: A Transport Protocol for Rea-Time Applications. RFC 1889,1996.
[11] Schulzrinne H , Casner S , Frederick R , et al. RTP : A Transport Protocol for Real-Time Applications [EB/OL]. RFC3550,2003
[12] RTP Payload Format for AC-3 Audio. RFC 4184,2005
[13] RTP Payload Format for H.264 Video. RFC 3984,2005
[14] RTP Payload Format for Transport of MPEG-4 Elementary Streams. RFC 3640, 2003
[15] RTP Payload Format for MPEG-4 Audio/Visual Streams. RFC3016,2000
[16] 董振亚，张拥军，彭宇行．基于RTP的MPEG-4视频传输．计算机应用研究，2003(7)；52-55
[17] Dapeng Wu, Yiwei Thomas Hou. Transporting Real-Time Video overtheInternet: Challenges and Approaches. PROCEEDINGS OF THE IEEE, December 2000, 88(12): 1855-1874,
[18] Cai N, Chiu D. Transport of MPEG-2 Video in Routed IP Networks: Effects of Network Congestion on Transport Stream Errors. France IDMS'99 Conf, October 1999
[19] Schulzrinne H. RTP Profile for Audio and Video Conferences with Minimal Control. RFC 1890,1996
[20] Hoffman D, Femando G. RTP Payload Format for MPEG-1/MPEG-2 Video. RFC2250,1998
[21] ISO/IEC JTC 1/SC29/WG11 Document N2552. MPEG-4 Video Verification Model Version 12.1.Dec 1998
[22] ISO/IEC JTC 1/SC29/WG11 Document N3056. Information Technology-Coding of Audio- Visual Objects, Part 2: Visual Amendment 1:Visual extensions. ISO/IEC 14496-2, 1999/Amd. 1, 2000(E), Jan 2000
[23] CHENGI, BASUA. QoS based video delivery with foveation and bandwidth monitoring. Pattern Recognition Letters, 2003, 24 (15): 2675-2686.
[24] WIEBEK, BASUA. Modelling ecologically specialized biological visual systems . Pattern Recognition, 1997, 30 (1): 1687-1703.
[25] ISO/IEC 14496-6. Coding of audio-visual objects-Part 6:Delivery Multimedia Integration Framework (DMIF)
[26] Vetro A, Sun H, Wang Y. MPEG-4 rate control for multiple video objects. IEEE Trans, Circuits Syst, Video Technol, 1999, 9(1): 186-199.
[27] Ronda J I, Eckert M, Jaureguizar F, et al. Rate control and bit allocation for MPEG-4. IEEE Trans, Circuits Syst, Video Technol, 1999, 9(8): 1243-1258.
[28] Wu D, Hou Y T, Zhu W, et al. On end-to-end architecture for transporting MPEG-4 video over the internet. IEEE Trans, Circuits Syst, Video Technol, 2000, 10(6): 923-941.
[29] 宋刚，杨显富．实时流媒体传输及其协议．成都大学学报(自然科学版)，2005(3)
[30] 钟玉琢，向哲，沈洪．流媒体和视频服务器．北京：清华大学出版社，2003．
[31] Beau Williamson．Developing IP Multicast Networks，顾金星译．北京：电子工业出版社，2000
[32] 鲁士文．多媒体网络技术与应用．北京：清华大学出版社，2002
[33] Kenneth D Reed．TCP／IP基础．北京：电子工业出版社，2002．
[34] Henning Schulzrinne. RTP: About RTP and the Audio-Video Transport Working Group. http://www.cs.columbia.edu/～hgs/rtp
[35] Colin Perkinsl. RTP: Audio and Video for the Internet. New York: Addison Wesley, 2003
[36] 余兆明，李晓飞，陈来春．MPEG标准及其应用．北京：北京邮电大学出版社，2002
[37] Rao K R，Zoran S B，Dragorad A M1．多媒体通信系统技术、标准及网络(影印版)．北京：清华大学出版社，2003
[38] Rosenberg J, Schulzrinne H. Sampling of the Group Membership in RTP . RFC 2762, 2000
[39] 邱小燕，吴产乐，叶刚等．RTP协议中RTCP传输间隔算法．武汉大学学报(理学版)，2005(2)，74-76
[40] Rosenberg J, Schulzrinne H. Timer Reconsideration for Enhanced RTP Scalability[A]. S-eventeenth Annual Joint Conference of the IEEE Comp uter and Communicat ions Societies, 1998, 1,233-241.
[41] 黄家传，王福豹，段渭军．MPEG-4的RTP封装技术及其应用．计算机应用研究，2005(8)：158-160
[42] 许先斌等．运用RTP协议实时传输MPEG-4流．计算机工程与设计，2003(2)：57-59
[43] 董振亚，张拥军，彭宇行．基于RTP的MPEG-4视频传输．计算机应用研究，2003，20(7)：52-55
[44] Basso A, Varakliotis S., Transport of MPEG24 over IP /RTP. 2000 IEEE International Conference, 2000, 1067-1070.
[45] RTP Payload Format for Transport of MPEG-4 Elementary Steams. RFC3640, 2003
[46] Van Der Meer, et al Transport of MPEG-4 Elementary Steams. draft-avt-mpeg4-simple-05, 2002
[47] Basso, et al. RTP Payload Format for MPEG-4 Streams. Draft-ietf-avt-mpeg4-multisl-04, 2002
[48] Curet, et al. RTP Payload Format for MPEG-4 FlexMultip lexed Streams. draft-curet-avt-rtp-mpeg4-flexmux-03, 2002
[49] 郝智泉，吕汉兴，程臻．基于局域网的视频图像传输与监视系统．计算机应用研究，2003(6)：61-63
[50] 沈进棋，阮锋，诸静．基于Web的视频图像的实时传输．计算机工程，2005(1)：187-188
[51] 赵进，叶梧，冯穗力．基于RTP协议族的流媒体系统设计和实现．计算机工程，2005(1)：195-197
[52] http://research.edm.uhasselt.be/～jori/page/index.php?n=CS.Jrtplib
[53] 陆其明．DirectShow开发指南．北京：清华大学出版社，2003
[2] 林福宗．多媒体技术基础．北京：清华大学出版社，2000
[3] D. Wu, Y. T. Hou, Y. Q. Zhang. Streaming video over the Internet: approaches and directions. IEEE Trans on Circuits and Systems For Video Technology, 2001, 11(1): 1-20
[4] 詹慧静．MPEG-4编码特性剖析及应用研究．武汉理工大学学报，2005，(6)：102-105
[5] 薛文通，宋建社，袁礼海．图像压缩技术的现状与发展．计算机工程与应用，2003，39(2)：65-67
[6] 钟玉琢，王琪，贺玉文．基于对象的多媒体数据压缩编码国际标准MPEG-4及校验模型．北京：科学出版社，2000
[7] ISO/IEC JTC1/SC29/WG11 Document N2501. Information Technology-Generic Coding of Audio-Visual Objects, Part 2: Systems. ISO/IEC 14496-1,Final Draft International Standard, Nov, 1998
[8] ISO/IEC JTC1/SC29/WG11 Document N2501. Information Technology-Generic Coding of Audio-Visual Objects, Part 2: Visual. ISO/IEC 14496-2,Final Draft International Standard, Nov, 1998
[9] 李太君，吴泽晖．流媒体传输协议及其应用开发．计算机工程与应用，2004，40(3)：138-141．
[10] RTP: A Transport Protocol for Rea-Time Applications. RFC 1889,1996.
[11] Schulzrinne H , Casner S , Frederick R , et al. RTP : A Transport Protocol for Real-Time Applications [EB/OL]. RFC3550,2003
[12] RTP Payload Format for AC-3 Audio. RFC 4184,2005
[13] RTP Payload Format for H.264 Video. RFC 3984,2005
[14] RTP Payload Format for Transport of MPEG-4 Elementary Streams. RFC 3640, 2003
[15] RTP Payload Format for MPEG-4 Audio/Visual Streams. RFC3016,2000
[16] 董振亚，张拥军，彭宇行．基于RTP的MPEG-4视频传输．计算机应用研究，2003(7)；52-55
[17] Dapeng Wu, Yiwei Thomas Hou. Transporting Real-Time Video overtheInternet: Challenges and Approaches. PROCEEDINGS OF THE IEEE, December 2000, 88(12): 1855-1874,
[18] Cai N, Chiu D. Transport of MPEG-2 Video in Routed IP Networks: Effects of Network Congestion on Transport Stream Errors. France IDMS'99 Conf, October 1999
[19] Schulzrinne H. RTP Profile for Audio and Video Conferences with Minimal Control. RFC 1890,1996
[20] Hoffman D, Femando G. RTP Payload Format for MPEG-1/MPEG-2 Video. RFC2250,1998
[21] ISO/IEC JTC 1/SC29/WG11 Document N2552. MPEG-4 Video Verification Model Version 12.1.Dec 1998
[22] ISO/IEC JTC 1/SC29/WG11 Document N3056. Information Technology-Coding of Audio- Visual Objects, Part 2: Visual Amendment 1:Visual extensions. ISO/IEC 14496-2, 1999/Amd. 1, 2000(E), Jan 2000
[23] CHENGI, BASUA. QoS based video delivery with foveation and bandwidth monitoring. Pattern Recognition Letters, 2003, 24 (15): 2675-2686.
[24] WIEBEK, BASUA. Modelling ecologically specialized biological visual systems . Pattern Recognition, 1997, 30 (1): 1687-1703.
[25] ISO/IEC 14496-6. Coding of audio-visual objects-Part 6:Delivery Multimedia Integration Framework (DMIF)
[26] Vetro A, Sun H, Wang Y. MPEG-4 rate control for multiple video objects. IEEE Trans, Circuits Syst, Video Technol, 1999, 9(1): 186-199.
[27] Ronda J I, Eckert M, Jaureguizar F, et al. Rate control and bit allocation for MPEG-4. IEEE Trans, Circuits Syst, Video Technol, 1999, 9(8): 1243-1258.
[28] Wu D, Hou Y T, Zhu W, et al. On end-to-end architecture for transporting MPEG-4 video over the internet. IEEE Trans, Circuits Syst, Video Technol, 2000, 10(6): 923-941.
[29] 宋刚，杨显富．实时流媒体传输及其协议．成都大学学报(自然科学版)，2005(3)
[30] 钟玉琢，向哲，沈洪．流媒体和视频服务器．北京：清华大学出版社，2003．
[31] Beau Williamson．Developing IP Multicast Networks，顾金星译．北京：电子工业出版社，2000
[32] 鲁士文．多媒体网络技术与应用．北京：清华大学出版社，2002
[33] Kenneth D Reed．TCP／IP基础．北京：电子工业出版社，2002．
[34] Henning Schulzrinne. RTP: About RTP and the Audio-Video Transport Working Group. http://www.cs.columbia.edu/～hgs/rtp
[35] Colin Perkinsl. RTP: Audio and Video for the Internet. New York: Addison Wesley, 2003
[36] 余兆明，李晓飞，陈来春．MPEG标准及其应用．北京：北京邮电大学出版社，2002
[37] Rao K R，Zoran S B，Dragorad A M1．多媒体通信系统技术、标准及网络(影印版)．北京：清华大学出版社，2003
[38] Rosenberg J, Schulzrinne H. Sampling of the Group Membership in RTP . RFC 2762, 2000
[39] 邱小燕，吴产乐，叶刚等．RTP协议中RTCP传输间隔算法．武汉大学学报(理学版)，2005(2)，74-76
[40] Rosenberg J, Schulzrinne H. Timer Reconsideration for Enhanced RTP Scalability[A]. S-eventeenth Annual Joint Conference of the IEEE Comp uter and Communicat ions Societies, 1998, 1,233-241.
[41] 黄家传，王福豹，段渭军．MPEG-4的RTP封装技术及其应用．计算机应用研究，2005(8)：158-160
[42] 许先斌等．运用RTP协议实时传输MPEG-4流．计算机工程与设计，2003(2)：57-59
[43] 董振亚，张拥军，彭宇行．基于RTP的MPEG-4视频传输．计算机应用研究，2003，20(7)：52-55
[44] Basso A, Varakliotis S., Transport of MPEG24 over IP /RTP. 2000 IEEE International Conference, 2000, 1067-1070.
[45] RTP Payload Format for Transport of MPEG-4 Elementary Steams. RFC3640, 2003
[46] Van Der Meer, et al Transport of MPEG-4 Elementary Steams. draft-avt-mpeg4-simple-05, 2002
[47] Basso, et al. RTP Payload Format for MPEG-4 Streams. Draft-ietf-avt-mpeg4-multisl-04, 2002
[48] Curet, et al. RTP Payload Format for MPEG-4 FlexMultip lexed Streams. draft-curet-avt-rtp-mpeg4-flexmux-03, 2002
[49] 郝智泉，吕汉兴，程臻．基于局域网的视频图像传输与监视系统．计算机应用研究，2003(6)：61-63
[50] 沈进棋，阮锋，诸静．基于Web的视频图像的实时传输．计算机工程，2005(1)：187-188
[51] 赵进，叶梧，冯穗力．基于RTP协议族的流媒体系统设计和实现．计算机工程，2005(1)：195-197
[52] http://research.edm.uhasselt.be/～jori/page/index.php?n=CS.Jrtplib
[53] 陆其明．DirectShow开发指南．北京：清华大学出版社，2003