3D流媒体系统的设计与实现
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着显示技术、信号处理技术和电子电路技术的发展,如今观看3D视频对于普通人来说已经变得非常容易。3D视频内容越来越多,消费者对于3D的兴趣也与日俱增。支持3D节目的设备出现了全球性的爆发式增长。但是目前很多关键问题还没有解决。例如多视角的立体视频数据量成倍增加,与有限的传输带宽相互矛盾;立体视频源数量有限,通过广播和因特网等渠道能观看的立体视频不能满足观看者需求。
     针对以上问题,本文设计并实现了一个完整的3D流媒体播控系统。本系统采用上下拼接式的帧兼容格式,无缝兼容传统的2D视频系统。因此解决了多视角大数据量与信道带宽的矛盾。同时系统可以实现用户将已有视频进行在线转码,转换为立体视频,从而增加了可观看的立体视频的数量。本文根据系统的特点,设计了一个立体视频播放器,可以实现在线点播功能。播放器可以根据需要,播放红蓝模式和偏振式模式的立体视频。
     本系统以网页/服务器的形式实现。用户可以通过网页访问服务器,提交转码需求,将视频转换为3D立体视频后观看。转码的视频源可以为传统2D视频,通过2D转3D技术实现转码;也可以是3D蓝光光盘中的视频文件,通过MVC解码技术实现转码。用户将待转码视频上传至指定FTP,并向系统发出转码请求。转码后系统自动将转换后的3D视频上传至指定FTP。用户可以从FTP下载视频观看,也可以使用本文中所设计的立体视频播放器在线观看。
     本系统后台采用服务器集群实现,能够高效地处理用户请求。系统具有友好的人机交互界面和良好的视频观看效果。
With the development of display technology, signal processing technology and electronic circuit technology, now watching3D video has become very popular. There are more and more3D video content, and consumer's interest in3D isincreasing. Devices that support3Dhave seen worldwide growth. But many of the key issues have not been resolved. Such as the multipled multi-view data conflicts with transmission bandwidth;limited stereo video sourcecan notsatisfy the viewer.
     To solve these problems, we designed a complete3D streaming media playback and control system using frame compatible format, which was seamless compatible with traditional2D video system. Thisdecreased the amount of data. While the system ccouldrealize transcoding vieo to3D format online, thereby increasing the number of viewable stereoscopic video. According to the characteristics of the system, we designed a stereoscopic video player, by which users could watch3D video online. The player couldshow video in both anaglyphmode and polarization mode.
     The system is a B/S system. Users can submit transcoding command through the webpage, and watch the3D video. The transcoded video canbe a2D video or video from Blu-ray Disc. Users can download the video from the FTP aftertranscoding or watch it online.
     The system can handle users' command efficiently using server cluster technology and has a friendly user interface and a high image quality.
引文
[1]P.Surman.Thehistory and development of viable domestic 3-dimensional video displays[J].Three-Dimensional Television:Capture,Transmissionand Display,23(3), 2007:24-29.
    [2]Video and Requirements Group.Applications and requirements on 3D video coding[J]. Proceedings of ICME,49(6),2010:36-49.
    [3]E.Reinhard,GWard,S.Pattanaik.High Dynamic Range Imaging:Acquisition,Disp-lay,and Image-Based Lighting[J].Morgan Kaufmann,2005.
    [4]成于庆,姜秀华.立体电视视频质量影响因素分析[J].电视技术,2011.
    [5]Oliver Schreer,Christoph Fehn,Nicole Atzpadin.A flexible 3D TV system for different multi-baseline geometries[J].IEEE ICME,2006.
    [6]李杰.广播电台音频节目制作的现状及发展方向.见中国新闻技术工作者联合会五届二次理事会暨学术年会论文集(上篇),北京,2010:100-104.
    [7]Smolic,K.Muller,P.Merkle.3D video and free viewpoint video-technologies, applications and MPEG standards[J]. Proceedings of ICME,49(6),2006:520-526.
    [8]Zicong Mai,Colin Doutre,Panos Nasiopolos.Subjective Evaluation of Tone-mapping Method on 3D Image[J].the Natural Sciences and Engineering Research Council of Canada,2009.
    [9]Mobile 3DTV.Novel Stereo-Video Quality Metric.http://sp.cs.tut.fi/mobile3dtv/ stereo-video/,2010.
    [10]P.Merkle,H.Brust.Adaptation and optimization of coding algorithms for mobile 3DTV[J].Mobile3DTV Tech,2008.
    [11]Anthony Vetro.3D-TV Content Storage and Transmission[J].IEEE Transactions on Broadcasting,57(2),2011:384-394.
    [12]Ka-Man Wong,Lai-Man Po,Kwok-Wai Cheung.Stretching,Compression and Shearing Disparity Compensated Prediction Techniques for Stereo and Multiview Video Coding[J].ICASSP,56(7),2011:260-271.
    [13]Kwan-Jung Oh,Anthony Vetro,Yo-Sung Ho.Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems[J].IEEE Transaction on Circuits and System for Video Technology,39(1),2010:335-339.
    [14]Hewage,C.T.E.R.Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video[J].Signal Processing,16(3),2009:32-36.
    [15]Zhou Wang,Ligang Lu,Alan C.Bovik.Video Quality Assessment Based on Structural Distortion Measuremen[J].Signal Processing:Image Communication,19(1), 2004:19-25.
    [16]Laboratory for Image and Video Engineering at Texas.Image and video Quality Assessment at LIVE.http://live.ece.utexas.edu/research/quality/,2012.
    [17]顾锋.立体视频网络传输控制与损伤研究[D].上海交通大学,2012.
    [18]Hamid Rahim Sheikh,Member.An Information Fidelity Criterion for Image Quality Assessment Using Natural Scene Statistics[J].IEEE Transacion on Image Processing,14(12),2005:19-28.
    [19]L.Zhang,W.J.Tarn.Stereoscopic image generation based on depth images for 3D TV[J].IEEE Transactions on Broadcasting,15(3),2005:552-560.
    [20]J.You,L.Xing,A.Perkis.Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis.in International workshop on video processing and quality metricsfor consumer electronics(VPQM), Scottsdale,AZ,USA,2010.
    [21]东野升云.多尺度分析与相似度的立体视频人类视觉评价模型的研究[D].吉林大学,2011.
    [22]MSU Graphics and Media Lab.Converting video to high-resolution photo. http://graphics.cs.msu.ru/en/science/research/videoprocessing/video2photo,20 12.
    [23]罗四维.视觉感知系统信息处理理论[M].电子工业出版社,2006.
    [24]H.Hong.B.Determination of luminance distribution of autostereoscopic 3D displays through calculation of angularprofile[J].Soc.Inf.Display,18(6),2010:300-310.
    [25]刘涛.眼底OCT图像降噪及边缘检测算法研究[D].清华大学,2010.
    [26]A.Boev,D.Hollosi,A.Gotchev.B.Classification and simulation of stereoscopic artifacts inmobile 3DTV content[J].Proc.SPIE,Stereoscopic Disp.Appl,7237(1), 2009:1-12.
    [27]唐俊林.多视点立体视频采集与发送系统的设计与实现[D].天津大学,2012.
    [28]K.Muller,A.Smolic,K.Dix.View synthesis for advanced 3D video systems[J], EURASIPJ.ImageVideo Process,Special Issue on 3D Image Video Process, 2008:11-12.
    [29]Video and Requirements Group.Problem statement for scalable resolution enhan-cement of frame-compatible stereoscopic 3D video[J].Geneva,Switzerland,ISO/IEC JTC1/SC29/WG11 Doc.N11526,2010.
    [30]胡海峰,熊银根.三维机器视觉中摄像机内外方位元素的确定[J].中山大学学报:自然科学版,2002,41(6):22-25.
    [31]A. Vetro,S.Yea,A.Smolic.Towards a 3D video format forauto-stereoscopic display. In Proc.SPIE Conf.AppLDigital ImageProcess.XXXI,San Diego,CA,2008.
    [32]T.Chen,Y.Kashiwagi.Subjective picture quality evaluation of MVC stereo high profile for full-resolution stereoscopic high-definition 3D video applications[J]. Signal Image Process,56(3),2010:62-69.
    [33]A.Vetro,T.Wiegand,GJ.Sullivan.Overview of the stereo and multiview video coding extensions of the H.264/AVC standard[J]. Signal Image Process,81(7), 2011:41-49.
    [34]严恺.多视角立体视频编解码的关键技术研究[D].上海交通大学,2010.
    [35]ITU-T and ISO/IEC JTC 1.Advanced video coding for genericaudiovisual services[J]. ITU-T Recommendation H.264 and ISO/IEC14496-10(MPEG-4 AVC),2010.
    [36]刘庚生.多视点立体视频的传输与差错控制[D].天津大学,2010.
    [37]Graphics and Media Lab.Video quality increasing. http://graphics.cs. msu.ru/en/science/research/videoqualityincreasing,2012.
    [38]Shimizu S,KitaharaM,Kimata.View scalable multiview video coding using 3-D warping with depth map[J].IEEE Transactions on Circuits and Systems for Video Technology,74(3),2007:20-26.
    [39]Mckee S.P,Verghese P,Farell B.Sensitivity depends on stereo matching[J].Journal of Vision,2006.
    [40]Gary J Sullivan,Jens-Rainer Ohm,Antonio Ortega.Future of video coding and transmission[J].IEEE Signal Processing Magazine,16(1),2006:10-19.
    [41]HDMI Licensing,LLC.High definition multimediainterface.Specification version 1.4a,2009.
    [42]Setton E,Baccichet P,Girod B.Peer-to-peer live multicast:A video perspective[J].Proceedings of Tricomm,2008.
    [43]E.Kurutepe,T.Sikora.Feasibility of Multi-View Video Streaming Over P2P Networks[J].3DTV conference,60(9),2008:586-597.
    [44]Yao Chunlian,LiWei,Meng Qinlei. Embedded multi-channel video encoder based on DSP[J]. Fifth IEEE International symposium on Embedded Computing, 30(8),2008:964-980.
    [45]C.Wu,B.C.Li,Z.P.Li.Dynamic Bandwidth Auctions in Multi-overlay P2P Streaming with Network Coding[J].IEEE Transactions on Parallel and Distributed Systems,11(3),2008:25-32.
    [46]Jongryool Kim,Kiho Choi,Hyunyong Lee.Multi-View 3D Video Transport Using Application Layer Multicast with View Switching Delay Constraints[J].3DTV Conference,2007.
    [47]Blu-ray Disc Association.White Paper Blu-ray Disc Rewritable Format.Audio Visual Application Format Specification for BD RE Version 2.1,2008.
    [48]Blu-ray Disc Association,White Paper Blu-ray Disc Rewritable Format,Audio Visual Application Format Specifications for BD-ROM Version 2.4,2010.
    [49]M. Wang,L. Xu,B. Ramamurthy.A flexible divide-and-conquer protocol for multi-view peer-to-peer live streaming[J].IEEE P2P International Conference on Peer-to-Peer Computing,2009.
    [50]侯春萍,杨蕾,宋晓炜.立体电视技术综述[J].信号处理,2007.
    [51]季茂胜.三维视频深度信息压缩技术研究[D].中国科学技术大学学报,2010.
    [52]余宗焕.新颖的彩色电视机[J].中国科学技术大学学报,2004.
    [53]C.Fehn,K.Hopf,B.Quante.Key technologies for an advanced 3D-TV System[J]. Proceedings of SPIE Three-Dimensional TV.3(3)2004:530-541.
    [54]Quality evaluation of color plus depth map-based stereoscopic video[J],IEEE Jouurnal of selected topocs in signal processing,3(2),2009:12-19.
    [55]A.M.Tourapis,P.Pahalawatta,A.Leontaris.Frame compatible system for 3D delivery[J].Geneva,Switzerland,ISO/IEC JTC1/SC29/WG11 Doc.M17925,2010.
    [56]P.Merkle,Y.Morvan,A.Smolic.The effects of multiview depth video compression onmultiview rendering[J].Signal Process.Image Commun,24(1),2009:73-88.
    [57]黄晓军,王梁昊.2D视频转换3D视频技术概览[J].影视制作,2011.
    [58]K.Muller,P.Merkle,T.Wiegand.3D video representation using depth maps[J]. Proc.IEEE,2011.
    [59]Blu-ray Disc Association.System Description:Blu-ray Disc Read-Only Format Part3.Audio Visual Basic Specifications,2009.
    [60]VideoLAN. How To Write a Module.official VLC media player Documentation,2012.
    [61]W.L.IJzerman,S.T.deZwart,T.Dekker.B.Design of 2D/3D switchable displays [J].Soc.Inf.Display,36(1),2005:98-101.
    [62]盛骁杰.数字视频处理与管理的若干问题研究[D].上海交通大学,2009.
    [63]邵丹,韩家伟.YUV与RGB之间的转换[J].长春大学学报,2004.
    [64]贺鹏.数字化远程视频监控关键技术分析[J].甘肃科技,2010.
    [65]J.D.Owens.Sreaming architectures and technology trends[J].GPU Gems,2005 457-470.
    [66]LI Juan,CHEN Bin.Application of streaming media technology for modern education[J].IEEE conference on IT in Medical and Education,89(3),2009:52-60.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700