基于内容的足球视频自适应传输策略与优化算法研究
|
摘要
近年来，随着多媒体技术和网络技术的迅猛发展，视频数据的生成、处理和获取的便利性日益增加，更多的用户选择使用无线网络和手持终端访问各种多媒体内容。当前的媒体服务面临着网络形式的异构性、终端设备的多样性以及用户偏好的复杂性等使用环境的制约，使得统一的媒体访问技术成为迫切需要。基于内容自适应视频传输充分考虑原始视频的内容特性，根据语义特征和用户需求确定视频内容的重要性级别，选择主观质量优化的自适应策略处理被传输视频内容以适应网络环境和访问终端，使重要的视频内容获得较高的回放质量。基于内容的自适应视频传输已成为近年来统一媒体访问技术的研究热点，需要解决语义内容描述与分级、自适应传输决策模型、自适应操作方法及质量评估等关键问题。针对基于内容的自适应视频传输策略和优化算法等主要问题，以足球视频为研究对象进行了深入研究。
针对视频自适应传输环境中用户偏好内容的主观质量优化问题，提出一种基于语义内容的视频自适应传输架构。在此架构下，定义了语义内容的时域和空域描述方法，根据用户偏好交互性地确定内容的重要性级别，将约束条件下不同级别语义内容的自适应传输决策定义为时-空域内的多目标效用优化模型，将自适应操作方法定义为时-空域内对不同粒度语义单元的选择或丢弃，使用客观质量和主观质量相结合的方法评价自适应操作效用。
根据视频内容的时-空句法结构和自适应目标，建立了基于语义内容的自适应传输策略的时-空优化模型。足球视频内容在时-空域内分别可以描述为严格句法结构的语义单元，基于各语义单元的自适应策略根据约束条件选择或丢弃不同粒度语义单元以最大化主观效用，基于内容的视频自适应传输策略分别在时域和空域根据不同的应用环境构建为两种不同的优化模型。其中，时域上的自适应策略被构建为基于不同粒度语义单元的多约束背包优化模型，空域上的自适应策略被构建为基于语义对象的感兴趣区域优化模型。
为了解决实时流点播服务中带宽约束自适应问题，设计并实现了一种基于语义内容自适应丢帧的实时自适应传输方法。该方法在时域上标注语义内容的重要性、镜头类别和帧类型等，基于事件、镜头和图像组等不同语义单元确定实时拥塞条件下的自适应丢帧比率，实现了根据不同粒度语义内容丢帧以解决低码率带宽可变网络环境中的视频传输质量优化问题。由于重要的语义内容传输了尽可能多的帧，主观质量评价结果表明本文的方法比传统的精彩事件自适应和运动强度丢帧方法取得了更高的用户平均满意度。
为了自适应不同终端设备的异构显示性能，设计并实现了一种基于用户感兴趣对象的足球视频重定向方法。该方法在不同类型镜头中根据用户感兴趣对象的坐标确定优化的感兴趣区域，然后将裁剪下的感兴趣内容根据终端屏幕分辨率和宽高比缩放。实验结果表明本文的方法能够提高被传输内容的视觉质量和语义质量，且感兴趣对象击中率高于固定感兴趣窗裁剪法。
基于内容的足球视频自适应传输系统还存在许多进一步的研究工作，基于用户偏好的语义内容分级方法还需在智能性学习方面进行改进，相应的自适应决策引擎和自适应引擎期待在更多的视频流传输技术中得到应用，实时的多维自适应策略和基于MPEG-21的端到端系统跨层设计也将成为今后的研究重点。
Along with the advance of multimedia technologies and network communicaitons inrecent years, as well as the increasing ease of generation, processing and access of videodata, more and more users prefer accessing diversity multimedia content with the mobileterminals and handheld devices. The current multimedia services are limited by thecomplexity of usage environments, such as the heterogeneity of network characteristics,the diversity of terminal devices and diversity user preferences, which urges thedevelopment of universal media access (UMA). Content based adaptive transmission(CBAT) of video stream utlitlizes a lot of content characteristics of original videos, to rankvideo contents with semantic features to user’s requirements, makes an optimal decisionon manipulating the transmitted video clips to adapt the constraints of heterogeneouty ofusage environments, and achieves higher quality for those important contents than othersless important. The challenge of UMA has lead to hot research and development on CBAT,which are involved in several key issues, such as semantic content description andclassification, adaptive transmission decision-taking model, adaptation engine and qualityevaluation. In order to solve the issues on content-based adaptive transmission decisionand optimal algorithm, soccer video is taken as research object to study CBAT in deepth.
For the optimization on subjective quality of user's prefered content in adaptive videotransmission, an archichecture is proposed on semantic content based on adaptive videotransmission. And then, temporal and spatial descriptions of semantic contents are defined,the importance of semantic content is ranked by user's preference interactively, amulti-objective utility optimizing model is set for adaptation decision on semanticcontents according to user’s preferences, the content based adapation is defined asselection/dropping on different granularities of sematic units in temporal-spatial domain,the perfromance of adaption is evaluated by means of objective quality and subjectivequality.
According to the syntactic structure and adaptation objective for temporal-spatialsemantic contents, an optimal model on adaptation decision based on temporal-spatialsemantic contents is proposed. Content of soccer video can be decomposed into semanticunits with strict syntactic structures in temporal-spatatial domain respectively, theadaptation decision is settled on each semantic to select/drop different ranularities of content to maxmize subjective utility under a certain constraint, content based adapationdecision is separately set as two optimal models for the different application. Among them,the temporal adaptation decision is modeled as Multidimensional Knapsack Problemsbased on different grannulaties of semantic units, and the spatatial adaptation decision ismodeled as optimization model for the semantic object based regions of interest in screen.
In order to solve the adaptation on bandwidth constraint for Internet real-timestreaming on-demand services, a real-time adaptive transmission based on frame droppingof semantic content is implemented. The important level, shot classification and frametype is ranked on temperol content, the ratio to drop frames on different semantic unitswhich includes event, shot and GoP is determined on condersideration of networkcongestion status, the optimal quality of transmitted video is solved in low and variable bitrate network by frames dropping on different granularities of semantic contents. For theimportant content is retained to delivery, the user's overall satisfaction is improved mostthan other traditional means such as highlight or motion activity based frme dropping,which is indicated by the subjective evaluations.
In order to solve the adaptation on heterogeneous display performance for diversityterminal equipments, a video retargeting method based on user interested object for soccervideo is implemented. Optimal region of interest in different types of shots is determinedon the coordinates of user interested object, and then content in the region of interest iscropped and scaled to terminal's screen as its resolution and aspect ratio. Not onlytransmits adaptive video content under the limitation on different resolutions and aspectratios of heterogeneous terminals, the proposed method also indicates great improvementon visual quality and semantic quality.
Many further research work are proposed to content-based adaptive video transmissionsystem of soccer video, intellectual learning to rank semantic content based on user'spreference should be improved, the corresponding adaptation decision taking engine andadaptation engine look forward to be applied in more adaptive engine Internet videostreaming technologies, taking real-time multi-dimensional adaptation decision anddesigning an end to end cross-layer application based on MPEG-21standard will also be afocus in future work.
针对视频自适应传输环境中用户偏好内容的主观质量优化问题，提出一种基于语义内容的视频自适应传输架构。在此架构下，定义了语义内容的时域和空域描述方法，根据用户偏好交互性地确定内容的重要性级别，将约束条件下不同级别语义内容的自适应传输决策定义为时-空域内的多目标效用优化模型，将自适应操作方法定义为时-空域内对不同粒度语义单元的选择或丢弃，使用客观质量和主观质量相结合的方法评价自适应操作效用。
根据视频内容的时-空句法结构和自适应目标，建立了基于语义内容的自适应传输策略的时-空优化模型。足球视频内容在时-空域内分别可以描述为严格句法结构的语义单元，基于各语义单元的自适应策略根据约束条件选择或丢弃不同粒度语义单元以最大化主观效用，基于内容的视频自适应传输策略分别在时域和空域根据不同的应用环境构建为两种不同的优化模型。其中，时域上的自适应策略被构建为基于不同粒度语义单元的多约束背包优化模型，空域上的自适应策略被构建为基于语义对象的感兴趣区域优化模型。
为了解决实时流点播服务中带宽约束自适应问题，设计并实现了一种基于语义内容自适应丢帧的实时自适应传输方法。该方法在时域上标注语义内容的重要性、镜头类别和帧类型等，基于事件、镜头和图像组等不同语义单元确定实时拥塞条件下的自适应丢帧比率，实现了根据不同粒度语义内容丢帧以解决低码率带宽可变网络环境中的视频传输质量优化问题。由于重要的语义内容传输了尽可能多的帧，主观质量评价结果表明本文的方法比传统的精彩事件自适应和运动强度丢帧方法取得了更高的用户平均满意度。
为了自适应不同终端设备的异构显示性能，设计并实现了一种基于用户感兴趣对象的足球视频重定向方法。该方法在不同类型镜头中根据用户感兴趣对象的坐标确定优化的感兴趣区域，然后将裁剪下的感兴趣内容根据终端屏幕分辨率和宽高比缩放。实验结果表明本文的方法能够提高被传输内容的视觉质量和语义质量，且感兴趣对象击中率高于固定感兴趣窗裁剪法。
基于内容的足球视频自适应传输系统还存在许多进一步的研究工作，基于用户偏好的语义内容分级方法还需在智能性学习方面进行改进，相应的自适应决策引擎和自适应引擎期待在更多的视频流传输技术中得到应用，实时的多维自适应策略和基于MPEG-21的端到端系统跨层设计也将成为今后的研究重点。
Along with the advance of multimedia technologies and network communicaitons inrecent years, as well as the increasing ease of generation, processing and access of videodata, more and more users prefer accessing diversity multimedia content with the mobileterminals and handheld devices. The current multimedia services are limited by thecomplexity of usage environments, such as the heterogeneity of network characteristics,the diversity of terminal devices and diversity user preferences, which urges thedevelopment of universal media access (UMA). Content based adaptive transmission(CBAT) of video stream utlitlizes a lot of content characteristics of original videos, to rankvideo contents with semantic features to user’s requirements, makes an optimal decisionon manipulating the transmitted video clips to adapt the constraints of heterogeneouty ofusage environments, and achieves higher quality for those important contents than othersless important. The challenge of UMA has lead to hot research and development on CBAT,which are involved in several key issues, such as semantic content description andclassification, adaptive transmission decision-taking model, adaptation engine and qualityevaluation. In order to solve the issues on content-based adaptive transmission decisionand optimal algorithm, soccer video is taken as research object to study CBAT in deepth.
For the optimization on subjective quality of user's prefered content in adaptive videotransmission, an archichecture is proposed on semantic content based on adaptive videotransmission. And then, temporal and spatial descriptions of semantic contents are defined,the importance of semantic content is ranked by user's preference interactively, amulti-objective utility optimizing model is set for adaptation decision on semanticcontents according to user’s preferences, the content based adapation is defined asselection/dropping on different granularities of sematic units in temporal-spatial domain,the perfromance of adaption is evaluated by means of objective quality and subjectivequality.
According to the syntactic structure and adaptation objective for temporal-spatialsemantic contents, an optimal model on adaptation decision based on temporal-spatialsemantic contents is proposed. Content of soccer video can be decomposed into semanticunits with strict syntactic structures in temporal-spatatial domain respectively, theadaptation decision is settled on each semantic to select/drop different ranularities of content to maxmize subjective utility under a certain constraint, content based adapationdecision is separately set as two optimal models for the different application. Among them,the temporal adaptation decision is modeled as Multidimensional Knapsack Problemsbased on different grannulaties of semantic units, and the spatatial adaptation decision ismodeled as optimization model for the semantic object based regions of interest in screen.
In order to solve the adaptation on bandwidth constraint for Internet real-timestreaming on-demand services, a real-time adaptive transmission based on frame droppingof semantic content is implemented. The important level, shot classification and frametype is ranked on temperol content, the ratio to drop frames on different semantic unitswhich includes event, shot and GoP is determined on condersideration of networkcongestion status, the optimal quality of transmitted video is solved in low and variable bitrate network by frames dropping on different granularities of semantic contents. For theimportant content is retained to delivery, the user's overall satisfaction is improved mostthan other traditional means such as highlight or motion activity based frme dropping,which is indicated by the subjective evaluations.
In order to solve the adaptation on heterogeneous display performance for diversityterminal equipments, a video retargeting method based on user interested object for soccervideo is implemented. Optimal region of interest in different types of shots is determinedon the coordinates of user interested object, and then content in the region of interest iscropped and scaled to terminal's screen as its resolution and aspect ratio. Not onlytransmits adaptive video content under the limitation on different resolutions and aspectratios of heterogeneous terminals, the proposed method also indicates great improvementon visual quality and semantic quality.
Many further research work are proposed to content-based adaptive video transmissionsystem of soccer video, intellectual learning to rank semantic content based on user'spreference should be improved, the corresponding adaptation decision taking engine andadaptation engine look forward to be applied in more adaptive engine Internet videostreaming technologies, taking real-time multi-dimensional adaptation decision anddesigning an end to end cross-layer application based on MPEG-21standard will also be afocus in future work.
引文
[1] Mohan R, Smith J, Li C S. Adapting Multimedia Internet Content for UniversalAccess. IEEE Transactions on Multimedia,1999,1(1):104-114
[2] Shih Fu Chang, Vetro A. Video adaptation: Concepts, technologies and openissues, Proceedings of the IEEE,2005,93(1):148-158
[3] Chang Wen Chen, Houqiang Li. Video Streaming to Mobile Handheld Devices:Challenges in Decoding, Adaptation, and Browsing. N. Sebe, Y. Liu, and Y.Zhuang (Eds.): MCAM2007, LNCS4577,2007,42-51
[4] Rejaie, R. Handley, M. Estrin, D.. RAP: An end-to-end rate-based congestioncontrol mechanism for realtime streams in the Internet, INFOCOM '99. New York:IEEE,1999,3(3):1337-1345
[5] Margaritis Margaritidis, George C. Polyzos. Adaptation Techniques forUbiquitous Internet Multimedia. Wireless Communications and MobileComputing,2001,1(2):141-163
[6] Pereira F, Burnett I. Universal Multimedia Experiences for Tomorrow. IEEESignal Processing Magazine,2003,20(2):63-73
[7] Bernhard Reiterer, Cyril Concolato, Janine Lachner et al. User-centric universalmultimedia access in home networks. Visual Computer,2008,24:837-845
[8] Gao Wen, Huang Qingming, Jiang Shuqiang, Zang Peng. Sports videosummarization and adaptation for application in mobile communication. Journalof Zhejiang University SCIENCE A,2006,5(7):819-829
[9]黄天云.数字媒体适配过程的一般框架、模型及应用研究.计算机学报,2008,31(7):1185-1199
[10] T. C. Thang, Y. J. Jung, Y. M. Ro. Modality conversion for QoS management inuniversal multimedia access, IEEE Proceedings. Part K, Vision, Image, andSignal Processing.2005,152(3):374-384
[11] Michael Zufferey, Harald Kosch. Semantic Adaptation of Multimedia Content.48th International Symposium ELMAR-2006, Zadar, Croatia.2006,319-322
[12] Joseph Thomas-Kerr, Ian Burnett, Christian Ritz. Intelligent Multimedia Delivery?It’s a question of semantics,2007International Symposium on Communicationsand Information Technologies,2007,474-478
[13] Marco Bertini, Rita Cucchiara, Alberto Del Bimbo, Andrea Prati. SemanticAdaptation of Sport Videos with User-Centred Performance Analysis. IEEETransactions on Multimedia,2006,8(3):433-443
[14] Nuno Matos, Fernando Pereira. Automatic creation and evaluation of MPEG-7compliant summary descriptions for generic audiovisual content, SignalProcessing: Image Communication,2008,23:581-598
[15] Luis Herranz, Jose′M. Mart′nez. An integrated approach to summarization andadaptation using H.264/MPEG-4SVC. Signal Processing: Image Communication.2009,(2):1-11
[16] Yong Wei, Suchendra M. Bhandarkar, Kang Li. Client-centered multimediacontent adaptation. Transactions on Multimedia Computing, Communications,and Applications,2009,5(3):1-26
[17] Shenghong Hu, Personalized Content Adaptation Using Multimodal Highlights ofSoccer Video. The2010Pacific-Rim Conference on Multimedia, Shanghai,2010,537-548
[18] Shih Fu Chang, Zhong Di, Kumar R. Real-time content-based adaptive streamingof sports videos, Content-Based Access of Image and Video Libraries, IEEEWorkshop,2001,139-146
[19] Pereira F, Vetro A, Sikora T. Multimedia Retrieval and Delivery: EssentialMetadata Challenges and Standards. Proceedings of the IEEE,2008,96(4):721-744
[20] Vetro A, Timmerer C. Digital Item Adaptation: Overview of Standardization andResearch Activities. IEEE Transactions on Multimedia,2005,3(7):418-426
[21] ISO/IEC IS21000-7:2004. Information technology–Multimedia framework(MPEG-21)–Part7: Digital Item Adaptation,2004
[22] Burnett, R. Van de Walle, K. Hill, J. Bormans et al. MPEG-21: Goals andAchievements. IEEE Multimedia,2003,10(4):60-70
[23] ISO/IEC. Information technology-multimedia content description interface-Part5, multimedia description schemes (1593825). MPEG MDS Group,2001
[24]胡胜红,于俊清.视频适配的关键技术与研究进展,第19届全国多媒体学术会议（NCMT2010）,洛阳,2010,84-90
[25] Debargha Mukherjee, Eric Delfosse, Jae-Gon Kim, Yong Wang. OptimalAdaptation Decision-Taking for Terminal and Network Quality of Service. IEEETransactions on Multimedia,2005,7(3):454-462
[26] Fernando López, José M. Martínez, Víctor Valdés. Multimedia ContentAdaptation within the CAIN Framework Via Constraints Satisfaction andOptimization, Adaptive Multimedia Retrieval, Berlin: Springer,2006,149-163
[27] Anastasis A. Sofokleous, Marios C. Angelides. Dynamic Selection of a VideoContent Adaptation Strategy from a Pareto Front. The Computer Journal,2009,52(4):413-428
[28] Martin Prangl, Tibor Szkaliczki, Hermann Hellwagner. A Framework forUtility-Based Multimedia Adaptation. IEEE Transactions on Circuits and Systemsfor Video Technology,2007,6(17):719-728
[29] Zhu Li, Fan Zhai, Aggelos K. Katsaggelos. Joint Video Summarization andTransmission Adaptation for Energy-Efficient Wireless Video Streaming.EURASIP Journal on Advances in Signal Processing,2008,1-11
[30] Truong Cong Thang, Jung Won Kang, Jeong-Ju Yoo et al. Optimal MultilayerAdaptation of SVC Video over Heterogeneous Environments, Proceedings of the2007international conference on Wireless communications and mobilecomputing,2007,308-313
[31] Jae-Gon Kim, Yong Wang, Shih-Fu Chang, Hyung-Myung Kim. An OptimalFramework of Video Adaptation and Its Application to Rate AdaptationTranscoding. ETRI Journal,2005,27(4):341-354
[32] Yong Wang, Jae-Gon Kim, Shi-Fu Chang, Hyung-Myung Kim. Utility-BasedVideo Adaptation for Universal Multimedia Access (UMA) and Content-BasedUtility Function Prediction for Real-Time Video Transcoding. IEEE Transactionson Multimedia2007,9(2):213-220
[33] Chao Liang, Yu Jiang, Jian Cheng, Changsheng Xu, Xiaowei Luo, JinqiaoWang,Yu Fu, Hanqing Lu, Jian Ma. Personalized Sports Video Customization forMobile Devices, MMM2010, Berlin: Springer,2010, LNCS5916:614-625
[34] Fernando Pereira. A triple user characterization model for video adaptation andquality of experience evaluation, IEEE7th Workshop on multimedia SignalProcessing,2005,1-4
[35] Raymond R. Hill, Chaitr S. Hiremath. Generation Methods for MultidimensionalKnapsack Problems and their Implications. Systemics, Cybernetics andInformatics.2007,5(5):59-64
[36] Ming-Wen Tong, Zong-Kai Yang and Qing-TangLiu, A novel model of adaptationdecision-taking engine in multimedia adaptation. Journal of Network andComputer Applications,2010,33:43-49
[37] Jannach D, Leopold K, Timmerer C, Hellwagner H. A knowledge-basedframework for multimedia adaptation. Applied Intelligence,2006,2:109-125
[38] M. De Geyter, P. Soetens. A Planning Approach to Media Adaptation within theSemantic Web, Proceedings of the11th International Conference on DistributedMultimedia Systems, Banff, Canada,2005,129–134
[39] Fernando López, Dietmar Jannach, José M. Martínez et al. MultimediaAdaptation Decisions Modeled as Non-Deterministic Operations, NinthInternational Workshop on Image Analysis for Multimedia Interactive Services,2008,46-49
[40] Yi-Wen Chen, Hua-Tsung Chen, Kuan-Hung Chou, Suh-Yin Lee. Content-AwareVideo Adaptation under Low-Bitrate Constraint. EURASIP Journal on Advancesin Signal Processing,2007(2007):1-17
[41] Muntean G.-M., Ghinea G., Sheehan T.N. Region of Interest-Based AdaptiveMultimedia Streaming Scheme. IEEE Transactions on Broadcasting,2008,54(2):296-303
[42] Asiya Khan, Lingfen Sun, Emmanuel Ifeachor. Content-Based Video QualityPrediction for MPEG-4Video Streaming over Wireless Networks. Journal ofMultimedia,2009,4(4):228-239
[43] Qiu Shen, Yi Guo, Houqiang Li, Feng Wu. Intermediate Description for MultipleVideo Adaptation. IEEE Transactions on Consumer Electronics,2009,55(2):919-926
[44] Truong Cong Thang, Jae-Gon Kim, Jung Won Kang, Jeong-Ju Yoo. SVCadaptation: Standard tools and supporting methods. Signal Processing: ImageCommunication,2009,24:214-228
[45] Steiger, O., Fontan, M.S., Marimon-Sanjuan et al. Personalized ContentPreparation and Delivery for Universal Multimedia Access, Technical reports atEPFL, No.2005.010,2005
[46] Liang Shi, Jinqiao Wang, Lingyu Duan, and Hanqing Lu, Consumer videoretargeting: context assisted spatial-temporal grid optimization, Proceedings ofthe seventeen ACM international conference on Multimedia, Beijing, China,2009,301-310
[47] Jesús Bescós, José M. Martínez, Luis Herranz, Fabricio Tiburzi. Content-drivenadaptation of on-line video. Signal Processing: Image Communication.2007,22:651-668
[48]于俊清,刘冲,何云峰,胡胜红.利用运动强度自适应传输视频内容.计算机辅助设计与图形学学报,2009,21(6):847-852
[49] Min Xu, Jiaming Li, Liang-Tien Chia et al. Event on Demand with MPEG-21Video Adaptation System, Proceedings of the14th annual ACM internationalconference on Multimedia, California, USA.2006,921-930
[50] C. Timmerer, S. Devillers, M. Ransburg, editors. ISO/IEC21000-7:2004/FPDAmd2: Dynamic and Distributed Adaptation. InternationalStandardization Organization,2006
[51] Peter Lambert, Davy De Schrijver, Davy Van Deursen et al. A Real-Time ContentAdaptation Framework for Exploiting ROI Scalability in H.264/AVC. ACIVS2006,442-453
[52] Razib Iqbal, Shervin Shirmohammadi, Chris Joslin. MPEG-21Based TemporalAdaptation of Live H.264Video. Proceedings of the Eighth IEEE InternationalSymposium on Multimedia,2006,457-464
[53] Michael Ransburg, Hubert Gressl, Hermann Hellwagner. Efficient Transformationof MPEG-21Metadata for Codec-agnostic Adaptation in Real-Time StreamingScenarios, Ninth International Workshop on Image Analysis for MultimediaInteractive Services,2008,143-146
[54]佟雨兵,胡薇薇,杨东凯,张其善.视频质量评价方法综述.计算机辅助设计与图形学学报,2006,118(15):735-741
[55] ITU-T Recommendation P.910. Subjective Video Quality Assessment Methodsfor Multimedia Applications.1999,9
[56] Christian Timmerer, Victor H. Ortega, Jose M. Gonzalez, Alberto Leon.Measuring quality of experience for MPEG-21-based cross-layer multimediacontent adaptation, IEEE/ACS International Conference on Computer Systemsand Applications,2008,969-974
[57] Gheorghita Ghinea, Johnson P. Quality of Perception: User Quality of Service inMultimedia Presentations. IEEE Transactions on Multimedia,2005,7(4):786-789
[58] Gheorghita Ghinea, Sherry Y. Chen. Measuring quality of perception indistributed multimedia: Verbalizers vs. imagers. Computers in Human Behavior.2008,24:1317-1329
[59] Cuneyt M. Taskiran, Frank Bentley. Automatic and User-Centric Approaches toVideo Summary Evaluation, SPIE Conference on Multimedia Content Access:Algorithms and Systems, Bellingham:SPIE,2007,6506:1-9
[60] T.D’Orazio, M.Leo, A review of vision-based systems for soccer video analysis,Pattern Recognition,2010,43(8):1-16
[61]童晓峰,刘青山,卢汉清.体育视频分析,计算机学报,2008,31(7):1242-1251
[62] Razib Iqbal, Shervin Shirmohammadi. DAg-stream: Distributed video adaptationfor overlay streaming to heterogeneous devices. Peer-to-Peer Networking andApplications,2009,2(3):202-216
[63] Razib Iqbal, Behnoosh Hariri, Shervin Shirmohammadi. Modeling and evaluationof overlay generation problem for peer-assisted video adaptation and streaming,NOSSDAV2008, New York, ACM,2008,87-92
[64]赵刚,移动互联网上自适应多媒体研究,武汉:华中科技大学,2005
[65] Lotfallah O A, Reisslein M, Panchanathan S.. Adaptive Video TransmissionSchemes Using MPEG-7Motion Intensity Descriptor. IEEE Transactions onCircuits and Systems for Video Technology,2006,16(8):929-946
[66] Velibor Adzic, Hari Kalva, Borko Furht. A survey of multimedia contentadaptation for mobile devices, Multimedia Tools and Applications,2011,51:379-396
[67] Khan, S., Li, K.F., Manning, E.G., Akbar, M. M.. Solving the Knapsack Problemfor Adaptive Multimedia Systems, Studia Informatica Universalis, HERMANN,France,2002,2:61-82
[68] M. Handley, S. Floyd, J. Padhye, and J. Widmer. TCP friendly rate control TFRC:protocol specification, RFC3448, Internet Engineering Task Force,2003
[69] Floyd S, Fall K. Promoting the use of end to end congestion control in theInternet, IEEE/ACM Transactions on Networking,1999,7(4):458-472
[70] Y. Hu, L.-T. Chia and D. Rajan. Region-of-interest based image resolutionadaptation for mpeg-21digital item, Proceedings of ACM Multimedia, New York,USA,2004,340-343
[71] W.-H. Cheng, C.-W. Wang, J.-L. Wu. Video Adaptation for Small Display Basedon Content Recomposition, IEEE Transactions on Circuits and Systems for VideoTechnology,17(1),2007,48-53
[72] Liang Shi, Jinqiao Wang, Lingyu Duan, Hanqing Lu. Consumer video retargeting:context assisted spatial-temporal grid optimization, Proceedings of the seventeenACM international conference on Multimedia, Beijing, China,2009,301-310.
[73]王志芳,于俊清,何云峰.利用改进的GLA算法快速检测球场区域,系统仿真学报,2006,18(10):2984-2987
[74] Ahmet Ekin, A. Murat Tekalp, Rajiv Mehrotra. Automatic Soccer Video Analysisand Summarization, IEEE Transactions on Image Processing,2003,12(7):796-807
[75] Gu Xu, Yu-Fei Ma, Hong-Jiang Zhang, Shiqiang Yang. An HMM-basedframework for video semantic analysis, IEEE Transaction on Circuits andSystems for Video Technology,2005,15(11):1422-1433.
[76] Yu-Fei Ma, Lie Lu, Hong-Jiang Zhang, Mingjing Li.. A user attention model forvideo summarization, ACM Multimedia, Juan les Pins, France,2002,533-542
[77] Hanjalic, A., Adaptive extraction of highlights from a sport video based onexcitement modeling. IEEE Transactions on Multimedia,2005,7:1114-1122
[78] Changsheng, X., Jian, C., Yi, Z., Yifan, Z., Hanqing, L.. Sports Video Analysis:Semantics Extraction, Editorial Content Creation and Adaptation. Journal ofMultimedia,2009,4:69-79
[79] Junqing Yu, Yang Tang and Zhifang Wang. Playfield and Ball Detection in SoccerVideo, Advances in Visual Computing, Springer Berlin, Heidelberg,2007,4842:387-396
[80] P. Viola, M. Jones. Rapid object detection using a boosted cascade of simplefeatures. In Proc. IEEE Conference on Computer Vision and Pattern Recognition,2001,511-518.
[81] Intel IPP-Open Source Computer Vision Library (OpenCV),http://sourceforge.net/projects/opencvlibrary/
[82] Fitzek, F., Seeling, P., Reisslein, M. Video streaming in wireless internet,Electrical Engineering and Applied Signal Processing Series, CRC press,2004
[83] Nicola Cranley, Philip Perry, Liam Murphy. Dynamic content-based adaptation ofstreamed multimedia. Journal of Network and Computer Applications,2007,30:983-1006
[84] Apple Inc. http://developer.apple.com/opensource/server/streaming/index.html
[85] NIST Internetworking Technology Group (ITG). http://snad.ncsl.nist.gov/nistnet/
[86] WinPcap4.1.1http://www.winpcap.org/
[87] D. Gao, J. Cai, P. Bao, and Z. He. MPEG-4video streaming quality evaluation inIEEE802.11e WLANs, IEEE International Conference on Image Processing,Genoa, Italy,2005, I:197-200.
[88]. D. nür and A. A. Alatan. Video adaptation for transmission channel by utilitymodeling. IEEE International Conference on Multimedia&Expo, Amsterdam,USA,2005,1400-1403
[89] Chang Wen Chen, Houqiang Li. Video Streaming to Mobile Handheld Devices:Challenges in Decoding, Adaptation, and Browsing. N. Sebe, Y. Liu, and Y.Zhuang (Eds.): MCAM2007, LNCS4577,2007,42-51
[90] Svetlana Kim, Yongik Yoon. Universal Video Adaptation Model for ContentsDelivery using Focus-Of-Choice Model, Second International Conference onFuture Generation Communication and Networking, Sanya, China,2008,46-49
[91] Stephan Kopf, Thomas Haenselmann, Johannes Kiess, Benjamin Guthier,Wolfgang Effelsberg. Algorithms for video retargeting, Multimedia Tools andApplications,2011,51(2):1-43
[92] Keewon Seo, Jaeseung Ko, Ilkoo Ahn, Changick Kim, An Intelligent DisplayScheme of Soccer Video on Mobile Devices, IEEE Transactions on Circuits andSystems for Video Technology,2007,17(10):1395-1401
[93] L. Itti, C. Koch, E. Niebur, A model of saliency-based visual attention for rapidscene analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259
[2] Shih Fu Chang, Vetro A. Video adaptation: Concepts, technologies and openissues, Proceedings of the IEEE,2005,93(1):148-158
[3] Chang Wen Chen, Houqiang Li. Video Streaming to Mobile Handheld Devices:Challenges in Decoding, Adaptation, and Browsing. N. Sebe, Y. Liu, and Y.Zhuang (Eds.): MCAM2007, LNCS4577,2007,42-51
[4] Rejaie, R. Handley, M. Estrin, D.. RAP: An end-to-end rate-based congestioncontrol mechanism for realtime streams in the Internet, INFOCOM '99. New York:IEEE,1999,3(3):1337-1345
[5] Margaritis Margaritidis, George C. Polyzos. Adaptation Techniques forUbiquitous Internet Multimedia. Wireless Communications and MobileComputing,2001,1(2):141-163
[6] Pereira F, Burnett I. Universal Multimedia Experiences for Tomorrow. IEEESignal Processing Magazine,2003,20(2):63-73
[7] Bernhard Reiterer, Cyril Concolato, Janine Lachner et al. User-centric universalmultimedia access in home networks. Visual Computer,2008,24:837-845
[8] Gao Wen, Huang Qingming, Jiang Shuqiang, Zang Peng. Sports videosummarization and adaptation for application in mobile communication. Journalof Zhejiang University SCIENCE A,2006,5(7):819-829
[9]黄天云.数字媒体适配过程的一般框架、模型及应用研究.计算机学报,2008,31(7):1185-1199
[10] T. C. Thang, Y. J. Jung, Y. M. Ro. Modality conversion for QoS management inuniversal multimedia access, IEEE Proceedings. Part K, Vision, Image, andSignal Processing.2005,152(3):374-384
[11] Michael Zufferey, Harald Kosch. Semantic Adaptation of Multimedia Content.48th International Symposium ELMAR-2006, Zadar, Croatia.2006,319-322
[12] Joseph Thomas-Kerr, Ian Burnett, Christian Ritz. Intelligent Multimedia Delivery?It’s a question of semantics,2007International Symposium on Communicationsand Information Technologies,2007,474-478
[13] Marco Bertini, Rita Cucchiara, Alberto Del Bimbo, Andrea Prati. SemanticAdaptation of Sport Videos with User-Centred Performance Analysis. IEEETransactions on Multimedia,2006,8(3):433-443
[14] Nuno Matos, Fernando Pereira. Automatic creation and evaluation of MPEG-7compliant summary descriptions for generic audiovisual content, SignalProcessing: Image Communication,2008,23:581-598
[15] Luis Herranz, Jose′M. Mart′nez. An integrated approach to summarization andadaptation using H.264/MPEG-4SVC. Signal Processing: Image Communication.2009,(2):1-11
[16] Yong Wei, Suchendra M. Bhandarkar, Kang Li. Client-centered multimediacontent adaptation. Transactions on Multimedia Computing, Communications,and Applications,2009,5(3):1-26
[17] Shenghong Hu, Personalized Content Adaptation Using Multimodal Highlights ofSoccer Video. The2010Pacific-Rim Conference on Multimedia, Shanghai,2010,537-548
[18] Shih Fu Chang, Zhong Di, Kumar R. Real-time content-based adaptive streamingof sports videos, Content-Based Access of Image and Video Libraries, IEEEWorkshop,2001,139-146
[19] Pereira F, Vetro A, Sikora T. Multimedia Retrieval and Delivery: EssentialMetadata Challenges and Standards. Proceedings of the IEEE,2008,96(4):721-744
[20] Vetro A, Timmerer C. Digital Item Adaptation: Overview of Standardization andResearch Activities. IEEE Transactions on Multimedia,2005,3(7):418-426
[21] ISO/IEC IS21000-7:2004. Information technology–Multimedia framework(MPEG-21)–Part7: Digital Item Adaptation,2004
[22] Burnett, R. Van de Walle, K. Hill, J. Bormans et al. MPEG-21: Goals andAchievements. IEEE Multimedia,2003,10(4):60-70
[23] ISO/IEC. Information technology-multimedia content description interface-Part5, multimedia description schemes (1593825). MPEG MDS Group,2001
[24]胡胜红,于俊清.视频适配的关键技术与研究进展,第19届全国多媒体学术会议（NCMT2010）,洛阳,2010,84-90
[25] Debargha Mukherjee, Eric Delfosse, Jae-Gon Kim, Yong Wang. OptimalAdaptation Decision-Taking for Terminal and Network Quality of Service. IEEETransactions on Multimedia,2005,7(3):454-462
[26] Fernando López, José M. Martínez, Víctor Valdés. Multimedia ContentAdaptation within the CAIN Framework Via Constraints Satisfaction andOptimization, Adaptive Multimedia Retrieval, Berlin: Springer,2006,149-163
[27] Anastasis A. Sofokleous, Marios C. Angelides. Dynamic Selection of a VideoContent Adaptation Strategy from a Pareto Front. The Computer Journal,2009,52(4):413-428
[28] Martin Prangl, Tibor Szkaliczki, Hermann Hellwagner. A Framework forUtility-Based Multimedia Adaptation. IEEE Transactions on Circuits and Systemsfor Video Technology,2007,6(17):719-728
[29] Zhu Li, Fan Zhai, Aggelos K. Katsaggelos. Joint Video Summarization andTransmission Adaptation for Energy-Efficient Wireless Video Streaming.EURASIP Journal on Advances in Signal Processing,2008,1-11
[30] Truong Cong Thang, Jung Won Kang, Jeong-Ju Yoo et al. Optimal MultilayerAdaptation of SVC Video over Heterogeneous Environments, Proceedings of the2007international conference on Wireless communications and mobilecomputing,2007,308-313
[31] Jae-Gon Kim, Yong Wang, Shih-Fu Chang, Hyung-Myung Kim. An OptimalFramework of Video Adaptation and Its Application to Rate AdaptationTranscoding. ETRI Journal,2005,27(4):341-354
[32] Yong Wang, Jae-Gon Kim, Shi-Fu Chang, Hyung-Myung Kim. Utility-BasedVideo Adaptation for Universal Multimedia Access (UMA) and Content-BasedUtility Function Prediction for Real-Time Video Transcoding. IEEE Transactionson Multimedia2007,9(2):213-220
[33] Chao Liang, Yu Jiang, Jian Cheng, Changsheng Xu, Xiaowei Luo, JinqiaoWang,Yu Fu, Hanqing Lu, Jian Ma. Personalized Sports Video Customization forMobile Devices, MMM2010, Berlin: Springer,2010, LNCS5916:614-625
[34] Fernando Pereira. A triple user characterization model for video adaptation andquality of experience evaluation, IEEE7th Workshop on multimedia SignalProcessing,2005,1-4
[35] Raymond R. Hill, Chaitr S. Hiremath. Generation Methods for MultidimensionalKnapsack Problems and their Implications. Systemics, Cybernetics andInformatics.2007,5(5):59-64
[36] Ming-Wen Tong, Zong-Kai Yang and Qing-TangLiu, A novel model of adaptationdecision-taking engine in multimedia adaptation. Journal of Network andComputer Applications,2010,33:43-49
[37] Jannach D, Leopold K, Timmerer C, Hellwagner H. A knowledge-basedframework for multimedia adaptation. Applied Intelligence,2006,2:109-125
[38] M. De Geyter, P. Soetens. A Planning Approach to Media Adaptation within theSemantic Web, Proceedings of the11th International Conference on DistributedMultimedia Systems, Banff, Canada,2005,129–134
[39] Fernando López, Dietmar Jannach, José M. Martínez et al. MultimediaAdaptation Decisions Modeled as Non-Deterministic Operations, NinthInternational Workshop on Image Analysis for Multimedia Interactive Services,2008,46-49
[40] Yi-Wen Chen, Hua-Tsung Chen, Kuan-Hung Chou, Suh-Yin Lee. Content-AwareVideo Adaptation under Low-Bitrate Constraint. EURASIP Journal on Advancesin Signal Processing,2007(2007):1-17
[41] Muntean G.-M., Ghinea G., Sheehan T.N. Region of Interest-Based AdaptiveMultimedia Streaming Scheme. IEEE Transactions on Broadcasting,2008,54(2):296-303
[42] Asiya Khan, Lingfen Sun, Emmanuel Ifeachor. Content-Based Video QualityPrediction for MPEG-4Video Streaming over Wireless Networks. Journal ofMultimedia,2009,4(4):228-239
[43] Qiu Shen, Yi Guo, Houqiang Li, Feng Wu. Intermediate Description for MultipleVideo Adaptation. IEEE Transactions on Consumer Electronics,2009,55(2):919-926
[44] Truong Cong Thang, Jae-Gon Kim, Jung Won Kang, Jeong-Ju Yoo. SVCadaptation: Standard tools and supporting methods. Signal Processing: ImageCommunication,2009,24:214-228
[45] Steiger, O., Fontan, M.S., Marimon-Sanjuan et al. Personalized ContentPreparation and Delivery for Universal Multimedia Access, Technical reports atEPFL, No.2005.010,2005
[46] Liang Shi, Jinqiao Wang, Lingyu Duan, and Hanqing Lu, Consumer videoretargeting: context assisted spatial-temporal grid optimization, Proceedings ofthe seventeen ACM international conference on Multimedia, Beijing, China,2009,301-310
[47] Jesús Bescós, José M. Martínez, Luis Herranz, Fabricio Tiburzi. Content-drivenadaptation of on-line video. Signal Processing: Image Communication.2007,22:651-668
[48]于俊清,刘冲,何云峰,胡胜红.利用运动强度自适应传输视频内容.计算机辅助设计与图形学学报,2009,21(6):847-852
[49] Min Xu, Jiaming Li, Liang-Tien Chia et al. Event on Demand with MPEG-21Video Adaptation System, Proceedings of the14th annual ACM internationalconference on Multimedia, California, USA.2006,921-930
[50] C. Timmerer, S. Devillers, M. Ransburg, editors. ISO/IEC21000-7:2004/FPDAmd2: Dynamic and Distributed Adaptation. InternationalStandardization Organization,2006
[51] Peter Lambert, Davy De Schrijver, Davy Van Deursen et al. A Real-Time ContentAdaptation Framework for Exploiting ROI Scalability in H.264/AVC. ACIVS2006,442-453
[52] Razib Iqbal, Shervin Shirmohammadi, Chris Joslin. MPEG-21Based TemporalAdaptation of Live H.264Video. Proceedings of the Eighth IEEE InternationalSymposium on Multimedia,2006,457-464
[53] Michael Ransburg, Hubert Gressl, Hermann Hellwagner. Efficient Transformationof MPEG-21Metadata for Codec-agnostic Adaptation in Real-Time StreamingScenarios, Ninth International Workshop on Image Analysis for MultimediaInteractive Services,2008,143-146
[54]佟雨兵,胡薇薇,杨东凯,张其善.视频质量评价方法综述.计算机辅助设计与图形学学报,2006,118(15):735-741
[55] ITU-T Recommendation P.910. Subjective Video Quality Assessment Methodsfor Multimedia Applications.1999,9
[56] Christian Timmerer, Victor H. Ortega, Jose M. Gonzalez, Alberto Leon.Measuring quality of experience for MPEG-21-based cross-layer multimediacontent adaptation, IEEE/ACS International Conference on Computer Systemsand Applications,2008,969-974
[57] Gheorghita Ghinea, Johnson P. Quality of Perception: User Quality of Service inMultimedia Presentations. IEEE Transactions on Multimedia,2005,7(4):786-789
[58] Gheorghita Ghinea, Sherry Y. Chen. Measuring quality of perception indistributed multimedia: Verbalizers vs. imagers. Computers in Human Behavior.2008,24:1317-1329
[59] Cuneyt M. Taskiran, Frank Bentley. Automatic and User-Centric Approaches toVideo Summary Evaluation, SPIE Conference on Multimedia Content Access:Algorithms and Systems, Bellingham:SPIE,2007,6506:1-9
[60] T.D’Orazio, M.Leo, A review of vision-based systems for soccer video analysis,Pattern Recognition,2010,43(8):1-16
[61]童晓峰,刘青山,卢汉清.体育视频分析,计算机学报,2008,31(7):1242-1251
[62] Razib Iqbal, Shervin Shirmohammadi. DAg-stream: Distributed video adaptationfor overlay streaming to heterogeneous devices. Peer-to-Peer Networking andApplications,2009,2(3):202-216
[63] Razib Iqbal, Behnoosh Hariri, Shervin Shirmohammadi. Modeling and evaluationof overlay generation problem for peer-assisted video adaptation and streaming,NOSSDAV2008, New York, ACM,2008,87-92
[64]赵刚,移动互联网上自适应多媒体研究,武汉:华中科技大学,2005
[65] Lotfallah O A, Reisslein M, Panchanathan S.. Adaptive Video TransmissionSchemes Using MPEG-7Motion Intensity Descriptor. IEEE Transactions onCircuits and Systems for Video Technology,2006,16(8):929-946
[66] Velibor Adzic, Hari Kalva, Borko Furht. A survey of multimedia contentadaptation for mobile devices, Multimedia Tools and Applications,2011,51:379-396
[67] Khan, S., Li, K.F., Manning, E.G., Akbar, M. M.. Solving the Knapsack Problemfor Adaptive Multimedia Systems, Studia Informatica Universalis, HERMANN,France,2002,2:61-82
[68] M. Handley, S. Floyd, J. Padhye, and J. Widmer. TCP friendly rate control TFRC:protocol specification, RFC3448, Internet Engineering Task Force,2003
[69] Floyd S, Fall K. Promoting the use of end to end congestion control in theInternet, IEEE/ACM Transactions on Networking,1999,7(4):458-472
[70] Y. Hu, L.-T. Chia and D. Rajan. Region-of-interest based image resolutionadaptation for mpeg-21digital item, Proceedings of ACM Multimedia, New York,USA,2004,340-343
[71] W.-H. Cheng, C.-W. Wang, J.-L. Wu. Video Adaptation for Small Display Basedon Content Recomposition, IEEE Transactions on Circuits and Systems for VideoTechnology,17(1),2007,48-53
[72] Liang Shi, Jinqiao Wang, Lingyu Duan, Hanqing Lu. Consumer video retargeting:context assisted spatial-temporal grid optimization, Proceedings of the seventeenACM international conference on Multimedia, Beijing, China,2009,301-310.
[73]王志芳,于俊清,何云峰.利用改进的GLA算法快速检测球场区域,系统仿真学报,2006,18(10):2984-2987
[74] Ahmet Ekin, A. Murat Tekalp, Rajiv Mehrotra. Automatic Soccer Video Analysisand Summarization, IEEE Transactions on Image Processing,2003,12(7):796-807
[75] Gu Xu, Yu-Fei Ma, Hong-Jiang Zhang, Shiqiang Yang. An HMM-basedframework for video semantic analysis, IEEE Transaction on Circuits andSystems for Video Technology,2005,15(11):1422-1433.
[76] Yu-Fei Ma, Lie Lu, Hong-Jiang Zhang, Mingjing Li.. A user attention model forvideo summarization, ACM Multimedia, Juan les Pins, France,2002,533-542
[77] Hanjalic, A., Adaptive extraction of highlights from a sport video based onexcitement modeling. IEEE Transactions on Multimedia,2005,7:1114-1122
[78] Changsheng, X., Jian, C., Yi, Z., Yifan, Z., Hanqing, L.. Sports Video Analysis:Semantics Extraction, Editorial Content Creation and Adaptation. Journal ofMultimedia,2009,4:69-79
[79] Junqing Yu, Yang Tang and Zhifang Wang. Playfield and Ball Detection in SoccerVideo, Advances in Visual Computing, Springer Berlin, Heidelberg,2007,4842:387-396
[80] P. Viola, M. Jones. Rapid object detection using a boosted cascade of simplefeatures. In Proc. IEEE Conference on Computer Vision and Pattern Recognition,2001,511-518.
[81] Intel IPP-Open Source Computer Vision Library (OpenCV),http://sourceforge.net/projects/opencvlibrary/
[82] Fitzek, F., Seeling, P., Reisslein, M. Video streaming in wireless internet,Electrical Engineering and Applied Signal Processing Series, CRC press,2004
[83] Nicola Cranley, Philip Perry, Liam Murphy. Dynamic content-based adaptation ofstreamed multimedia. Journal of Network and Computer Applications,2007,30:983-1006
[84] Apple Inc. http://developer.apple.com/opensource/server/streaming/index.html
[85] NIST Internetworking Technology Group (ITG). http://snad.ncsl.nist.gov/nistnet/
[86] WinPcap4.1.1http://www.winpcap.org/
[87] D. Gao, J. Cai, P. Bao, and Z. He. MPEG-4video streaming quality evaluation inIEEE802.11e WLANs, IEEE International Conference on Image Processing,Genoa, Italy,2005, I:197-200.
[88]. D. nür and A. A. Alatan. Video adaptation for transmission channel by utilitymodeling. IEEE International Conference on Multimedia&Expo, Amsterdam,USA,2005,1400-1403
[89] Chang Wen Chen, Houqiang Li. Video Streaming to Mobile Handheld Devices:Challenges in Decoding, Adaptation, and Browsing. N. Sebe, Y. Liu, and Y.Zhuang (Eds.): MCAM2007, LNCS4577,2007,42-51
[90] Svetlana Kim, Yongik Yoon. Universal Video Adaptation Model for ContentsDelivery using Focus-Of-Choice Model, Second International Conference onFuture Generation Communication and Networking, Sanya, China,2008,46-49
[91] Stephan Kopf, Thomas Haenselmann, Johannes Kiess, Benjamin Guthier,Wolfgang Effelsberg. Algorithms for video retargeting, Multimedia Tools andApplications,2011,51(2):1-43
[92] Keewon Seo, Jaeseung Ko, Ilkoo Ahn, Changick Kim, An Intelligent DisplayScheme of Soccer Video on Mobile Devices, IEEE Transactions on Circuits andSystems for Video Technology,2007,17(10):1395-1401
[93] L. Itti, C. Koch, E. Niebur, A model of saliency-based visual attention for rapidscene analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |