智能电视软件平台关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着“三网融合”的推进和“宽带提速”的实施,智能电视成为继3D电视以来的行业新热点,智能电视软件平台成为继智能手机软件平台之后的又一研究热点,其中Android-Based和Web-Based的智能电视平台更受产业界的关注。然而,原生的Android平台不支持数字电视广播业务,其多媒体系统也不支持电视的应用特性,已成为基于Android研发智能电视平台的首要问题;另外,随着智能电视的内容与应用日渐丰富,过载的信息使人机交互过余复杂,海量内容与用户个性化需求难以匹配,以及开放平台引起的安全隐患,已经成为智能电视发展中的突出问题。
     本文针对上述问题,以四川省战略性新兴产业关键技术产业化重大专项“面向三网融合的新型数字家庭的智能终端设备研发及产业化”项目为依托,主要研究了:TV与多媒体的融合技术、基于自然语音的智能电视Web交互技术、基于视频图像对象识别的上下文感知关键技术、智能电视的系统安全模型与技术架构。
     本文的主要工作及创新点如下:
     1.提出了智能电视的三网融合终端多媒体架构模型。基于对原生Android的多媒体框架和数字电视的广播框架深入分析,以及基于对TV的多媒体特性的分析,提出了一种多媒体与TV的终端多媒体架构模型,基于这个架构的TV中间件和电视多媒体引擎方案,以及相应的资源管理方案,实现了广播与互联网的功能融合。
     2.提出了全语音交互的Web多业务架构模型。基于智能电视对Web应用(WebApp)承载的需求,提出了融合的智能电视Web应用架构,利用JavaScript扩展机制,对数字电视等TV本地应用,以及语音交互能力进行了Web扩展,将基于语音的自然人机交互技术整合到Web框架中,使智能电视成为一个支持全语音交互的Web多业务终端。
     3.提出了用户行为上下文感知总体架构,以及基于视频图像对象识别的上下文感知模型及识别算法。为感知电视用户行为,向用户提供个性化服务,研究并设计了智能电视终端与云端协同的用户上下文感知总体架构,通过对视频图像中特定对象识别的理论建模,设计了动态背景的图像对象轮廓的训练及识别算法。实验表明该模型及算法具有较高的对象识别能力,为基于用户上下文的个性化服务奠定了良好的基础。
     4.提出了智能电视软件平台的安全架构模型。针对Android的系统安全问题,研究了Android-Based智能电视平台的安全架构,提出了智能电视软件平台安全模型和实现架构。基于所提出的安全模型和实现架构,重点研究了系统安全加载、端到端的应用安全保障、视频内容防篡改、CA防破解等技术方案,相关技术成果已被视像电子行业协会智能电视标准组等行业标准作为优选技术实现方案采纳。
With the implementation of the "Tri-network convergence" and "promotingbroadband speed" projects, the “smart TV” has become the most popular keywords after3DTV in TV industry. Moreover, smart TV platform becomes one hot research topicafter the smart phone platform. In all research of smart TV software platform, theAndroid-Based and Web-Based smart TV platform attract more attention. However,the original android system cannot support digital television broadcasting service, andits multimedia system cannot support the special requirements of television. These havebecome the primary problem of android-based smart TV platform development. Inaddition, along with the content becoming richer and the emergence of tremendoussmart TV applications, overloaded information makes the human-computer interactionbecome more complex, and it is more difficult to match the massive content with theindividual needs. With the smart TV platform being opened, security issues becomeanother focus of concern.
     Aiming at these problems, based on the industrialization of key technologies ofSichuan strategic emerging industries major project for “Development andindustrialization for new digital home smart terminals of Tri-network convergence”, themain research of this thesis includes: TV and multimedia convergence technology,voice-based interactive Web technology, context-aware key technology based on thevideo image object recognition, smart TV system security model and technicalarchitecture.
     The main works and innovations of this thesis are as follows:
     1. Propose a multimedia terminal architecture model for smart TV. Based on thethorough analysis of the original Android multimedia framework and the digital TVbroadcasting framework, along with the multimedia characteristics of TV, this thesisproposes a terminal architecture model which integrated TV and multimedia, and aseries of solutions for TV middleware, multimedia engine and corresponding resourcemanagement. This thesis implements functional converging between broadcasting andinternet.
     2. Propose a web multi-service architecture model based on voice interactive.Aiming at web applications hosting needs, this thesis proposes the smart TV webarchitecture, and extends the TV native applications and voice interaction capabilitiesinto web architecture by JavaScript extensions mechanism. The web architecture makesthe smart TV become a full voice-interactive web multi-service terminal.
     3. Propose the overall architecture of context-aware based on user behavior, as wellas context-aware model and algorithms for video-based image object recognition. Inorder to perceive the user behavior and to provide personalized services, this thesisresearches and designs a kind of smart TV context-aware architecture based oncollaborating between terminal and cloud-service. Moreover, according to thetheoretical modeling on the specialty image recognition, an object's outline training andrecognition algorithms of the dynamic background are designed. Experiments show thatthe model and the object recognition algorithm reserve higher capacity. This researchlays a good foundation for the future personalized service study in terms of userbehavior context.
     4. Propose a security architecture model for smart TV platform. In order to solvethe system security concerns in the open platform, the security architecture for theandroid-based smart TV platform is desired. Thus, a complete security model for smartTV platform is submitted. Moreover, based on the security model and achieved schema,more emphasis is given on the system security loading, end to end security guaranteeapplication, anti-tampered video content and anti-cracked CA. The related technologyresearch is adopted as an optimization technology solution by smart TV standard groupof the CVIA (CHINA VIDEO INDUSTRY ASSOCIATION).
引文
[1]王海威.智能电视操作系统服务性能与资源调度关键技术研究[D].合肥:中国科学技术大学,2011,1-8
    [2]杨梅.浅谈智能电视的发展与普及对数字媒体技术专业发展的影响[C].全国数字媒体技术专业建设与人才培养研讨会论文集,北京,2011,122-125
    [3]廖晶晶.智能电视解决方案的关键技术分析及应用[J].电视技术,2012,36(24):36-40
    [4] MorrisS,Smith-ChaigneauA.Interactive TV Standards: A Guide to MHP, OCAP and JavaTV[M].Elsevier,2005,20-40
    [5] European Telecommunications Sdandards Institute(ETSI).TS102-796.Hybrid Broadcast Broadband TV[S].Nice France:ETSI,2010
    [6] Samsung.Application Development Guide for Samsung SmartTV SDK2.0[EB/OL].http://dev-eloper.samsung.com/home.do:Samsung,2011
    [7] LG Electronics.Main Features of LG Smart TV SDK3.0APIs[EB/OL].http://developer.lge.com/resource/tv/RetrieveDocReferencesContent.dev#none:LG Electronics,2013
    [8]胡洪森.互联网电视在全球发达地区兴起[N].中国电子报,2009年9月1日
    [9] Gartner.2013年全球智能电视渗透率将达50%[J].印制电路资讯,2012,第6期:66-68
    [10]杨丰盛.Android技术内幕-系统卷[M].北京:机械工业出版社,2011,2-12
    [11]姚昱星,刘卫国.Android的架构与应用幵发研究[J].计算机系统应用,2008,第11期:110-113
    [12]韩超,梁泉.Android系统原理及开发要点详解[M].北京:电子工业出版社,2010,190-236
    [13]杨景.Google TV:从产品开发走向产业创新[J].中国数字电视,2010年05期,26-27
    [14]广播电影电视总局.广电总局关于加强以电视机为接收终端的互联网视听节目服务管理有关问题的通知[EB/OL].http://www.sarft.gov.cn/:国家广播电影电视总局,2009年8月11日
    [15]廖洪涛.数字电视中间件的技术标准与发展方向[EB/OL]. http://www.sarft.net/a/34454.aspx:中广互联,2011年9月23日
    [16] HLblingG,RablT,KosehH.Overview of Open Standards for Interactive TV[C].Studies in Computational Intelligence (SCI),Berlin Heidelberg,2008,45-64
    [17]零崇伟.基于OpenCore多媒体框架应用的扩展[D].西安:西安电子科技大学,2011,9-15
    [18]沈永增,李晓凤,吴冬林.Android下OpenMax IL框架的研究和应用[J].计算机应用与软件,2012,29卷(8):265-268
    [19] Khronos Group Inc.OpenMAX IL specification and tests[S],Khronos Group Inc,2005
    [20] Khronos Group Inc.OpenMAX Integration Layer Application Programming Interface Specification V1.0[S].Khronos Group Inc,2005
    [21]白璐.ANDROID系统多媒体功能增强的研究与实现[D].西安:西安科技大学,2012,6-20
    [22]张孟东.基于Android的多媒体系统的设计与实现[D].武汉:武汉大学,2011,5-8
    [23]唐勇.基于多核心平台的Android Stagefright多媒体框架的研究[D].淮南:安徽理工大学,2012,5-16
    [24] Karim Yaghmour.Embedded Android Porting,Extending,and Customizing[M].Sebastopol:O’Reilly Media, Inc.,2013.03,249-300
    [25]萧圣伦.Smart TV目标直指数字家庭中心而人机界面未臻完善[EB/OL].http://www.digitimes.com.tw:DIGITIMES,2012.9
    [26]萧圣伦.语音识别技术初现SmartTV自然语意发展为最直觉人机界面[EB/OL].http://www.digitimes.com.tw:DIGITIMES,2012.10
    [27] W3C.Web Speech API Specification[S].W3C,19October2012
    [28] NoTube.Research project about the future of TV[EB/OL].http://notube.tv/about-3/:NoTube,2009
    [29] Amit Thawani,Srividya Gopalan and Sridhar V.Context Aware Personalized Ad Insertion-in an Interactive TV Environment[EB/OL]. http://wenku.baidu.com/view/650cbe2c0066f5335a8121d2.html,2004
    [30] Internet Engineering Task Force(IETF).RFC2326.Real Time Streaming Protocol[S].California:IETF,April1998
    [31]陈靖隆.基于Http Live Streaming Protocol的移动多媒体系统设计[D].广州:华南理工大学,2011,3-11
    [32] ETSI.EN300468.Digital Video Broadcasting (DVB):Specification for Service Information(SI) in DVB systems[S],1996
    [33] DVB.ETSIEN301192.DVB specification for data broadcasting[S].DVB,2004
    [34] DVB.ETSITR101202.DVB Implementation guidelines for Data Broadcasting[S].DVB,2003
    [35]马俊,王欣,王侃等.基于DSP单芯片多通道多语音编解码器的通道开启方法[P].中国,发明专利,200610161966.9,2006年12月8日
    [36] Mastronarde,N., Kanoun,K.,Atienza,D.,et al. Markov Decision Process Based Energy-Efficient On-Line Scheduling for Slice-Parallel Video Decoding on Multicore Systems[J].IEEE Transactions on Multimedia,2013,15(2):268-278
    [37] E.Douglas Jensen,C. Douglas Locke, Hideyuki Tokuda. A Time-Driven Scheduling Model for Real-Time Operating Systems[C].1985The6th IEEE Real-Time Systems Symp-osium, California,USA,1985,112-122
    [38] Kwon.T.G., Lee.S.H., Rho.J.K. Scheduling algorithm for real-time burst traffic using d-ynamic weighted round robin[C]. In Circuits and Systems, ISCAS'98,Monterey,CA,1998,506-509
    [39] John A.Stankovic. Deadline Scheduling for Real-Time Systems: Edf and Related Algo-rithms[M]. Norwell, MA, USA, Kluwer Academic Publishers,1998,152-165
    [40] Wan Yeon Lee,Hyogon Kim,Heejo Lee. Energy-efficient scheduling of a real-time taskon DVFS-enabled multi-cores[C]. International Conference on Hybrid Information Technology,New York,2009,273-27
    [41] Zhang D., Chen F., Jin S. Global EDF-based online, energy-efficient real-time scheduling in multi-core platform[C]. In Computer Science and Automation Engineering (CSAE),Shanghai,2011,666-670
    [42] Anderson J. H., Calandrino J. M., Devi U. C. Real-time scheduling on multicore plat-forms[C]. In Real-Time and Embedded Technology and Applications Symposium, San Jose, CA,USA,2006,179-190
    [43] Anderson J. H., Calandrino J. M. Parallel real-time task scheduling on multicore platf-orms[C]. In Real-Time Systems Symposium, Rio de Janeiro, Brazil,27th IEEE Internatio-nal,2006,89-100
    [44] Ritson C. G., Sampson A. T., Barnes F. R. Multicore scheduling for lightweight com-municating processes[C]. In Coordination Models and Languages, Springer Berlin Hei-delberg,2009,163-183
    [45] Tan P. Task scheduling of real-time systems on multi-core architectures[C]. In Electr-onic Commerce and Security,ISECS'09,Nanchang,2009,190-193
    [46] Lakshmanan K., Rajkumar R., Lehoczky J.Partitioned fixed-priority preemptive schedul-ing for multi-core processors[C]. The21st Euromicro Conference on Real-Time Syste-ms,ECRTS'09,Dublin,2009,239-248
    [47] Boyd-Wickizer S., Morris R., Kaashoek M. F. Reinventing Scheduling for Multicore Systems[C]. The12th Workshop on Hot Topics in Operating Systems, Switzerland,20-09
    [48] Lee L. T., Chang H. Y., Luk W. M. An Adaptive Embedded Multi-core Real-Time System Scheduling, In Ubiquitous Computing and Multimedia Applications[M]. Berlin Heidelberg: Springer,2011,263-272
    [49] Saifullah A., Agrawal K., Lu C.,et al. Multi-core real-time scheduling for generalized parallel task models[C]. The32nd IEEE Real-Time Systems Symposium, Vienna, Aus-tria,2011,217-226
    [50] FIFO[EB/OL].https://en.wikipedia.org/wiki/First_In_First_Out: wikipedia, May22,2013
    [51] Round-robin scheduling[EB/OL]. https://en.wikipedia.org/wiki/Round-robin_scheduling: wikipedia, May22,2013
    [52] Ryan Asleson,Nathaniel T.Schutta.Ajax基础教程[M].(金灵译).北京:人民邮电出版社,2006,10-55
    [53]李安琪.HTML5标准实施与未来发展[J].信息技术与标准化,2012,第11期:9-11
    [54] W3C.HTML5: A vocabulary and associated APIs for HTML and XHTML[EB/OL].http://www.w3.org/TR/2012/CR-html5-20121217/:W3C,2012年12月
    [55]庞程,崔宣,粟潘等.基于Android平台HTML5的研究与实现[J].机械管理开发,2012,第6期(总第130期):136-137.
    [56] W3School.HTML5教程[EB/OL].http://www.w3school.com.cn/html5/:W3School,2010年10月28日
    [57]姜江.WebKit For Android[EB/OL].http://www.jjos.org/,2010年5月10日
    [58]刘华星,杨庚.HTML5—下一代Web开发标准研究[J].计算机技术与发展,2011,21(8):54-57
    [59] Aditya Bansod.Android or iOS:Which platform is better for HTML5?[EB/OL].http://www.fiercedeveloper.com/story/android-or-ios-which-platform-better-html5/2012-02-03
    [60]吴报玉.RIA客户端技术研究与应用[D].合肥:合肥工业大学,2009,15-30
    [61]何娅.嵌入式浏览器扩展机制的研究与设计[D].成都:电子科技大学,2011,18-42
    [62] Dey AK.Understanding and using context[C].Personal and Ubiquitous Computing,2001,4-7
    [63]卜颖毅,李俊,陈沙寻等.上下文感知计算研究与进展[C].第一届建立和谐人机环境联合学术会议(HHME2005)论文集,云南昆明,2005
    [64]岳玮宁,王悦,汪国平等.基于上下文感知的智能交互系统模型[J].计算机辅助设计与图形学学报,2005,17(1):74-77
    [65]魏婧,覃征.基于上下文感知的智能用户界面构件模型[C].计算机技术与应用进展,2007,319-323
    [66] Amir Padovitz,Arkady Zaslavsky,Seng Wai Loke.Maintaining continuous dependability insensor-based context-aware pervasive computing systems[C].The38th Hawaii Internatio-nal Conf.on System Sciences,Big Island,Hawaii,USA,2005,1-10
    [67] Kaori Fujinami,Tetsuo Yamabe,Tatsuo Nakajima.A case study of context-aware applicati-on integrating cyber and physical spaces[C].ACM Symposium on Applied Computing,C-yprus,2004,1607–1614
    [68] Jason I.Hong.An infrastructure for context-aware computing[C].Conference on Human Fa-ctors in Computing Systems,Minneapolis,Minnesota,USA,2002,554–555
    [69]阴躲芬,李一民,王英妹等.图像阈值分割技术的研究[J].科技广场,2008,3:136-137
    [70]邓延权.基于二型模糊集的图像阈值分割方法研究[D].哈尔滨:哈尔滨工程大学,2009,3-12
    [71]曾俊.图像边缘检测技术及应用研究[D].武汉:华中科技大学,2011,15-30
    [72]向方,王宏福.图像边缘分割算法的优化研究与仿真[J].计算机仿真,2011,28(8):280-283
    [73]熊伟.基于Snake模型的目标图像边缘分割方法[J].科技视界,2012,11:135-136
    [74]乔闹生,邓磊.一种基于图像融合的含噪图像边缘检测方法[J].光电子激光,2012,23(11):2215-2220
    [75] Liang Haichao,Kawashima Yusuke.A region-based coupled MRF model for coarse imageregion segmentation toward its VLSI implementation[J].Institute of Electrical Engineersof Japan,2011,131(2):567-575
    [76]李苏梅,韩国强.基于K-均值聚类算法的图像区域分割方法[J].计算机工程与应用,2008,44(16):163-167
    [77]胡一丹,李文.基于高斯统计模型的快速图像区域分割方法[J].福建师范大学学报,2011,27(2):133-137
    [78]段湘斌.基于灰度图像的匹配算法改进[D].长沙:中南大学,2012,4-9
    [79]李健江,张磊,李兴钢.CUDA架构下的灰度图像匹配并行算法[J].电子科技大学学报,2012,41(1):110-113
    [80]于二丽.图像匹配的并行算法研究[D].南京:南京邮电大学,2011,10-23
    [81] H.P.Moravec.Towards automatic visual obstacle avoidance[C].5th International Joint Conf-erence on Artificial Intelligence,MA,USA,1977,584
    [82] C. Harris,M. Stephens.A combined corner and edge detector[C].Alvey Vision Conference,Manchester,1988,147-151
    [83] S.M. Smith,J.M.Brady.SUSAN-an new approach to low level image processing[C].Intern-ational Journal of Computer Vision,netherlands,1997,23(1):45-78
    [84] M. TRAJKOVIC,M.HEDLEY.Fast corner detection Image and Vision[J],Computing,1998,16(1):75-87
    [85] D.Lowe.Distinctive image features from scale-invariant keypoints[J].International Journalof Computer Vision,2004,1-28
    [86] Dufournaud Yves,Schmid Cordelia,Horaud Radu.Matching images with different resolutio-ns[C].IEEE Conference on Computer Vision and Pattern Recognition.2000,1:612-618
    [87] Fei Ren,Hancong Duan,Tingzhi Pu et al.Cache aging mechanism of regression-based pre-diction[J],IJACT(International Journal of Advancements in Computing Technology),2012,4:11-20
    [88]梁炜莹.数字电视信息安全研究[D].广州:华南理工大学,2009,15-34
    [89]李铉洵.三网融合内容集成播控平台的设计与应用[D].广州:华南理工大学,2011,7-20
    [90]廖洪涛.Android电视不符合中国电视的安全管控与运营发展要求[C].2011国际传输与覆盖研讨会,西安,2011,352~356
    [91]韦东山.嵌入式linux应用开发完全手册[M].北京:人民邮电出版社,2008,15-34
    [92] Trusted Computing Group.TPM Main Part1Design Principles Specification[S].Trusted Computing Group,2007
    [93]国家密码管理局.可信技术密码支撑平台功能与接口规范[EB/OL].http://www.oscca.gov.cn/:国家密码管理局,2007年12月
    [94]杜文银,张涛,凌君.基于ARM TrustZone技术的移动可信平台测控技术[J].测控技术,2009,28:52-54
    [95]萨其日娜,谢晓尧,刘天昭.基于TrustZone的嵌入式系统安全性研究[J].贵州师范大学学报(自然科学版),2011,28(3):59-63
    [96]刘文清,卿斯汉.一个修改BLP安全模型的设计及在SecLinux上的应用[J],软件学报,2002,13(4):567-573
    [97]孙瑜.高安全级操作系统结构化关键技术研究[D].北京:北京工业大学,2011,13-34
    [98]姜春茂,倪藴涛,黄春梅.嵌入式多核操作系统关键技术[J].科技导报,2012,30(11):69-75
    [99]郭晋.基于可信计算的嵌入式Linux内核安全性加固的研究[D].成都:电子科技大学,2011,12-37
    [100]符易阳,周丹平.Android安全机制分析[C].第26次全国计算机安全学术交流会论文集,武夷山,2011年9月,23-25
    [101]胡大磊,周学海.平台无关的访问控制框架研究与实现[J].计算机系统应用,2010,19(3):1720
    [102]雷灵光,张中文,王跃武等.Android系统代码签名验证机制的实现及安全性分析[C].第27次全国计算机安全学术交流会论文集,九寨沟,2012年9月,61-63
    [103]李佳.Android平台恶意软件检测评估技术研究[D].北京:北京邮电大学,2012,5-17
    [104]李智.移动互联网终端安全关键技术研究及实现[D].北京:北京交通大学,2011,10-26
    [105]任飞,刘贤洪,秦志光.智能电视安全存储数据访问方法[J].电子科技大学学报(自然版),已录用
    [106]李柏岚.IOS平台的软件安全性分析[D].上海:上海交通大学,2011,15-34
    [107] A.Main,P.C.Oomchot.Software Protection and Application Security:Understanding theBat-tle ground[EB/OL].http://people.scs.carleton.ca/~paulv/papers/softprot8a.pdf,2003
    [108] C.S.Collberg,C.Thomborson,Watermarking.Tamper-proofing and Obfuscation Tools forSo-ftware Protection[J].IEEE Transactions on Software Engineering,2002,28(8):735-746
    [109] I.J.Jozwiak,A.Liber,K.Marczak.A Hardware-Based Software Protection Systems-Analysisof Security Dongles with Memory[C].International Multi-Conference on Computing inthe Global Information Technology(ICCGI’07),Washington,2007,28-28
    [110] Tang Jiutao,Lin Guoyuan.Research of Software Protection[C]. International Conferenceon Educational and Network Technology(ICENT2010),秦皇岛,2010,410-413
    [111]周亦敏,隋伟鑫.ARM架构中TrustZone安全处理技术的研究[J].信息安全,2008,12(3):25-28
    [112] Kennedy. Booting of Multiprocessor System From A Boot Rom of narrower Width Than The System Memory[P].United States,US005659748A,Aug.l9,1997
    [113]邓臻,王键.基于PKI的证书认证体系计算技术与自动化[J].计算机技术与标准化,2008年6月,27(2):141-144
    [114] LJ. Cox,M.L.Miller,J.Bloom.Digital watermarking[M].Morgan Kaufmann,2002,12-36
    [115]中华人民共和国国家质量监督检验检疫总局,中国家标准化管理委员会. GB/T20090.1-2006.Audio Video coding Standard Workgroup of China[S].北京:中国标准出版社,2006年2月
    [116]吕品.数字电视条件接收系统的破解与反破解技术[J].卫星电视与宽带多媒体,2006,2:42-43
    [117] Digital Video Broadcasting (DVB).Implementation Guidelines of the DVB SimulcryptStandard[S].Digital Video Broadcasting (DVB),Apr.2002
    [118] Ren Fei,Qin Zhiguang,Liu Xianhong.A Method to Prevent CW Sharing in DTV CAS
    [C].2010International Conference on Computational Intelligence and Security,南宁,2010,429-432
    [119] Ren Fei,Qin Zhiguang,Yang Jinfeng.A New Technique of Anti-tampering TechnologyBased on AVS Video[C].2010International Conference on Computational Intelligenceand Security,南宁,2010,386-389

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700