基于DaVinci HD处理器的视频会议系统软件设计
摘要
本课题研究和开发了基于德州仪器(Texas Instruments Inc.)DaVinci HD处理器的高清视频会议系统。系统中采用嵌入式Linux操作系统。本文详细论述基于DaVinci HD处理器的高清视频会议系统的板级支持包软件开发过程,包括:系统引导程序的开发和系统驱动程序的实现。
第一部分,首先说明课题背景,视频会议发展趋势和课题任务。
第二部分,主要论述了基于DaVinci HD高清视频会议系统硬件架构和板级软件支持包架构体系,并且介绍了DaVinci HD的DSP架构。
第三部分,详细论述了系统启动软件设计,包括12C主模式启动和PCI从模式启动软件。
第四部分,详细论述了系统驱动软件设计。首先论述Linux视频处理驱动的实现。接着,讨论DSP的启动驱动实现,HD-VICP的启动驱动实现。论述主处理器与HD系统的PCI通讯机制。最后,着重论述本系统的ARM与DSP的通讯机制与方式。
第五部分,分析引导程序和驱动程序测试过程。
最后部分,对本课题——高清视频会议系统所完成的工作进行总结,并展望系统的改进和发展方向。
The design and implementation of this project is based on DaVinci HD processor. This system uses GNU/Linux operating system. This paper describes the design of system boot loader and system driver software.
The design of this project contains several sections. The first part describes the context of this project, the development of video conferencing system, and the tasks of this project.
The second part depicts the structure and technique of video conferencing system, then the hardware system design, DSP architecture and the software system architecture base on DaVinci HD.
The third part focuses on system boot. It contains I2C and PCI boot mode.
The forth part analyzes the design of system driver software. Firstly, discusses about video process drivers in Linux kernel. Following, discusses about the boot of DSP and HD-VICP. Then, discusses about how the main processor communicates with DaVinci HD system through PCI bus. At last, it focuses on the interacting activity between ARM core and the DSP core.
The fifth part focuses on the test of boot loader and the system driver software.
The last part summarizes the work which has been done in this design, and the expectation of the system improvement and the development direction.
第一部分,首先说明课题背景,视频会议发展趋势和课题任务。
第二部分,主要论述了基于DaVinci HD高清视频会议系统硬件架构和板级软件支持包架构体系,并且介绍了DaVinci HD的DSP架构。
第三部分,详细论述了系统启动软件设计,包括12C主模式启动和PCI从模式启动软件。
第四部分,详细论述了系统驱动软件设计。首先论述Linux视频处理驱动的实现。接着,讨论DSP的启动驱动实现,HD-VICP的启动驱动实现。论述主处理器与HD系统的PCI通讯机制。最后,着重论述本系统的ARM与DSP的通讯机制与方式。
第五部分,分析引导程序和驱动程序测试过程。
最后部分,对本课题——高清视频会议系统所完成的工作进行总结,并展望系统的改进和发展方向。
The design and implementation of this project is based on DaVinci HD processor. This system uses GNU/Linux operating system. This paper describes the design of system boot loader and system driver software.
The design of this project contains several sections. The first part describes the context of this project, the development of video conferencing system, and the tasks of this project.
The second part depicts the structure and technique of video conferencing system, then the hardware system design, DSP architecture and the software system architecture base on DaVinci HD.
The third part focuses on system boot. It contains I2C and PCI boot mode.
The forth part analyzes the design of system driver software. Firstly, discusses about video process drivers in Linux kernel. Following, discusses about the boot of DSP and HD-VICP. Then, discusses about how the main processor communicates with DaVinci HD system through PCI bus. At last, it focuses on the interacting activity between ARM core and the DSP core.
The fifth part focuses on the test of boot loader and the system driver software.
The last part summarizes the work which has been done in this design, and the expectation of the system improvement and the development direction.
引文
[1].Shaker Sabri,Birendra Prasada,Video Conferencing Systems,Proceedings of the IEEE,1985
[2].William D.Engilman,Thomas H.Cox,Eric D.Bednar,William R.Proffit,Equipping orthodontic residency programs for interactive distance learning,Elsevier,American Journal of Orthodontics and Dentofacial Orthopedics,Volume 131,Issue 5,May 2007,Pages 651-655
[3].李岩,荣盘祥.基于S3C44BOX嵌入式uCLinux系统原理及应用.北京:清华大学出版社,2005:6-8
[4].汪洋.多媒体终端的WinCE BSP软件设计:[硕士学位论文].杭州:浙江大学
[5].www.rtems.com,2008
[6].Li Zong,Bourbakis N.G,Digital video and digital TV:a comparison and the future directions,Information Intelligence and Systems,1999.Proceedings.1999 International Conference on 31 Oct.-3 Nov.1999 Page(s):470-481,Digital Object Identifier 10.1109/ICIIS.1999.810318
[7].http://www2.ccw.com.cn/weekly/zk/htm2008/20080315_389988.shtml,视频会议--专家视点,计算机世界报 2008年03月17日第09期 09
[8].http://www.asteriskvoipnews.com/blogsphere_news/the_10_best_video_confere ncing_solutions_for_2006.html
[9].Ladan Gharai,Tom Lehman,Alvaro Saurin,Colin Perkins,Experiences with High Definition Interactive Video Conferencing,Multimedia and Expo,2006IEEE International Conference on July 2006 Page(s):433 - 436,Digital Object Identifier 10.1109/ICME.2006.262565
[10].Cynthia LeRouge,Alan R.Hevner,Rosarm Webb Collins,It′s more than just use:An exploration of telemedicine use quality,Elsevier,Decision Support Systems,Volume 43,Issue 4,August 2007,Pages 1287-1304
[11].Bhargava B.,Adaptable Software for Communications in Video Conferencing,Application-Specific Software Engineering Technology,1998.ASSET-98.Proceedings.1998 IEEE Workshop on 26-28 March 1998 Page(s):8-13,Digital Object Identifier 10.1109/ASSET.1998.688226
[12].Navid Jam,Elliot Proebstel,Work in Progress:Who is Watching You? Video Conferencing Security,Securecomm and Workshops,2006.Aug.28 2006-Sept.1 2006.Page(s):1-2
[13].Lee Ling Chuan,Jumari,K.,Ismail,M.,Implementation of video conferencing over IPv6 on the Linux platform,Research and Development,2002.SCORED 2002.Student Conference on 16-17 July 2002 Page(s):375-377,Digital Object Identifier 10.1109/SCORED.2002.1033136
[14].Lee Ling Chuan,Jumari K.,Ismail M.,Anuar,K.,Implementation of Internet protocol security in video conferencing over IPV4/V6 on the Linux platform,Research and Development,2003.SCORED 2003.Proceedings.Student Conference on 25-26 Aug.2003 Page(s):338-340
[15].Cha Zhang,Yong Rui,Li-wei He,Light Weight Background Blurring for Video Conferencing Applications,Image Processing,2006 IEEE International Conference on 8-11 Oct.2006 Page(s):481-484,Digital Object Identifier 10.1109/ICIP.2006.312498
[16].Qingguo Zhao,Chongrong Li,Xuan Zhang,Dongtao Liu,A New FEC Scheme for Real-time Transmission of High Definition Video over IP Network,Intelligent Pervasive Computing,2007.IPC.The 2007 International Conference on 11-13 Oct.2007 Page(s):232 - 235,Digital Object Identifier 10.1109/IPC.2007.50
[17].刘悦.视频会议系统的技术和发展趋势.中国建筑学会建筑电气分会 2004年年会
[18].Iain E.G.Richardson 著,欧阳合,韩军 译.H.264和MPEG-4视频压缩.湖南·长沙:国防科技大学出版社,2004.11:6-7
[19].Polycom Inc.,High-Definition:The Evolution of Video Conferencing,2005, http://ldrktelecom.us/common/documents/whitepapers/high_definition_the_ev olution_of_video_conferencing.pdf,
[20].Zhenyu Wei,Kai Lain Tang and King N.Ngan,Implementation of H.264 on Mobile Device,Consumer Electronics,IEEE,Aug.2007,Volume:53,Issue:3On page(s):1109-1116,ISSN:0098-3063,INSPEC Accession Number:9624259
[21].Texas Instruments Inc.,DaVinci Technology Overview(TI literature number:SPRB 189A)
[22].Texas Instruments Inc.,TMS320DM6467 Digital Media System-on-Chip(Rev.A)Datasheet,http://focus.ti.com/lit/ds/symlink/tms320dm6467.pdf
[23].Texas Instruments Inc.,TMS320DM6446 Digital Media System-on-Chip(Rev.F)Datasheet,http://focus.ti.com/lit/ds/symlink/tms320dm6446.pdf
[24].李善平,陈文智等 编著.边干边学--Linux内核指导.杭州:浙江大学出版社,2002.8:3,95-96,337
[25].宋宝华.Linux设备驱动开发详解.北京:人民邮电出版社,2008:6-7,96,17-18,20-21,530,354
[26].Andy Oram,Greg Wilson.Beautiful Code 1~(st)ed.O'Reilly 2007:Chapter 16
[27].Jonathan Corber,Alessandro Rubini & Greg Kroah-Hartman.Linux Device Drivers 3~(rd)ed.O'Reilly Media,Inc.2005:Chapter 14;Chapter 8
[28].Greg Kroah-Hartman,udev and devfs - The final word,Dec.2003,www.kernel.org/pub/linux/utils/kemel/hotplug/udev_vs_devfs
[29].Sreekrishnan Venkateswaran.Essential Linux Device Drivers 1~(st)ed.Prentice Hall,2008:Chapter 4
[30].Texas Instruments Inc.,Codec Engine Server Integrator User′s Guide DaVinci Technology Overview(TI literature number:SPRUED5B)
[31].Texas Instruments Inc.,Using the TMS320DM6467 DMSoC Bootloader(TI literature number:SPRAASOA)
[32].http://www.denx.de/wiki/UBootdoc/,2008
[33].U-Boot 1.20源码根目录README
[34].Philips Semiconductors,THE I2C-BUS SPECIFICATION VERSION 2.1,JAN.2000,www.nxp.com/acrobat_download/literature/9398/39340011.pdf
[35].Texas Instruments Inc.,TMS320DM646x DMSoC Asynchronous External Memory Interface(EMIF)User′s Guide,(TI literature number:SPRUEQ7)
[36].www.atmel.com/dyn/resources/prod_documents/doc6255.pdf,ATMEL Inc.NAND Flash Support in AT91 SAM Microcontrollers,Oct.2006
[37].www.data-io.com/pdf/NAND/Toshiba/WhatIsNand.pdf.pdf,TOSHIBA Corp.What is NAND Flash Memory,2003
[38].Texas Instruments Inc.,TMS320DM646x DMSoC EMAC_MDIO Module User′s Guide,(TI literature number:SPRUEQ6)
[39].Texas Instruments Inc.,TMS320DM646x DMSoC Peripheral Component Interconnect(PCI)User′s Guide,(TI literature number:SPRUER2)
[40].Texas Instruments Inc.,TMS320DM646x DMSoC Inter-Integrated Circuit(I2C)Module User′s Guide,(TI literature number:SPRUER0)
[41].Michael H Schimek,Bill Dirks,Hans Verkuil,Martin Rubli.Video for Linux Two API Specification Revision 0.24,http://v412spec.bytesex.org/spec/
[42].Texas Instruments Inc.,TMS320DM646x DMSoC Video Port Interface(VPIF)User′s Guide,(TI literature number:SPRUER9)
[43].Tom Shanley,Don Anderson,刘晖,冀然然,夏意军 译.PCI系统结构.北京:电子工业出版社,2000.7:第一章
[44].Texas Instruments Inc.,TMS320DM646x DMSoC ARM Subsystem Reference Guide,(TI literature number:SPRUEP9)
[45].www.kanecomputing.co.uk/pdfs/easy_path_to_DaVinci.pdf,ATEME Inc.,Easy path to DaVinci,2006
[46].Texas Instruments Inc.,xDAIS-DM(Digital Media)User Guide,(TI literature number:SPRUEC8B)
[47].Texas Instruments Inc.,Codec Engine Algorithm Creator User′s Guide,(TI literature number:SPRUED6C)
[48].Texas Instruments Inc.,Codec Engine Application Developer User′s Guide,(TI literature number:SPRUE67D)
[49].Texas Instruments Inc.,Mastering the Art of Memory Map Configuration for DaVinci-Based Systems,(TI literature number:SPRAAQ6)
[50].Texas Instruments Inc.,TMS320DM646x DMSoC General-Purpose Input_Output(GPIO)User′s Guide,(TI literature number:SPRUEQ8)
[2].William D.Engilman,Thomas H.Cox,Eric D.Bednar,William R.Proffit,Equipping orthodontic residency programs for interactive distance learning,Elsevier,American Journal of Orthodontics and Dentofacial Orthopedics,Volume 131,Issue 5,May 2007,Pages 651-655
[3].李岩,荣盘祥.基于S3C44BOX嵌入式uCLinux系统原理及应用.北京:清华大学出版社,2005:6-8
[4].汪洋.多媒体终端的WinCE BSP软件设计:[硕士学位论文].杭州:浙江大学
[5].www.rtems.com,2008
[6].Li Zong,Bourbakis N.G,Digital video and digital TV:a comparison and the future directions,Information Intelligence and Systems,1999.Proceedings.1999 International Conference on 31 Oct.-3 Nov.1999 Page(s):470-481,Digital Object Identifier 10.1109/ICIIS.1999.810318
[7].http://www2.ccw.com.cn/weekly/zk/htm2008/20080315_389988.shtml,视频会议--专家视点,计算机世界报 2008年03月17日第09期 09
[8].http://www.asteriskvoipnews.com/blogsphere_news/the_10_best_video_confere ncing_solutions_for_2006.html
[9].Ladan Gharai,Tom Lehman,Alvaro Saurin,Colin Perkins,Experiences with High Definition Interactive Video Conferencing,Multimedia and Expo,2006IEEE International Conference on July 2006 Page(s):433 - 436,Digital Object Identifier 10.1109/ICME.2006.262565
[10].Cynthia LeRouge,Alan R.Hevner,Rosarm Webb Collins,It′s more than just use:An exploration of telemedicine use quality,Elsevier,Decision Support Systems,Volume 43,Issue 4,August 2007,Pages 1287-1304
[11].Bhargava B.,Adaptable Software for Communications in Video Conferencing,Application-Specific Software Engineering Technology,1998.ASSET-98.Proceedings.1998 IEEE Workshop on 26-28 March 1998 Page(s):8-13,Digital Object Identifier 10.1109/ASSET.1998.688226
[12].Navid Jam,Elliot Proebstel,Work in Progress:Who is Watching You? Video Conferencing Security,Securecomm and Workshops,2006.Aug.28 2006-Sept.1 2006.Page(s):1-2
[13].Lee Ling Chuan,Jumari,K.,Ismail,M.,Implementation of video conferencing over IPv6 on the Linux platform,Research and Development,2002.SCORED 2002.Student Conference on 16-17 July 2002 Page(s):375-377,Digital Object Identifier 10.1109/SCORED.2002.1033136
[14].Lee Ling Chuan,Jumari K.,Ismail M.,Anuar,K.,Implementation of Internet protocol security in video conferencing over IPV4/V6 on the Linux platform,Research and Development,2003.SCORED 2003.Proceedings.Student Conference on 25-26 Aug.2003 Page(s):338-340
[15].Cha Zhang,Yong Rui,Li-wei He,Light Weight Background Blurring for Video Conferencing Applications,Image Processing,2006 IEEE International Conference on 8-11 Oct.2006 Page(s):481-484,Digital Object Identifier 10.1109/ICIP.2006.312498
[16].Qingguo Zhao,Chongrong Li,Xuan Zhang,Dongtao Liu,A New FEC Scheme for Real-time Transmission of High Definition Video over IP Network,Intelligent Pervasive Computing,2007.IPC.The 2007 International Conference on 11-13 Oct.2007 Page(s):232 - 235,Digital Object Identifier 10.1109/IPC.2007.50
[17].刘悦.视频会议系统的技术和发展趋势.中国建筑学会建筑电气分会 2004年年会
[18].Iain E.G.Richardson 著,欧阳合,韩军 译.H.264和MPEG-4视频压缩.湖南·长沙:国防科技大学出版社,2004.11:6-7
[19].Polycom Inc.,High-Definition:The Evolution of Video Conferencing,2005, http://ldrktelecom.us/common/documents/whitepapers/high_definition_the_ev olution_of_video_conferencing.pdf,
[20].Zhenyu Wei,Kai Lain Tang and King N.Ngan,Implementation of H.264 on Mobile Device,Consumer Electronics,IEEE,Aug.2007,Volume:53,Issue:3On page(s):1109-1116,ISSN:0098-3063,INSPEC Accession Number:9624259
[21].Texas Instruments Inc.,DaVinci Technology Overview(TI literature number:SPRB 189A)
[22].Texas Instruments Inc.,TMS320DM6467 Digital Media System-on-Chip(Rev.A)Datasheet,http://focus.ti.com/lit/ds/symlink/tms320dm6467.pdf
[23].Texas Instruments Inc.,TMS320DM6446 Digital Media System-on-Chip(Rev.F)Datasheet,http://focus.ti.com/lit/ds/symlink/tms320dm6446.pdf
[24].李善平,陈文智等 编著.边干边学--Linux内核指导.杭州:浙江大学出版社,2002.8:3,95-96,337
[25].宋宝华.Linux设备驱动开发详解.北京:人民邮电出版社,2008:6-7,96,17-18,20-21,530,354
[26].Andy Oram,Greg Wilson.Beautiful Code 1~(st)ed.O'Reilly 2007:Chapter 16
[27].Jonathan Corber,Alessandro Rubini & Greg Kroah-Hartman.Linux Device Drivers 3~(rd)ed.O'Reilly Media,Inc.2005:Chapter 14;Chapter 8
[28].Greg Kroah-Hartman,udev and devfs - The final word,Dec.2003,www.kernel.org/pub/linux/utils/kemel/hotplug/udev_vs_devfs
[29].Sreekrishnan Venkateswaran.Essential Linux Device Drivers 1~(st)ed.Prentice Hall,2008:Chapter 4
[30].Texas Instruments Inc.,Codec Engine Server Integrator User′s Guide DaVinci Technology Overview(TI literature number:SPRUED5B)
[31].Texas Instruments Inc.,Using the TMS320DM6467 DMSoC Bootloader(TI literature number:SPRAASOA)
[32].http://www.denx.de/wiki/UBootdoc/,2008
[33].U-Boot 1.20源码根目录README
[34].Philips Semiconductors,THE I2C-BUS SPECIFICATION VERSION 2.1,JAN.2000,www.nxp.com/acrobat_download/literature/9398/39340011.pdf
[35].Texas Instruments Inc.,TMS320DM646x DMSoC Asynchronous External Memory Interface(EMIF)User′s Guide,(TI literature number:SPRUEQ7)
[36].www.atmel.com/dyn/resources/prod_documents/doc6255.pdf,ATMEL Inc.NAND Flash Support in AT91 SAM Microcontrollers,Oct.2006
[37].www.data-io.com/pdf/NAND/Toshiba/WhatIsNand.pdf.pdf,TOSHIBA Corp.What is NAND Flash Memory,2003
[38].Texas Instruments Inc.,TMS320DM646x DMSoC EMAC_MDIO Module User′s Guide,(TI literature number:SPRUEQ6)
[39].Texas Instruments Inc.,TMS320DM646x DMSoC Peripheral Component Interconnect(PCI)User′s Guide,(TI literature number:SPRUER2)
[40].Texas Instruments Inc.,TMS320DM646x DMSoC Inter-Integrated Circuit(I2C)Module User′s Guide,(TI literature number:SPRUER0)
[41].Michael H Schimek,Bill Dirks,Hans Verkuil,Martin Rubli.Video for Linux Two API Specification Revision 0.24,http://v412spec.bytesex.org/spec/
[42].Texas Instruments Inc.,TMS320DM646x DMSoC Video Port Interface(VPIF)User′s Guide,(TI literature number:SPRUER9)
[43].Tom Shanley,Don Anderson,刘晖,冀然然,夏意军 译.PCI系统结构.北京:电子工业出版社,2000.7:第一章
[44].Texas Instruments Inc.,TMS320DM646x DMSoC ARM Subsystem Reference Guide,(TI literature number:SPRUEP9)
[45].www.kanecomputing.co.uk/pdfs/easy_path_to_DaVinci.pdf,ATEME Inc.,Easy path to DaVinci,2006
[46].Texas Instruments Inc.,xDAIS-DM(Digital Media)User Guide,(TI literature number:SPRUEC8B)
[47].Texas Instruments Inc.,Codec Engine Algorithm Creator User′s Guide,(TI literature number:SPRUED6C)
[48].Texas Instruments Inc.,Codec Engine Application Developer User′s Guide,(TI literature number:SPRUE67D)
[49].Texas Instruments Inc.,Mastering the Art of Memory Map Configuration for DaVinci-Based Systems,(TI literature number:SPRAAQ6)
[50].Texas Instruments Inc.,TMS320DM646x DMSoC General-Purpose Input_Output(GPIO)User′s Guide,(TI literature number:SPRUEQ8)