GPU加速全局光照与红外多点触摸系统研究
|
摘要
虚拟植物生长(植物生长建模)研究是伴随着计算机科学、仿真科学及农林业科学等多个领域的发展而产生的一门交叉性学科。其主要研究目的和工作为：探索植物生长机理并在计算机中对该机理进行重建与仿真,从而进一步指导农林业及相关技术(地理信息系统、水土保持、沙漠化、数字城市等)的发展。在虚拟植物仿真中,光照的模拟是最重要的环节之一,除视觉效果模拟外,更重要的意义在于研究光照对植物生长过程的影响。本论文第一部分将计算机图形学全局光照理论、并行计算技术与虚拟植物生长相结合,探讨适合于虚拟植物的光照仿真模型及相应算法。
该部分主要工作如下：
1、研究辐射度算法及其在GPU上的并行实现；
2、研究光子映射算法及其在GPU上的并行实现,并探讨其在三维虚拟植物上的应用；
3、编写三维植物可视化及光照模拟软件wxVisualPlant。
近年来多点触摸操控系统由于其高操作维度及更直观的操作模式,已成为人机交互的一个重要研究方向。在大尺寸交互平台(区别于手持设备)中,由于成本及可靠性等多方面原因,不适宜采用传统的电容式和电阻式多点触摸屏。本论文第二部分研发了基于红外光线、计算机视觉、图像处理等技术的多点触摸操控平台,并基于TUIO协议实现了该操控平台与虚拟现实软件的结合。
该部分主要工作如下：
1、研究并设计基于红外光的多点操控平台硬件及相关触摸识别系统；
2、研发基于上述硬件平台及TUIO协议的控制驱动；
3、该系统与虚拟现实应用的结合研究。
The research of Virtual plants growth (plant growth modeling) is derived from computer science, simulation technology, agriculture and forestry science as an inter-discipline. The main research purpose is: exploring the inherent mechanism of plant growth, which is rebuilt and simulated on computers, then guide the further research of agriculture and forestry related technology (e.g., GIS, water and soil conservation, desertification and digital cities etc.). In the research of virtual plants, simulation of illumination is one of the most important elements, which has values not only in visual effects but also in exploring how it affects the growth of plants. The first part of this thesis synthesized the technology of global illumination theory, parallel computing and virtual plants growth and discussed proper lighting model and relevant algorithms.
Main work of this part is as follows:
1. Researched the Radiosity algorithm and realized it parallel on GPU;
2. Researched the Photon Mapping algorithm and realized it parallel on GPU, then discussed its application on 3D virtual plants;
3. Completed 3D virtual plants software-wxVisualPlant.
Multi-touch systems are becoming an important research direction within recent years due to their higher manipulating dimension and more intuitional manipulating pattern. On large-scale platforms, traditional capacitor panels and resistance panels are not eligible owing to the costs and reliability. The second part of this thesis developed a novel multi-touch system based on IR lights, computer vision and image processing and then synthesis this platform with virtual reality applications, which is based on the TUIO protocol.
Main work of this part is as follows:
1. Researched and designed the IR-based multi-touch hardware and related touch recognition system;
2. Developed control driver based on the system above and TUIO protocol;
3. Researched the combination of multi-touch system & virtual reality applications.
该部分主要工作如下：
1、研究辐射度算法及其在GPU上的并行实现；
2、研究光子映射算法及其在GPU上的并行实现,并探讨其在三维虚拟植物上的应用；
3、编写三维植物可视化及光照模拟软件wxVisualPlant。
近年来多点触摸操控系统由于其高操作维度及更直观的操作模式,已成为人机交互的一个重要研究方向。在大尺寸交互平台(区别于手持设备)中,由于成本及可靠性等多方面原因,不适宜采用传统的电容式和电阻式多点触摸屏。本论文第二部分研发了基于红外光线、计算机视觉、图像处理等技术的多点触摸操控平台,并基于TUIO协议实现了该操控平台与虚拟现实软件的结合。
该部分主要工作如下：
1、研究并设计基于红外光的多点操控平台硬件及相关触摸识别系统；
2、研发基于上述硬件平台及TUIO协议的控制驱动；
3、该系统与虚拟现实应用的结合研究。
The research of Virtual plants growth (plant growth modeling) is derived from computer science, simulation technology, agriculture and forestry science as an inter-discipline. The main research purpose is: exploring the inherent mechanism of plant growth, which is rebuilt and simulated on computers, then guide the further research of agriculture and forestry related technology (e.g., GIS, water and soil conservation, desertification and digital cities etc.). In the research of virtual plants, simulation of illumination is one of the most important elements, which has values not only in visual effects but also in exploring how it affects the growth of plants. The first part of this thesis synthesized the technology of global illumination theory, parallel computing and virtual plants growth and discussed proper lighting model and relevant algorithms.
Main work of this part is as follows:
1. Researched the Radiosity algorithm and realized it parallel on GPU;
2. Researched the Photon Mapping algorithm and realized it parallel on GPU, then discussed its application on 3D virtual plants;
3. Completed 3D virtual plants software-wxVisualPlant.
Multi-touch systems are becoming an important research direction within recent years due to their higher manipulating dimension and more intuitional manipulating pattern. On large-scale platforms, traditional capacitor panels and resistance panels are not eligible owing to the costs and reliability. The second part of this thesis developed a novel multi-touch system based on IR lights, computer vision and image processing and then synthesis this platform with virtual reality applications, which is based on the TUIO protocol.
Main work of this part is as follows:
1. Researched and designed the IR-based multi-touch hardware and related touch recognition system;
2. Developed control driver based on the system above and TUIO protocol;
3. Researched the combination of multi-touch system & virtual reality applications.
引文
[1]胡包钢,赵星,严红平,Ph. De Reffye, F. Blaise,熊范纶,王一鸣.植物生长建模与可视化-回顾与展望[J].自动化学报,2001,27(6)：816-835
[2]郭焱,李保国.虚拟植物的研究进展[J].科学通报,2001,46(4)：608-615
[3]丁维龙,赵星,熊范纶,滕明贵,撒力.虚拟植物建模及其软件开发进展[J].模式识别与人工智能,2002,15(4)：435-441
[4]高亮之.关于数字农业[J].农业现代化研究,2000,21(4)：254-256
[5]唐世浩,朱启疆,闫广建,周晓东,屋门新.关于数字农业的基本构想[J].农业现代化研究,2002,23(3)：183-187
[6]Oppendheimer P E. Real time Design and animation of fractal plants and trees[J]. SIGGRAPH:Proceedings of annual conference on computer graphics and interactive techniques,1986,20(4):55-64
[7]Smith A R. Plants, fractals, and formal language[J]. SIGGRAPH:Proceedings of the 11th annual conference on computer graphics and interactive techniques,1984,18(3):1-10
[8]Reeves W T. Particle systems-a technique for modeling a class of fuzzy objects[J]. ACM Transactions on Graphics.1083,2:359-376
[9]Lindenmayer A. Mathematical models for cellular interaction in development Ⅰ. Filaments with one-sided inputs[J]. Journal of Theoretical Biology.1968,18:280-289
[10]Lindenmayer A. Mathematical models for cellular interaction in development Ⅱ. Simple and branching filaments with two-sided inputs[J]. Journal of Theoretical Biology.1968, 18:280-289
[11]Prusinkiewicz P. A look at the visual modeling of plants using L-system[J]. Lecture Notes in Computer Science,1997,1278:11-29
[12]Prusinkewicz P, Hammel M, Mjolsness E. Animation of plant development[J]. SIGGRAPH: Proceedings of annual conference on computer graphics and interactive techniques,1993, 351-360
[13]de Reffye P, Edelin C, Francon J et al. Plant models faithful to botanical structure and development[J]. Computer Graphics,1988,22(4):151-158
[14]赵星,de Reffye P,熊范纶,胡包钢,展志岗.虚拟植物生长的双尺度自动机模型[J].计算机学报,2001,24(6)：608-615
[15]Xiong F L. Neural network based on intelligent system in agriculture[C]. In:Proceedings of IFAC Workshop on Expert systems in Agriculture. Huangshan:International Academia Publisher,1992
[16]Lemmon H E. COMAX:An expert system for cotton crop management[J]. Science,1986, 233:29-33
[17]Kang M Z, Cournede P H, de Reffye P, Auclair D, Hu B G. Analytical study of a stochastic plant growth model:Application to the GreenLab model[J]. Mathematics and Computers in Simulation,2008,78:57-75
[18]Goral C M, Torrance K E, Greenberg D P, Battaile B. Modeling the interaction of light between diffuse surfaces[J]. SIGGRAPH:Proceedings of annual conference on Computer graphics and interactive techniques.1984,18(3):213-222
[19]Whitted T. An improved illumination model for shaded display [J]. Communications of the ACM.1980,23(6):343-349
[20]Jensen H W. Realistic image synthesis using photon mapping[M]. A.K. Peters,2001
[21]Owens J. Streaming architectures and technology trends, in[M]. Addison-Wesley,2005
[22]Fujii J. GPGPU:General-purpose computation on graphics hardware[R]. NY, USA:ACM SIGGRAPH 2005 Courses,2005
[23]nVIDIA. CUDA Zone[OL]. http://www.nvidia.com/object/cuda home new.html
[24]Khronos. OpenCL web site[OL]. http://www.khronos.org/opencl/
[25]郑寿云.电容触摸屏的研究[D].广东：汕头大学,2009
[26]Han J Y. Low-cost multi-touch sensing through frustrated total internal reflection[C]. In: proceedings of the 18th annual ACM symposium on user interface software and technology. NY, USA,2005
[271 Schoning J, Brandl P, Daiber P, et al. Multi-touch surfaces:a technical guide[R]. Germany: Technical University of Munich,2008
[28]Kaltenbrunner M, Bovermann T, Bencina Ross, Costanza E. TUIO:A protocol for table-top tangible user interface[C]. In:proceeding of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005). Vannes, France,2005
[29]Deussen O, Hanrahan P, Lintermann B et al. Realistic modeling and rendering of plant ecosystems[C]. In:SIGGRAPH'98, proceedings of the 25th annual conference on computer graphics and interactive techniques. NY, USA:1998
[30]Hu B G, de Reffye P, Zhao X, Yan H P, Kang M Z. GreenLab:a new methodology towards plant functional-structure model[C]. In:PMA 03, proceedings of the first international symposium on plant growth modeling, simulation, visualization and applications. Beijing: Tsinghua University Press,2003
[31]LIAMA. GreenLab Web Site[OL]. http://liama.ia.ac.cn/gl_research.htm
[32]Zhao X, de Reffye P, Xiong F L, Hu B G, Zhan Z G. Dual-scale automaton model for virtual plant development[J]. The Chinese Journal of Computers.2001,24(6):608-617
[33]Code::Blocks[OL]. http://www.codeblocks.org
[34]wxWidgets[OL]. http://www.wxwidgets.org
[35]Barczi J F, Rey H, Caraglio Y, de Reffye P, Barthelemy D et al. AMAPsim:an integrative whole-plant architecture simulator based on botanical knowledge[J]. Annals of Botany. 2008,101(8):1125-1138
[36]Ashdown I. Radiosity:a programmer's perspective[M]. US,1994
[371 Cohen M F, Wallace J R. Radiosity and realistic image synthesis[M]. US,1995
[38]Nusselt W. Grapische Bestimmung des winkelverhaltnisses bei der warmestrahlung[J]. Zeitschrift des Vereines Deustcher Ingenieure.1928,72(20):673
[39]Cohen M F, Greenberg D P, Immel D S, Brock P J. An efficient radiosity approach for realistic image synthesis[J]. IEEE Computer Graphics and Applications.1986,6(2):26-35
[40]Hechbert P S. Discontinuity meshing for radiosity[C]. In:proceedings of the Third Eurographics Workshop on Rendering.1992:203-226
[41]Rost R J. OpenGL Shading Language[M]. US:Addison-Wesley Professional,2009
[42]Jensen H W Christensen N J. Photon maps in bidirectional monte carlo ray tracing of complex objects[J]. Computer and Graphics.1995,19(2):215-224
[43]Glassner A S. An introduction to ray tracing[M]. USA:Academic Press,1989
[44]Whitted Turner. An improved illumination model for shaded display[J]. Communications of the ACM.1980,23(6):343-349
[45]Jensen H W. Realistic image synthesis using photon mapping[M]. US:A K Peters,2001
[46]Spanier J, Gelbard E. Monte Carlo principles and neutron transport problems[M]. MA:Addison-Wesley,1969
[47]Bentley J L. Multidimensional binary search trees in database applications[J]. IEEE Trans. On Software Engineering.1979,5(4):333-340
[48]Wang W Y, Cao L L. Parallel k-nearest neighbor search on graphics hardware[C]. In: proceedings of 3rd International Symposium on Parallel Architectures, Algorithms and Programming. IEEE Computer Society,2010:291-294
[49]Han J. Low-cost multi touch sensing through frustrated total internal reflection[C], In: proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology. USA:2005
[50]Wright M, Freed A, Momeni A. Open Sound Control:State of the Art 2003[C]. In: proceedings of the 3rd Conference on New Instruments for Musical Expression. Canada, 2003
[51]Zheng B Y, Ma Y T, Li B G, et al. Assessment of the influence of global dimming on the photosynthetic production or rice based on three dimensional modeling[J]. Sci China Earth Sci,2001
[2]郭焱,李保国.虚拟植物的研究进展[J].科学通报,2001,46(4)：608-615
[3]丁维龙,赵星,熊范纶,滕明贵,撒力.虚拟植物建模及其软件开发进展[J].模式识别与人工智能,2002,15(4)：435-441
[4]高亮之.关于数字农业[J].农业现代化研究,2000,21(4)：254-256
[5]唐世浩,朱启疆,闫广建,周晓东,屋门新.关于数字农业的基本构想[J].农业现代化研究,2002,23(3)：183-187
[6]Oppendheimer P E. Real time Design and animation of fractal plants and trees[J]. SIGGRAPH:Proceedings of annual conference on computer graphics and interactive techniques,1986,20(4):55-64
[7]Smith A R. Plants, fractals, and formal language[J]. SIGGRAPH:Proceedings of the 11th annual conference on computer graphics and interactive techniques,1984,18(3):1-10
[8]Reeves W T. Particle systems-a technique for modeling a class of fuzzy objects[J]. ACM Transactions on Graphics.1083,2:359-376
[9]Lindenmayer A. Mathematical models for cellular interaction in development Ⅰ. Filaments with one-sided inputs[J]. Journal of Theoretical Biology.1968,18:280-289
[10]Lindenmayer A. Mathematical models for cellular interaction in development Ⅱ. Simple and branching filaments with two-sided inputs[J]. Journal of Theoretical Biology.1968, 18:280-289
[11]Prusinkiewicz P. A look at the visual modeling of plants using L-system[J]. Lecture Notes in Computer Science,1997,1278:11-29
[12]Prusinkewicz P, Hammel M, Mjolsness E. Animation of plant development[J]. SIGGRAPH: Proceedings of annual conference on computer graphics and interactive techniques,1993, 351-360
[13]de Reffye P, Edelin C, Francon J et al. Plant models faithful to botanical structure and development[J]. Computer Graphics,1988,22(4):151-158
[14]赵星,de Reffye P,熊范纶,胡包钢,展志岗.虚拟植物生长的双尺度自动机模型[J].计算机学报,2001,24(6)：608-615
[15]Xiong F L. Neural network based on intelligent system in agriculture[C]. In:Proceedings of IFAC Workshop on Expert systems in Agriculture. Huangshan:International Academia Publisher,1992
[16]Lemmon H E. COMAX:An expert system for cotton crop management[J]. Science,1986, 233:29-33
[17]Kang M Z, Cournede P H, de Reffye P, Auclair D, Hu B G. Analytical study of a stochastic plant growth model:Application to the GreenLab model[J]. Mathematics and Computers in Simulation,2008,78:57-75
[18]Goral C M, Torrance K E, Greenberg D P, Battaile B. Modeling the interaction of light between diffuse surfaces[J]. SIGGRAPH:Proceedings of annual conference on Computer graphics and interactive techniques.1984,18(3):213-222
[19]Whitted T. An improved illumination model for shaded display [J]. Communications of the ACM.1980,23(6):343-349
[20]Jensen H W. Realistic image synthesis using photon mapping[M]. A.K. Peters,2001
[21]Owens J. Streaming architectures and technology trends, in
[22]Fujii J. GPGPU:General-purpose computation on graphics hardware[R]. NY, USA:ACM SIGGRAPH 2005 Courses,2005
[23]nVIDIA. CUDA Zone[OL]. http://www.nvidia.com/object/cuda home new.html
[24]Khronos. OpenCL web site[OL]. http://www.khronos.org/opencl/
[25]郑寿云.电容触摸屏的研究[D].广东：汕头大学,2009
[26]Han J Y. Low-cost multi-touch sensing through frustrated total internal reflection[C]. In: proceedings of the 18th annual ACM symposium on user interface software and technology. NY, USA,2005
[271 Schoning J, Brandl P, Daiber P, et al. Multi-touch surfaces:a technical guide[R]. Germany: Technical University of Munich,2008
[28]Kaltenbrunner M, Bovermann T, Bencina Ross, Costanza E. TUIO:A protocol for table-top tangible user interface[C]. In:proceeding of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005). Vannes, France,2005
[29]Deussen O, Hanrahan P, Lintermann B et al. Realistic modeling and rendering of plant ecosystems[C]. In:SIGGRAPH'98, proceedings of the 25th annual conference on computer graphics and interactive techniques. NY, USA:1998
[30]Hu B G, de Reffye P, Zhao X, Yan H P, Kang M Z. GreenLab:a new methodology towards plant functional-structure model[C]. In:PMA 03, proceedings of the first international symposium on plant growth modeling, simulation, visualization and applications. Beijing: Tsinghua University Press,2003
[31]LIAMA. GreenLab Web Site[OL]. http://liama.ia.ac.cn/gl_research.htm
[32]Zhao X, de Reffye P, Xiong F L, Hu B G, Zhan Z G. Dual-scale automaton model for virtual plant development[J]. The Chinese Journal of Computers.2001,24(6):608-617
[33]Code::Blocks[OL]. http://www.codeblocks.org
[34]wxWidgets[OL]. http://www.wxwidgets.org
[35]Barczi J F, Rey H, Caraglio Y, de Reffye P, Barthelemy D et al. AMAPsim:an integrative whole-plant architecture simulator based on botanical knowledge[J]. Annals of Botany. 2008,101(8):1125-1138
[36]Ashdown I. Radiosity:a programmer's perspective[M]. US,1994
[371 Cohen M F, Wallace J R. Radiosity and realistic image synthesis[M]. US,1995
[38]Nusselt W. Grapische Bestimmung des winkelverhaltnisses bei der warmestrahlung[J]. Zeitschrift des Vereines Deustcher Ingenieure.1928,72(20):673
[39]Cohen M F, Greenberg D P, Immel D S, Brock P J. An efficient radiosity approach for realistic image synthesis[J]. IEEE Computer Graphics and Applications.1986,6(2):26-35
[40]Hechbert P S. Discontinuity meshing for radiosity[C]. In:proceedings of the Third Eurographics Workshop on Rendering.1992:203-226
[41]Rost R J. OpenGL Shading Language[M]. US:Addison-Wesley Professional,2009
[42]Jensen H W Christensen N J. Photon maps in bidirectional monte carlo ray tracing of complex objects[J]. Computer and Graphics.1995,19(2):215-224
[43]Glassner A S. An introduction to ray tracing[M]. USA:Academic Press,1989
[44]Whitted Turner. An improved illumination model for shaded display[J]. Communications of the ACM.1980,23(6):343-349
[45]Jensen H W. Realistic image synthesis using photon mapping[M]. US:A K Peters,2001
[46]Spanier J, Gelbard E. Monte Carlo principles and neutron transport problems[M]. MA:Addison-Wesley,1969
[47]Bentley J L. Multidimensional binary search trees in database applications[J]. IEEE Trans. On Software Engineering.1979,5(4):333-340
[48]Wang W Y, Cao L L. Parallel k-nearest neighbor search on graphics hardware[C]. In: proceedings of 3rd International Symposium on Parallel Architectures, Algorithms and Programming. IEEE Computer Society,2010:291-294
[49]Han J. Low-cost multi touch sensing through frustrated total internal reflection[C], In: proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology. USA:2005
[50]Wright M, Freed A, Momeni A. Open Sound Control:State of the Art 2003[C]. In: proceedings of the 3rd Conference on New Instruments for Musical Expression. Canada, 2003
[51]Zheng B Y, Ma Y T, Li B G, et al. Assessment of the influence of global dimming on the photosynthetic production or rice based on three dimensional modeling[J]. Sci China Earth Sci,2001