A Distributed Stream Computing Architecture for Dynamic Light-Field Acquisition and Rendering System

详细信息    查看全文

• 关键词：Distributed architecture ; Virtual reality ; Light ; field acquisition ; Rendering ; Stream computing
• 刊名：Lecture Notes in Computer Science
• 出版年：2017
• 出版时间：2017
• 年：2017
• 卷：10092
• 期：1
• 页码：123-132
• 参考文献：1.Levoy, M., Hanrahan, P.: Light field rendering. In: 23rd Annual Conference on Computer Graphics, pp. 31–42 (1996)
  2.Adelson, E., Wang, J.: Single lens stereo with a plenoptic camera. IEEE Trans. Pattern Anal. Mach. Intell. 14, 99–106 (1992)CrossRef
  3.McMillan, L., Bishop, G.: Plenoptic modeling: an image-based rendering system. In: 22nd Annual Conference on Computer Graphics, pp. 39–46 (1995)
  4.Gortler, S., Grzeszczuk, R., Szeliski, R., Cohen, M.: The lumigraph. In: 23rd Annual Conference on Computer Graphics, pp. 43–54 (1996)
  5.Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. In: ACM SIGGRAPH, pp. 600–608 (2004)
  6.Debevec, P., Hawkins, T., Tchou, C., Duiker, H., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: 27th Annual Conference on Computer Graphics, pp. 145–156 (2000)
  7.Debevec, P., Wenger, A., Tchou, C., Gardner, A., Waese, J., Hawkins, T.: A lighting reproduction approach to live-action compositing. ACM Trans. Graph. 21, 547–556 (2002)CrossRef
  8.Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. In: ACM SIGGRAPH, pp. 756–764 (2005)
  9.Chabert, C., Einarsson, P., Jones, A., Lamond, B., Ma, W., Sylwan, S., Hawkins, T., Debevec, P.: Relighting human locomotion with flowed reflectance fields. In: Eurographics Symposium on Rendering, pp. 183–194 (2006)
  10.Starck, J., Hilton, A.: Surface capture for performance-based animation. IEEE Comput. Graph. Appl. 27, 21–31 (2007)CrossRef
  11.Yang, J.C., Everett, M., Buehler, C., Mcmillan, L.: A real-time distributed light field camera. In: Eurographics Workshop on Rendering, pp. 77–86 (2002)
  12.Liu, Y., Dai, Q., Xu, W.: A real time interactive dynamic light field transmission system. In: IEEE International Conference on Multimedia and Expo, pp. 2173–2176 (2006)
  13.Jiao, S., Wu, W., Wang, H., Zhou, M., Hong, T., Sun, X., Wu, E.: Real time light field reconstruction for sub-pixel based integral imaging display. In: SIGGRAPH Asia Technical Briefs, pp. 1–4 (2014)
  14.Matusik, W., Buehler, C., Raskar, R.: Image-based visual hulls. In: 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 369–374 (2000)
  15.Wu, C., Liu, Y., Dai, Q.: Fusing multiview and photometric stereo for 3D reconstruction under uncalibrated illumination. IEEE Trans. Visual Comput. Graph. 17, 1082–1095 (2011)CrossRef
  
• 作者单位：Wenhui Zhou (17)
  Jiaqi Pan (17)
  Pengfei Li (17)
  Xuehui Wei (17)
  Zhen Liu (17)
  
  17. Hangzhou Dianzi University, Hangzhou, China
  
• 丛书名：Transactions on Edutainment XIII
• ISBN：978-3-662-54395-5
• 卷排序：10092

文摘

The architectures of image acquisition and computation usually play important roles in most computer vision systems, especially in the multi-camera dynamic light-field acquisition and rendering systems for virtual reality. This paper designs a general distributed stream computing architecture to support light-field data stream acquisition and computation. Taking advantage of the distributed computing framework and in-memory high-speed processing engine, this architecture combines stream and batch processing together, which could reduce the computation burden. In order to evaluate the performance of proposed distributed stream computing architecture, we construct a dynamic light-field acquisition and rendering system, and the light-field data are obtained from a 10-meter-diameter and 7-meter-height hemispherical steel-frame dome that is equipped with 20 cameras and 2000 LED lightings. Experiments results show our system can continuously acquire and render light-field data at more than 1 frame per second with limited computational resources.