Interactive building and augmentation of piecewise planar environments using the intersection lines
详细信息    查看全文
  • 作者：1. LORIA ; Nancy University ; Campus Scientifique ; BP 239 ; 54506 Vand?uvre-les-Nancy ; France2. LORIA ; INRIA Nancy-Grand Est ; 615 rue du Jardin Botanique ; 54600 Villers-lès-Nancy ; France
  • 关键词：Interactive building – Structure ; from ; motion – SLAM – Particle filtering – Camera tracking – Augmented reality
  • 刊名：The Visual Computer
  • 出版年：2011
  • 出版时间：September 2011
  • 年：2011
  • 卷：27
  • 期：9
  • 页码：827-841
  • 全文大小：5.0 MB
  • 参考文献：1. Arulampalam, S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for on-line non-linear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50(2), 174–188 (2002)
    2. Bunnun, P., Mayol-Cuevas, W.W.: OutlinAR: An assisted interactive model building system with reduced computational effort. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 61–64. IEEE Computer Society, Los Alamitos (2008)
    3. Chekhlov, D., Gee, A.P., Calway, A., Mayol-Cuevas, W.: Ninja on a plane: Automatic discovery of physical planes for augmented reality using visual slam. In: Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR ’07, Washington, DC, USA, pp. 1–4. IEEE Computer Society, Los Alamitos (2007)
    4. Chekhlov, D., Pupilli, M., Mayol-Cuevas, W., Calway, A.: Real-time and robust monocular slam using predictive multi-resolution descriptors. In: 2nd International Symposium on Visual Computing, November 2006 (2006)
    5. Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: MonoSLAM: Real-time single camera SLAM. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 1052–1067 (2007)
    6. Faugeras, O., Lustman, F.: Motion and structure from motion in a piecewise planar environment. Rapport de recherche 856. INRIA (1988)
    7. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Technical Note 213, Artificial Intelligence Center, SRI International, Menlo Park, CA, March 1980
    8. Freeman, R., Steed, A.: Interactive modelling and tracking for mixed and augmented reality. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST ’06, New York, NY, USA, pp. 61–64. ACM, New York (2006)
    9. Gee, A.P., Chekhlov, D., Calway, A., Mayol-Cuevas, W.W.: Discovering higher level structure in visual slam. IEEE Trans. Robot. 24(5), 980–990 (2008)
    10. Harris, C., Stephens, M.: A Combined Corner and Edge Detector. In: Proceedings of 4th Alvey Conference, Cambridge, August 1988 (1988)
    11. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000). ISBN: 0521623049
    12. Huynh, D.N.T., Raveendran, K., Xu, Y., Spreen, K., MacIntyre, B.: Art of defense: A collaborative hand-held augmented reality board game. In: Sandbox ’09: Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games, New York, NY, USA, pp. 135–142. ACM, New York (2009)
    13. Jin, H., Favaro, P., Soatto, S.: A semi-direct approach to structure from motion. Vis. Comput. 19(6), 377–394 (2003)
    14. Johansson, B.: View synthesis and 3d reconstruction of piecewise planar scenes using intersection lines between the planes. In: ICCV, pp. 54–59 (1999)
    15. Julier, S., Baillot, Y., Lanzagorta, M., Brown, D., Rosenblum, L.: Bars: Battlefield augmented reality system. In: NATO Symposium on Information Processing Techniques for Military Systems, Istanbul, Turkey, October 2000, pp. 9–11 (2000)
    16. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd International Workshop on Augmented Reality, San Francisco (1999)
    17. Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proc. Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, Japan, November 2007 (2007)
    18. Klein, G., Murray, D.: Improving the agility of keyframe-based SLAM. In: Proc. Eur. Conf. Computer Vision (ECCV’08) (2008)
    19. Klein, G., Murray, D.: Parallel Tracking and Mapping on a Camera Phone. In: Proc. Eighth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’09), Orlando, USA, October 2009 (2009)
    20. Lepetit, V., Vachetti, L., Thalmann, D., Fua, P.: Fully automated and stable registration for augmented reality applications. In: Proceedings of International Symposium on Mixed and Augmented Reality, Tokyo, June 2003, pp. 93–101 (2003)
    21. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
    22. Noury, N., Sur, F., Berger, M.-O.: Determining point correspondences between two views under geometric constraint and photometric consistency. Research Report RR-7246, INRIA, 04 (2010)
    23. Rabin, J., Delon, J., Gousseau, Y., Moisan, L.: MAC-RANSAC: A robust algorithm for the recognition of multiple objects. In: Fifth International Symposium on 3D Data Processing, Visualization and Transmission (2010)
    24. Schmid, C., Zisserman, A.: Automatic line matching across views. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 666–671 (1997)
    25. Simon, G., Berger, M.-O.: Detection of the intersection lines in multiplanar environments: application to real-time estimation of the camera-scene geometry. In: 19th International Conference on Pattern Recognition—ICPR, pp. 1–4, Tampa United States, IEEE (2008)
    26. Sinha, S., Steedly, D., Szeliski, R.: Piecewise planar stereo for image-based rendering. In: Proc. Int. Conf. Computer Vision (ICCV’09), pp. 1881–1888 (2009)
    27. Thorm?hlen, T.: Zuverl?ssige Sch?tzung der Kamerabewegung aus einer Bildfolge. Ph.D. Thesis, University of Hannover. Related software ‘Voodoo Camera Tracker’ can be downloaded from http://www.digilab.uni-hannover.de (2006)
    28. Toldo, R., Fusiello, A.: Robust multiple structures estimation with j-linkage. In: Proceedings of the 10th European Conference on Computer Vision: Part I, ECCV ’08, pp. 537–547. Springer, Berlin (2008)
    29. Tomasi, C., Kanade, T.: Detection and tracking of point features. Technical Report CMU-CS-91-132, Carnegie Mellon University, April 1991
    30. van den Hengel, A., Hill, R., Ward, B., Dick, A.: In situ image-based modeling. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 107–110 (2009)
    31. Vigueras, F., Berger, M.-O., Simon, G.: Iterative multi-planar camera calibration: Improving stability using model selection. In: Vision, Video and Graphics (VVG’03), Bath, UK, July 2003 (2003)
    32. Vincent, E., Laganière, R.: Detecting planar homographies in an image pair. In: 2nd International Symposium on Image and Signal Processing and Analysis, Pula, Croatia, June 2001 (2001)
    33. Xu, G., Terai, J., Shum, H.: A linear algorithm for camera self-calibration, motion and structure recovery for multi-planar scenes from two perspective images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head Island, South Carolina (USA) (2000)
    34. Xu, L., Oja, E., Kultanen, P.: A new curve detection method: Randomized Hough Transform (RHT). Pattern Recognit. Lett. 11, 331–338 (1990)
    35. Zuliani, M., Kenney, C.S., Manjunath, B.S.: The multiransac algorithm and its application to detect planar homographies. In: IEEE International Conference on Image Processing (2005)
  • 作者单位：http://www.springerlink.com/content/jq9702g507377457/
  • 刊物类别：Computer Science
  • 刊物主题：Computer Graphics
    Computer Science, general
    Artificial Intelligence and Robotics
    Image Processing and Computer Vision
  • 出版者：Springer Berlin / Heidelberg
  • ISSN：1432-2315
文摘
This paper describes a method for online interactive building of piecewise planar environments for immediate use in augmented reality. This system combines user interaction from a camera–mouse and automated tracking/reconstruction methods to recover planar structures of the scene that are relevant for the augmentation task. An important contribution of our algorithm is that the process of tracking and reconstructing planar structures is decomposed into three steps—tracking, computation of the intersection lines of the planes, reconstruction—that can each be visually assessed by the user, making the interactive modeling procedure really robust and accurate with intuitive interaction. Videos illustrating our system both on synthetic and long real-size experiments are available at http://www.loria.fr/~gsimon/vc.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址：北京市海淀区学院路29号 邮编：100083

电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700