Wearable RGBD Indoor Navigation System for the Blind

详细信息    查看全文

• 作者：Young Hoon Lee (16)
  G茅rard Medioni (16)
  
  16. Institute for Robotics and Intelligent Systems ; University of Southern California ; Los Angeles ; CA ; USA
  
• 刊名：Lecture Notes in Computer Science
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：8927
• 期：1
• 页码：493-508
• 全文大小：2,141 KB
• 参考文献：1. Borenstein, J., Ulrich, I.: The GuideCane - A computerized travel aid for the active guidance of blind pedestrians. In: IEEE Int. Conf. on Robotics and Automation. pp. 1283鈥?288 (1997)
  2. Brock, M., Kristensson, P.: Supporting blind navigation using depth sensing and sonification. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 255鈥?58 (2013)
  3. Clark-Carter, D, Heyes, A, Howarth, C (1986) The efficiency and walking speed of visually impaired people. Ergonomics 29: pp. 779-789 dx.doi.org/10.1080/00140138608968314" target="_blank" title="It opens in new window">CrossRef
  4. Golledge, RG, Marston, JR, Costanzo, CM (1997) Attituds of visually imparied persons towards the use of public transportation. Journal of Visual Impairment Blindness 91: pp. 446-459
  5. Google: Google glass (2013). http://www.google.com/glass
  6. Guerrero, L, Vasquez, F, Ochoa, S (2012) An indoor navigation system for the visually impaired. Sensors 12: pp. 8236-8258 dx.doi.org/10.3390/s120608236" target="_blank" title="It opens in new window">CrossRef
  7. Helal, A., Moore, S., Ramachandran, B.: Drishti: An integrated navigation system for visually impaired and disabled. In: Proceedings Fifth International Symposium on Wearable Computers, pp. 149鈥?56. IEEE (2001)
  8. Hirschmuller, H., Innocent, P., Garibaldi, J.: Fast, unconstrained camera motion estimation from stereo without tracking and robust statistics. In: 7th International Conference on Control, Automation, Robotics and Vision. ICARCV 2002. vol. 2, pp. 1099鈥?104. IEEE (2002)
  9. Holzer, S., Rusu, R., Dixon, M., Gedikli, S., Navab, N.: Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2684鈥?689. IEEE (2012)
  10. Horn, B (1987) Closed-form solution of absolute orientation using unit quaternions. JOSA A 4: pp. 629-642 dx.doi.org/10.1364/JOSAA.4.000629" target="_blank" title="It opens in new window">CrossRef
  11. Howard, A.: Real-time stereo visual odometry for autonomous ground vehicles. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS 2008, pp. 3946鈥?952. IEEE (2008)
  12. Huang, A., Bachrach, A., Henry, P., Krainin, M., Maturana, D., Fox, D., Roy, N.: Visual odometry and mapping for autonomous flight using an rgb-d camera. In: International Symposium on Robotics Research (ISRR), pp. 1鈥?6 (2011)
  13. Koenig, S, Likhachev, M (2005) Fast replanning for navigation in unknown terrain. IEEE Transactions on Robotics 3: pp. 354-363 dx.doi.org/10.1109/TRO.2004.838026" target="_blank" title="It opens in new window">CrossRef
  14. Lee, Y., Medioni, G.: A RGB-D camera based navigation for the visually impaired. In: RSS 2011 RGB-D: Advanced Reasoning with Depth Camera Workshop, pp. 1鈥? (2011)
  15. Legood, R, Scuffham, P, Cryer, C (2002) Are we blind to injuries in the visually impaired? a review of the literature. Injury Prevention 8: pp. 155-160 dx.doi.org/10.1136/ip.8.2.155" target="_blank" title="It opens in new window">CrossRef
  16. Loomis, J., Golledge, R., Klatzky, R.: Gps-based navigation systems for the visually impaired. Fundamentals of Wearable Computers and Augmented Reality 429(46) (2001)
  17. Manduchi, R., Kurniawan, S.: Mobility-related accidents experienced by people with visual impairment. Insight: Research & Practice in Visual Impairment & Blindness 4(2), 44鈥?4 (2011)
  18. Martinez, J., Ruiz, F., et al.: Stereo-based aerial obstacle detection for the visually impaired. In: Workshop on Computer Vision Applications for the Visually Impaired (2008)
  19. Mei, C., Sibley, G., Cummins, M., Newman, P., Reid, I.: A constant-time efficient stereo slam system. In: BMVC, pp. 1鈥?1 (2009)
  20. Moravec, H., Elfes, A.: High resolution maps from wide angle sonar. In: Proceedings 1985 IEEE International Conference on Robotics and Automation. vol. 2, pp. 116鈥?21. IEEE (1985)
  21. Nguyen, C., Izadi, S., Lovell, D.: Modeling kinect sensor noise for improved 3d reconstruction and tracking. In: 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 524鈥?30. IEEE (2012)
  22. Pradeep, V., Medioni, G., Weiland, J.: Robot vision for the visually impaired. In: Computer Vision Applications for the Visually Impaired, pp. 15鈥?2 (2010)
  23. S谩ez, J, Escolano, F (2011) 6dof entropy minimization slam for stereo-based wearable devices. Computer Vision and Image Understanding 115: pp. 270-285 dx.doi.org/10.1016/j.cviu.2010.10.004" target="_blank" title="It opens in new window">CrossRef
  24. Schiller, J., Peregoy, J.: Provisional report: Summary health statistics for u.s. adults: National health interview survey, 2011. National Center for Health Statistics 10(256) (2012)
  25. JVIB news service: Demographics update: Alternate estimate of the number of guide dog users. Journal of Visual Impairment Blindness 89(2), 4鈥? (1995)
  26. Turano, K, Broman, A, Bandeen-Roche, K, Munoz, B, Rubin, G, West, S (2004) Association of visual field loss and mobility performance in older adults: Salisbury eye evaluation study. Optometry & Vision Science 81: pp. 298-307 dx.doi.org/10.1097/01.opx.0000134903.13651.8e" target="_blank" title="It opens in new window">CrossRef
  27. West, S, Rubin, G, Broman, A, Munoz, B, Bandeen-Roche, K, Turano, K (2002) How does visual impairment affect performance on tasks of everyday life?. Archives of Ophthalmology 120: pp. 774-780 dx.doi.org/10.1001/archopht.120.6.774" target="_blank" title="It opens in new window">CrossRef
  28. Wurm, K., Hornung, A., Bennewitz, M., Stachniss, C., Burgard, W.: Octomap: A probabilistic, flexible, and compact 3d map representation for robotic systems. In: Proc. of the ICRA 2010 workshop on best practice in 3D perception and modeling for mobile manipulation. vol. 2 (2010)
  29. Yguel, M., Aycard, O., Laugier, C.: Update policy of dense maps: Efficient algorithms and sparse representation. In: Field and Service Robotics. pp. 23鈥?3. Springer (2008)
  30. Yuan, D., Manduchi, R.: Dynamic environment exploration using a virtual white cane. In: IEEE Conf. on Computer Vision and Pattern Recognition, pp. 243鈥?49 (2005)
  31. Z枚llner, M, Huber, S, Jetter, H-C, Reiterer, H NAVI 鈥?a proof-of-concept of a mobile navigational aid for visually impaired based on the microsoft kinect. In: ditors">Campos, P, Graham, N, Jorge, J, Nunes, N, Palanque, P, Winckler, M eds. (2011) Human-Computer Interaction 鈥?INTERACT 2011. Springer, Heidelberg, pp. 584-587 dx.doi.org/10.1007/978-3-642-23768-3_88" target="_blank" title="It opens in new window">CrossRef
  
• 作者单位：Computer Vision - ECCV 2014 Workshops
• 丛书名：978-3-319-16198-3
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

In this paper, we present a novel wearable RGBD camera based navigation system for the visually impaired. The system is composed of a smartphone user interface, a glass-mounted RGBD camera device, a real-time navigation algorithm, and haptic feedback system. A smartphone interface provides an effective way to communicate to the system using audio and haptic feedback. In order to extract orientational information of the blind users, the navigation algorithm performs real-time 6-DOF feature based visual odometry using a glass-mounted RGBD camera as an input device. The navigation algorithm also builds a 3D voxel map of the environment and analyzes 3D traversability. A path planner of the navigation algorithm integrates information from the egomotion estimation and mapping and generates a safe and an efficient path to a waypoint delivered to the haptic feedback system. The haptic feedback system consisting of four micro-vibration motors is designed to guide the visually impaired user along the computed path and to minimize cognitive loads. The proposed system achieves real-time performance at \(28.4\) Hz in average on a laptop, and helps the visually impaired extends the range of their activities and improve the mobility performance in a cluttered environment. The experiment results show that navigation in indoor environments with the proposed system avoids collisions successfully and improves mobility performance of the user compared to conventional and state-of-the-art mobility aid devices.