Real-Time Single Camera Hand Gesture Recognition System for Remote Deaf-Blind Communication

详细信息    查看全文

• 作者：Giuseppe Airò Farulla (15)
  Ludovico Orlando Russo (15)
  Chiara Pintor (15)
  Daniele Pianu (16)
  Giorgio Micotti (17)
  Alice Rita Salgarella (18)
  Domenico Camboni (18)
  Marco Controzzi (18)
  Christian Cipriani (18)
  Calogero Maria Oddo (18)
  Stefano Rosa (15)
  Marco Indaco (15)
  
• 关键词：Real ; time Markerless Hand Tracking ; Hand Gesture Recognition ; Tactile Sign ; Language Communication ; Haptic Interface
• 刊名：Lecture Notes in Computer Science
• 出版年：2014
• 出版时间：2014
• 年：2014
• 卷：1
• 期：1
• 页码：35-52
• 全文大小：1,816 KB
• 参考文献：1. Openni. http://www.openni.org/
  2. Prensilia s.r.l., datasheet eh1 milano series (2010). http://www.prensilia.com/index.php?q=en/node/41
  3. Abbou, C.C., Hoznek, A., Salomon, L., Olsson, L.E., Lobontiu, A., Saint, F., Cicco, A., Antiphon, P., Chopin, D.: Laparoscopic radical prostatectomy with a remote controlled robot. The Journal of Urology 165(6), 1964-966 (2001) CrossRef
  4. Athitsos, V., Sclaroff, S.: Estimating 3d hand pose from a cluttered image. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. II-432. IEEE (2003)
  5. Bray, M., Koller-Meier, E., Van Gool, L.: Smart particle filtering for 3d hand tracking. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 675-80. IEEE (2004)
  6. Breiman, L.: Random forests. Machine Learning 45(1), 5-2 (2001) CrossRef
  7. Breuer, P., Eckes, C., Müller, S.: Hand gesture recognition with a novel ir time-of-flight range camera–a pilot study. In: Gagalowicz, A., Philips, W. (eds.) MIRAGE 2007. LNCS, vol. 4418, pp. 247-60. Springer, Heidelberg (2007) CrossRef
  8. Comaniciu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(5), 603-19 (2002) CrossRef
  9. Controzzi, M., Cipriani, C., Carrozza, M.C.: Design of artificial hands: A review. The Human Hand as an Inspiration for Robot Hand Development. STAR, vol. 95, pp. 219-46. Springer, Heidelberg (2014) CrossRef
  10. Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: Vision-based hand pose estimation: A review. Computer Vision and Image Understanding 108(1), 52-3 (2007) CrossRef
  11. Frankel, S., Glenn, R., Kelly, S.: The aes-cbc cipher algorithm and its use with ipsec. RFC3602 (2003)
  12. Gavrila, D.M., Davis, L.S.: 3-d model-based tracking of humans in action: A multi-view approach. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 1996, pp. 73-0. IEEE (1996)
  13. Goncalves, L., Di Bernardo, E., Ursella, E., Perona, P.: Monocular tracking of the human arm in 3d. In: Proceedings of Fifth International Conference on Computer Vision, pp. 764-70. IEEE (1995)
  14. Grebenstein, M.: The awiwi hand: An artificial hand for the DLR hand arm system. In: Grebenstein, M. (ed.) Approaching Human Performance. STAR, vol. 98, pp. 67-36. Springer, Heidelberg (2014) CrossRef
  15. Han, J., Shao, L., Xu, D., Shotton, J.: Enhanced computer vision with microsoft kinect sensor: A review (2013)
  16. Keskin, C., K?ra?, F., Kara, Y.E., Akarun, L.: Real time hand pose estimation using depth sensors. In: Consumer Depth Cameras for Computer Vision, pp. 119-37. Springer (2013)
  17. Kuznetsova, A., Leal-Taixe, L., Rosenhahn, B.: Real-time sign language recognition using a consumer depth camera. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 83-0 (2013)
  18. Lorussi, F., Scilingo, E.P., Tesconi, M., Tognetti, A., De Rossi, D.: Strain sensing fabric for hand posture and gesture monitoring. IEEE Transactions on Information Technology in Biomedicine 9(3), 372-81 (2005) CrossRef
  19. Mesch, J.: Signed conversations of deafblind people
  20. Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Efficient model-based 3d tracking of hand articulations using kinect. In: BMVC, pp. 1-1 (2011)
  21. Raspopovic, S., Capogrosso, M., Petrini, F.M., Bonizzato, M., Rigosa, J., Di Pino, G., Carpaneto, J., Controzzi, M., Boretius, T., Fernandez, E., Granata, G., Oddo, C.M., Citi, L., Ciancio, A.L., Cipriani, C
• 作者单位：Giuseppe Airò Farulla (15)
  Ludovico Orlando Russo (15)
  Chiara Pintor (15)
  Daniele Pianu (16)
  Giorgio Micotti (17)
  Alice Rita Salgarella (18)
  Domenico Camboni (18)
  Marco Controzzi (18)
  Christian Cipriani (18)
  Calogero Maria Oddo (18)
  Stefano Rosa (15)
  Marco Indaco (15)
  
  15. Politecnico di Torino, Turin, Italy
  16. Institute of Electronics, Computer and Telecommunication Engineering, National Research Council of Italy, Padova, Italy
  17. Politecnico di Milano, Milano, Italy
  18. The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
  
• ISSN：1611-3349

文摘

This paper presents a fast approach for marker-less Full-DOF hand tracking, leveraging only depth information from a single depth camera. This system can be useful in many applications, ranging from tele-presence to remote control of robotic actuators or interaction with 3D virtual environment. We applied the proposed technology to enable remote transmission of signs from Tactile Sing Languages (i.e., Sign Languages with Tactile feedbacks), allowing non-invasive remote communication not only among deaf-blind users, but also with deaf, blind and hearing with proficiency in Sign Languages. We show that our approach paves the way to a fluid and natural remote communication for deaf-blind people, up to now impossible. This system is a first prototype for the PARLOMA project, which aims at designing a remote communication system for deaf-blind people.