A 5 degrees of freedom multi-user pointing device for interactive whiteboards

详细信息    查看全文

• 作者：Andrea Albarelli ; Luca Cosmo ; Filippo Bergamasco…
• 关键词：Tracking ; Human ; machine interaction ; Interactive whiteboards ; Artificial markers
• 刊名：Pattern Analysis & Applications
• 出版年：2016
• 出版时间：February 2016
• 年：2016
• 卷：19
• 期：1
• 页码：237-250
• 全文大小：4,211 KB
• 参考文献：1.Albarelli A, Rodolà E, Bergamasco F, Torsello A (2011) A non-cooperative game for 3D object recognition in cluttered scenes. In: Proceedings—2011 international conference on 3D imaging, modeling, processing, visualization and transmission, 3DIMPVT, pp 252–259. doi:10.​1109/​3DIMPVT.​2011.​39
  2.Balsamo S, Marin A (2007) Queueing networks. In 7th international school on formal methods for the design of computer, communication, and software systems, pp 34–82. doi:10.​1007/​978-3-540-72522-0_​2
  3.Balsamo S, Marin A (2011) Performance engineering with product-form models: efficient solutions and applications. In: Proceedings of the 2nd ACM/SPEC international conference on performance engineering (ICPE '11), pp 437–448. ACM, New York, NY, USA. doi:10.​1145/​1958746.​1958812
  4.Bartoli Adrien, Lapresté Jean-Thierry (2008) Triangulation for points on lines. Image Vis Comput 26(2):315–324CrossRef
  5.Bartu Petr, Neulinger Anton, Jakoby Bernhard, Bauer Siegfried, Koeppe Robert (2013) Light curtain for 2d large-area object detection. Opt Express 21(10):12757–12766CrossRef
  6.Bergamasco F, Albarelli A, Rodola E, Torsello A (2011) Rune-tag: a high accuracy fiducial marker with strong occlusion resilience. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’11, pp 113–120, Washington, DC. (IEEE Computer Society)
  7.Bergamasco Filippo, Albarelli Andrea, Torsello Andrea (2013) Pi-tag: a fast image-space marker design based on projective invariants. Mach Vis Appl 24(6):1295–1310CrossRef
  8.Bosetti M, Pilolli P, Ruffoni M, Ronchetti M (2011) Interactive whiteboards based on the wiimote: Validation on the field. In: Interactive Collaborative Learning (ICL), 2011 14th International Conference on, pp 269–273
  9.Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly Media Inc, 1st edn
  10.Brandl P, Haller M, Hurnaus M, Lugmayr V, Oberngruber J, Oster C, Schafleitner C, Billinghurst M (2007) An adaptable rear-projection screen using digital pens and hand gestures. In: Artificial reality and telexistence, 17th International Conference on, pp 49–54
  11.Camplani M, Salgado L, Camplani R (2012) Low-cost efficient interactive whiteboard. In: Consumer electronics (ICCE), 2012 IEEE International Conference on, pp 686–687
  12.Chesi Graziano, Hung Yeungsam (2011) Fast multiple-view l2 triangulation with occlusion handling. Comput Vis Image Underst 115(2):211–223CrossRef
  13.Dietz P, Leigh D (2001) Diamondtouch: a multi-user touch technology. In: Proceedings of the 14th annual ACM symposium on User interface software and technology, UIST ’01, ACM, New York, pp 219–226
  14.Elrod S, Bruce R, Gold R, Goldberg D, Halasz F, Janssen W, Lee D, McCall K, Pedersen E, Pier K, Tang J, Welch B (1992) Liveboard: a large interactive display supporting group meetings, presentations and remote collaboration. In: Proc. Conf. on Human Factors in Computing Systems (CHI). ACM Press, New York, pp 599–607
  15.Fiala Mark (2010) Designing highly reliable fiducial markers. Pattern Anal Mach Intell IEEE Trans 32(7):1317–1324MathSciNet CrossRef
  16.Hartley Richard I, Sturm Peter (1997) Triangulation. Comput Vis Image Underst 68(2):146–157CrossRef
  17.Horn BKP (1987) Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am A 4(4):629–642
  18.Emil Kalman R (1960) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng 1(82 (Series D)):35–45
  19.Kim Sunkook, Choi Woong, Rim Woojin, Chun Youngtea, Shim Hongsik, Kwon Hyukjun, Kim Jongsoo, Kee Inseo, Kim Sungchul, Lee Sangyoon, Park Jongsun (2011) A highly sensitive capacitive touch sensor integrated on a thin-film-encapsulated active-matrix oled for ultrathin displays. Electron Devices IEEE Trans 58(10):3609–3615CrossRef
  20.Lech M, Kostek B (2010) Gesture-based computer control system applied to the interactive whiteboard. In: Information Technology (ICIT), 2010 2nd International Conference on, pp 75–78
  21.Liang R-H, Su C-H, Weng C-T, Cheng K-Y, Chen B-Y, Yang D-N (2012) Gaussbrush: drawing with magnetic stylus. In: SIGGRAPH Asia 2012 Emerging Technologies, SA ’12, ACM, New York, pp 11:1–11:2
  22.Liang Tsung-Ho, Huang Yueh-Min, Tsai Chin-Chung (2012) An investigation of teaching and learning interaction factors for the use of the interactive whiteboard technology. Educ Technol Soc 15(4):356–367
  23.Musa Eldar (2008) Laser-based light barrier. Appl Opt 47(19):3415–3422CrossRef
  24.Otsu Nobuyuki (1979) A threshold selection method from gray-level histograms. Syst Man Cybern IEEE Trans 9(1):62–66MathSciNet CrossRef
  25.Ouellet J, Hebert P (2009) Precise ellipse estimation without contour point extraction. Mach. Vision Appl. p 21
  26.Pinhanez C (2001) Using a steerable projector and a camera to transform surfaces into interactive displays. In: CHI ’01 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’01, ACM, New York, pp 369–370
  27.Shi Y, Yang Z, Hao Yang H, Liu S (2012) Study on the research hotspots of interactive whiteboards in education. In: Yu X, Lienhart R, Zha Z-J, Yan L, Satoh S (eds) ICIMCS, ACM, pp 209–212
  28.Slay Hannah, Siebrger Ingrid, Hodgkinson-Williams Cheryl (2008) Interactive whiteboards: real beauty or just lipstick? Comput Educ 51(3):1321–1341CrossRef
  29.Smith Heather J, Higgins Steve, Wall Kate, Miller Jen (2005) Interactive whiteboards: boon or bandwagon? a critical review of the literature. J Comput Assist Learn 21(2):91–101CrossRef
  30.So E, Zhang H, Guan YS (1999) Sensing contact with analog resistive technology. In: Systems, Man, and Cybernetics, 1999. IEEE SMC ’99 Conference Proceedings. 1999 IEEE International Conference on, vol 2, pp 806–811
  31.Stewenius H, Schaffalitzky F, Nister D (2005) How hard is 3-view triangulation really? In: Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05) vol 1, ICCV ’05, IEEE Computer Society, Washington, DC, pp 686–693
  32.Sung Kelvin (2011) Recent videogame console technologies. Computer 44(2):91–93CrossRef
  33.Takeoka Y, Miyaki T, Rekimoto J (2010) Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS ’10, ACM, New York, pp 91–94
  34.Tang JC, Minneman S (1991) Videowhiteboard: video shadows to support remote collaboration. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’91, ACM, New York, pp 315–322
  35.Tang JC, Minneman SL (1990) Videodraw: a video interface for collaborative drawing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’90, ACM, New York, pp 313–320
  36.Torsello A, Rodola E, Albarelli A (2011) Multiview registration via graph diffusion of dual quaternions. In: Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pp 2441–2448
  37.Torsello A, Rodolà E, Albarelli A (2011) Sampling relevant points for surface registration. In: 2011 international conference on 3D imaging, modeling, processing, visualization and transmission (3DIMPVT), pp 290–295. Hangzhou, 16–19 May 2011. doi:10.​1109/​3DIMPVT.​2011.​43
  38.Walny Jagoda, Lee Bongshin, Johns Paul, Henry Riche Nathalie, Carpendale Sheelagh (2012) Understanding pen and touch interaction for data exploration on interactive whiteboards. IEEE Trans Vis Comput Graph 18(12):2779–2788CrossRef
  39.Wang Z, Louey J (2008) Economical solution for an easy to use interactive whiteboard. In: Frontier of Computer Science and Technology, 2008. FCST ’08. Japan-China Joint Workshop on, pp 197–203
  40.Wilson AD (2005) Playanywhere: a compact interactive tabletop projection-vision system. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST ’05, ACM, New York, pp 83–92
  41.Zhang H, So E (2002) Hybrid resistive tactile sensing. Syst Man Cybern Part B: Cybern IEEE Trans 32(1):57–65
  42.Zhang S, He W, Yu Q, Zheng X (2012) Low-cost interactive whiteboard using the kinect. In: Image Analysis and Signal Processing (IASP), 2012 International Conference on, pp 1–5
  
• 作者单位：Andrea Albarelli (1)
  Luca Cosmo (1)
  Filippo Bergamasco (1)
  Flavio Sartoretto (1)
  Andrea Torsello (1)
  
  1. Dipartimento di Scienze Ambientali, Informatica e Statistica, Università Ca’ Foscari Venezia, Venice, Italy
  
• 刊物类别：Computer Science
• 刊物主题：Pattern Recognition
  
• 出版者：Springer London
• ISSN：1433-755X

文摘

Interactive whiteboards are nowadays rather common equipments in classrooms as they provide large advantages in terms of expressive power. Despite the radical paradigm shift, their interaction model is firmly tied to the archetypal concept of strokes and gestures over a whiteboard. In this paper we introduce a novel pointing device that enables one to escape the surface-based interaction, by means of a robust and occlusion-resilient multi-camera 3D tracking. More precisely, we designed a frequency-based active pen. By means of a camera network such pen can be localized in a 3D frame featuring the same 5 degrees of freedom exposed by a real whiteboard marker. Our approach allows for using many pointers at the same time, by reliably assigning an unique and permanent identity to each one. By levering on these capabilities, interaction designers can conceive new and inventive interaction models. A few of them have been implemented within this study and are described in the experimental part of this work. Keywords Tracking Human-machine interaction Interactive whiteboards Artificial markers