一种基于颜色结构光的投影仪摄像头触摸板人机交互系统
|
摘要
本文提出了一种只用投影仪和单摄像头搭建的投影触摸板人机交互系统.本人机交互系统是利用投影仪摄像头系统对手指的运动进行捕捉,可以使任何平面变成触摸板.本文分析了系统测量三维坐标的误差,通过优化标定提高了测量精度.为了解决手指触碰的高度和位置的精准度问题,基于建立的手指模型利用颜色结构光来实时获取手指三维信息和寻找触碰点,并且利用卡尔曼滤波优化手指触碰后手指的运动轨迹,提高了手指触碰的精度在2mm以下99%准确率,触碰后的位置精度达到1个像素点,利用投影仪-摄像头系统实现了触摸板的功能和应用.
A method using only one projector and one camera is proposed to build a Projector-Camera-Touchpad(PCT).This HCI system uses projector-camera to catch the finger's motion to make any plane to a touchpad.This paper analyzes the error measuring the 3-dimentional coordinates of the system,and improves the accuracy by optimizing the calibration.To solve the problem of height when to touch happens and finger's position accuracy,based on a finger model the color structured light is adopted to get 3-dimension information and locate the finger touch point.At meanwhile,the trajectory of finger touch is optimized by Kalman filter.Finally,the touch accuracy is improved to 99% under 2mm and touch position precision are increased to 1pixel.The function of the touchpad is realized by the projector-camera system.
A method using only one projector and one camera is proposed to build a Projector-Camera-Touchpad(PCT).This HCI system uses projector-camera to catch the finger's motion to make any plane to a touchpad.This paper analyzes the error measuring the 3-dimentional coordinates of the system,and improves the accuracy by optimizing the calibration.To solve the problem of height when to touch happens and finger's position accuracy,based on a finger model the color structured light is adopted to get 3-dimension information and locate the finger touch point.At meanwhile,the trajectory of finger touch is optimized by Kalman filter.Finally,the touch accuracy is improved to 99% under 2mm and touch position precision are increased to 1pixel.The function of the touchpad is realized by the projector-camera system.
引文
[1] Wilson A D.Using a depth camera as a touch sensor[C]//proc.of ACM int.conf.interactive tabletops and surfaces.Saarbrcken,Germany,2010:69-72.
[2] Wilson A D.Play Anywhere:a compact interactive tabletop projection-vision system[C]//Proc.of the 18th annual ACM symp.User interface software and technology.New York,2005:83-92.
[3]Harrison C,Benko H,Wilson A D.OmniTouch:wearable multi touch interaction everywhere[C]//Proc.of the 24th annual ACM symp.User interface software and technology.Berlin,2011:441-450.
[4] Dai J,Chung R.Making any planar surface into a touch sensitive display by a mere projector and camera[C]//Proc.of IEEE Computer Vision and Pattern Recognition Workshops(CVPRW).CVPRW).Providence,Rhode Island,USA,2012:35-42.
[5] Hu J,Li G,Xie X,et al.Bare-fingers touch detection by the button's distortion in projector-camera system[J].IEEE Trans.On Circuits and Systems for Video Technology,2014,24(4):566-575.
[6] Cai X,Xie X,Li G,et al.A new method of detecting fingertip touch for the projector-camera HCI system[C]//Proc.of IEEE Int.Symp.on Circuits and Systems.Melbourne,Australia,2014:526-529.
[7] Li S,Xie X,Li G,et al.Bare-finger projector-cameratouchpad(PCT)HCI system using color structured light[C]//IEEE International Symposium on Circuits and Systems.Baltimore,MD,USA,IEEE,2017:1-4.
[8]宋玮,郑毅,谢翔,等.一种投影仪-摄像机系统的简易高精度标定方法[J].微电子学与计算机,2015,32(2):28-32.
[9] Zhang Y,Li G,Xie X,et al.A new algorithm for accurate and automatic chessboard corner detection[C]//IEEE International Symposium on Circuits and Systems.Baltimore,MD,USA,IEEE,2017:1-4.
[10]Lanman D,Taubin G.Build your own 3Dscanner:3D photography for beginners[EB/OL].(2016-09-26).http://mesh.brown.edu/byo3d/
[11]Faragher R.Understanding the basis of the kalman filter via a simple and intuitive derivation[Lecture Notes][J].IEEE Signal Processing Magazine,2012,29(5):128-132.
[2] Wilson A D.Play Anywhere:a compact interactive tabletop projection-vision system[C]//Proc.of the 18th annual ACM symp.User interface software and technology.New York,2005:83-92.
[3]Harrison C,Benko H,Wilson A D.OmniTouch:wearable multi touch interaction everywhere[C]//Proc.of the 24th annual ACM symp.User interface software and technology.Berlin,2011:441-450.
[4] Dai J,Chung R.Making any planar surface into a touch sensitive display by a mere projector and camera[C]//Proc.of IEEE Computer Vision and Pattern Recognition Workshops(CVPRW).CVPRW).Providence,Rhode Island,USA,2012:35-42.
[5] Hu J,Li G,Xie X,et al.Bare-fingers touch detection by the button's distortion in projector-camera system[J].IEEE Trans.On Circuits and Systems for Video Technology,2014,24(4):566-575.
[6] Cai X,Xie X,Li G,et al.A new method of detecting fingertip touch for the projector-camera HCI system[C]//Proc.of IEEE Int.Symp.on Circuits and Systems.Melbourne,Australia,2014:526-529.
[7] Li S,Xie X,Li G,et al.Bare-finger projector-cameratouchpad(PCT)HCI system using color structured light[C]//IEEE International Symposium on Circuits and Systems.Baltimore,MD,USA,IEEE,2017:1-4.
[8]宋玮,郑毅,谢翔,等.一种投影仪-摄像机系统的简易高精度标定方法[J].微电子学与计算机,2015,32(2):28-32.
[9] Zhang Y,Li G,Xie X,et al.A new algorithm for accurate and automatic chessboard corner detection[C]//IEEE International Symposium on Circuits and Systems.Baltimore,MD,USA,IEEE,2017:1-4.
[10]Lanman D,Taubin G.Build your own 3Dscanner:3D photography for beginners[EB/OL].(2016-09-26).http://mesh.brown.edu/byo3d/
[11]Faragher R.Understanding the basis of the kalman filter via a simple and intuitive derivation[Lecture Notes][J].IEEE Signal Processing Magazine,2012,29(5):128-132.