笔式聋儿多媒体讲课系统的设计与实现
|
摘要
随着计算机应用领域的不断拓展,教育领域首当其冲,尤其对于聋儿教育领域,借助先进的计算机多媒体工具进行教学,实现传统媒体与电教媒体的有机结合,可以更好地利用聋幼儿的残余听力,达到优化聋幼儿语言康复训练的目的。多种媒体在聋儿教师的经验指导下有机的整合,在聋儿的康复过程中具有重要的作用,通过一个完整的课件可以使聋儿了解周围世界、认识自我、并融入文化。传统的鼠标、键盘的交互方式并不适合老师们上课时使用,并且两者的切换很不自然。笔手势交互是近年来迅速发展起来的一种人机交互技术,它适应了“以人为中心”的自然交互准则,也被诸多研究证明是提高交互效率和自然性的有效途径。随着人机交互户界面的不断发展,笔手势交互技术已经在一些面向儿童教育的交互系统中得到了应用。
本文主要在面向聋儿的讲课系统与基于笔的单笔手势的结合方面研究了一些新的设计和解决方法,设计并实现了基于笔的多媒体聋儿讲课系统,采用笔手势交互的自然交互方式,增强老师在课堂上对课堂的把握能力,运用他们已有的经验,充分发挥了他们的想象力和创造力,吸引聋儿的注意力,进一步提高聋儿的听力康复速度。本文的主要研究内容如下:
1、深入分析了目前国内外手势识别技术,以及多媒体教学的进展和现状,比较和研究了大量多媒体教学系统的优劣点和适用范围,提出了普遍的交互体验不足的问题,提出了新的基于笔手势的多媒体教学方法。
2、将多种媒体应用于教学过程中,提出了将传统的基于鼠标、按钮的音视频编辑交互与笔手势交互相结合的方式,给用户提供了新的交互途径,用简单的勾画就可以准确地进行所需的操作,简化了备课和授课过程中的繁复操作,使教师将更多的精力关注于教学质量。
3、提出了视频编辑的预览选择再定位方法,摒弃了精确定位复杂操作,简化了交互难度。不但满足了教师的需求,达到了反复选择再相对精确定位的目的,还简化了操作难度。
4、在前面几项工作的基础上,设计并实现了面向聋儿的多媒体讲课系统及相关工具。该系统以手势作为主要的交互方式,通过自然、和谐的笔式用户界面,将讲课和素材的制作过程变得非常简单、有趣,极大地提高了用户的交互体验。
Company with the expansion of computer's application, computers be used in more and more field. Education is the most important use of computer.In the domain of deaf children education, we can combine traditional media and multimedia with the advanced multimedia techniques, and then we can obviously improve effects of hearing recovering for deaf children. Under the instruction of deaf child teacher's experience, many kinds of media have been integrated play an important role. Children learn to understand the world and culture surrounding them, and to recognize and blend themselves into the social and cultural context, by a good courseware. However, due to the unnatural switch operation, the traditional interaction style with mouse and keyboard is not suitable for children. Recently, the Pen-based gestures interaction is a rapidly developing technique in the Human-Computer Interaction. It adapts the "human-centered" principle of natural interaction and has been proved to be a valid way to improve the efficiency and the neutrality of interaction by a lot of research work. With the development of the multimodal user interfaces, the Pen-based gestures interactionhas been applied in several children's interaction systems.
The thesis presents some novice method focus on the application of deaf children's teaching system combine with the single gestures. A pen-based multimedia courseware system for deaf children has been designed and developed, which uses the natural interaction modal to enhance the imagination and creativity of teacher and attract deaf child's attention are based on teacher's experience. The main contributions of the thesis are:
1. Analyzed the development of technology of gestures and the use of multimedia in education. Presents a pen-based multimedia educates method.
2. Applies the many kinds of media in the teaching process, combine the traditional interactive method such as icon and mouse with pen gestures, which used in audio and video's edit progress. Simplified the complicate operations in preparing and teaching lessons. So that teacher can pay more attention to the deaf children's recovering.
3. Give a way to re-edit audio and vedio files by pre-view and re-choice.Reduced the interface difficulty and satisfied the requirements of teachers.
4. Based on the work above ,designed multimedia teaching system used for deaf child and several related tools . The interaction is based on pen gestures, improved users experiences.
本文主要在面向聋儿的讲课系统与基于笔的单笔手势的结合方面研究了一些新的设计和解决方法,设计并实现了基于笔的多媒体聋儿讲课系统,采用笔手势交互的自然交互方式,增强老师在课堂上对课堂的把握能力,运用他们已有的经验,充分发挥了他们的想象力和创造力,吸引聋儿的注意力,进一步提高聋儿的听力康复速度。本文的主要研究内容如下:
1、深入分析了目前国内外手势识别技术,以及多媒体教学的进展和现状,比较和研究了大量多媒体教学系统的优劣点和适用范围,提出了普遍的交互体验不足的问题,提出了新的基于笔手势的多媒体教学方法。
2、将多种媒体应用于教学过程中,提出了将传统的基于鼠标、按钮的音视频编辑交互与笔手势交互相结合的方式,给用户提供了新的交互途径,用简单的勾画就可以准确地进行所需的操作,简化了备课和授课过程中的繁复操作,使教师将更多的精力关注于教学质量。
3、提出了视频编辑的预览选择再定位方法,摒弃了精确定位复杂操作,简化了交互难度。不但满足了教师的需求,达到了反复选择再相对精确定位的目的,还简化了操作难度。
4、在前面几项工作的基础上,设计并实现了面向聋儿的多媒体讲课系统及相关工具。该系统以手势作为主要的交互方式,通过自然、和谐的笔式用户界面,将讲课和素材的制作过程变得非常简单、有趣,极大地提高了用户的交互体验。
Company with the expansion of computer's application, computers be used in more and more field. Education is the most important use of computer.In the domain of deaf children education, we can combine traditional media and multimedia with the advanced multimedia techniques, and then we can obviously improve effects of hearing recovering for deaf children. Under the instruction of deaf child teacher's experience, many kinds of media have been integrated play an important role. Children learn to understand the world and culture surrounding them, and to recognize and blend themselves into the social and cultural context, by a good courseware. However, due to the unnatural switch operation, the traditional interaction style with mouse and keyboard is not suitable for children. Recently, the Pen-based gestures interaction is a rapidly developing technique in the Human-Computer Interaction. It adapts the "human-centered" principle of natural interaction and has been proved to be a valid way to improve the efficiency and the neutrality of interaction by a lot of research work. With the development of the multimodal user interfaces, the Pen-based gestures interactionhas been applied in several children's interaction systems.
The thesis presents some novice method focus on the application of deaf children's teaching system combine with the single gestures. A pen-based multimedia courseware system for deaf children has been designed and developed, which uses the natural interaction modal to enhance the imagination and creativity of teacher and attract deaf child's attention are based on teacher's experience. The main contributions of the thesis are:
1. Analyzed the development of technology of gestures and the use of multimedia in education. Presents a pen-based multimedia educates method.
2. Applies the many kinds of media in the teaching process, combine the traditional interactive method such as icon and mouse with pen gestures, which used in audio and video's edit progress. Simplified the complicate operations in preparing and teaching lessons. So that teacher can pay more attention to the deaf children's recovering.
3. Give a way to re-edit audio and vedio files by pre-view and re-choice.Reduced the interface difficulty and satisfied the requirements of teachers.
4. Based on the work above ,designed multimedia teaching system used for deaf child and several related tools . The interaction is based on pen gestures, improved users experiences.
引文
[Mark Weiser,1991],Mark Weiser,"The Computer for the Twenty-First Century,"Scientific American,pp.94-10,September 1991
[Jurgen,1996].Jurgen,Interactive Techniques[C].ACM Computer Survey,1996.
[Briggs R.,1996].Briggs R.,Dennis A.,Beck B.and Nunamaker J.Whither the Pen-based Interface?,Journal of Management Information Systems,9(3),pp71-90,1993
[Sutherland I.E.,1963].Sutherland I.E.A man-machine graphical communication system[C].AFIPS Conference Proceedings,1963.
[Davis M.R.,1964],Davis M.R.Ellis T.O.The Rand Tablet:A Man-Machine Graphical Communication Device[C].Proceedings of Human Factors in Computing System,ACM CHI'95.Denver,CO,1964.
[Moran T.P.,1981],Moran T.P.Mellew V.,Chiu P.Spatial Interpretation of Domain Objects Integrated into a Freeform Electronic Whiteboard[C].In Proceedings of the ACM Symposium on User Interface Software and Technology:UIST'98.San Francisco,CA.,1998.
[Pedersen E.R.,1993].Pedersen E.R.Mccall K.,Moran T.P.,Halasz F.G.Tivoli:An Electronic Whiteboard for Informal Workgroup Meetings[C].In Proceedings of the ACM INTERCHI'93 Conference on Human in Computing Systems,1993.
[Hong J.I.,2000].Hong J.I.,Landay J.A.SATIN:A Toolkit for Informal Ink-based Applications[C].In Proceedings of UIST'00 Symposium on User Interface Software and Technology.San Diego,CA.,2000.
[Lin J.,Newman M.,2000].Lin J.,Newman M.,Hong J.,Landay J.DENIM:Finding a Tighter Fit Between Tools and Practice for Web Site Design[C].CHI Letters:Human Factors in Computing Systems,CHI'2000,2000.
[Lin James,2002].Lin James,Landay James A.Damask:A Tool for Early-Stage Design and Prototyping of Multi-Device User Interfaces[C].In Proceedings of the 8th International Conference on Distributed Multimedia Systems(2002 International Workshop on Visual Computing).San Francisco,CA.,2002.
[Landay J.A.,1996].Landay J.A.,SILK:Sketching Interfaces Like Crazy[C].Proceedings of Human Factors in Computing Systems(Conference Companion),ACM CHI'96.Vancouver,Canada,1996.
[Landay J.A.,2001].Landay J.A.,Myers B.A.Sketching Interfaces:Toward More Human Interface Design[C].IEEE Computer,2001.
[Rosson,2002].Rosson M B and Carroll J M.Scenario-Based Design.In:Jacko J A and Sears A.The Human-Computer Interaction Handbook[M].New Jersey:Lawrence Erlbaum Associates,2002.1032-1050.
[Management Services,1989].Computer helps Deaf Children's Literacy.Mar 1989,Vol.33 Issue 3,p42-43,
[Hudson valley,2001].Hudson valley,Talking Tutor software teaches deaf children to speck.Business Journal.march.12.2001.
[Franz Dotter,1996].Franz Dotter,Computer for the deaf(and hearing impaired):Towards an integrated solution from a linguistic standpoint.In:Klaus,Joachim/Auff,Eduard/Kremser Willibald/Zagler,Wolfgang L.(eds.):Interdisciplinary aspects on computers helping people with special needs. Wien/Miinchen:Oldenbourg 1996,Bd 1,S.205-210
[Linda Mechling,2005].Linda Mechling,The Effect of Instructor-created Video Programs to Teach Students with Disabilities:A Literature Review.Journal of Special Education Technology,20(2),Spring 2005.25-37.
[Nicholas Siakopoulos,2006],Nicholas Siakopoulos;Irfan Essa,Videotater:An Approach for Pen-Based Digital Video Segmentation and Tagging,UIST'06,October 15-18,2006,pp221-224
[Beaudouin LM,2000].Beaudouin LM,Instrumental interaction:an interaction model for designing post-WIMP user interfaces.In:Turner T,Szwillus G.eds.Proceedings of the SIGCHI conference on Human factors in computing systems,New York:ACM Press,2000.446-453.
[Golub E,2004].Golub E,Handwritten slides on a tabletPC in a discrete mathematics course.In:Joyce D,Knox D,Dann W,Naps T,eds.Proceedings of the 35th SIGCSE technical symposium on Computer science education.New York:ACM Press,2004.51-55
[Rubine D,1991].Rubine D,Specifying gestures by example[J].Computer Graphics,1991,25:329-337.
[Igarashi T.,1997],Igarashi T.,Matsuoka S.,Kawachiya S.,Tanaka H.Interactive Beautification:A Technique for Rapid Geometric Design[C].UIST,1997.
[Sezgin Tevfik Metin,2001],Sezgin Tevfik Metin,Stahovich Thomas,Davis Randall.Sketch Based Interfaces:Early Processing for Sketch Understanding[C].In Proceedings of 2001 Perceptive User Interface Workshop(PUI'01),2001.
[Banks M.,1990],Banks M.,Cohen E.Realtime spline curves from interactively sketched data[C].In SIGGRAPH,Symposium on 3D Graphics,1990.
[Eggli L.,1994].Eggli L.,Sketching with constraints[D].University of Utah,1994.
[P.Phoenix,1988].P.Phoenix,:An interactive curve design system based on the automatic fitting of hand-sketched curves[D].University of Washington,1988.
[Mankoff Jennifer,2000].Mankoff Jennifer,Hudson Scott E.,Abowd Grefory D.Providing integrated toolkit-level support for ambiguity in recognition-based interfaces[C].In Proceedings of the CHI2000 conference on Human factors in computing systems,2000.
[Kobsa,1994]Alfred Kobsa,User Modeling and User-Adapted Interaction,Proc.Of CHI 1994.
[Ellen Yi-Luen,1996].Ellen Yi-Luen,Gross Mark D.Drawings as a means to design reasoning[J].AI and Design,1996.
[Alvarado Christine,2001].Alvarado Christine,Davis Randall.Resolving Ambiguities to Create a Natural Computer-Based Sketching Environment[C].In Proceedings of IJCAI-01,2001.
[Nicholas,2006].Nicholas,Diakopoulos,Irfan Essa,Videotater:An Approach for Pen-Based Digital Video Segmentation and Tagging.College of Computing(IIC),GVU Center,Georgia,Georgia Institute of Technology 855thStreet NW,Atlanta,GA 30332-0760,2006.USA
[董建明,2002]。董建明,Salvendy Gavriel.人机交互:以用户为中心的设计和评估[M].清华大学出版社,2002.
[李杰,2002]。李杰,笔式用户界面开发方法研究[D]。中国科学院软件研究所,2002。
[孙丽萍,2004],孙丽萍,丛慧,阴凌.多媒体听觉学习系统教学与传统听觉训练之比较 (The compareison of the Multimedia audiotory sensation learning system teachings and the traditional auditory sensation training)中国听力语言康复科学杂志2004年第一期
[蔡利栋,2006]。蔡利栋,Alan Dix.Gregory D.Abowd.Janet Finlay.Russell Beale著.蔡利栋,方思行,周继鹏等译.人机交互(第三版).北京:电子工业出版社.2006.
[籍静媛,2005].籍静媛,黄昭鸣。聋儿康复和聋儿教育应该适应多媒体技术的发展-中国听力语言康复科学杂志,2005
[葛修娟,2005],在学科教学中利用视觉文化发展聋生智力的策略研究,南京特教学院学报,Sep.2005,No 3
[m.w.艾森克,2002].m.w.艾森克,m.Z.基恩,《认知心理学》,华东师范大学出版社,2002年版
[李明,2004],李明,运用多媒体教学手段优化聋幼儿语言康复训练,现代特殊教育,2004
[余敦清,1989].余敦清,聋儿康复的初步探索:聋儿听觉语言康复实验报告,中国康复,1989
[郭金美,2005],郭金美,陈玲聋儿心理健康状况分析及对策,中华现代医学与临床,2005
[梁巍,2004],梁巍,历史新阶段开展聋儿早期康复教育工作的观念与对策,中国听力语言康复科学杂志,2004,1
[汪海萍,2004]。汪海萍,美国特教印象及其思考.中国特殊教育,2004,1:79-83
[马艳云,2004].马艳云,视听觉障碍儿童的认知能力.中国特殊教育,2004,1:59-61
[金野,2005].金野,谈特教教师在教学中的多媒体应用问题.中国特殊教育,2005,6:84-87
[叶奕乾,1991].叶奕乾,何存道,梁宁建等,普通心理学(修订2版),1991年
[郑伟伟,2004].郑伟伟,试探CAI课件教学在聋儿素质教育中的重要作用.中国听力语言康复科学杂志.2004年1期
[张筠曼,2000].张筠曼,计算机辅助聋生数学学习的研究.特殊教育研究.2000年1期,29-32.
[陈洪才,2001]。陈洪才,谈聋校数学CAI课件的制作与应用.教育现代化.2001年9期,56
[宗志虹,2005].宗志虹,多媒体在聋校教学中的应用。南昌教育-2005年3期,27
[董小刚,2004],董小刚,Eduoffice--帮你方便地完成数字化教学任务,《电脑校园》-2004年12期-28-29
[黄昭鸣,2004],黄昭鸣,杜晓新,黄鹤年,语训新说:新概念学说话,现代特殊教育,2004年2期,41-42
[周若鸿,2004],孙正兴,张莉莎,徐晓刚.草图理解技术研究进展[J].计算机科学,2004,31(4).
[马翠霞,2004],张凤军,陈由迪,戴国忠.支持概念设计的特征手势建模[J].计算机辅助设计与图形学学报,2004,16(4).
[马翠霞,2005],王宏安,戴国忠,陈由迪.基于手势和草图的概念设计协同交互的研究[J].计算机研究与发展,2005,42(5).
[宋保华,2004],宋保华,叶军,于明玖,杨海成,陆长德.笔输入草图的分层识别[J].计算机辅助设计与图形学学报,2004,16(6).
[田丰,20031田丰,Post-WIMP软件界面研究,中国科学院研究生院博士学位论文,2003
[栗阳,2002]栗阳,笔式用户界面研究--理论、方法和实现,中国科学院研究生院博士学位论文,2002.5
[秦严严,2006]秦严严,田丰,王晓春,戴国忠.以交互为中心的Post-WIMP界面模型研究。软件学报,April 2006,17(4):691-70
[杨斌,2002],杨斌,何玉林.基于草图的计算机辅助家具造型技术[J].计算机辅助设计与图形学学报,2002,14(6)。
[孙正兴,2004],孙正兴,彭彬彬,丛兰兰,孙建勇,张斌.在线草图识别中的用户适应性研究[J]。计算机辅助设计与图形学学报,2004,16(9)。
[董建明,2003]董建明,傅利民.人机交互:以用户为中心的设计与评估.北京:清华大学出版社.2003。
[1].IT in education,http://www.networkmagazineindia.com/200508/coverstory04.shtml
[2].http://www.whaty.com/product/jpkj.htm
[3].http://www.aojoy.com
[4].http://www.guanghua.sh.cn/guanghua/eng/product/jy/jy_01a.htm
[Jurgen,1996].Jurgen,Interactive Techniques[C].ACM Computer Survey,1996.
[Briggs R.,1996].Briggs R.,Dennis A.,Beck B.and Nunamaker J.Whither the Pen-based Interface?,Journal of Management Information Systems,9(3),pp71-90,1993
[Sutherland I.E.,1963].Sutherland I.E.A man-machine graphical communication system[C].AFIPS Conference Proceedings,1963.
[Davis M.R.,1964],Davis M.R.Ellis T.O.The Rand Tablet:A Man-Machine Graphical Communication Device[C].Proceedings of Human Factors in Computing System,ACM CHI'95.Denver,CO,1964.
[Moran T.P.,1981],Moran T.P.Mellew V.,Chiu P.Spatial Interpretation of Domain Objects Integrated into a Freeform Electronic Whiteboard[C].In Proceedings of the ACM Symposium on User Interface Software and Technology:UIST'98.San Francisco,CA.,1998.
[Pedersen E.R.,1993].Pedersen E.R.Mccall K.,Moran T.P.,Halasz F.G.Tivoli:An Electronic Whiteboard for Informal Workgroup Meetings[C].In Proceedings of the ACM INTERCHI'93 Conference on Human in Computing Systems,1993.
[Hong J.I.,2000].Hong J.I.,Landay J.A.SATIN:A Toolkit for Informal Ink-based Applications[C].In Proceedings of UIST'00 Symposium on User Interface Software and Technology.San Diego,CA.,2000.
[Lin J.,Newman M.,2000].Lin J.,Newman M.,Hong J.,Landay J.DENIM:Finding a Tighter Fit Between Tools and Practice for Web Site Design[C].CHI Letters:Human Factors in Computing Systems,CHI'2000,2000.
[Lin James,2002].Lin James,Landay James A.Damask:A Tool for Early-Stage Design and Prototyping of Multi-Device User Interfaces[C].In Proceedings of the 8th International Conference on Distributed Multimedia Systems(2002 International Workshop on Visual Computing).San Francisco,CA.,2002.
[Landay J.A.,1996].Landay J.A.,SILK:Sketching Interfaces Like Crazy[C].Proceedings of Human Factors in Computing Systems(Conference Companion),ACM CHI'96.Vancouver,Canada,1996.
[Landay J.A.,2001].Landay J.A.,Myers B.A.Sketching Interfaces:Toward More Human Interface Design[C].IEEE Computer,2001.
[Rosson,2002].Rosson M B and Carroll J M.Scenario-Based Design.In:Jacko J A and Sears A.The Human-Computer Interaction Handbook[M].New Jersey:Lawrence Erlbaum Associates,2002.1032-1050.
[Management Services,1989].Computer helps Deaf Children's Literacy.Mar 1989,Vol.33 Issue 3,p42-43,
[Hudson valley,2001].Hudson valley,Talking Tutor software teaches deaf children to speck.Business Journal.march.12.2001.
[Franz Dotter,1996].Franz Dotter,Computer for the deaf(and hearing impaired):Towards an integrated solution from a linguistic standpoint.In:Klaus,Joachim/Auff,Eduard/Kremser Willibald/Zagler,Wolfgang L.(eds.):Interdisciplinary aspects on computers helping people with special needs. Wien/Miinchen:Oldenbourg 1996,Bd 1,S.205-210
[Linda Mechling,2005].Linda Mechling,The Effect of Instructor-created Video Programs to Teach Students with Disabilities:A Literature Review.Journal of Special Education Technology,20(2),Spring 2005.25-37.
[Nicholas Siakopoulos,2006],Nicholas Siakopoulos;Irfan Essa,Videotater:An Approach for Pen-Based Digital Video Segmentation and Tagging,UIST'06,October 15-18,2006,pp221-224
[Beaudouin LM,2000].Beaudouin LM,Instrumental interaction:an interaction model for designing post-WIMP user interfaces.In:Turner T,Szwillus G.eds.Proceedings of the SIGCHI conference on Human factors in computing systems,New York:ACM Press,2000.446-453.
[Golub E,2004].Golub E,Handwritten slides on a tabletPC in a discrete mathematics course.In:Joyce D,Knox D,Dann W,Naps T,eds.Proceedings of the 35th SIGCSE technical symposium on Computer science education.New York:ACM Press,2004.51-55
[Rubine D,1991].Rubine D,Specifying gestures by example[J].Computer Graphics,1991,25:329-337.
[Igarashi T.,1997],Igarashi T.,Matsuoka S.,Kawachiya S.,Tanaka H.Interactive Beautification:A Technique for Rapid Geometric Design[C].UIST,1997.
[Sezgin Tevfik Metin,2001],Sezgin Tevfik Metin,Stahovich Thomas,Davis Randall.Sketch Based Interfaces:Early Processing for Sketch Understanding[C].In Proceedings of 2001 Perceptive User Interface Workshop(PUI'01),2001.
[Banks M.,1990],Banks M.,Cohen E.Realtime spline curves from interactively sketched data[C].In SIGGRAPH,Symposium on 3D Graphics,1990.
[Eggli L.,1994].Eggli L.,Sketching with constraints[D].University of Utah,1994.
[P.Phoenix,1988].P.Phoenix,:An interactive curve design system based on the automatic fitting of hand-sketched curves[D].University of Washington,1988.
[Mankoff Jennifer,2000].Mankoff Jennifer,Hudson Scott E.,Abowd Grefory D.Providing integrated toolkit-level support for ambiguity in recognition-based interfaces[C].In Proceedings of the CHI2000 conference on Human factors in computing systems,2000.
[Kobsa,1994]Alfred Kobsa,User Modeling and User-Adapted Interaction,Proc.Of CHI 1994.
[Ellen Yi-Luen,1996].Ellen Yi-Luen,Gross Mark D.Drawings as a means to design reasoning[J].AI and Design,1996.
[Alvarado Christine,2001].Alvarado Christine,Davis Randall.Resolving Ambiguities to Create a Natural Computer-Based Sketching Environment[C].In Proceedings of IJCAI-01,2001.
[Nicholas,2006].Nicholas,Diakopoulos,Irfan Essa,Videotater:An Approach for Pen-Based Digital Video Segmentation and Tagging.College of Computing(IIC),GVU Center,Georgia,Georgia Institute of Technology 855thStreet NW,Atlanta,GA 30332-0760,2006.USA
[董建明,2002]。董建明,Salvendy Gavriel.人机交互:以用户为中心的设计和评估[M].清华大学出版社,2002.
[李杰,2002]。李杰,笔式用户界面开发方法研究[D]。中国科学院软件研究所,2002。
[孙丽萍,2004],孙丽萍,丛慧,阴凌.多媒体听觉学习系统教学与传统听觉训练之比较 (The compareison of the Multimedia audiotory sensation learning system teachings and the traditional auditory sensation training)中国听力语言康复科学杂志2004年第一期
[蔡利栋,2006]。蔡利栋,Alan Dix.Gregory D.Abowd.Janet Finlay.Russell Beale著.蔡利栋,方思行,周继鹏等译.人机交互(第三版).北京:电子工业出版社.2006.
[籍静媛,2005].籍静媛,黄昭鸣。聋儿康复和聋儿教育应该适应多媒体技术的发展-中国听力语言康复科学杂志,2005
[葛修娟,2005],在学科教学中利用视觉文化发展聋生智力的策略研究,南京特教学院学报,Sep.2005,No 3
[m.w.艾森克,2002].m.w.艾森克,m.Z.基恩,《认知心理学》,华东师范大学出版社,2002年版
[李明,2004],李明,运用多媒体教学手段优化聋幼儿语言康复训练,现代特殊教育,2004
[余敦清,1989].余敦清,聋儿康复的初步探索:聋儿听觉语言康复实验报告,中国康复,1989
[郭金美,2005],郭金美,陈玲聋儿心理健康状况分析及对策,中华现代医学与临床,2005
[梁巍,2004],梁巍,历史新阶段开展聋儿早期康复教育工作的观念与对策,中国听力语言康复科学杂志,2004,1
[汪海萍,2004]。汪海萍,美国特教印象及其思考.中国特殊教育,2004,1:79-83
[马艳云,2004].马艳云,视听觉障碍儿童的认知能力.中国特殊教育,2004,1:59-61
[金野,2005].金野,谈特教教师在教学中的多媒体应用问题.中国特殊教育,2005,6:84-87
[叶奕乾,1991].叶奕乾,何存道,梁宁建等,普通心理学(修订2版),1991年
[郑伟伟,2004].郑伟伟,试探CAI课件教学在聋儿素质教育中的重要作用.中国听力语言康复科学杂志.2004年1期
[张筠曼,2000].张筠曼,计算机辅助聋生数学学习的研究.特殊教育研究.2000年1期,29-32.
[陈洪才,2001]。陈洪才,谈聋校数学CAI课件的制作与应用.教育现代化.2001年9期,56
[宗志虹,2005].宗志虹,多媒体在聋校教学中的应用。南昌教育-2005年3期,27
[董小刚,2004],董小刚,Eduoffice--帮你方便地完成数字化教学任务,《电脑校园》-2004年12期-28-29
[黄昭鸣,2004],黄昭鸣,杜晓新,黄鹤年,语训新说:新概念学说话,现代特殊教育,2004年2期,41-42
[周若鸿,2004],孙正兴,张莉莎,徐晓刚.草图理解技术研究进展[J].计算机科学,2004,31(4).
[马翠霞,2004],张凤军,陈由迪,戴国忠.支持概念设计的特征手势建模[J].计算机辅助设计与图形学学报,2004,16(4).
[马翠霞,2005],王宏安,戴国忠,陈由迪.基于手势和草图的概念设计协同交互的研究[J].计算机研究与发展,2005,42(5).
[宋保华,2004],宋保华,叶军,于明玖,杨海成,陆长德.笔输入草图的分层识别[J].计算机辅助设计与图形学学报,2004,16(6).
[田丰,20031田丰,Post-WIMP软件界面研究,中国科学院研究生院博士学位论文,2003
[栗阳,2002]栗阳,笔式用户界面研究--理论、方法和实现,中国科学院研究生院博士学位论文,2002.5
[秦严严,2006]秦严严,田丰,王晓春,戴国忠.以交互为中心的Post-WIMP界面模型研究。软件学报,April 2006,17(4):691-70
[杨斌,2002],杨斌,何玉林.基于草图的计算机辅助家具造型技术[J].计算机辅助设计与图形学学报,2002,14(6)。
[孙正兴,2004],孙正兴,彭彬彬,丛兰兰,孙建勇,张斌.在线草图识别中的用户适应性研究[J]。计算机辅助设计与图形学学报,2004,16(9)。
[董建明,2003]董建明,傅利民.人机交互:以用户为中心的设计与评估.北京:清华大学出版社.2003。
[1].IT in education,http://www.networkmagazineindia.com/200508/coverstory04.shtml
[2].http://www.whaty.com/product/jpkj.htm
[3].http://www.aojoy.com
[4].http://www.guanghua.sh.cn/guanghua/eng/product/jy/jy_01a.htm