用户名: 密码: 验证码:
现代交互技术下的Story-Telling方法综述
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:A Survey on Story-Telling Methods in Modern Interaction Technology
  • 作者:李翔 ; 黄进 ; 田丰 ; 刘杰 ; 王宏安 ; 戴国忠
  • 英文作者:Li Xiang;Huang Jin;Tian Feng;Liu Jie;Wang Hongan;Dai Guozhong;Beijing Key Laboratory of Human-Computer Interaction, Institute of Software, Chinese Academy of Sciences;School of Computer and Control Engineering, University of Chinese Academy of Sciences;
  • 关键词:故事讲述 ; 交互技术 ; 场景树设计工具 ; 笔式交互 ; 儿童教育
  • 英文关键词:story-telling;;interaction technology;;scenario tree design tool;;pen-based interaction;;children education
  • 中文刊名:JSJF
  • 英文刊名:Journal of Computer-Aided Design & Computer Graphics
  • 机构:中国科学院软件研究所人机交互北京市重点实验室;中国科学院大学计算机与控制学院;
  • 出版日期:2019-03-15
  • 出版单位:计算机辅助设计与图形学学报
  • 年:2019
  • 期:v.31
  • 基金:国家重点研发计划(2016YFB1001405)
  • 语种:中文;
  • 页:JSJF201903001
  • 页数:15
  • CN:03
  • ISSN:11-2925/TP
  • 分类号:3-17
摘要
Story-Telling(ST)是一种训练儿童语言表达能力的重要教育活动,随着新型交互技术的不断发展,大量工作致力于将这些新型交互技术融入ST场景之中,涌现出一系列ST系统原型以及商业应用.文中围绕近十年来关于ST应用技术的研究,重点讨论了ST技术的应用需求以及ST系统中交互技术的运用,并以应用场景作为划分介绍了典型的ST系统.文中针对已有系统中存在的几个突出问题,提出了一套基于场景树设计工具的儿童讲述故事应用设计方法,并对这套设计方法的创新点和贡献做出了讨论.最后对ST这一领域的未来发展方向进行了展望.
        Story-telling(ST) is an important activity to train children's language expression ability. With the development of novel human-computer interaction technologies, a numerous of researches have been done aiming for integrating these new technologies into ST scenarios, and a series of ST prototypes and commercial systems have been developed. This paper reviewed researches in the field of ST in the last decade, and discussed technical requirements of the ST scenarios, as well as how interactive technologies can be applied in the scenarios. Typical ST systems categorized by application scenarios were summarized and introduced. To address the problems of the existing systems, this paper proposed a set of methods for designing ST applications based on a scenario tree design tool(SDT). Finally, the paper concluded with a discussion of future development in this field.
引文
[1]Druin A,Montemayor J,Hendler J,et al.Designing PETS:a personal electronic teller of stories[C]//Proceedings of SIGCHIConference on Human Factors in Computing Systems.New York:ACM Press,1999:326-329
    [2]Friedrich-Cofer L K,Huston-Stein A,Mcbride Kipnis D,et al.Environmental enhancement of prosocial television content:effects on interpersonal behavior,imaginative play,and self-regulation in a natural setting[J].Developmental Psychology,1979,15(6):637-646
    [3]Glos J W,Cassell J.Rosebud:technological toys for storytelling[C]//Proceedings of International Conference on Document Analysis&Recognition.New York:ACM Press,1997:359-360
    [4]Hourcade J P,Bederson B B,Druin A.KidPad:collaborative storytelling for children[C]//Proceedings of CHI’02 Extended Abstracts on Human Factors in Computing Systems.New York:ACM Press,2002:500-501
    [5]Calvert S L,Others A.Educational and prosocial programming on saturday morning television[OL].[2018-04-28].https://eric.ed.gov/?id=ED406062
    [6]Crawford C.The art of computer game design[M].New York:Osborne/McGraw-Hill,1984
    [7]Mc Kinley B,Lee Y L.Mystorymaker[C]//Proceedings of CHI’08 Extended Abstracts on Human Factors in Computing Systems.New York:ACM Press,2008:3219-3224
    [8]Sylla C,Branco P,Coutinho C,et al.TOK:a tangible interface for storytelling[C]//Proceedings of CHI’11 Extended Abstracts on Human Factors in Computing Systems.New York:ACMPress,2011:1363-1368
    [9]Massung E,Dickins S,Torbett J,et al.Intouch tactile tales:haptic feedback and long-distance storytelling[C]//Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems.New York:ACM Press,2015:1289-1294
    [10]Goldman L R.Child’s play:myth,mimesis and make-believe[M].Oxford:Berg Publishers,1998
    [11]Wallbaum T,Ananthanarayan S,Borojeni S S,et al.Towards a tangible storytelling kit for exploring emotions with children[C]//Proceedings of on Thematic Workshops of ACM Multimedia.New York:ACM Press,2017:10-16
    [12]Vaucelle C,Ishii H.Picture this!:film assembly using toy gestures[C]//Proceedings of the 10th International Conference on Ubiquitous Computing.New York:ACM Press,2008:350-359
    [13]Chu S L,Quek F,Sridharamurthy K.Ready.action!:a performative authoring system for children to create animated stories[C]//Proceedings of the 11th Conference on Advances in Computer Entertainment Technology.New York:ACM Press,2014:Article No.52
    [14]Cole M,John-Steiner V,Scribner S,et al.Mind in society[M].Cambridge:Harvard University Press,1978
    [15]Multisilta J,Niemi H,Hamilton E.Children designing videos:tools,pedagogical models,and best practices for digital storytelling and media-making in the classroom[C]//Proceedings of the Conference on Interaction Design and Children.New York:ACM Press,2017:693-696
    [16]Russell A.ToonTastic:a global storytelling network for kids,by kids[C]//Proceedings of the 4th International Conference on Tangible and Embedded Interaction.New York:ACM Press,2010:271-274
    [17]Bruner J.Acts of meaning[M].Cambridge:Harvard University Press,1990
    [18]Zhou Z Y,Cheok A D,Pan J H,et al.Magic story cube:an interactive tangible interface for storytelling[C]//Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology.New York:ACM Press,2004:364-365
    [19]Sylla C,Branco P,Goncalves S,et al.T-books:merging traditional storybooks with electronics[C]//Proceedings of the 11th International Conference on Interaction Design and Children.New York:ACM Press,2012:323-326
    [20]Ryokai K,Lee M J,Breitbart J M.Children’s storytelling and programming with robotic characters[C]//Proceedings of the7th ACM Conference on Creativity and Cognition.New York:ACM Press,2009:19-28
    [21]Oberhuber S,Kothe T,Schneeqass S,et al.Augmented games:exploring design opportunities in AR settings with children[C]//Proceedings of the Conference on Interaction Design and Children.New York:ACM Press,2017:371-377
    [22]Qi Y F,Wang D L,Zhang L,et al.TanProStory:a tangible programming system for children’s storytelling[C]//Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems.New York:ACM Press,2015:1001-1006
    [23]Chang A,Breazeal C.TinkRBook:shared reading interfaces for storytelling[C]//Proceedings of the 10th International Conference on Interaction Design and Children.New York:ACMPress,2011:145-148
    [24]Sylla C,Goncalves S,Branco P,et al.Peter piper picked a peck of pickled peppers:an interface for playful language exploration[C]//Proceedings of CHI’13 Extended Abstracts on Human Factors in Computing Systems.New York:ACM Press,2013:3127-3130
    [25]Ryokai K,Marti S,Ishii H.I/O brush:drawing with everyday objects as ink[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.New York:ACM Press,2004:303-310
    [26]Huang C C,Lin Y J,Zeng X D,et al.Olegoru:a soundscape composition tool to enhance imaginative storytelling with tangible objects[C]//Proceedings of the 9th International Conference on Tangible,Embedded,and Embodied Interaction.New York:ACM Press,2015:709-714
    [27]Al-Mousawi Z,Alsumait A.A digital storytelling tool for Aarab children[C]//Proceedings of the 14th International Conference on Information Integration and Web-Based Applications&Services.New York:ACM Press,2012:26-35
    [28]Stanton D,Bayon V,Neale H,et al.Classroom collaboration in the design of tangible interfaces for storytelling[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.New York:ACM Press,2001:482-489
    [29]Chignell M,Hancock P A,Takeshita H.Human-computer interaction:the psychology of augmented human behavior[M]//Human Performance&Ergonomics.2nd ed.New York:Academic Press,1999:291-328
    [30]Myers B A.A brief history of human-computer interaction technology[J].Interactions,1998,5(2):44-54
    [31]Wigdor D,Wixon D.Brave NUI world:designing natural user interfaces for touch and gesture[M].Scan Francisco:Morgan Kaufmann Publishers,2011
    [32]Dai Guozhong,Tian Feng.Pen-based user interface[M].Hefei:Press of University of Science and Technology of China,2014(in Chinese)(戴国忠,田丰.笔式用户界面[M].合肥:中国科学技术大学出版社,2014)
    [33]van Dam A.Post-WIMP user interfaces[J].Communications of the ACM,1997,40(2):63-67
    [34]Li Jie,Tian Feng,Dai Guozhong.Research on pen-based interaction information model[J].Journal of Software,2005,16(1):50-57(in Chinese)(李杰,田丰,戴国忠.笔式用户界面交互信息模型研究[J].软件学报,2005,16(1):50-57)
    [35]Bonsignore E.Sharing stories“in the wild”:a mobile storytelling case study[C]//Proceedings of CHI’11 Extended Abstracts on Human Factors in Computing Systems.New York:ACMPress,2011:917-922
    [36]Blas N D,Paolini P,Sabiescu A.Collective digital storytelling at school as a whole-class interaction[C]//Proceedings of the9th International Conference on Interaction Design and Children.New York:ACM Press,2010:11-19
    [37]Blas N D,Boretti B.Interactive storytelling in pre-school:a case-study[C]//Proceedings of the 8th International Conference on Interaction Design and Children.New York:ACM Press,2009:44-51
    [38]Cao X,Lindley S E,Helmes J,et al.Telling the whole story:anticipation,inspiration and reputation in a field deployment of TellTable[C]//Proceedings of the ACM Conference on Computer Supported Cooperative Work.New York:ACM Press,2010:251-260
    [39]Lu F,Tian F,Jiang Y Y,et al.ShadowStory:creative and collaborative digital storytelling inspired by cultural heritage[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.New York:ACM Press,2011:1919-1928
    [40]Sylla C,Figueiredo A C,Pinto A L,et al.Merging physical and digital white canvas to unleash children’s creativity[C]//Proceedings of the Workshops on Advances in Computer Entertainment Conference.New York:ACM Press,2014:Article No.13
    [41]Sato M,Poupyrev I,Harrison C.Touché:enhancing touch interaction on humans,screens,liquids,and everyday objects[C]//Proceedings of SIGCHI Conference on Human Factors in Computing Systems.New York:ACM Press,2012:483-492
    [42]Azuma R T.A survey of augmented reality,presence[OL].[2018-04-28].https://dl.acm.org/citation.cfm?id=2871075.2871077
    [43]Ito T,Nguyen T N,Sugimoto M.A storytelling support system using robots and handheld projectors[C]//Proceedings of the7th International Conference on Interaction Design and Children.New York:ACM Press,2008:113-116
    [44]Sugimoto M,Ito T,Nguyen T N,et al.GENTORO:a system for supporting children’s storytelling using handheld projectors and a robot[C]//Proceedings of the 8th International Conference on Interaction Design and Children.New York:ACMPress,2009:214-217
    [45]?kerman P,Puikkonen A.Prochinima:using pico projector to tell situated stories[C]//Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services.New York:ACM Press,2011:337-346
    [46]Mcfarland D J,Wollpaw J R.Brain-computer interfaces for communication and control[J].Communications of the ACM,2011,54(5):60-66
    [47]Saponas T S,Tan D S,Morris D,et al.Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.New York:ACM Press,2008:515-524
    [48]Allanson J,Fairclough S H.A research agenda for physiological computing[J].Interacting with Computers,2004,16(5):857-878
    [49]Gilroy S,Porteous J,Charles F,et al.PINTER:interactive storytelling with physiological input[C]//Proceedings of the ACMInternational Conference on Intelligent User Interfaces.New York:ACM Press,2012:333-334
    [50]Vonach E,Ternek M,Gerstweiler G,et al.Design of a health monitoring toy for children[C]//Proceedings of the 15th International Conference on Interaction Design and Children.New York:ACM Press,2016:58-67
    [51]Go K,Carroll J M.The blind men and the elephant:views of scenario-based system design[J].Interactions,2004,11(6):44-53
    [52]Zhang Jie Sun Zhixia,Wang Danli,et al.An interactive storytelling system for children[C]//Proceedings of the 2nd Chinese Human-Computer Interaction Conference.Beijing:China Academic Journal Electronic Publishing House Press,2006:138-143(in Chinese)(张婕,孙志霞,王丹力,等.面向儿童的交互式讲故事系统[C]//第2届和谐人机环境联合学术会议论文集.北京:中国学术期刊电子杂志社,2006:138-143)
    [53]Wang Danli,Li Jie,Sun Zhixia,et al.Usability evaluation of storytelling system for children using interface scenarios[C]//Proceedings of the 2nd Chinese Human-Computer Interaction Conference.Beijing:China Academic Journal Electronic Publishing House Press,2006:9-15(in Chinese)(王丹力,李洁,孙志霞,等.基于界面场景的儿童讲故事系统可用性评估[C]//第2届和谐人机环境联合学术会议论文集.北京:中国学术期刊电子杂志社,2006:9-15)
    [54]Druin A,Bederson B B,Quinn A.Designing intergenerational mobile storytelling[C]//Proceedings of the 8th International Conference on Interaction Design and Children.New York:ACM Press,2009:325-328
    [55]Matthews M,Doherty G.My mobile story:therapeutic storytelling for children[C]//Proceedings of CHI’11 Extended Abstracts on Human Factors in Computing Systems.New York:ACM Press,2011:2059-2064
    [56]Papert S.Mindstorms:children,computers,and powerful ideas[M].New York:Basic Book,1980
    [57]Resnick M,Rusk N,Cooke S.The computer clubhouse:technological fluency in the inner city[M]//High Technology and Low-Income Communities.Cambridge:MIT Press,2009
    [58]Druin A.Mobile technology for children[M].New York:John Wiley&Sons,2009
    [59]Fein G G.Play and the acquisition of symbols[OL].[2018-04-28].https://eric.ed.gov/?id=ED152431
    [60]Pryor J B,Day J D.The development of social cognition[M]//the Development of Social Cognition.Hove:Psychology Press,1997:119-142
    [61]Honig A S,Brophy H E.Talking with your baby:family as the first school[M].New York:Syracuse University Press,1996
    [62]Whitehurst G J,Lonigan C J.Child development and emergent literacy[J].Child Development,1998,69(3):848-872
    [63]Ellis J B,Bruckman A S.Encouraging attitudinal change through online oral history[OL].[2018-04-28].https://www.cc.gatech.edu/fac/asb/papers/palaver_icls02.html
    [64]Bruner J S.The culture of education[M].Cambridge:Harvard University Press,1996
    [65]Yuksel-Arslan P,Yildirim S,Robin B R.A phenomenological study:teachers’experiences of using digital storytelling in early childhood education[J].Educational Studies,2016,42(5):427-445
    [66]Gr?nvall E,Verdezoto N.Beyond self-monitoring:understand-ing non-functional aspects of home-based healthcare technology[C]//Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing.New York:ACM Press,2013:587-596
    [67]Mark M,Gavin D,John S,et al.Mobile phone mood charting for adolescents[J].British Journal of Guidance&Counselling,2008,36(2):113-129
    [68]Rubegni E,Landoni M.Modelling the role of teachers in introducing portable technology to the school curriculum[C]//Proceedings of the 31st European Conference on Cognitive Ergonomics.New York:ACM Press,2013:Article No.13
    [69]Panjwani A.Constructing meaning:designing powerful story-making explorations for children to express with tangible computational media[C]//Proceedings of the Conference on Interaction Design and Children.New York:ACM Press,2017:358-364
    [70]Weibert A,Kai S.How the social structure of intercultural computer clubs fosters interactive storytelling[C]//Proceedings of the 9th International Conference on Interaction Design and Children.New York:ACM Press,2010:368-371
    [71]Williams J,Do E Y L.Locomotion storytelling:kinesthetic intelligence and tangible objects in storytelling creativity[C]//Proceedings of the 7th ACM Conference on Creativity and Cognition.New York:ACM Press,2009:415-416
    [72]Chu S L,Quek F.Things to imagine with:designing for the child’s creativity[C]//Proceedings of the 12th International Conference on Interaction Design and Children.New York:ACM Press,2013:261-264
    [73]Benton L,Vasalou A,Gooch D,et al.Understanding and fostering children,s storytelling during game narrative design[C]//Proceedings of the Conference on Interaction Design and Children.New York:ACM Press,2014:301-304
    [74]Liu Jian,Deng Changzhi,Dai Guozhong.Pen-based interface software design tool based on scene method[J].Computer Engineering and Design,2009,30(8):2011-2014(in Chinese)(刘健,邓昌智,戴国忠.基于场景方法的笔式界面软件设计工具[J].计算机工程与设计,2009,30(8):2011-2014)
    [75]Shi Lei,Deng Changzhi,Dai Guozhong.Implementation of PGIS:a type of Post-WIMP user interface[J].Journal of Image and Graphics,2010,15(7):985-992(in Chinese)(石磊,邓昌智,戴国忠.一种Post-WIMP界面:PGIS的实现[J].中国图象图形学报,2010,15(7):985-992)
    [76]Fan X M,Luo W C,Menekse M,et al.Scaling reflection prompts in large classrooms via mobile interfaces and natural language processing[C]//Proceedings of the 22nd International Conference on Intelligent User Interfaces.New York:ACMPress,2017:363-374

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700