交互式信息检索研究中的眼动追踪分析
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:Eye-Tracking Analysis in Interactive Information Retrieval
  • 作者:吴丹 ; 刘春香
  • 英文作者:WU Dan;LIU Chunxiang;
  • 关键词:交互式信息检索 ; 信息搜索行为 ; 眼动追踪 ; 搜索引擎
  • 英文关键词:Interactive information retrieval;;Information search behavior;;Eye-tracking;;SERP
  • 中文刊名:ZGTS
  • 英文刊名:Journal of Library Science in China
  • 机构:武汉大学信息管理学院;
  • 出版日期:2019-03-15 12:04
  • 出版单位:中国图书馆学报
  • 年:2019
  • 期:v.45;No.240
  • 基金:国家自然科学基金面上项目“多设备融合的用户网络搜索行为建模与技术实现研究”(编号:71673204);; 武汉大学人文社会科学青年学者学术发展计划学术团队项目“人机交互与协作创新团队”(编号:Whu2016020)的研究成果之一~~
  • 语种:中文;
  • 页:ZGTS201902008
  • 页数:20
  • CN:02
  • ISSN:11-2746/G2
  • 分类号:111-130
摘要
眼动追踪技术在信息检索领域的应用研究较为广泛,对该技术进行分析可以更加深入地理解信息搜索背后的行为动机。交互式信息检索研究中常用的眼动设备分为远程眼动仪、头戴式眼动仪和开源资源三种类,常用的眼动指标有功能识别指标和情感识别指标,眼动分析方法常与其他方法结合使用,主要有Eye-Mouse协同模式、Eye-NP协同模式和Eye-Cognition协同模式,眼动追踪方法主要用于信息搜索行为影响因素研究,以及搜索引擎结果页面上的浏览行为、隐性相关反馈和预测推荐研究。基于上述发现,本研究构建了基于眼动的交互式信息检索模,并提出眼动追踪在交互式信息检索研究中的四个应用趋势,包括:交互式信息检索中的认知差异研究;基于眼动的移动搜索研究;自然环境下的交互信息检索行为眼动研究;眼动追踪方法与其他多元化的分析方法的结合。
        Eye-tracking was first used in the study of reading behavior,and with the development of this technology,it has been widely used in psychology,medicine,advertising,human-computer interaction and other fields.At present,the application of eye-tracking technology in the field of information retrieval is also a frontier topic. Interactive Information Retrieval( IIR) has a strong interdisciplinary nature,involving psychology,sociology,computer science and other fields. It is beneficial to use eye-tracking technology to better understand the motivation and mechanism of information seeking behavior. Although some studies have sorted out the application of eye tracking technology in the field of Library and Information Science,they have not yet elaborated the application of eye tracking technology in IIR and these studies only pointed out a general overview of eye tracking measurement indicators and the combination of eye tracking and other methods. The purpose of this paper is to expound the application of eye tracking technology in IIR as comprehensively as possible,and put forward the prospect of the research trends of eye tracking technologyin IIR.The literatures used in this paper mainly come from databases such as Wo S,ACM,Springer,Elsevier,Emerald,IEEE and CNKI. All of the selected literatures are closely related to IIR,the main method of which is eye-tracking. The retrieval methods of English documents are( "interactive information retrieval"or"information retrieval"or "information search behavior"or "information seeking behavior"or "web search") *( "eye-tracking"),and Chinese documents are( "交互式信息检索"OR"信息检索行为"OR"信息搜索行为"OR"信息搜寻行为"OR"网页搜索行为").Through reviewing the related researches,four findings can be concluded: 1) Eye-tracking devices used in the research of IIR can be divided into three types: remote eye-tracker,head-mounted eye-tracker and open resources; 2) Eye-tracking analysis indicators commonly used in IIR research can be divided into two categories: functional identification indicators( i. e. indicators inferring that stimulate materials can be noticed,found and recognized by the subjects) and emotional identification indicators( i.e. indicators that reflect the emotional and cognitive state of the subjects to stimulate); 3) Eye-tracking is often used in combination with other methods, including three patterns: Eye-mouse collaboration model, Eye-NP collaboration model and Eye-cognition collaboration model; 4) Four research topics about eye-tracking in IIR are identified: the factors that influence the information search behavior,the browsing behavior on SERP,implicit relevance feedback on SERP and the prediction and recommendation on SERP.Based on the findings above,an eye-tracking-based interactive information retrieval model is constructed.Meanwhile,three limitations of the current work are pointed out,including: there is a lack of in-depth study on the factors affecting IIR,such as individual characteristics,memory load and cognitive style and so on; most studies focus on the application of eye-tracking technology in desktop, lacking of the application in mobile; most eye-tracking studies are performed in the controlled laboratory,and there is a lack of IIR research performed in real environment. In view of the current limitations,we propose four research trends of eye-tracking research in IIR,including: cognitive difference research in IIR,mobile search behavior based on eye-tracking,IIR research in natural environment,and the combination of eyetracking and other research methods,especially neuropsychological methods.
引文
[1] 刘萍,李斐雯,杨宇.国外交互式信息检索研究进展[J].情报理论与实践,2017,40(5):132-138.(Liu Ping, Li Feiwen, Yang Yu. Research progress of interactive information retrieval at abroad[J]. Information Studies: Theory & Application, 2017,40(5):132-138.)
    [2] Eileen K. Eye movements: the past 25years[J]. Vision Research,2011,13(1): 1457-1483.
    [3] Lund H. Eye tracking in Library and Information Science: a literature review[J]. Library Hi Tech, 2016, 34(4):585-614.
    [4] Anita K, Károly H. Exploring cultural differences in information behavior applying psychophysiological methods[C]// CHI'10 Extended Abstracts on Human Factors in Computing Systems. ACM, 2010:4153-4158.
    [5] Rayner K. Eye movements in reading and information processing[J]. Psychological Bulletin, 1978, 85(3):618-660.
    [6] Mostafa J, Gwizdka J. Deepening the role of the user: neuro-physiological evidence as a basis for studying and improving search[C]// ACM on Conference on Human Information Interaction and Retrieval. ACM, 2016:63-70.
    [7] Lorigo L, Haridasan M, Brynjarsdóttir H, et al. Eye tracking and online search: lessons learned and challenges ahead[J]. Journal of the Association for Information Science & Technology, 2014, 59(7):1041-1052.
    [8] Katti H, Kankanhalli M. Eye-tracking methodology and applications to images and video[C]// ACM International Conference on Multimedia. ACM, 2011:641-642.
    [9] Papoutsaki A, Laskey J, Huang J. SearchGazer: Webcameye tracking for remote studies of web search[C]// Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval.AMC, 2017:17-26.
    [10] Joachims T, Granka L, Pan B, et al. Accurately interpreting click through data as implicit feedback[J].ACM SIGIR Forum,2017,51(1):4-11.
    [11] Joachims T, Granka L, Pan B, et al. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search[J]. Acm Transactions on Information Systems, 2007, 25(2):7.
    [12] Vrochidis S, Patras I, Kompatsiaris I. An eye-tracking-based approach to facilitate interactive video search[C]// ACM International Conference on Multimedia Retrieval. ACM, 2011:1-8.
    [13] Sari J N, Ferdiana R, Santosa P I, et al. An eye tracking study: exploration customer behavior on web design[C]// International Hci and Ux Conference in Indonesia. ACM, 2015:69-72.
    [14] Chizari S. Exploring the role of culture in online searching behavior from cultural cognition perspective[C]// Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. ACM, 2016:349-351.
    [15] Marcos M C, Gavin F, Arapakis I. Effect of snippets on user experience in web search[C]// Proceedings of the XVI International Conference on Human Computer Interaction.ACM,2015:1-8.
    [16] Kim J, Thomas P, Sankaranarayana R, et al. Comparing scanning behaviour in web search on small and large screens[C]// Seventeenth Australasian Document Computing Symposium, 2012:25-30.
    [17] Rodden K, Fu X, Aula A, et al. Eye-mouse coordination patterns on web search results pages[C]// Extended Abstracts Proceedings of the 2008 Conference on Human Factors in Computing Systems, CHI 2008, Florence, Italy, April. DBLP, 2008:2997-3002.
    [18] Liu Y, Wang C, Zhou K, et al. From skimming to reading: a two-stage examination model for web search[C]// Acm International Conference on Conference on Information & Knowledge Management. ACM, 2014:849-858.
    [19] Chen M C, Anderson J R, Sohn M H. What can a mouse cursor tell us more? correlation of eye/mouse movements on web browsing[C]// CHI'01 Extended Abstracts on Human Factors in Computing Systems. ACM, 2001:281-282.
    [20] Gwizdka J, Jose J, Mostafa J, et al. NeuroIR 2015: Neuro-physiological methods in IR research[J].ACM SIGIR Forum, 2015,49(2):83-88.
    [21] Xu S, Jiang H, Lau F C M. Observing facial expressions and gaze positions for personalized webpage recommendation[C]// International Conference on Electronic Commerce: Roadmap for the Future of Electronic Business, 2010:78-87.
    [22] Kn?usl H, Ludwig B. Assessing the relationship between context, user preferences, and content in search behaviour[C]//Proceedings of the 5th Ph.D. Workshop on Information and Knowledge. ACM, 2012:67-74.
    [23] Smith C L, Gwizdka J, Feild H. Exploring the use of query auto completion: search behavior and query entry profiles[C]// Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval, 2016:101-110.
    [24] Dewitt A J. Examining the order effect of website navigation menus with eye tracking[M]. Usability Professionals' Association, 2010.
    [25] Bilal D, Gwizdka J. Children's eye-fixations on google search results[C]// Asist & Meeting: Creating Knowledge, Enhancing Lives Through Information & Technology. American Society for Information Science, 2016:89.
    [26] P?ivi M, Aula A. Effects of feedback on eye typing with a short dwell time[C]// Symposium on Eye Tracking Research & Applications. ACM, 2004:139-146.
    [27] Muralidharan A, Gyongyi Z, Chi E. Social annotations in web search[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2012:1085-1094.
    [28] Al-Samarraie H, Eldenfria A, Dawoud H. The impact of personality traits on users information-seeking behavior[M]. Pergamon Press, Inc. 2017.
    [29] Raptis G E, Belk M, Belk M, et al. Using eye gaze data and visual activities to infer human cognitive styles: method and feasibility studies[C]// Conference on User Modeling, Adaptation and Personalization. ACM, 2017:164-173.
    [30] Chrobot N. The role of processing fluency in online consumer behavior: evaluating fluency by tracking eye movements[C]// Symposium on Eye Tracking Research and Applications, 2014:387-388.
    [31] Gwizdka J. I can and so I search more: effects of memory span on search behavior[C]//Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, 2017:341-344.
    [32] Brennan K, Kelly D, Arguello J. The effect of cognitive abilities on information search for tasks of varying levels of complexity[C]// Information Interaction in Context Symposium. ACM, 2014:165-174.
    [33] Dumais S T, Buscher G, Cutrell E. Individual differences in gaze patterns for web search[C]// Symposium on Information Interaction in Context. ACM, 2010:185-194.
    [34] Pan B, Hembrooke H A, Gay G K, et al. The determinants of web page viewing behavior: an eye-tracking study[C]// Symposium on Eye Tracking Research & Applications. ACM, 2004:147-154.
    [35] Lorigo L, Pan B, Hembrooke H, et al. The influence of task and gender on search and evaluation behavior using Google[J]. Information Processing & Management, 2006, 42(4):1123-1131.
    [36] Gossen T. Usability and perception of young users and adults on targeted web search engines[C]// Information Interaction in Context Symposium. ACM, 2014:18-27.
    [37] Faiola A ,Matei S A .Cultural cognitive style and web design: beyond a behavioral inquiry into computer mediated communication[J]. Journal of Computer-Mediated Communication, 2006,11:375-394.
    [38] Maqbali H A, Scholer F, Thom J A, et al. Using eye tracking for evaluating web search interfaces[C]// IEEE International Conference on Wireless Communications, NETWORKING and Information Security. IEEE, 2013:2-9.
    [39] Buscher G, Cutrell E, Morris M R. What do you see when you're surfing? using eye tracking to predict salient regions of web pages[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2009:21-30.
    [40] Kr?mer N C, Preko N, Flanagin A, et al. What do people attend to when searching for information on the web: an eye-tracking study[C]// The Technology, Mind, and Society, 2018:1-1.
    [41] Chen Y, Zhang P, Song D, et al. A real-time eye tracking based query expansion approach via latent topic modeling[C]// Acm International on Conference on Information & Knowledge Management. ACM, 2015:1719-1722.
    [42] Talja S, Keso H . The production of ‘context’ in information seeking research: a metatheoretical view[M]. Pergamon Press, Inc., 1999.
    [43] Hofmann K, Mitra B, Radlinski F, et al. An eye-tracking study of user interactions with queryauto completion[C]// Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, 2014:549-558.
    [44] 卢万譞. 基于眼动跟踪的网络搜索行为分析与预测[D].北京:北京理工大学,2015.(Lu Wanxuan. Web search behavior analysis and prediction based on eye-tracking[D]. Beijing:Beijing Institute of Technology, 2015.)
    [45] Liu J, Cole M J, Liu C, et al. Search behaviors in different task types[C]// Joint Conference on Digital Libraries. ACM, 2010:69-78.
    [46] Gossen T, Hobel J, Nurnberger A. A comparative study about children's and adults' perception of targeted web search engines[C]// Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2014:1821-1824.
    [47] Granka L A, Joachims T, Gay G. Eye-tracking analysis of user behavior in WWW search[C]// International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2004:478-479.
    [48] Marcos M C, Gonzalez-Caro C.User behavior in the search engines results page: a study based on the eye tracking technique[J]. Professional de la Information, 2010, 19(4): 348-358.
    [49] Bando L L, Scholer F, Turpin A. Constructing query-biased summaries: a comparison of human and system generated snippets[C]// Proceedings of the third symposium on Information interaction in context, 2010:195-204.
    [50] Cutrell E, Guan Z. What are you looking for? an eye-tracking study of information usage in web search[C]// Conference on Human Factors in Computing Systems, CHI 2007, San Jose, California, Usa, April 28 - May. DBLP, 2007:407-416.
    [51] Lagun D, Agichtein E. ViewSer: enabling large-scale remote user studies of web search examination and interaction[C]// International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2011:365-374.
    [52] Vakkari P. Result list actions in fiction search[C]// Acm/ieee-Cs Joint Conference on Digital Libraries. ACM, 2015:7-16.
    [53] Lagun D, Agichtein E. Re-examining search result snippet examination time for relevance estimation[C]// Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2012:1141-1142.
    [54] Grauer L, Lomakina A. On the effect of “stupid” search components on user interaction with search engines[C]// ACM International on Conference on Information and Knowledge Management. ACM, 2015:1727-1730.
    [55] Granka L, Hembrooke H, Gay G. Location location location: viewing patterns on WWW pages[C]// Symposium on Eye Tracking Research & Applications. ACM, 2006:43-43.
    [56] 王宇,张云秋.探索式搜索行为的眼动研究[J].图书情报工作,2014,58(11):29-35.(Wang Yu, Zhang Yunqiu. An eye tracking study on exploratory search behaviors[J].Library and Information Service,2014,58(11):29-35.)
    [57] 梁少博,吴丹,董晶,等.跨设备搜索引擎结果页面注意力分布研究——基于眼动视觉数据的实证分析[J].图书情报知识,2018(1):4,27-35,15.(Liang Shaobo, Wu Dan, Dong Jing, et al. A research on the distribution of attention in cross-device search engine result page: an empirical study based on eye tracking data analysis[J]. Documentation Information & Knowledge, 2018(1):4,27-35,15.)
    [58] 栗觅,钟宁,吕胜富.Web页面信息的视觉搜索行为特征的研究[J].计算机科学与探索,2009,3(6):649-655.(Li Mi, Zhong Ning, Lü Shengfu. A study about the characteristics of visual search on web pages[J]. Journal of Frontiers of Computer Science & Technology, 2009,3(6):649-655.)
    [59] 盛金根,李永建,夏曦.电子商务网页信息搜索中的视觉优选效应[J].工业工程与管理,2011,16(6):79-83.(Sheng Jingen, Li Yongjian, Xia Xi. A visual priority selection effect of searching information in e-commerce web page[J]. Industrial Engineering and Management, 2011,16(6):79-83.)
    [60] 许鑫,曹阳.基于眼动追踪实验的高校图书馆门户网站网页设计研究[J].大学图书馆学报,2017,35(3):46-52.(Xu Xin, Cao Yang. Research on web design of university library portal website based on eye tracking experiment[J]. Journal of Academic Libraries, 2017,35(3):46-52.)
    [61] Jér?me Dinet, Bastien J M C, Kitajima M. What, where and how are young people looking for in a search engine results page?:impact of typographical cues and prior domain knowledge[C]// Conference on L'interaction Homme-Machine. ACM, 2010:105-112.
    [62] 宫勇,张三元,刘志方,等.颜色对图标视觉搜索效率影响的眼动研究[J].浙江大学学报(工学版),2016,50(10):1987-1994.(Gong Yong, Zhang Sanyuan, Liu Zhifang, et al. Eye movement study on color effects to icon visual search efficiency[J]. Journal of Zhejiang University(Engineering Science), 2016,50(10):1987-1994.)
    [63] 栗觅,卢万譞,吕胜富,等.网页信息过载时视觉搜索策略与信息加工方式的眼动研究[J].北京工业大学学报,2012,38(3):390-395.(Li Mi, Lu Wanxuan, Lü Shengfu, et al. Strategy and processing mode of visual search under information overload on web pages: an eye-tracking study[J]. Journal of Beijing University of Technology, 2012,38(3):390-395.)
    [64] 杨海波,汪洋,张磊.电商手机APP界面背景和图片特征对消费者搜索效率影响的研究[J].包装工程,2016,37(20):45-49.(Yang Haibo, Wang Yang, Zhang Lei. Influence of the background and picture features of the mobile APP interface on the consumer search [J]. Packaging Engineering, 2016,37(20):45-49.)
    [65] Richardson M, Dominowska E, Ragno R. Predicting clicks: estimating the click-through rate for new ads[C]// International Conference on World Wide Web. ACM, 2007:521-530.
    [66] Craswell N, Zoeter O, Taylor M, et al. An experimental comparison of click position-bias models[C]// Proceedings of the 2008 International Conference on Web Search and Data Mining, 2008:87-94.
    [67] Balatsoukas P, Ruthven I. What eyes can tell about the use of relevance criteria during predictive relevance judgment?[C]// Symposium on Information Interaction in Context. ACM, 2010:389-394.
    [68] Buscher G, Dengel A, Elst L V. Query expansion using gaze-based feedback on the subdocument level[C]// International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008:387-394.
    [69] Hardoon D R, Shawe-Taylor J, Ajanki A, et al. Information retrieval by inferring implicit queries from eye movements[J]. Journal of Machine Learning Research, 2007, 2(1):179-186.
    [70] Moore R J, Churchill E F, Kantamneni R G P. Three sequential positions of query repair in interactions with internet search engines[C]// ACM 2011 Conference on Computer Supported Cooperative Work. ACM, 2011:415-424.
    [71] Seifert C, Mitschick A, Dachselt R. Focus paragraph detection for online zero-effort queries:lessons learned from eye-tracking data[C]//Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, 2017:301-304.
    [72] Beckers T, Korbar D. Using eye-tracking for the evaluation of interactive information retrieval[C]//9th Internet Workshop of the Initiative for the Evaluation of XML Retrieval. ACM, 2010: 236-240.
    [73] Zhao Q, Chang S, Harper F M, et al. Gaze prediction for recommender systems[C]// ACM Conference on Recommender Systems. ACM, 2016:131-138.
    [74] Giordano D, Kavasidis I, Pino C, et al. Content based recommender system by using eye gaze data[C]// Proceedings of the Symposium on Eye Tracking Research and Applications. ACM,2012:369-372.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700