Evaluating information retrieval using document popularity: An implementation on MapReduce

详细信息    查看全文

• 作者：Xenophon Evangelopoulos^a ; ^{evangelopo@ceid.upatras.gr" class="auth_mail" title="E-mail the corresponding author} ; Victor Giannakouris-Salalidis^b ; ^{p12gian1@ionio.gr" class="auth_mail" title="E-mail the corresponding author} ; Lazaros Iliadis^c ; ^{liliadis@fmenr.duth.gr" class="auth_mail" title="E-mail the corresponding author} ; Christos Makris^a ; ^{makri@ceid.upatras.gr" class="auth_mail" title="E-mail the corresponding author} ; Yannis Plegas^a ; ^{plegas@ceid.upatras.gr" class="auth_mail" title="E-mail the corresponding author} ; Antonia Plerou^b ; ^{tplerou@ionio.gr" class="auth_mail" title="E-mail the corresponding author} ; Spyros Sioutas^b ; ^{sioutas@ionio.gr" class="auth_mail" title="E-mail the corresponding author}
• 关键词：Information retrieval ; Evaluation ; Metrics ; User behaviour ; MapReduce ; Cosine similarity
• 刊名：Engineering Applications of Artificial Intelligence
• 出版年：2016
• 出版时间：May 2016
• 年：2016
• 卷：51
• 期：Complete
• 页码：16-23
• 全文大小：904 K

文摘

Over the last few years, one major research direction of information retrieval includes user behaviour prediction. For that reason many models have been proposed aiming at the accurate evaluation of information retrieval systems and the best prediction of web search users׳ behaviour. In this paper we propose a new evaluation metric for information retrieval systems which employs two relevance factors; a relevance judgement grade and a popularity grade that represents users׳ vote for a document. We show that this new metric performs better than other evaluation metrics when expressing user behaviour. Moreover, in order to test the performance of our metric on different and scalable ranking algorithms, we develop a pairwise text similarity algorithm using cosine similarity, implemented on the MapReduce model, and then perform experiments on rankings generated by the algorithm.