Different Rankers on Different Subcollections

详细信息    查看全文

• 作者：Timothy Jones (19)
  Falk Scholer (19)
  Andrew Turpin (20)
  Stefano Mizzaro (21)
  Mark Sanderson (19)
  
  19. RMIT University ; Australia
  20. University of Melbourne ; Australia
  21. University of Udine ; Italy
  
• 关键词：Collection Partitioning ; Subcollections ; Retrieval effectiveness
• 刊名：Lecture Notes in Computer Science
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：9022
• 期：1
• 页码：203-208
• 全文大小：155 KB
• 参考文献：1. Beitzel, S.M., Jensen, E.C., Chowdhury, A., Grossman, D., Goharian, N., Frieder, O. Recent results on fusion of effective retrieval strategies in the same information retrieval system. In: Callan, J., Crestani, F., Sanderson, M. eds. (2004) Distributed Multimedia Information Retrieval. Springer, Heidelberg, pp. 101-111 CrossRef
  2. Fox, E.A., Shaw, J.A. (1994) Combination of multiple searches. Proc. TREC 2: pp. 243-252
  3. Jones, T., Turpin, A., Mizzaro, S., Scholer, F., Sanderson, M.: Size and source matter: Understanding inconsistencies in test collection-based evaluation. In: CIKM 2014 (2014)
  4. Land, A.H., Doig, A.G. (1960) An automatic method of solving discrete programming problems. Econometrica 28: pp. 497-520 CrossRef
  5. Lee, J.H. (1997) Analyses of multiple evidence combination. Proc. SIGIR. ACM Press, New York, pp. 267-276 CrossRef
  6. Ounis, I., Amati, G., Plachouras, V., He, B., Macdonald, C., Lioma, C.: Terrier: A high performance and scalable information retrieval platform. In: Proc. OSIR Workshop, pp. 18鈥?5 (2006)
  7. Sanderson, M., Turpin, A., Zhang, Y., Scholer, F.: Differences in effectiveness across sub-collections. In: CIKM 2012, pp. 1965鈥?969. ACM (2012)
  8. Sheldon, D., Shokouhi, M., Szummer, M., Craswell, N. (2011) Lambdamerge: Merging the results of query reformulations. WSDM 2011. ACM, New York, pp. 795-804
  9. Thomas, P., Shokouhi, M. Evaluating server selection for federated search. In: Gurrin, C., He, Y., Kazai, G., Kruschwitz, U., Little, S., Roelleke, T., R眉ger, S., Rijsbergen, K. eds. (2010) Advances in Information Retrieval. Springer, Heidelberg, pp. 607-610 CrossRef
  10. Wilkie, C., Azzopardi, L. Efficiently estimating retrievability bias. In: Rijke, M., Kenter, T., Vries, A.P., Zhai, C., Jong, F., Radinsky, K., Hofmann, K. eds. (2014) Advances in Information Retrieval. Springer, Heidelberg, pp. 720-726 CrossRef
  11. Wu, M., Hawking, D., Turpin, A., Scholer, F. (2012) Using anchor text for homepage and topic distillation search tasks. JASIST 63: pp. 1235-1255 CrossRef
  
• 作者单位：Advances in Information Retrieval
• 丛书名：978-3-319-16353-6
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

Recent work has shown that when documents in a TREC ad hoc collection are partitioned, different rankers will perform optimally on different partitions. This result suggests that choosing different highly effective rankers for each partition and merging the results, should be able to improve overall effectiveness. Analyzing results from a novel oracle merge process, we demonstrate that this is not the case: selecting the best performing ranker on each subcollection is very unlikely to outperform just using a single best ranker across the whole collection.