搜索引擎检索功能的性能评价研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
搜索引擎评价研究是信息检索领域研究的热点之一,网络信息和信息检索技术的发展推动了搜索引擎实践的发展。为了满足用户日益增长的信息需求,搜索引擎除了完善其简单检索功能外,也不断开发高级检索功能。这些检索功能旨在帮助用户获取高质量的网络信息,但它们的检索性能并不为人所知。本文以搜索引擎检索结果的相关性和排序质量为两个核心评价指标,对当前主流搜索引擎的主要检索功能进行了评价。本研究的成果一方面可以帮助用户在利用搜索引擎进行信息检索时选取恰当的检索策略,另一方面则可以知道不同的检索功能对搜索引擎检索性能的影响。
     在第一章中,笔者论述了近年来搜索引擎及其评价研究的现状。在大量文献的基础上,对研究内容、方法、特点、不足以及发展趋势进行了总结。目前搜索引擎评价研究主要以相关性研究为核心内容,以实验方法、调查方法、数据分析法、观察法、综述和评论等为主要的研究方法,具有依附性、动态性、多样化、重视用户参与等特点。然而搜索引擎评价研究还有所不足,主要在于缺乏不同检索功能之间检索效率的比较以及检索结果排序质量的评价等方面。随着多媒体信息的发展,对搜索引擎多媒体检索功能的评价必将成为今后研究的热点。
     在第二章中,笔者指出,相关性是搜索引擎评价的基础指标,并由此衍生出检索结果的排序质量这一指标,相关性根据网页的形式和内容进行评判,结果排序的质量由检索结果的排列次序和排序的稳定性决定。围绕这两个核心指标,笔者构建了一套评价体系,并根据一定的标准选取了5个中英文搜索引擎以及5种检索功能作为研究对象。英文搜索引擎为Google、Yahoo和MSN/Live/Bing,中文搜索引擎为百度和谷歌,5种检索功能分别为题名检索、短语检索、PDF检索、URL检索和普通检索,其中以普通检索作为比较分析的基准。
     在第三章中,笔者对所研究的内容提出了假设,并设计了实验步骤。应用层次分析法对相关性的评价指标进行了分析,从一系列的指标中选取了检索结果的全文、摘要、题名、网页有效性、用户负担和网页长度等核心指标来衡量网页的相关性,并对检索结果相关性的计算方法进行了修正,用修正的相关性计算公式来衡量每一检索功能检索结果的整体相关性。方差分析法用于比较分析搜索引擎各检索功能之间的检索效率是否具有显著性差异。如果存在显著性差异,Tukey多重比较检验法则会用于探究造成这一差异的原因。同时,通过回归分析法评价检索结果排序的次序和稳定性。
     在第四章中,基于50,000份数据,笔者应用了方差分析法对5个搜索引擎的5种检索功能进行了评价,结果显示各检索功能之间的检索效率存在显著性差异,Tukey多重比较检验法探明了造成这一差异的原因。在各检索功能中,PDF检索的效率最高,其余依次为题名检索、普通检索、短语检索和URL检索。在各检索功能的稳定性测评中,普通检索的稳定性要优于其他检索功能。英文搜索引擎中,Yahoo!在5种检索功能中的检索效率均高于Google和MSN/Live/Bing,其次为Google, MSN/Live/Bing的检索效率最差。中文搜索引擎中,谷歌题名检索、普通检索、PDF检索和URL检索的检索效率要明显优于百度,短语检索两者并无显著区别。
     在第五章中,笔者利用回归分析法的曲线估计方法比较分析了5个搜索引擎的5种检索功能的结果排序质量。英文搜索引擎中,普通检索的结果排序质量最好,URL检索最差,中文搜索引擎中,URL检索的结果排序质量最差,百度的PDF检索结果排序质量最好,谷歌的题名检索结果排序质量最好。数据显示,中文搜索引擎检索结果的排序质量与英文搜索引擎相比具有较大的差距。
     在第六章中,笔者指出,在数据收集和分析的过程中,发现中英文搜索引擎无论在检索效率还是在检索结果排序上,都存在较大的差距。针对中文搜索引擎目前存在的问题,笔者提出了相应的优化策略,不仅要加强中文网页的质量建设,还要推动开放存取的发展,这样可以从源头上提升中文网络资源质量。搜索引擎应该具备强有力的信息过滤能力,同时谨慎采用一些商业行为人为干扰检索结果的排序。
The study of evaluation of search engine is one of the popular issues in the field of information retrieval. The development of Internet information and technologies of information retrieval accelerates the development of search engine. Besides simple search, search engines have developed many other advanced search features. These features are at the aim of helping users to find the information they need, but as the matter of fact, the performance of these features is still a puzzle. This study takes relevance and ranking quality of retrieval results as two key indexes to evaluate the main search features of popular search engines. The findings of this study can be used to assist users in formulating an appropriate search strategy to improve search effectiveness, and to shed light on how search engines react to different types of search features in terms of retrieval effectiveness.
     In the first chapter, the author discusses the research status of the study of search engine and its evaluation and summarizes the content, methods, characteristics, deficiency, and the development trend. At present, the relevance is the core content in the evaluation of search engine. Experimentation, observation, investigation, data analysis, and review are main research methods. The study of evaluation of search engine has the characteristics of dependence, dynamic, diversity, emphasis on users' participation and so on. There is less finding which compares the search effectiveness between different search features, as well as the ranking quality of search results. As the development of multimedia information, the study on the evaluation of performance of multimedia retrieval features will become part of the hot research issues.
     In the second chapter, the author points out that relevance, which is the basic index, derives the index of ranking quality of search results. Relevance can be judged based on the form and content of retrieval web pages. And the ranking quality is decided by the sequence and stability of search results. Based on the two key indexes, the author sets up an evaluation system. Following the standards, five search engines and five search features are selected respectively. There are three English search engines, which are Google, Yahoo! and Bing, and two Chinese search engines, which are Baidu and Google China. Five search features are title search, phrase search (exact search), PDF file format restriction search, URL search and regular search, and the results from a regular search can serve as a baseline for comparison and analysis in a search engine.
     In the third chapter, the overarching research question for this study is whether the use of advanced search features would enhance retrieval effectiveness in a search engine. Based on the research question, some null hypotheses of the study are developed. The author selects some indicators, which are full text, abstract, title, the validity of web page, user's burden and the length of web pages, to evaluate the relevance of search results based on the methods of Analytic Hierarchy Process (AHP). A revised relevance is used to evaluate the effectiveness of a search feature. A one-way ANOVA analysis method is applied to whether there are significant differences among the effectiveness of search features. If there are significant differences, the Tukey analysis method is used to detect what causes the significant differences. The regression analysis method is applied to detect the sequence and stability of ranking of search results.
     In the fourth chapter, a one-way ANOVA analysis method is used to evaluate theeffectiveness of five search features of five search engines based on the 50,000 date. The findings show that there are significant differences between search features, so the Tukey analysis method is used to detect the cause of the significant differences. Among these search features, PDF file format restriction search achieves the best retrieval effectiveness. Yahoo! achieves the best retrieval effectiveness among three English search engines in all search features. And Google China gets better retrieval effectiveness than Baidu at title search, regular search, PDF file format restriction search and URL search, but there is no significant difference in phrase search.
     In the fifth chapter, the regression analysis method is applied to analyze the ranking quality of five search features of five search engines. The regular search achieves the best ranking quality among the search features of English search engines, and URL gets the worst ranking quality among all search engines. PDF file format restriction search achieves the best ranking quality within Baidu's five search features. Correspondingly, title search achieves the best ranking quality in Google China. Obviously, the ranking quality of search features of Chinese search engines is lower than English search engines.
     In the sixth chapter, the author finds that Chinese search engines achieve worse results both in retrieval effectiveness and ranking quality during the process of data collecting and analyzing, The author puts forward to some optimization strategies to improve the development of Chinese search engines in retrieval effectiveness and ranking quality. We should pay much attention to the quality of web pages at very beginning of creating them. And open access should be propelled in China to improve the quality of Chinese web resources. Search engines can develop some powerful features to filter particular search results that users have no interests, and should be cautious when operate the policy of bid ranking.
引文
1 Henzinger, Motwani, & Silverstein. Challenges in Web Search Engines. SIGIR Forum,2002 (2),11-22.
    2 Internetworldstats.com. (2009). World Internet Users and Population Stats. http://www. internetworldstats. com/stats.htm检索时间:2010年3月8日
    3 Pewlnternet.org. (2008). Internet activities. http://www.pewinternet.org/Data-Tools/Do wnload-Data/-/media/Infographics/Trend%20Data/January%202009% 20updates/Internet%20Activities%20-%20all%20-%201%206%2009.jpg.检索时间:2010年3月8日
    4中国互联网络信息中心.第25次中国互联网络发展状况统计报告(2010年1月)
    5 MINTS. Traffic growth rates from publicly observed sites. http://www.dtc.umn.edu/mints/home.php.检索时间:2010年3月8日
    6 Y. Theng, M. Jones and H. Thimbleby, Lost in Hyperspace-Psychological Problem or Bad Design? In Proceedings of the first Asia Pacific Conference on Computer Human Interaction,1996,387-396.
    7 Wu, G., Li, J. Comparing web search engine performance in searching consumer health information:evaluation and recommendations. Bull Med Libr Assoc,1999 (4),456-461.
    8 Market Share. Search Engine Market Share. http://marketshare.hitslink.com/search-engine-market-share.aspx?qprid=4检索时间:2010年3月8日
    9 Searchenginewatch.com. Stats Show Google Dominates the International Search Landscape. http://searchenginewatch.com/3625072.检索时间:2010年3月8日
    1费巍,武利红.数字时代目录学的数字化和大众化——第五届全国目录学学术研讨会会议纪要[J].图书情报知识,2007,(04).
    2柯平.数字目录学——当代目录学的发展方向.图书情报知识,105(6),18-22.
    3柯平,曾伟忠.试论面向数字书目控制和数字资源控制的数字目录学.图书情报知识,119(9),34-41.
    4彭斐章,乔好勤,陈传夫.目录学.武汉:武汉大学出版社,2003,11:11
    1 冯英健著.网络营销基础与实践(第2版).北京:清华大学出版社,2004年10月
    2 吴泽欣编著.SEO教程:搜索引擎优化入门与进阶.北京:人民邮电出版社,2008年12月
    3 Jennifer Grappone; Gradiva Couzin著,杨明军译.搜索引擎优化.北京:清华大学出版社,2007
    4 Rebecca Lieb. The Truth About Search Engine Optimization. FT Press,2009
    5 Samuel Blankson. Search Engine Optimization (SEO) How to Optimize Your Website for Internet Search Engines. Blankson Enterprises Limited,2008
    6 David Viney. Get to the Top on Google:Tips and Techniques to Get Your Site to the Top of the Search Engine Rankings - and Stay There. Nicholas Brealey Publishing; illustrated edition,2008
    7 Jaimie Sirovich, Cristian Darie. Professional Search Engine Optimization with PHP:A Developer's Guide to SEO. Wrox,2007.
    8 Heather J. Lovely. The Best Damn Google Seo Book. CreateSpace,2009
    9 Kristopher B. Jones Search Engine Optimization:Your Visual Blueprint for Effective Internet Marketing Visual 2008
    10 Jon Rognerud. Ultimate Guide to Search Engine Optimization:Drive Traffic, Boost Conversion Rates and Make Lots of Money. Entrepreneur Press; 1 edition,2008
    11 Larry Bailin. Mommy, Where Do Customers Come From?:How to Market to a New World of Connected Customers. Larstan,2007
    12 李晓明,闫宏飞,王继民著.搜索引擎原理、技术与系统.北京:科学出版社,2005.01
    13 Patrick Tisseghem, Lars Fastrup. Inside the Index and Search Engines:Microsoft Office SharePoint Server 2007. Microsoft Office Sharepoint Server,2007
    1王学松编著.Lucene+nutch搜索引擎开发.北京:人民邮电出版社,2008
    2于天恩编著.做自己的搜索引擎——搜索引擎精解案例教程.北京:北京交通大学出版社,2007.09
    3 David A. Vise, Mark Malseed. The Google Story. Delta,2006
    4 Amy N. Langville, Carl D. Meyer. Google's PageRank and Beyond:The Science of Search Engine Rankings. Princeton University Press,2006
    5梁诚主编.Google与百度全球两大搜索巨头的技术创新与赢利策略.北京:中国经济出版社,2007
    6 John King. Search Engine Content Analysis:Analysing the subject distribution of the largest and most popular search engines. VDM Verlag,2009
    7 Ken Haycock, Barbara Edwards, Michelle Dober. The Neal-Schuman Authoritative Guide to Kids' Search Engines, Subject Directories, and Portals. Neal-Schuman Publishers,2003
    8中国互联网络信息中心.第25次中国搜索引擎用户行为研究报告(2010年1月)
    9 Techcrunchies.com. Mobile Search Engine Market Share. http://techcrunchies.com/mobile-search-engine-market-share/.检索时间:2010年3月8日
    10王鹏编著.移动搜索引擎原理与实践.北京:机械工业出版社,2009.03
    11 Gale Reference Team. Search engines go mobile. Thomson Gale,2007
    1 Uyar A. Google stemming mechanisms. Journal of Informatin Science,2009(5),499-514.
    2 Bar-Ilan J, Peritz B. C. A. (2009). Method for Measuring the Evolution of a Topic on the Web:The Case of "Informetrics". Journal of the American Society for Information Science and Technology,2009(9),1730-1740.
    3 Kokalj-Filipovic S, Spasojevic P, Yates R. Geographic Data Propagation in Location-Unaware Wireless Sensor Networks:A Two-Dimensional Random Walk Analysis. IEEE Journal on Selected Areas in Communications, 2009(7),1158-1168.
    4 Castella-Roca J, Viejo A, Herrera-Joancomarti J. Preserving user's privacy in web search engines. Computer Communications,2009 (13-14),1541-1551.
    5 Tjondronegoro D, Spink A, Jansen B. J. A Study and Comparison of Multimedia Web Searching:1997-2006. Journal of the American Society for Information Science and Technology,2009(9),1756-1768.
    6 Aguillo, I. A New Generation of Tools for Search, Recovery and Quality Evaluation of World Wide Web Medical Resources. Online information Review,2000(2),138-143
    7 Tran HM, Lange C, Chulkov G, et al. Applying Semantic Techniques to Search and Analyze Bug Tracking Data. Journal of Network and Systems Management,2009(3),285-308.
    8 Metaxas PT, Ivanova L, Mustafaraj E. New Quality Metrics for Web Search Results. Web Information Systems and Technologies,2009(18), 278-292.
    9 Huang SY, Lee YK, Wang RZ, et al. Threshold-based Successive Elimination Algorithm for Block Motion Estimation. Optical Engineering,2006(2),122-131.
    10 El Ferchichi S, Laabidi K, Zidi S. Genetic Algorithm and Tabu Search for Feature Selection. Studies in INformatics and Control,2009(2),181-187.
    11 Mavrikakis M. Computational Methods:A Search Engine for Catalysts. Nature Materials,2006(11), 847-848.
    12 Rao GLN, Saravanan S, Ilavarasi PS, et al. Combustion Analysis of a Direct Injection Diesel Engine When Fuelled with Sunflower Methyl Ester and its Diesel blends. International Journal of Vehicle Design,2008(14), 289-303.
    13 Dumas L, Druez B, Lecerf N. A Fully Adaptive Hybrid Optimization of Aircraft Engine Blades. Journal of Computational and Applied Mathematics,2009(1),54-60.
    14 Laurent MR, Vickers TJ. Seeking Health Information Online:Does Wikipedia Matter?. Journal of the American Medical Informatics Association,2009(4),471-479.
    15 Coiera EW, Vickland V. Is Relevance Relevant? User Relevance Ratings May Not Predict the Impact of Internet Search on Decision Outcomes. Journal of the American Medical Informatics Association,2009(4), 542-545.
    1 Crudge, S.E., & Johnson, F.C. Using the Information Seeker to Elicit Construct Models for Search Engine Evaluation. Journal of the American Society for Information Science and Technology,2004(9),794-806.
    2 Su, L.T. A Comprehensive and Systematic Model of User Evaluation of Web Search Engines:Ⅰ. Theory and background. Journal of the American Society for Information Science and Technology,2003(13),1175-1192.
    3 Spink, A. A User-centered Approach to Evaluating Human Interaction with Web Search Engines:an Exploratory Study. Information Processing and Management,2003(3),401-426
    4 Zhang, J., & Lin, S. Multiple Language Supports in Search Engines. Online Information Review,2007(4),516-532.
    5 Hassan, I., & Zhang, J. Image Search Engine Feature Analysis. Online Information Review,2001(2),103-114.
    6 Zhang, J. & Chueng, C. Meta Search Engine Feature Analysis. Online Information Review,2003(6),433-441.
    7 Jansen, B.J., & Molina, P.R.. The Effectiveness of Web Search Engines for Retrieving Relevant Ecommerce Links. Information Processing and Management,2006(4),1075-1098.
    8 Ozmutlu, S., Spink, A., & Ozmutlu, H.C. Multimedia Web Searching Trends:1997-2001. Information Processing and Management,2003(4),611-621
    9 Vaughan, L., & Thelwall, M. Search Engine Coverage Bias:Evidence and Possible Causes. Information Processing and Management,2004(4),693-707.
    10 Mowshowiz, A., & Kawaguchi, A. Measuring Search Engines Bias. Information Processing and Management, 2005(5),1193-1205.
    11 Spink, A., Jansen, B.J., Blakely, C., & Koshman, S. A Study of Results Overlap and Uniqueness Among Major Web Search Engines. Information Processing and Management,2006(5),1379-1391.
    12 Bar-Ilan, J., Keenoy, K., Yaari, E., & Levene, M. User Rankings of Search Engine Results. Journal of the American Society for Information Science and Technology,2007(9),1254-1266.
    13 Bar-Ilan, J. Web Links and Search Engine Ranking:The Case of Google and the Query "jew". Journal of the American Society for Information Science and Technology,2006(12),1581-1589.
    14 Thelwall, M. Quantitative Comparisons of Search Engine Results. Journal of the American Society for Information Science and Technology,2008(11),1702-1710.
    1 Nicholson, S., Sierra, T., Eseryel, U.Y., etc. How Much of It Is Real? Analysis of Paid Placement in Web Search Engine Results. Journal of the American Society for Information Science and Technology,2006(4),448-461.
    2 Ford, N., Miller, D., & Moss, N. Web Search Strategies and Retrieval Effectiveness:an Empirical Study. Journal of Documentation,2002(1),30-48.
    3 Whittle, M., Eaglestone, B., Ford, N., Gillet, V.J., & Madden, A. Data Mining of Search Engine Logs. The Journal of the American Society for Information Science and Technology,2007(14),2382-2400
    4 Shi, X.D., & Yang, C.C. Mining Related Queries from Web Search Engine Query Logs Using an Improved Association Rule Mining Model. Journal of the American Society for Information Science and Technology, 2007(12),1871-1883.
    5 Jansen, B.J., & Spink, A. An Analysis of Web Searching by European Alltheweb.com Users. Information processing and Management,2005(6),361-381.
    1 Jansen, B. J., Spink, A., & Saracevic, T. Real Life, Real Users, and Real Needs:a Study and Analysis of User Queries on the Web. Information Processing and Management,2000(2),207-227.
    2 Holscher, C., & Strube, G. Web Search Behavior of Internet Experts and Newbies. International Journal of Computer and Telecommunications Networking,2000(1),337-346.
    3 Silverstein, C., Henzinger, M., Marais, H., & Moricz, M. Analysis of a Very Large Web Search Engine Query Log. SIGIR Forum,1999(1),6-12.
    4 Wolfram, D., Spink, A., Jansen, B. J., & Saracevic, T. Vox populi:the Public Searching of the Web. Journal of the American Society of Information Science and Technology,2001(12),1073-1074.
    5 Cacheda, F., & Vina, A. Experiences Retrieving Information in the World Wide Web. In Proceedings of the 6th IEEE Symposium on Computers and Communications,2001,72-79.
    6 Cacheda, F., & Vina,A. Understanding How People Use Search Engines:A Statistical Analysis for E-business. In Proceedings of the e-Business and e-Work Conference and Exhibition,2001,319-325.
    7 Spink, A., Jansen, B. J., Wolfram, D., & Saracevic, T. From E-sex to E-commerce:Web Search Changes. IEEE Computer,2002(3),107-111.
    8 Spink, A., Ozmutlu, S., Ozmutlu, H. C., & Jansen, B. J. US Versus European Web Searching Trends. SIGIR Forum,2002(1),30-37.
    9 Jansen, B.J., & Spink, A. How Are We Searching the World Wide Web? A Comparison of Nine Search Engine Transaction Logs. Information Processing and Management,2006(1),248-263.
    10 Jansen, B.J., Spink, A., Blakely, C., & Koshman, S. Defining a Session on Web Search Engines. Journal of the American Society for Information Science and Technology,2007(6),862-871.
    1 Chau, M., Fang, X., & Sheng, O.R.L. Analysis of the Query Logs of a Web Site Search Engine. Journal of the American Society for Information Science and Technology,2005(13),1363-1376.
    2 He, D. Q., Brusilovsky, P., Ahn, J., Grady, J., etc. An Evaluation of Adaptive Filtering in the Context of Realistic Task-based Information Exploration. Information Processing and Management,2007(6),511-533.
    3 Bilal, D. Children's Use of the Yahooligans! Web Search Engine:Ⅰ. Cognitive, Physical, and Affective Behaviors on Fact-Based Search Tasks. Journal of the American Society for Information and Technology,2000(7), 646-665.
    4 Bilal, D. Children's Use of the Yahooligans! Web Search Engine:Ⅱ. Cognitive and Physical Behavior on Research Tasks. Journal of the American Society for Information Science and Technology,2001(2),118-136.
    5 Bilal, D. Children's Use of the Yahooligans! Web Search Engine. Ⅲ. Cognitive and Physical Behaviors on Fully Self-Generated Search Tasks. Journal of American Society for Information Science and Technology, 2002(13),1170-1183.
    6 Riahinia, N., & Zandian, F. Evaluation of Information Providers and Popular Search Engines on the Base of Postgraduate Students' Perspectives. Electronic Library,2008(4),594-604.
    1 Yu, H., & Kaufman, D. A Cognitive Evaluation of Four Online Search Engines for Answering Definitional Questions Posed by Physicians. Pacific Symposium on Biocomputing,2007,328-339.
    2 Tongchim, S., Somlertlamvanich, V.,& Isahara, H. Measuring the Effectiveness of Public Search Engines on Thai Queries. Proceedings of the Fifth IASTED International Conference on Communications, Internet, and Information Technology,2006,349-354.
    3 Long, H.Q., Lv, B.F., Zhao, T.B., & Liu, Y. Evaluate and Compare Chinese Internet Search Engines Based on Users' Experience.2007 International Conference on Wireless Communications, Networking and Mobile Computing,2007(1),6134-6137.
    4 Griesbaum, J. Evaluation of three German Search Engines:Altavista.de, Google.de and Lycos.de. Information Research,2004(4). http://informationr.net/ir/9-4/paper189.html. 检索时间:2010年3月10日
    5 Lazarinis, F. Evaluating the Searching Capabilities of E-commerce Web Sits in a Non-English Language-A Greek Case Study. Online Information Review,2007(6),881-891.
    1 Zhang, J., & Lin, S. Multiple Language Supports in Search Engines. Online Information Review,2007(4), 516-532.
    2 CLEF, http://clef-campaign.org/.检索时间:2010年3月9日
    3 Kishida, K. Predication of Performance of Cross-language Information Retrieval Using Automatic Evaluation of Translation. Library & Information Science Research,2008(2),138-144.
    4田丹,王轶宁,李孟涛.改善网上自然语言检索的几点建议.现代图书情报技术,2002(5),48-49.
    5龚芳,耿鸯,王洋.自然语言检索中的概念控制.中国图书馆学报,2005(4),45-48.
    6 Fattahi, R., Wilson, C.S., & Cole, F. An Alternative Approach to Natural Language Query Expansion in Search Engines:Text Analysis of Non-topical Terms in Web Documents. Information Processing and Management, 2008(4),1503-1516.
    1 Ford, N., Miller, D., & Moss, N. Web Search Strategies and Retrieval Effectiveness:An Empirical Study. Journal of Documentation,2002(1),30-48.
    2 Ozmutlu, S., Spink, A., & Ozmutlu, H.C. Multimedia Web Searching Trends:1997-2001. Information Processing and Management,2003(4),611-621
    3 Stevenson, K., & Leung, C. Comparative Evaluation of Web Image Search Engines for Multimedia Applications.2005 IEEE International Conference on Multimedia and Expo (ICME),2005(1-2),1195-1198.
    4 Hastings, S. K... Evaluation of Image Retrieval Systems:Role of User Feedback. Library Trends,1999(2), 438-452.
    5 Muller, W., Marchand-Maillet, S., Muller, H., Squire, D. M., Pun, T. Evaluating Image Browsers Using Structured Annotation. Journal of the American Society for Information Science and Technology,2001(11), 961-968.
    6 Dannenberg, R. B., Birmingham, W. P., Pardo, B., Hu, N., Meek, C., Tzanetakis, G. A Comparative Evaluation of Search Technologies for Query-by-Humming Using the Musart Testbed. Journal of the American Society for Information Science and Technology,2007(5),687-701
    1 Jansen, B.J., & Molina, P.R. The Effectiveness of Web Search Engines for Retrieving Relevant Ecommerce Links. Information Processing and Management,2006(4),1075-1098.
    2 Bar-Ilan, J. Comparing Rankings of Search Results on the Web. Information Processing and Management, 2005(6),1511-1519.
    3 Cortes, C., Mohri, M., & Rastogi, A. Alternative Ranking Problem for Search Engines. Experimental Algorithms, Proceedings,2007,1-22.
    4 Leighton, H.V., & Srivastava, J. First 20 Precision Among World Wide Web Search Services (Search Engines). Journal of the American Society for Information Science,1999(10),870-881
    5 Hanse, P., & Karlgren, J. Effects of Foreign Language and Task Scenario on Relevance Assessment. Journal of Documentation,2005(5),623-639.
    1 Meng, X.N., & Clark, T. An Empirical User Rating of Popular Search Engines Using RankPower. ITCC 2005: International Conference on Information Technology:Coding and Computing,2005(2),521-525.
    2 Guo, H., Zhang, J., & Zhou, L. Classifying and Ranking:The First Step Towards Mining Inside Vertical Search Engines. Database and Expert Systems Applications, Proceedings,2007,223-232.
    3 Jatowt, A., Kawai, Y., & Tanaka, K. Temporal Ranking of Search Engine Results. Web Information Systems Engineering-WISE 2005,43-52.
    4 Kumar, R., Suri, P.K., & Chauhan, R.K. Search Engines Evaluation. DESIDOC Bulletin of Information Technology,2005(2),3-10.
    5 Baeza-Yates, R., Hurtado, C., & Mendoza, M. Improving Search Engines by Query Clustering. Journal of the American Society for Information Science and Technology,2007(12),1793-1804.
    6 Zhu, Y., Wu, M.D., Zhang, Y., & Li, X.M. Promotional Ranking of Search Engine Results:Giving New Web Pages a Chance to Prove Their Values. Advances in Data and Web Management, Proceedings,2007,503-510.
    7 Soboroff, I., Nicholas, C., & Cahan, P. Ranking Retrieval System without Relevance Judgments. Proceedings of the 24th annual international ACM SIGIR conference on Research and Development in Information Retrieval, 2001,66-73.
    8 Watters, G., & Amoudi, G. GeoSearcher:Location-Based Ranking of Search Engine Results. Journal of the American Society for Information Science and Technology,2003(2),140-151.
    9 Zhang, J. An Experimental Investigation on the Distance Angle Integrated Similarity Measure. The Canadian Journal of Information and Library Science,2008(3-4),141-168.
    1 Jacs6, P. How Many Web-wide Search Engines Do We Need?. Online Information Review,2008(6),860-865.
    2 Su, L.T. A Comprehensive and Systematic Model of User Evaluation of Web Search Engines:II. An Evaluation by Undergraduates. Journal of the American Society for Information Science and Technology,2003(13), 1193-1223.
    3 Bar-Ilan, J. Web links and search engine ranking:The case of Google and the query "jew". Journal of the American Society for Information Science and Technology,2006(12),1581-1589.
    4 Thelwall, M. Subject Gateway Sites and Search Engine Ranking. Online Information Review,2002(2),101-107.
    5 Zhang, J., & Dimitroff, A. The Impact of Webpage Content Characteristics on Webpage Visibility in Search Engine Results (Part II). Information Processing and Management,2005(3),691-715.
    6 Bar-Ilan, J., Levene, M., & Mat-Hassan, M. Methods for evaluating dynamic changes in search engine rankings: a case study. Journal of Documentation,2006(6),708-729.
    1 Bar-Ilan, J., Keenoy, K., Yaari, E., & Levene, M. User Rankings of Search Engine Results. Journal of the American Society for Information Science and Technology,2007(9),1254-1266.
    2 Losee, R.M., & Paris, L.A.H. Measuring Search-Engine Quality and Query Difficulty:Ranking with Target and Freestyle. Journal of the American Society for Information Science,1999(10),882-889.
    3韩圣龙,赖茂生.网络信息检索工具评价实验(Ⅱ)—中、英文搜索引擎检索评价实验[J].情报科学,2001(4),430-434.
    4 Ing-Xiang Chen, Cheng-Zen Yang. Position Paper:A Study of Web Search Engine Bias and its Assessment. IW3C2, WWW 2006.
    5 Abbe Mowshowitz, Akira Kawaguchi. Assessing Bias in Search Engines. Information Processing and Management,2002(1),141-156.
    6 Abbe Mowshowiz, Akira Kawaguchi. Measuring Search Engines Bias. Information Processing and Management,2005(5),1193-1205.
    7 Liwen Vaughan, Mike Thelwall. Search Engine Coverage Bias:Evidence and Possible Causes. Information Processing and Management,2004(4),693-707.
    8 Junghoo Cho, Sourashis Roy. Impact of Search Engines on Page Popularity. Proceedings of the 13th International Conference on World Wide Web,2004,20-29.
    1 Bernared J. Jansen, Mimi Zhang, Ying Zhang. The Effect of Brand Awareness of the Evaluation of Search Engine Results. CHI'07 Extended Abstracts on Human Factors in Computing Systems,2007,2471-2476.
    2 Michael Chau, Hsinchun Chen. Comparison of Three Vertical Search Spiders. IEEE Computer,2003(5),56-62.
    3 Fuhr, N., Govert, N., Kazai, G., & Lalmas, M. INEX:INitiative for the Evaluation of XML Retrieval. In Proceedings of the SIGIR 2002 Workshop on XML and Information Retrieval,2002.
    4 Susan Davis Herring. The value of Interdisciplinary:A Study Based on the Design of Internet Search Engines. Journal of the American Society for Information Science,1999(4),358-365.
    5 Amanda Spink, Bernard J. Jansen, Chris Blakely, Sherry Koshman. A study of Results Overlap and Uniqueness Among Major Web Search Engines. Information Processing and Management,2006,1379-1391(5)
    6王益明,刘菲.中文搜索引擎的检索结果重合率研究.情报学报,2009,28(3),374-381.
    7 Jepsen, E.T., Seiden, P., Ingwersen, P., Bjorneborn, L., & Borlund, P. Characteristics of Scientific Web Publication:Preliminary Data Gathering and Analysis. Journal of the American Society for Information Science and Technology,2004(14),1239-1249
    8 Mike Thelwall. Extracting Accurate and Complete Results from Search Engines:Case Study Windows Live. Journal of the American Society for Information Science and Technology,2008(1),38-50.
    9 Su, L. T. A Comprehensive and Systematic Model of User Evaluation of Web Search Engines:1. Theory and Background. Journal of the American Society for Information Science and Technology,2008(13),1175-1192.
    10 Naturalistic Observation. http://en.wikipedia.org/wiki/Naturalistic_observation.检索时间:2010年3月9日
    11 Orland Hoeber. User Evaluation Methods for Visual Web Search Interfaces. Proceedings of the 200913th International Conference Information Visualisation,2009,139-145.
    12 Longitudinal studies. http://en.wikipedia.org/wiki/Longitudinal_studies.检索时间:2010年3月日
    1陈海龙.搜索引擎的评价标准及其方法研究.情报杂志,2001(9),50-51.
    2赵华.一种搜索引擎性能的简便评价方法和案例.图书馆理论与实践,2005(6),114-115.
    1 Bernard J. Jansen, Paulo R. Molina. The Effectiveness of Web Search Engines for Retrieving Relevant Ecommerce Links. Information Processing and Management,2006(4),1075-1098.
    2 Moskovitch R, Martins SB, Behiri E, Weiss A, Shahar Y. A Comparative Evaluation of Full-text, Concept-based, and Context-sensitive Search. Journal of the American Medical Informatics Association,2007(2), 164-174.
    3 Zhang, X.M, Chignell, M. Assessment of the Effects of User Characteristics on Mental Models of Information Retrieval Systems. Journal of the American Society for Information Science and Technology,2001(6),445-459.
    4 Mike Thelwall. Can Google's PageRank be Used to Find the most Important Academic Web Pages?. Journal of Documentation,2003(2),205-217.
    5 Preben Hanse, Jussi Karlgren. Effects of Foreign Language and Task Scenario on Relevance Assessment. Journal of Documentation,200(5),623-639.
    6 Zhang, J., & Dimitroff, A. The Impact of Metadata Implementation on Webpage Visibility in Search Engine Results (Part II). Information Processing and Management,2005(3),691-715.
    7 Shiri, A., & Revie, Crawford. Query Expansion Behavior Within a Thesaurus-Enhanced Search Environment:A User-Centered Evaluation. Journal of the American Society for Information Science and Technology,2006(4), 462-478.
    1 Spink, A., Bateman, J. and Jansen, B. J. Searching the Web:survey of Excite users. Internet Research: Electronic Networking Applications and Policy,1999(2),117-128.
    2 Kruschwitz, U., & Al-Bakour, H. Users Want More Sophisticated Search Assistants:Results of a Task-Based Evaluation. Journal of the American Society for the Information Science and Technology,2005(13),1377-1393.
    3 Liaw, S., & Huang, H. M. Information Retrieval from the World Wide Web:a User-focused Approach based on Individual Experience with Search Engines. Computers in Human Behavior,2006(3),501-517.
    1 Dudek, D., Mastora, A., & Landoni, M. Is Google the answer? A Study into Usability of Search Engines. Library Review,2006(3),224-233.
    2 Airio, E. Who Benefits from CLIR in Web Retrieval?. Journal of Documentation,2008(5),760-778.
    3 Lewandowski, D. The Retrieval Effectiveness of Web Search Engines:Considering Results Descriptions. Journal of Documentation,2008(6),915-937.
    4 Jansen, B.J., Zhang, M.M., & Zhang, Y. The Effect of Brand Awareness of the Evaluation of Search Engine Results. CHI'07 Extended Abstracts on Human Factors in Computing Systems,2007,2471-2476.
    5 Kleinberg, J. (1999). Hubs, authorities and communities. ACM Computing Surveys,31(4).
    6 Bilal, D. Children's Use of the Yahooligans! Web Search Engine. Ⅲ. Cognitive and Physical Behaviors on Fully Self-Generated Search Tasks. Journal of American Society for Information Science and Technology, 2002(13),1170-1183.
    7 Al-Ansari, H. Internet use by the faculty members of Kuwait University. The Electronic Library,2006(6), 791-803.
    1 Huntington, P., Nicholas, D., & Jamali, H. R. Employing Log Metrics to Evaluate Search Behavior and Success: Case Study BBC Search Engine. Journal of Information Science,2007(5),584-597.
    2 Chau, M., Fang, X., & Sheng, O.R.L. Analysis of the Query Logs of a Web Site Search Engine. Journal of the American Society for Information Science and Technology,2005(3),1363-1376
    3 Whittle, M., Eaglestone, B., Ford, N., Gillet, V.J., & Madden, A. Data Mining of Search Engine Logs. Journal of the American Society for Information Science and Technology,2007(14),2382-2400.
    4 Jansen, B.J., Spink, A., Blakely, C., & Koshman, S. Defining a Session on Web Search Engines. Journal of the American Society for Information Science and Technology,2007(6),862-871.
    5 Nicholas, D., Huntington, P., etc. Student Digital Information-seeking Behaviour in Context. Journal of Documentation,2009(1),106-132.
    1 Large, A., Beheshti, J., & Rahman, T. Gender Differences in Collaborative Web Searching Behavior:an Elementary School Study. Information Processing and Management,2002(3),427-443.
    2 Roy, M., & Chi, M. T. H. Gender Differences in Patterns of Searching the Web. Journal of Educational Computing Research,2003(3),335-348.
    3 Lorigo, L., Pan, B., Hernbrooke, H., Joachims, T., Granka, L., & Gay, G. The Influence of Task and Gender on Search and Evaluation Behavior Using Google. Information Processing and Management,2006(4),1123-1131.
    4 Rowlands, I., Nicholas, D., Williams, P., etc. The Google Generation:the Information Behaviour of the Researcher of the Future. Aslib Proceedings:New Information Perspectives,2008(4),290-310.
    5 Madden, A. D., Ford,N. J., Miller, D., & Levy, P. Children's Use of the inTernet for Information-seeking. Journal of Documentation,2006(6),744-761.
    6 Spink, A. and Ozmutlu, H.C.Characteristics of Question Format Web Queries:an Exploratory Study. Information Processing Management,2002(4),453-71.
    7 Spink, A.,&Xu, J. L. Selected Results from a Large Study of Web Searching:the Excite Study. Information Research,2000(1). http://InformationR.net/ir/6-1/paper90.html检索时间:2010年3月9日
    8 Broder, A. A taxonomy of web search. ACM SIGIR Forum,2002 (2). www.acm.org/sigir/forum/F2002/broder.pdf 检索时间:2010年3月9日
    1 Martzoukou, K. A Review of Web Information Seeking Research:Considerations of Method and Foci of Interest. Information Research,2005(2). http://informationr.net/ir/10-2/infres102.html检索时间:2010年3月9日.
    2 Manoj M., & Jacob, E. Information Retrieval on Internet Using Meta-search Engines:A Review. Journal of Scientific and Industrial Research,2008(10),739-746.
    3秦喜艳,陆伟,姜捷璞.信息检索中的相关性判断和系统评价述评.图书情报知识,2009(7),89-94.
    4曹超.2002-2007年国外对搜索引擎检索结果研究综述.图书情报知识,2009(1),90-96.
    5吴小兰,汪琪.元搜索引擎研究综述.图书情报工作,2009(5),46-49.
    6曹林,韩立新,吴胜利.元搜索引擎排序技术综述.计算机应用研究,2009(2),411-414.
    1 Aitchison, J. & Cleverdon, C. W. A Report on a Test of the Index of Metallurgical Literature of Western Reserve University. The College of Aeronautics, Cranfield,1963.
    2 Carpineto, C., D'Aloisi, D., Delogu, C, Ragazzini, S., etc. Evaluating Search Features in Public Administration Websites. Euroweb2001 Conference,2001,167-184.
    1 Oppenheim, C., Morris, A., McKnight, C., & Lowley, S. The Valuation of WWW Search Engines. Journal of Documentation,2000(2),190-211.
    2曾民族.网络信息检索现状和性能评价.情报学报,1997(4),90-99.
    1宛玲,杨秀丹,杜晓静.试析中文搜索引擎的评价标准.情报科学,2000(1),28-32.
    2 L. Wishard.. Precison Among Internet Search Engines:An Earth Sciences Case Study. Issues in Science and Technology Librarianship,1998(18). http://www.istl.org/98-spring/article5.html.检索时间:2010年3月9日
    3 H. Chu & Rosenthal, M. Search engines for the World Wide Web:A comparative study and evaluation methodology. ASIS'96:Proc.59th ASIS Annual Meeting, Medford, NJ, Information Today, Inc.,1996,127-135.
    1 Y. Theng, M. Jones and H. Thimbleby, Lost in Hyperspace-Psychological Problem or Bad Design? In: Proceedings of the first Asia Pacific Conference on Computer Human Interaction,1996(3101),387-396.
    2 H. Chu & Rosenthal, M. Search engines for the World Wide Web:A Comparative Study and Evaluation Methodology. ASIS'96:Proc.59th ASIS Annual Meeting, Medford, NJ, Information Today, Inc.,1996,127-135.
    3 Maglaughlin, K. L., & Sonnenwald, D. H. User Perspectives on Relevance Criteria:A Comparison among Relevant, Partially Relevant, and Not-Relevant Judgments. Journal of the American Society for Information Science and Technology,2002(5),327-342.
    4 Kekalainen, J. Binary and Graded Relevance in IR Evaluations-Comparison of the Effects on Rankings of IR Systems. Information Processing and Management, 2005(5),1019-1033.
    5 Tang, R., Shaw, W. M., & Vevea, J. L. Towards the Identification of the Optimal Number of Relevance Categories. Journal of the American Society for Information Science,1999(3),254-264.
    1 Saracevic, T. Relevance:A Review of the Literature and a Framework for Thinking on the Notion in information Science. Part III:Behavior and effects of relevance. Journal of the American Society for Information Science and Technology,2007(13),2126-2144.
    2 Kim, S., & Oh, S. Users' Relevance Criteria for Evaluating Answers in a Social Q&A Site. Journal of the American Society for Information Science and Technology,2009(4),716-727.
    1 Google Technology Overview. http://www.google.com/corporate/tech.html检索时间:2010年3月9日
    1 PageRank. http://en.wikipedia.org/wiki/Pagerank检索时间:2010年3月9日
    2 HITS algorithm. http://en.wikipedia.org/wiki/HITS_algorithm检索时间:2010年3月9日
    3 Meng, X.N., & Clark, T. An Empirical User Rating of Popular Search Engines Using RankPower. ITCC 2005: International Conference on Information Technology:Coding and Computing,2005(2),521-525.
    1 Guo, H.,.Zhang, J., & Zhou, L. Classifying and Ranking:The First Step Towards Mining Inside Vertical Search Engines. Database and Expert Systems Applications, Proceedings, LNCS2007,223-232
    2 Bidoki, A. M. Z., Yazdani, N. DistanceRank:An Intelligent Ranking Algorithm for Web Pages. Information Processing and Management,2008(2),877-892.
    3 Watters, G., & Amoudi, G. GeoSearcher:Location-Based Ranking of Search Engine Results. Journal of the American Society for Information Science and Technology,2003(2),140-151.
    4 Abiteboul, S., Preda, M.,&Cobena, G. Adaptive Online Page Importance Computation. Proceedings of the 12th International Conference on the World Wide Web. Budapest,Hungary, ACM Press, NY,2003,280-90. http://www2003.org/cdrom/papers/refereed/p007/p7-abiteboul.html检索时间:2010年3月9日
    5 Hochstotter, N., & Koch, M. Standard Parameters for Searching Behavior in Search Engines and Their Empirical Evaluation. Journal of Information Science,2009(1),45-65.
    1 J. Bar-Ilan. The Use of Web Search Engines in Information Science Research. Annual Review of Information Science and Technology,2004(38),231-288.
    1 Text Retrieval Conference. http://en.wikipedia.org/wiki/Text_Retrieval_Conference检索时间;2010年3月9日
    1 Hock, R. Web Search Engines-(More) Features and Commands. Online,2000(3),17-18,20,22-24,26.
    2 Fattahi, R., Wilson, C.S., & Cole, F. An Alternative Approach to Natural Language Query Expansion in Search Engines:Text Analysis of Non-topical Terms in Web Documents. Information Processing and Management, 2008(4),1503-1516.
    3 Ford, N., Miller, D., & Moss, N. Web Search Strategies and Retrieval Effectiveness:An Empirical Study. Journal of Documentation,2002(1),30-48.
    1 List of Search Engines. http://en.wikipedia.org/wiki/List_of_search_engines检索时间:2010年3月9日
    11% Market Share in Search is Worth Up to$3 Billion Dollars. http://www.altsearchengines.com/2009/06/10/1-market-share-in-search-is-worth-up-to-3-billion-dollars/检索时间:2010年3月9日
    2 iProspect Search Engine User Attitudes. http://www.iprospect.com/premiumPDFs/iProspectSurveyComplete.pdf检索时间:2010年3月9日
    1 Ford, N., Miller, D., & Moss, N. Web Search Strategies and Retrieval Effectiveness:an Empirical Study. Journal of Documentation,2002(1),30-48
    2 Fattahi, R., Wilson, C.S., & Cole, F. An Alternative Approach to Natural Language Query Expansion in Search Engines: Text analysis of Non-topical Terms in Web Documents. Information Processing and Management,2008(4),1503-1516.
    3 Zhang, J., & Dimitroff, A. (2005). The Impact of Webpage Content Characteristics on Webpage Visibility in Search Engine Results (Part 1). Information Processing and Management,2005(3),665-690.
    1 Ding, W. & Marchionini, G. A Comparative Study of Web Search Service Performance. ASIS'96:Proceedings of the 59th ASIS Annual Meeting,1996(33),136-142.
    2 Leighton, H.V. Performance of four World Wide Web(WWW) Index Services:Infoseek, Lycos, WebCrawler, and WWWWorm,1995.
    1 H. Verson Leighton. First 20 Precision among World Wide Web Search Services (Search Engine). Journal of the American Society for Information Science and Technology,1999(10),870-881.
    2余慧佳,刘奕群,张敏,茹立云,马少平.基于大规模日志分析的搜索引擎用户行为分析.中文信息学报,2007(1):109-113.
    3刘奕群,岑荣伟,张敏,茹立云,马少平.基于用户行为分析的搜索引擎自动性能评价.软件学报2008(11):3023-3032.
    4Dawn Kawamoto and Elinor Mills. AOL apologizes for release of user search data. http://news.cnet.com/2100-1030_3-6102793.html检索时间:2010年3月9日
    5 Spink, A. Wolfram, D. Jansen, B. J., Saracevic, T. Searching the Web:The Public and Their Queries. Journal of the American Society for Information Science and Technology,2001(3),226-234.
    6 Teevan, J., Adar, E., Jones, R., Potts, M. History Repeats Itself:Repeat Queries in Yahoo's Query Logs. Proceedings of the 29th Annual ACM Conference on Research and Development in Information Retrieval,2005,703-704.
    7 KDD Cup 2005. http://www.sigkdd.org/kdd2005/kddcup.html检索时间:2010年3月9日
    1 Broder, A. A Taxonomy of Web Search. SIGIR Forum,2002(36),3-10.
    1 http://www.cwirf.org/2007WebTrack/07.td_topics.216-285检索时间:2010年3月9日
    2 http://www.cwirf.org/2006WebTrack/06.nphp_topics.586-885检索时间:2010年3月9日
    3 MacFarlan. Evaluation of web search for the information practitioner. Aslib Proceedings:New Information Perspectives, 2007(4-5),352-366.
    4 Spink, A., Jansen, B.J., Blakely, C., & Koshman, S. A study of Results overlap and Uniqueness Among Major Web Search Engines. Information Processing and Management,2006(5),1379-1391.
    1 Eastman, C.M., & Jansen, B.J. Coverage, relevance, and ranking:The impact of query operators on web search engine results. Acm Transactions on Information Systems,2003(4),383-411.
    2 Can, F., Nuray, R., & Sevdik, A.B. Automatic Performance Evaluation of Web Search Engines. Information Processing and Management,2004(3),495-514.
    3刘奕群,岑荣伟,张敏,茹立云,马少平.基于用户行为分析的搜索引擎自动性能评价.软件学报2008(11):3023-3032.
    4 Frederic Lardinois. http://www.readwriteweb.com/archives/hitwise_search_queries_are_getting_longer.php检索时间:2010年3月9日
    1 What would you like removed?. https://www.google.com/webmasters/tools/removals检索时间:2010年3月9日
    2 Hochstotter, N., & Lewandowski, D. What users see-Structures in search engine results pages. Information Science, 2009(12),1796-1812.
    3 Zhang, J., & Dimitroff, A. The Impact of Webpage Content Characteristics on Webpage Visibility in Search Engine Results. Information Processing and Management,2005(3),665-690
    1杨谷.网上“制黄贩黄”何以屡屡得逞.光明日报,2006-2-14(6)
    2田豆豆.熊猫烧香,“烧”出多少漏洞?人民日报,2007-2-15(11)
    3杨卫平.网络著作权:令人关注的法律领域——从杨某诉千龙网等十几家网站著作权侵权纠纷案谈起.http://www.legalinfo.gov.cn/zt/2005-01/20/content_180791.htm检索时间:2010年3月9日
    1赵杰.新保密法修订草案初审 互联网泄密占七成.第一财经日报.http://www.china-cbn.com/s/n/000002/20090623/000000118665.shtml检索时间:2010年3月9日
    1 Jacso, P. Savvy Searching How Many Web-wide Search Engines Do We Need?. Online Information Review,2008(6), 860-865.
    2 Jansen, B. J., & Spink, A. How Are We Searching the World Wide Web? A Comparison of Nine Search Engine Transaction Logs. Information Processing and Management,2006(1),248-263.
    3 Kumar, R., Suri, P.K., & Chauhan R.K. Search Engines Evaluation. DESIDOC Bulletin of Information Technology, 2005(2),3-10.
    4 Leighton, H.V., & Srivastava, J. First 20 Precision Among World Wide Web Search Services (Search Engines). Journal of the American Society for Information Science,1999(10),870-881.
    1 Kekalainen, K.. Binary and Graded Relevance in IR Evaluations-Comparison of the Effects on Ranking of IR Systems. Information Processing and Management,2005(5),1019-1033.
    1 Croft, B., Metzler, D., & T. Strohman. Search Engines:Information Retrieval in Practice. Addison Wesley,2009.
    1秦喜艳,陆伟,姜捷璞.信息检索中的相关性判断和系统评价述评.图书情报知识,2009(7),89-94.
    1 Evans, M. P. Analysing Google Rankings Through Search Engine Optimization Data. Internet Research,2007(1),21-37.
    2 Bar-Ilan, J. Web Links and Search Engine Ranking:The Case of Google and the Query "Jew". Journal of the American Society for Information Science and Technology,2006(12),1581-1589.
    3 Jansen, B. J., Zhang, M., Schultz, C. D. Brand and its Effect on user Perception of Search Engine Performance. Journal of the American Society for Information Science and Technology,2009(8),1572-1595.
    1 Thelwall, M. Can Google's PageRank be Used to Find the most Important Academic Web Pages?. Journal of Documentation,2003(2),205-217.
    2 Mukherjee, B. Do Open-Access Journal in Library and Information Science Have Any Scholarly Impact? A Bibliometric Study of Selected Open-Access Journals Using Google Scholar. Journal of the American Society for information Science and Technology,2009(3),581-594,
    3 Hartman, K. A. Google Scholar and Academic Libraries:an Update. New Library World,2008(5-6),211-222.
    4 Kousha, K., Thelwall, M. Google Scholar Citations and Google Web/URL Citations:A Multi-Discipline Exploratory Analysis. Journal of the American Society for Information Science and Technology,2007(7),1055-1065.
    5 Walters, W. H. Google Scholar Coverage of a Multidisciplinary Field. Information Processing and Management,2007(4), 1121-1132.
    6 Norris, B. P. Google:Its Impact on the Library. Library High Technology News,2006(9),9-11.
    1 Yahoo. http://www.baidu.com/s?wd=yahoo&oq=yahoo&f=3&rsp=1.检索时间:2010年3月9日
    1 comScore Releases May 2009 U.S. Search Engine Rankings. http://ir.comscore.com/releasedetail.cfm?releaseid=390444检索时间:2010年3月9日
    2 comScore Releases November 2009 U.S. Search Engine Rankings. http://ir.comscore.com/releasedetail.cfm?releaseid=430895检索时间:2010年3月9日
    3 Google and Bing Keep Rising While Yahoo Drops Again. New York Times. http://bits.blogs.nytimes.com/2009/12/16/google-and-bing-keep-rising-while-yahoo-drops-again/检索时间:2010年3月9日
    4 Obscure Standard Plays Into Microsoft, Google Search Battle. Wall Street Journal. http://online.wsj.com/article/BT-CO-20091202-706252.html检索时间:2010年3月9日
    1关于百度.http://home.baidu.com/about/about.html检索时间:2010年3月9日
    1 Liwen Vaughan, Mike Thelwall. Search Engine Coverage Bias:Evidence and Possible Causes. Information Processing and Management,2004(4),693-707.
    1费巍.搜索引擎优化策略研究.武汉大学硕士学位论文,2006.
    1 DOAJ. http://www.doaj.org/检索时间:2010年3月9日
    2 陈传夫.中国科学数据公共获取机制:特点、障碍与优化的建议.中国软科学,2004(2),8-13.
    [1]曹超.2002-2007年国外对搜索引擎检索结果研究综述.图书情报知识,2009(1),90-96.
    [2]曹林,韩立新,吴胜利.元搜索引擎排序技术综述.计算机应用研究,2009(2),411-414.
    [3]曾民族.网络信息检索现状和性能评价.情报学报,1997(4),90-99.
    [4]陈传夫.中国科学数据公共获取机制:特点、障碍与优化的建议.中国软科学,2004(2),8-13.
    [5]陈海龙.搜索引擎的评价标准及其方法研究.情报杂志,2001(9),50-51.
    [6]柯平,曾伟忠.试论面向数字书目控制和数字资源控制的数字目录学.图书情报知识,119(9),34-41.
    [7]柯平.数字目录学——当代目录学的发展方向.图书情报知识,105(6),18-22.
    [8]刘奕群,岑荣伟,张敏,茹立云,马少平.基于用户行为分析的搜索引擎自动性能评价.软件学报2008(11),3023-3032.
    [9]彭斐章,乔好勤,陈传夫.目录学.武汉:武汉大学出版社,2003,11:11
    [10]秦喜艳,陆伟,姜捷璞.信息检索中的相关性判断和系统评价述评.图书情报知识,2009(7),89-94.
    [11]田丹,王轶宁,李孟涛.改善网上自然语言检索的几点建议.现代图书情报技术,2002(5),48-49.
    [12]王益明,刘菲.中文搜索引擎的检索结果重合率研究.情报学报,2009,28(3),374-381.
    [13]吴小兰,汪琪.元搜索引擎研究综述.图书情报工作,2009(5),46-49.
    [14]余慧佳,刘奕群,张敏,茹立云,马少平.基于大规模日志分析的搜索引擎用户行为分析.中文信息学报,2007(1):109-113.
    [15]赵华.一种搜索引擎性能的简便评价方法和案例.图书馆理论与实践,2005(6),114-115.
    [16]费巍,武利红.数字时代目录学的数字化和大众化——第五届全国目录学学术研讨会会议纪要[J].图书情报知识,2007,(04).
    [17]费巍.搜索引擎优化策略研究.武汉大学硕士学位论文,2006.
    [18]冯英健著.网络营销基础与实践(第2版).北京:清华大学出版社,2004年10月
    [19]龚芳,耿鸯,王洋.自然语言检索中的概念控制.中国图书馆学报,2005(4),45-48.
    [20]韩圣龙,赖茂生.网络信息检索工具评价实验(Ⅱ)——中、英文搜索引擎检索评价实验[J].情报科学,2001(4),430-434.
    [21]罗志成,关婉湫,张勤.维基百科与百度百科比较分析.情报理论与实践,2009(4),71-74.
    [22]宛玲,杨秀丹,杜晓静.试析中文搜索引擎的评价标准.情报科学,2000(1),28-32.
    [23]中国互联网络信息中心.2008年中国搜索引擎用户行为研究报告(2009年9月)
    [24]中国互联网络信息中心.第25次中国搜索引擎用户行为研究报告(2010年1月)
    [25]Abbe Mowshowitz, Akira Kawaguchi. Assessing Bias in Search Engines. Information Processing and Management,2002(1),141-156.
    [26]Abbe Mowshowiz, Akira Kawaguchi. Measuring Search Engines Bias. Information Processing and Management,2005(5),1193-1205.
    [27]Aguillo, I. A New Generation of Tools for Search, Recovery and Quality Evaluation of World Wide Web Medical Resources. Online information Review,2000(2),138-143
    [28]Airio, E. Who Benefits from CLIR in Web Retrieval?. Journal of Documentation, 2008(5),760-778.
    [29]Aitchison, J. & Cleverdon, C. W. A Report on a Test of the Index of Metallurgical Literature of Western Reserve University. The College of Aeronautics, Cranfield,1963.
    [30]Al-Ansari, H. Internet use by the faculty members of Kuwait University. The Electronic Library,2006(6),791-803.
    [31]Amanda Spink, Bernard J. Jansen, Chris Blakely, Sherry Koshman. A study of Results Overlap and Uniqueness Among Major Web Search Engines. Information Processing and Management,2006,1379-1391(5)
    [32]Amy N. Langville, & Carl D. Meyer. Google's PageRank and Beyond:The Science of Search Engine Rankings. Princeton University Press,2006
    [33]Baeza-Yates, R., Hurtado, C., & Mendoza, M. Improving Search Engines by Query Clustering. Journal of the American Society for Information Science and Technology, 2007(12),1793-1804.
    [34]Bidoki, A. M. Z., Yazdani, N. DistanceRank:An Intelligent Ranking Algorithm for Web Pages. Information Processing and Management,2008(2),877-892.
    [35]Bilal, D. Children's Use of the Yahooligans! Web Search Engine.Ⅲ. Cognitive and Physical Behaviors on Fully Self-Generated Search Tasks. Journal of American Society for Information Science and Technology,2002(13),1170-1183.
    [36]Bilal, D. Children's Use of the Yahooligans! Web Search Engine:Ⅰ. Cognitive, Physical, and Affective Behaviors on Fact-Based Search Tasks. Journal of the American Society for Information and Technology,2000(7),646-665.
    [37]Bilal, D. Children's Use of the Yahooligans! Web Search Engine:Ⅱ. Cognitive and Physical Behavior on Research Tasks. Journal of the American Society for Information Science and Technology,2001(2),118-136.
    [38]Broder, A. A Taxonomy of Web Search. SIGIR Forum,2002(36),3-10.
    [39]Cacheda, F., & Vina, A. Experiences Retrieving Information in the World Wide Web. In Proceedings of the 6th IEEE Symposium on Computers and Communications,2001, 72-79.
    [40]Cacheda, F., & Vina,A. Understanding How People Use Search Engines:A Statistical Analysis for E-business. In Proceedings of the e-Business and e-Work Conference and Exhibition,2001,319-325.
    [41]Can, F., Nuray, R., & Sevdik, A.B. Automatic Performance Evaluation of Web Search Engines. Information Processing and Management,2004(3),495-514.
    [42]Carpineto, C., D'Aloisi, D., Delogu, C., Ragazzini, S., etc. Evaluating Search Features in Public Administration Websites. Euroweb2001 Conference,2001,167-184.
    [43]Castella-Roca J, Viejo A, Herrera-Joancomarti J. Preserving user's privacy in web search engines. Computer Communications,2009 (13-14),1541-1551.
    [44]Chau, M., Fang, X., & Sheng, O.R.L. Analysis of the Query Logs of a Web Site Search Engine. Journal of the American Society for Information Science and Technology, 2005(13),1363-1376.
    [45]Coiera EW, Vickland V. Is Relevance Relevant? User Relevance Ratings May Not Predict the Impact of Internet Search on Decision Outcomes. Journal of the American Medical Informatics Association,2009(4),542-545.
    [46]Cortes, C., Mohri, M., & Rastogi, A. Anlternative Ranking Problem for Search Engines. Experimental Algorithms, Proceedings,2007,1-22.
    [47]Crudge, S.E., & Johnson, F.C. Using the Information Seeker to Elicit Construct Models for Search Engine Evaluation. Journal of the American Society for Information Science and Technology,2004(9),794-806.
    [48]Dannenberg, R. B., Birmingham, W. P., Pardo, B., Hu, N., Meek, C., Tzanetakis, G. A Comparative Evaluation of Search Technologies for Query-by-Humming Using the Musart Testbed. Journal of the American Society for Information Science and Technology,2007(5),687-701
    [49]Ding, W. & Marchionini, G. A Comparative Study of Web Search Service Performance. ASIS'96:Proceedings of the 59th ASIS Annual Meeting,1996(33),136-142.
    [50]Dudek, D., Mastora, A., & Landoni, M. Is Google the answer? A Study into Usability of Search Engines. Library Review,2006(3),224-233.
    [51]Dumas L, Druez B, Lecerf N. A Fully Adaptive Hybrid Optimization of Aircraft Engine Blades. Journal of Computational and Applied Mathematics,2009(1),54-60.
    [52]Eastman, C.M., & Jansen, B.J. Coverage, relevance, and ranking:The impact of query operators on web search engine results. Acm Transactions on Information Systems, 2003(4),383-411.
    [53]El Ferchichi S, Laabidi K, Zidi S. Genetic Algorithm and Tabu Search for Feature Selection. Studies in INformatics and Control,2009(2),181-187.
    [54]Evans, M. P. Analysing Google Rankings Through Search Engine Optimization Data. Internet Research,2007(1),21-37.
    [55]Fattahi, R., Wilson, C.S., & Cole, F. An Alternative Approach to Natural Language Query Expansion in Search Engines:Text Analysis of Non-topical Terms in Web Documents. Information Processing and Management,2008(4),1503-1516.
    [56]Ford, N., Miller, D., & Moss, N. Web Search Strategies and Retrieval Effectiveness:An Empirical Study. Journal of Documentation,2002(1),30-48.
    [57]Fuhr, N., Govert, N., Kazai, G., & Lalmas, M. INEX:INitiative for the Evaluation of XML Retrieval. In Proceedings of the SIGIR 2002 Workshop on XML and Information Retrieval,2002.
    [58]Guo, H., Zhang, J., & Zhou, L. Classifying and Ranking:The First Step Towards Mining Inside Vertical Search Engines. Database and Expert Systems Applications, Proceedings, LNCS2007,223-232
    [59]H. Chu & Rosenthal, M. Search engines for the World Wide Web:A Comparative Study and Evaluation Methodology. ASIS'96:Proc.59th ASIS Annual Meeting, Medford, NJ, Information Today, Inc.,1996,127-135.
    [60]H. Verson Leighton. First 20 Precision among World Wide Web Search Services (Search Engine). Journal of the American Society for Information Science and Technology, 1999(10),870-881.
    [61]Hanse, P., & Karlgren, J. Effects of Foreign Language and Task Scenario on Relevance Assessment. Journal of Documentation,2005(5),623-639.
    [62]Hartman, K. A. Google Scholar and Academic Libraries:an Update. New Library World, 2008(5-6),211-222.
    [63]Hassan, I., & Zhang, J. Image Search Engine Feature Analysis. Online Information Review,2001(2),103-114.
    [64]Hastings, S. K.. Evaluation of Image Retrieval Systems:Role of User Feedback. Library Trends,1999(2),438-452.
    [65]He, D. Q., Brusilovsky, P., Ahn, J., Grady, J., etc. An Evaluation of Adaptive Filtering in the Context of Realistic Task-based Information Exploration. Information Processing and Management,2007(6),511-533.
    [66]Heather J. Lovely. The Best Damn Google Seo Book. CreateSpace,2009
    [67]Henzinger, Motwani, & Silverstein. Challenges in Web Search Engines. SIGIR Forum, 2002(2),11-22.
    [68]Hochstotter, N., & Koch, M. Standard Parameters for Searching Behavior in Search Engines and Their Empirical Evaluation. Journal of Information Science,2009(1),45-65.
    [69]Hochstotter, N., & Lewandowski, D. What users see-Structures in search engine results pages. Information Science,2009(12),1796-1812.
    [70]Hock, R. Web Search Engines-(More) Features and Commands. Online,2000(3),17-18, 20,22-24,26.
    [71]Holscher, C., & Strube, G. Web Search Behavior of Internet Experts and Newbies. International Journal of Computer and Telecommunications Networking,2000(1), 337-346.
    [72]Huang SY, Lee YK, Wang RZ, et al. Threshold-based Successive Elimination Algorithm for Block Motion Estimation. Optical Engineering,2006(2),122-131.
    [73]Huntington, P., Nicholas, D., & Jamali, H. R. Employing Log Metrics to Evaluate Search Behavior and Success:Case Study BBC Search Engine. Journal of Information Science, 2007(5),584-597.
    [74]Jaimie Sirovich, Cristian Darie. Professional Search Engine Optimization with PHP:A Developer's Guide to SEO. Wrox,2007
    [75]Jansen, B. J., & Spink, A. How Are We Searching the World Wide Web? A Comparison of Nine Search Engine Transaction Logs. Information Processing and Management, 2006(1),248-263.
    [76]Jansen, B. J., Spink, A., & Saracevic, T. Real Life, Real Users, and Real Needs:a Study and Analysis of User Queries on the Web. Information Processing and Management, 2000(2),207-227.
    [77]Jansen, B. J., Zhang, M., Schultz, C. D. Brand and its Effect on user Perception of Search Engine Performance. Journal of the American Society for Information Science and Technology,2009(8),1572-1595.
    [78]Jansen, B.J., & Molina, P.R. The Effectiveness of Web Search Engines for Retrieving Relevant Ecommerce Links. Information Processing and Management,2006(4), 1075-1098.
    [79]Jansen, B. J., Peritz B. C. A. (2009). Method for Measuring the Evolution of a Topic on the Web:The Case of "Informetrics". Journal of the American Society for Information Science and Technology,2009(9),1730-1740.
    [80]Jansen, B. J. Comparing Rankings of Search Results on the Web. Information Processing and Management,2005(6),1511-1519.
    [81]Jansen, B. J. Web Links and Search Engine Ranking:The Case of Google and the Query "Jew". Journal of the American Society for Information Science and Technology, 2006(12),1581-1589.
    [82]Jansen, B. J., Keenoy, K., Yaari, E., & Levene, M. User Rankings of Search Engine Results. Journal of the American Society for Information Science and Technology, 2007(9),1254-1266.
    [83]Jansen, B. J., Levene, M., & Mat-Hassan, M. Methods for evaluating dynamic changes in search engine rankings:a case study. Journal of Documentation,2006(6),708-729.
    [84]Jansen, B. J., Paulo R. Molina. The Effectiveness of Web Search Engines for Retrieving Relevant Ecommerce Links. Information Processing and Management,2006(4), 1075-1098.
    [85]Jansen, B. J., Mimi Zhang, Ying Zhang. The Effect of Brand Awareness of the Evaluation of Search Engine Results. CHI'07 Extended Abstracts on Human Factors in Computing Systems,2007,2471-2476.
    [86]Jansen, B.J., & Spink, A. An Analysis of Web Searching by European Alltheweb.com Users. Information processing and Management,2005(6),361-381.
    [87]Jansen, B.J., & Spink, A. How Are We Searching the World Wide Web? A Comparison of Nine Search Engine Transaction Logs. Information Processing and Management, 2006(1),248-263.
    [88]Jansen, B.J., Spink, A., Blakely, C., & Koshman, S. Defining a Session on Web Search Engines. Journal of the American Society for Information Science and Technology, 2007(6),862-871.
    [89]Jansen, B.J., Zhang, M.M., & Zhang, Y. The Effect of Brand Awareness of the Evaluation of Search Engine Results. CHI'07 Extended Abstracts on Human Factors in Computing Systems,2007,2471-2476.
    [90]Jatowt, A., Kawai, Y., & Tanaka, K. Temporal Ranking of Search Engine Results. Web Information Systems Engineering-WISE 2005,43-52.
    [91]Jepsen, E.T., Seiden, P., Ingwersen, P., Bjorneborn, L., & Borlund, P. Characteristics of Scientific Web Publication:Preliminary Data Gathering and Analysis. Journal of the American Society for Information Science and Technology,2004(14),1239-1249
    [92]Junghoo Cho, Sourashis Roy. Impact of Search Engines on Page Popularity. Proceedings of the 13th International Conference on World Wide Web,2004,20-29.
    [93]Kekalainen, K. Binary and Graded Relevance in IR Evaluations-Comparison of the Effects on Ranking of IR Systems. Information Processing and Management,2005(5), 1019-1033.
    [94]Kim, S., & Oh, S. Users' Relevance Criteria for Evaluating Answers in a Social Q&A Site. Journal of the American Society for Information Science and Technology,2009(4), 716-727.
    [95]Kishida, K. Predication of Performance of Cross-language Information Retrieval Using Automatic Evaluation of Translation. Library & Information Science Research,2008(2), 138-144.
    [96]Kokalj-Filipovic S, Spasojevic P, Yates R. Geographic Data Propagation in Location-Unaware Wireless Sensor Networks:A Two-Dimensional Random Walk Analysis. IEEE Journal on Selected Areas in Communications,2009(7),1158-1168.
    [97]Kousha, K., Thelwall, M. Google Scholar Citations and Google Web/URL Citations:A Multi-Discipline Exploratory Analysis. Journal of the American Society for Information Science and Technology,2007(7),1055-1065.
    [98]Kruschwitz, U., & Al-Bakour, H. Users Want More Sophisticated Search Assistants: Results of a Task-Based Evaluation. Journal of the American Society for the Information Science and Technology,2005(13),1377-1393.
    [99]Kumar, R., Suri, P.K., & Chauhan, R.K. Search Engines Evaluation. DESIDOC Bulletin of Information Technology,2005(2),3-10.
    [100]Large, A., Beheshti, J., & Rahman, T. Gender Differences in Collaborative Web Searching Behavior:an Elementary School Study. Information Processing and Management,2002(3),427-443.
    [101]Laurent MR, Vickers TJ. Seeking Health Information Online:Does Wikipedia Matter?. Journal of the American Medical Informatics Association,2009(4),471-479.
    [102]Lazarinis, F. Evaluating the Searching Capabilities of E-commerce Web Sits in a Non-English Language-A Greek Case Study. Online Information Review,2007(6), 881-891.
    [103]Leighton, H.V., & Srivastava, J. First 20 Precision Among World Wide Web Search Services (Search Engines). Journal of the American Society for Information Science, 1999(10),870-881.
    [104]Lewandowski, D. The Retrieval Effectiveness of Web Search Engines:Considering Results Descriptions. Journal of Documentation,2008(6),915-937.
    [105]Liaw, S., & Huang, H. M. Information Retrieval from the World Wide Web:a User-focused Approach based on Individual Experience with Search Engines. Computers in Human Behavior,2006(3),501-517.
    [106]Li wen Vaughan, Mike Thelwall. Search Engine Coverage Bias:Evidence and Possible Causes. Information Processing and Management,2004(4),693-707.
    [107]Long, H.Q., Lv, B.F., Zhao, T.B., & Liu, Y. Evaluate and Compare Chinese Internet Search Engines Based on Users' Experience.2007 International Conference on Wireless Communications, Networking and Mobile Computing,2007(1),6134-6137.
    [108]Lorigo, L., Pan, B., Hernbrooke, H., Joachims, T., Granka, L., & Gay, G. The Influence of Task and Gender on Search and Evaluation Behavior Using Google. Information Processing and Management,2006(4),1123-1131.
    [109]Losee, R.M., & Paris, L.A.H. Measuring Search-Engine Quality and Query Difficulty:Ranking with Target and Freestyle. Journal of the American Society for Information Science,1999(10),882-889.
    [110]MacFarlan. Evaluation of web search for the information practitioner. Aslib Proceedings:New Information Perspectives,2007(4-5),352-366.
    [111]Madden, A. D., Ford,N. J., Miller, D., & Levy, P. Children's Use of the inTernet for Information-seeking. Journal of Documentation,2006(6),744-761.
    [112]Maglaughlin, K. L., & Sonnenwald, D. H. User Perspectives on Relevance Criteria: A Comparison among Relevant, Partially Relevant, and Not-Relevant Judgments. Journal of the American Society for Information Science and Technology,2002(5),327-342.
    [113]Manoj M., & Jacob, E. Information Retrieval on Internet Using Meta-search Engines: A Review. Journal of Scientific and Industrial Research,2008(10),739-746.
    [114]Mavrikakis M. Computational Methods:A Search Engine for Catalysts. Nature Materials,2006(11),847-848.
    [115]Meng, X.N., & Clark, T. An Empirical User Rating of Popular Search Engines Using RankPower. ITCC 2005:International Conference on Information Technology:Coding and Computing,2005(2),521-525.
    [116]Metaxas PT, Ivanova L, Mustafaraj E. New Quality Metrics for Web Search Results. Web Information Systems and Technologies,2009(18),278-292.
    [117]Michael Chau, Hsinchun Chen. Comparison of Three Vertical Search Spiders. IEEE Computer,2003(5),56-62.
    [118]Mike Thelwall. Can Google's PageRank be Used to Find the most Important Academic Web Pages?. Journal of Documentation,2003(2),205-217.
    [119]Mike Thelwall. Extracting Accurate and Complete Results from Search Engines: Case Study Windows Live. Journal of the American Society for Information Science and Technology,2008(1),38-50.
    [120]Moskovitch R, Martins SB, Behiri E, Weiss A, Shahar Y. A Comparative Evaluation of Full-text, Concept-based, and Context-sensitive Search. Journal of the American Medical Informatics Association,2007(2),164-174.
    [121]Mowshowiz, A., & Kawaguchi, A. Measuring Search Engines Bias. Information Processing and Management,2005(5),1193-1205.
    [122]Mukherjee, B. Do Open-Access Journal in Library and Information Science Have Any Scholarly Impact? A Bibliometric Study of Selected Open-Access Journals Using Google Scholar. Journal of the American Society for information Science and Technology,2009(3),581-594,
    [123]Muller, W., Marchand-Maillet, S., Muller, H., Squire, D. M., Pun, T. Evaluating Image Browsers Using Structured Annotation. Journal of the American Society for Information Science and Technology,2001(11),961-968.
    [124]Nicholas, D., Huntington, P., etc. Student Digital Information-seeking Behaviour in Context. Journal of Documentation,2009(1),106-132.
    [125]Nicholson, S., Sierra, T., Eseryel, U.Y., etc. How Much of It Is Real? Analysis of Paid Placement in Web Search Engine Results. Journal of the American Society for Information Science and Technology,2006(4),448-461.
    [126]Norris, B. P. Google:Its Impact on the Library. Library High Technology News, 2006(9),9-11.
    [127]Oppenheim, C., Morris, A., McKnight, C., & Lowley, S. The Valuation of WWW Search Engines. Journal of Documentation,2000(2),190-211.
    [128]Orland Hoeber. User Evaluation Methods for Visual Web Search Interfaces. Proceedings of the 2009 13th International Conference Information Visualisation,2009, 139-145.
    [129]Ozmutlu, S., Spink, A., & Ozmutlu, H.C. Multimedia Web Searching Trends: 1997-2001. Information Processing and Management,2003(4),611-621
    [130]Patrick Tisseghem, Lars Fastrup. Inside the Index and Search Engines:Microsoft Office SharePoint Server 2007. Microsoft Office Sharepoint Server,2007
    [131]Preben Hanse, Jussi Karlgren. Effects of Foreign Language and Task Scenario on Relevance Assessment. Journal of Documentation,200(5),623-639.
    [132]Rao GLN, Saravanan S, Ilavarasi PS, et al. Combustion Analysis of a Direct Injection Diesel Engine When Fuelled with Sunflower Methyl Ester and its Diesel blends. International Journal of Vehicle Design,2008(14),289-303.
    [133]Riahinia, N., & Zandian, F. Evaluation of Information Providers and Popular Search Engines on the Base of Postgraduate Students' Perspectives. Electronic Library,2008(4), 594-604.
    [134]Rowlands, I., Nicholas, D., Williams, P., etc. The Google Generation:the Information Behaviour of the Researcher of the Future. Aslib Proceedings:New Information Perspectives,2008(4),290-310.
    [135]Roy, M., & Chi, M. T. H. Gender Differences in Patterns of Searching the Web. Journal of Educational Computing Research,2003(3),335-348.
    [136]Samuel Blankson. Search Engine Optimization (SEO) How to Optimize Your Website for Internet Search Engines. Blankson Enterprises Limited,2008
    [137]Saracevic, T. Relevance:A Review of the Literature and a Framework for Thinking on the Notion in infOrmation Science. Part III:Behavior and effects of relevance. Journal of the American Society for Information Science and Technology,2007(13),2126-2144.
    [138]Shi, X.D., & Yang, C.C. Mining Related Queries from Web Search Engine Query Logs Using an Improved Association Rule Mining Model. Journal of the American Society for Information Science and Technology,2007(12),1871-1883.
    [139]Shiri, A., & Revie, Crawford. Query Expansion Behavior Within a Thesaurus-Enhanced Search Environment:A User-Centered Evaluation. Journal of the American Society for Information Science and Technology,2006(4),462-478.
    [140]Silverstein, C., Henzinger, M., Marais, H., & Moricz, M. Analysis of a Very Large Web Search Engine Query Log. SIGIR Forum,1999(1),6-12.
    [141]Soboroff, I., Nicholas, C., & Cahan, P. Ranking Retrieval System without Relevance Judgments. Proceedings of the 24th annual international ACM SIGIR conference on Research and Development in Information Retrieval,2001,66-73.
    [142]Spink, A. A User-centered Approach to Evaluating Human Interaction with Web Search Engines:an Exploratory Study. Information Processing and Management,2003(3), 401-426
    [143]Spink, A. and Ozmutlu, H.C.Characteristics of Question Format Web Queries:an Exploratory Study. Information Processing Management,2002(4),453-71.
    [144]Spink, A. Wolfram, D. Jansen, B. J., Saracevic, T. Searching the Web:The Public and Their Queries. Journal of the American Society for Information Science and Technology,2001(3),226-234.
    [145]Spink, A., Bateman, J. and Jansen, B. J. Searching the Web:survey of Excite users. Internet Research:Electronic Networking Applications and Policy,1999(2),117-128.
    [146]Spink, A., Jansen, B. J., Wolfram, D., & Saracevic, T. From E-sex to E-commerce:Web Search Changes. IEEE Computer,2002(3),107-111.
    [147]Spink, A., Jansen, B.J., Blakely, C., & Koshman, S. A study of Results overlap and Uniqueness Among Major Web Search Engines. Information Processing and Management,2006(5),1379-1391.
    [148]Spink, A., Ozmutlu, S., Ozmutlu, H. C., & Jansen, B. J. US Versus European Web Searching Trends. SIGIR Forum,2002(1),30-37.
    [149]Stevenson, K., & Leung, C. Comparative Evaluation of Web Image Search Engines for Multimedia Applications.2005 IEEE International Conference on Multimedia and Expo (ICME),2005(1-2),1195-1198.
    [150]Su, L. T. A Comprehensive and Systematic Model of User Evaluation of Web Search Engines:I. Theory and Background. Journal of the American Society for Information Science and Technology,2008(13),1175-1192.
    [151]Su, L.T. A Comprehensive and Systematic Model of User Evaluation of Web Search Engines:Ⅱ. An Evaluation by Undergraduates. Journal of the American Society for Information Science and Technology,2003(13),1193-1223.
    [152]Susan Davis Herring. The value of Interdisciplinary:A Study Based on the Design of Internet Search Engines. Journal of the American Society for Information Science, 1999(4),358-365.
    [153]Tang, R., Shaw, W. M., & Vevea, J. L. Towards the Identification of the Optimal Number of Relevance Categories. Journal of the American Society for Information Science,1999(3),254-264.
    [154]Teevan, J., Adar, E., Jones, R., Potts, M. History Repeats Itself:Repeat Queries in Yahoo's Query Logs. Proceedings of the 29th Annual ACM Conference on Research and Development in Information Retrieval,2005,703-704.
    [155]Thelwall, M. Can Google's PageRank be Used to Find the most Important Academic Web Pages?. Journal of Documentation,2003(2),205-217.
    [156]Thelwall, M. Quantitative Comparisons of Search Engine Results. Journal of the American Society for Information Science and Technology,2008(11),1702-1710.
    [157]Thelwall, M. Subject Gateway Sites and Search Engine Ranking. Online Information Review,2002(2),101-107.
    [158]Tjondronegoro D, Spink A, Jansen B. J. A Study and Comparison of Multimedia Web Searching:1997-2006. Journal of the American Society for Information Science and Technology,2009(9),1756-1768.
    [159]Tongchim, S., Somlertlamvanich, V., & Isahara, H. Measuring the Effectiveness of Public Search Engines on Thai Queries. Proceedings of the Fifth IASTED International Conference on Communications, Internet, and Information Technology,2006,349-354.
    [160]Tran HM, Lange C, Chulkov G, et al. Applying Semantic Techniques to Search and Analyze Bug Tracking Data. Journal of Network and Systems Management,2009(3), 285-308.
    [161]Uyar A. Google stemming mechanisms. Journal of Information Science,2009(5), 499-514.
    [162]Vaughan, L., & Thelwall, M. Search Engine Coverage Bias:Evidence and Possible Causes. Information Processing and Management,2004(4),693-707.
    [163]Walters, W. H. Google Scholar Coverage of a Multidisciplinary Field. Information Processing and Management,2007(4),1121-1132.
    [164]Watters, G., & Amoudi, G. GeoSearcher:Location-Based Ranking of Search Engine Results. Journal of the American Society for Information Science and Technology, 2003(2),140-151.
    [165]Whittle, M., Eaglestone, B., Ford, N., Gillet, V.J., & Madden, A. Data Mining of Search Engine Logs. The Journal of the American Society for Information Science and Technology,2007(14),2382-2400
    [166]Wolfram, D., Spink, A., Jansen, B. J., & Saracevic, T. Vox populi:the Public Searching of the Web. Journal of the American Society of Information Science and Technology,2001(12),1073-1074.
    [167]Wu, G., Li, J. Comparing web search engine performance in searching consumer health information:evaluation and recommendations. Bull Med Libr Assoc,1999 (4), 456-461.
    [168]Y. Theng, M. Jones and H. Thimbleby, Lost in Hyperspace-Psychological Problem or Bad Design? In Proceedings of the first Asia Pacific Conference on Computer Human Interaction,1996,387-396.
    [169]Yu, H., & Kaufman, D. A Cognitive Evaluation of Four Online Search Engines for Answering Definitional Questions Posed by Physicians. Pacific Symposium on Biocomputing,2007,328-339.
    [170]Zhang, J. & Chueng, C. Meta Search Engine Feature Analysis. Online Information Review,2003(6),433-441.
    [171]Zhang, J. An Experimental Investigation on the Distance Angle Integrated Similarity Measure. The Canadian Journal of Information and Library Science,2008(3-4),141-168.
    [172]Zhang, J., & Dimitroff, A. (2005). The Impact of Webpage Content Characteristics on Webpage Visibility in Search Engine Results (Part 1). Information Processing and Management,2005(3),665-690.
    [173]Zhang, J., & Dimitroff, A. The Impact of Webpage Content Characteristics on Webpage Visibility in Search Engine Results (Part Ⅱ). Information Processing and Management,2005(3),691-715.
    [174]Zhang, J., & Dimitroff, A. The Impact of Webpage Content Characteristics on Webpage Visibility in Search Engine Results. Information Processing and Management, 2005(3),665-690
    [175]Zhang, J., & Lin, S. Multiple Language Supports in Search Engines. Online Information Review,2007(4),516-532.
    [176]Zhang, X.M, Chignell, M. Assessment of the Effects of User Characteristics on Mental Models of Information Retrieval Systems. Journal of the American Society for Information Science and Technology,2001(6),445-459.
    [177]Zhu, Y., Wu, M.D., Zhang, Y., & Li, X.M. Promotional Ranking of Search Engine Results:Giving New Web Pages a Chance to Prove Their Values. Advances in Data and Web Management, Proceedings,2007,503-510.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700