Evaluating research institutions: the potential of the success-index

详细信息    查看全文

• 作者：Fiorenzo Franceschini (1)
  Domenico Maisano (1)
  Luca Mastrogiacomo (1)
  
• 关键词：Success ; index ; Hirsch index ; Field normalization ; Citation propensity ; Groups of researchers ; Research institutions
• 刊名：Scientometrics
• 出版年：2013
• 出版时间：July 2013
• 年：2013
• 卷：96
• 期：1
• 页码：85-101
• 全文大小：472KB
• 参考文献：1. Abramo, G., D’Angelo, C. A., & Di Costa, F. (2011). National research assessment exercises: a comparison of peer review and bibliometrics rankings. / Scientometrics, / 89(3), 929-41. CrossRef
  2. Albarrán, P., & Ruiz-Castillo, J. (2011). References made and citations received by scientific articles. / Journal of the American Society for Information Science and Technology, / 62(1), 40-9. CrossRef
  3. Burrell, Q. L. (2007). On the h-index, the size of the Hirsch core and Jin’s A-index. / Journal of Informetrics, / 1(2), 170-77. CrossRef
  4. Courtault, J. M., & Hayek, N. (2008). On the Robustness of the h-index: a mathematical approach. / Economics Bulletin, / 3(78), 1-.
  5. Franceschini, F., Galetto, M., & Maisano, D. (2007). / Management by measurement: designing key indicators and performance measurements. Berlin: Springer.
  6. Franceschini, F., Galetto, M., Maisano, D., & Mastrogiacomo, L. (2012a). The success-index: an alternative approach to the h-index for evaluating an individual’s research output. / Scientometrics, / 92(3), 621-41. CrossRef
  7. Franceschini, F., Galetto, M., Maisano, D., & Mastrogiacomo, L. (2012b). Further clarifications about the / success-index. / Journal of Informetrics, / 6(4), 669-73. CrossRef
  8. Franceschini, F., Galetto, M., Maisano, D., & Mastrogiacomo, L. (2012c). An informetric model for the / success-index. / Journal of Informetrics.
  9. Franceschini, F., & Maisano, D. (2010). Analysis of the Hirsch index’s operational properties. / European Journal of Operational Research, / 203(2), 494-04. CrossRef
  10. Franceschini, F., & Maisano, D. (2011). Structured evaluation of the scientific output of academic research groups by recent h-based indicators. / Journal of Informetrics, / 5(1), 64-4. CrossRef
  11. Franceschini, F., & Maisano, D. (2012). Sub-field normalization within the IEEE publication galaxy: a novel approach based on the link between journals and Technical Societies. Proceeding of the 17th international conference on science and technology indicators (STI 2012), 6- September 2012, Montréal, Canada.
  12. Garfield, E. (1979). / Citation indexing. Its theory and application in science, technology and humanities. New York: Wiley.
  13. Gl?nzel, W. (2011). The application of characteristic scores and scales to the evaluation and ranking of scientific journals. / Journal of Information Science, / 37(1), 40-8. CrossRef
  14. Gl?nzel, W., Schubert, A., Thijs, B., & Debackere, K. (2011). A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking. / Scientometrics, / 87(2), 415-24. CrossRef
  15. Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output, in. / Proceedings of the National Academy of Sciences of the United States of America, / 102, 16569-6572. CrossRef
  16. ISI Web of Knowledge (2012). Essential science indicators. http://thomsonreuters.com (11 July 2012).
  17. Leydesdorff, L., & Opthof, T. (2010). Normalization at the field level: fractional counting of citations. / Journal of Informetrics, / 4(4), 644-46. CrossRef
  18. Merton, R. K. (1968). The Matthew effect in science. / Science, / 159(3810), 56-3. CrossRef
  19. MIUR—Ministero dell’Istruzione dell’Università e della Ricerca (2012) http://cercauniversita.cineca.it/php5/settori/index.php.
  20. Moed, H. F. (2010a). Measuring contextual citation impact of scientific journals. / Journal of Informetrics, / 4(3), 265-77. CrossRef
  21. Moed, H. F. (2010b). CWTS crown indicator measures citation impact of a research group’s publication oeuvre. / Journal of Informetrics, / 3(3), 436-38. CrossRef
  22. Radicchi, F., & Castellano, C. (2012). Testing the fairness of citation indicators for comparison across scientific domains: the case of fractional citation counts. / Journal of Informetrics, / 6(1), 121-30. CrossRef
  23. Scopus—Elsevier (2012) http://www.info.scopus.com (20 Feb 2012).
  24. Vinkler, P. (2004). Characterization of the impact of sets of scientific papers: the Garfield (impact) factor. / Journal of the American Society for Information Science and Technology, / 55(5), 431-35. CrossRef
  25. Vinkler, P. (2011). Application of the distribution of citations among publications in scientometric evaluations. / Journal of the American Society for Information Science and Technology, / 62(10), 1963-978. CrossRef
  26. Waltman, L., Yan, E., & van Eck, N. J. (2011). A recursive field-normalized bibliometric performance indicator: an application to the field of library and information science. / Scientometrics, / 89(1), 301-14. CrossRef
  27. Wang, X., Liu, D., Ding, K., & Wang, X. (2012). Science funding and research output: a study on 10 countries. / Scientometrics, / 91(2), 591-99. CrossRef
  28. Zitt, M. (2010). Citing-side normalization of journal impact: a robust variant of the audience factor. / Journal of Informetrics, / 4(3), 392-06. CrossRef
  29. Zitt, M., & Small, H. (2008). Modifying the journal impact factor by fractional citation weighting: the audience factor. / Journal of the American Society for Information Science and Technology, / 59(11), 1856-860. CrossRef
  
• 作者单位：Fiorenzo Franceschini (1)
  Domenico Maisano (1)
  Luca Mastrogiacomo (1)
  
  1. DIGEP (Department of Management and Production Engineering), Politecnico di Torino, Corso Duca degli Abruzzi 24, 10129, Turin, Italy
  
• ISSN：1588-2861

文摘

Similarly to the h-index and other indicators, the success-index is a recent indicator that makes it possible to identify, among a general group of papers, those of greater citation impact. This indicator implements a field-normalization at the level of single paper and can therefore be applied to multidisciplinary groups of articles. Also, it is very practical for normalizations aimed at achieving the so-called size-independency. Thanks to these (and other) properties, this indicator is particularly versatile when evaluating the publication output of entire research institutions. This paper exemplifies the potential of the success-index by means of several practical applications, respectively: (i) comparison of groups of researchers within the same scientific field, but affiliated with different universities, (ii) comparison of different departments of the same university, and (iii) comparison of entire research institutions. A sensitivity analysis will highlight the success-index’s robustness. Empirical results suggest that the success-index may be conveniently extended to large-scale assessments, i.e., involving a large number of researchers and research institutions.