生命周期视角下的Altmetrics数据质量研究
|
摘要
[目的/意义]数据质量是Altmetrics当前面临的严峻问题之一,为进一步推进Altmetrics的理论发展与实际应用,需要对数据质量问题进行深入分析。[研究设计/方法]对Altmetrics数据的生命周期进行剖析,刻画数据从新生到投入应用的整个流程。从数据产生、数据收集和数据聚合三个环节,以动态视角分析数据质量问题及影响因素。[结论/发现]在数据产生阶段,用户的主观意愿可能造成数据质量问题;在数据收集阶段,Altmetrics来源平台的元数据准确性缺乏保障,而不同平台的文献识别方法也会影响数据质量;在数据聚合阶段,聚合器的目标定位和技术能力存在差异,数据的整合清洗方式不透明,所提供的数据缺乏质量保障。[创新/价值]从生命周期的视角梳理Altmetrics的数据质量问题,以期将来能够在科研工作中更加合理准确地使用Altmetrics数据。
[Purpose/Significance]Data quality has been one of the serious problems of Altmetrics. In order to promote the theoretical development and practical application of Altmetrics, a thorough analysis on this problem needs to be conducted.[Design/Methodology]This study decomposed the life cycle of Altmetrics data, including data generation, data collection and data aggregation. Issues and impact factors of data quality have been analyzed from a dynamic perspective.[Findings/Conclusion]In the stage of data generation, users' subjective wishes may cause data quality problems; In the stage of data collection, the accuracy of metadata from source platforms is not guaranteed, and different platforms may adopt different methods of document recognition, which could also affect the data quality; In the data aggregation stage, due to different targets and technical capabilities of various aggregators, the way of data integration and data cleaning is not clear, which also results in a lack of quality assurance.[Originality/Value]This study illustrates the issue of Altmetrics data quality from the perspective of life cycle, which could provide an application of Altmetrics data in a more reasonable and accurate way in the future.
[Purpose/Significance]Data quality has been one of the serious problems of Altmetrics. In order to promote the theoretical development and practical application of Altmetrics, a thorough analysis on this problem needs to be conducted.[Design/Methodology]This study decomposed the life cycle of Altmetrics data, including data generation, data collection and data aggregation. Issues and impact factors of data quality have been analyzed from a dynamic perspective.[Findings/Conclusion]In the stage of data generation, users' subjective wishes may cause data quality problems; In the stage of data collection, the accuracy of metadata from source platforms is not guaranteed, and different platforms may adopt different methods of document recognition, which could also affect the data quality; In the data aggregation stage, due to different targets and technical capabilities of various aggregators, the way of data integration and data cleaning is not clear, which also results in a lack of quality assurance.[Originality/Value]This study illustrates the issue of Altmetrics data quality from the perspective of life cycle, which could provide an application of Altmetrics data in a more reasonable and accurate way in the future.
引文
1 Priem J, Taraborelli D, Groth P, et al. Altmetrics: A Manifesto[EB/OL].[2010-10-26]. [2018-12-20].http://altmetrics.org/manifesto.
2,11,13 Haustein S. Grand Challenges in Altmetrics: Heterogeneity, Data Quality and Dependencies[J]. Scientometrics, 2016, 108(1): 413-423.
3 Wang R Y, Strong D M. Beyond Accuracy: What Data Quality Means to Data Consumers[J]. Journal of Management Information Systems, 1996, 12(4):5-33.
4 Redman T C.Data Quality: The Field Guide[M]. Digital Press, 2000:6-23.
5 陈远, 罗琳, 沈祥兴. 信息系统中的数据质量问题研究[J]. 中国图书馆学报, 2004, 30(1):48-50.
6 蒋鸿标.引文数据质量控制研究[J].图书馆建设,2014(9):81-86,91.
7 苏新宁.引文索引数据质量控制研究[J].中国图书馆学报,2001(2):76-78.
8,22 Outputs of the NISO Alternative Assessment Metrics Project[EB/OL]. [2019-01-23]. https://groups.niso.org/apps/group_public/download.php/17091/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf.
9,21 Zahedi Z, Haustein S, Bowman T D. Exploring Data Quality and Retrieval Strategies for Mendeley Reader Counts[C]// ASIS&T 2014 Annual Meeting, Seattle, America, 2014.
10 Dinsmore A,Allen L,Dolby K.Alternative Perspectives on Impact:The Potential of ALMs and Altmetrics to Inform Funders about Research Impact[J].PLoS Biology,2014,12(11):e1002003.
12 Priem J, Piwowar H A, Hemminger B M. Altmetrics in the Wild: Using Social Media to Explore Scholarly Impact[EB/OL]. http://altmetrics.org/altmetrics12/priem.
14,24 Rasmussen P G,Andersen J P.Altmetrics:An Alternate Perspective on Research Evaluation[J].ScieCom Info, 2013,9(2):5-9.
15 Wilsdon J, Bar-Ilan J, Frodeman R, et al. Next-Generation Metrics: Responsible Metrics and Evaluation for Open Science. Report of the European Commission Expert Group on Altmetrics[EB/OL]. [2019-01-23]. https://www.researchgate.net/publication/315385216_Next-generation_metrics_responsible_metrics_and_evaluation_for_open_science.
16 李宏,王海南,由庆斌.补充计量学的实证研究现状及面临挑战[J].情报理论与实践,2018,41(12):76-81.
17 余以胜,刘鑫艳.Altmetrics现存问题及未来应用领域研究[J].图书情报知识,2017(6):35-41.
18 郭飞,游滨,薛婧媛.Altmetrics热点论文传播特性及影响力分析[J].图书情报工作,2016,60(15):86-93.
19 刘春丽.Altmetrics工具的发展、现况及相关问题[J].图书情报工作,2016,60(5):87-92,117.
20 Robinsongarcia N, Costas R, Isett K, et al. The Unbearable Emptiness of Tweeting—aabout Journal Articles[J]. Plos One, 2017, 12(8):e0183551.
23 Alexandra Jobmann, Christian P. Hoffmann, et al. Altmetrics for Large, Multidisciplinary Research Groups: Comparison of Current Tools [J]. Bibliometrie: Praxis und Forschung, 2014, 3(1):1-19.
25 Gamble J M, Traynor R L, Gruzd A, et al. Measuring the Impact of Pharmacoepidemiologic Research Using Altmetrics: a Case Study of a CNODES Drug‐safety Article[J]. Pharmacoepidemiology and Drug Safety, 2018,27(S1):1-10.
2,11,13 Haustein S. Grand Challenges in Altmetrics: Heterogeneity, Data Quality and Dependencies[J]. Scientometrics, 2016, 108(1): 413-423.
3 Wang R Y, Strong D M. Beyond Accuracy: What Data Quality Means to Data Consumers[J]. Journal of Management Information Systems, 1996, 12(4):5-33.
4 Redman T C.Data Quality: The Field Guide[M]. Digital Press, 2000:6-23.
5 陈远, 罗琳, 沈祥兴. 信息系统中的数据质量问题研究[J]. 中国图书馆学报, 2004, 30(1):48-50.
6 蒋鸿标.引文数据质量控制研究[J].图书馆建设,2014(9):81-86,91.
7 苏新宁.引文索引数据质量控制研究[J].中国图书馆学报,2001(2):76-78.
8,22 Outputs of the NISO Alternative Assessment Metrics Project[EB/OL]. [2019-01-23]. https://groups.niso.org/apps/group_public/download.php/17091/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf.
9,21 Zahedi Z, Haustein S, Bowman T D. Exploring Data Quality and Retrieval Strategies for Mendeley Reader Counts[C]// ASIS&T 2014 Annual Meeting, Seattle, America, 2014.
10 Dinsmore A,Allen L,Dolby K.Alternative Perspectives on Impact:The Potential of ALMs and Altmetrics to Inform Funders about Research Impact[J].PLoS Biology,2014,12(11):e1002003.
12 Priem J, Piwowar H A, Hemminger B M. Altmetrics in the Wild: Using Social Media to Explore Scholarly Impact[EB/OL]. http://altmetrics.org/altmetrics12/priem.
14,24 Rasmussen P G,Andersen J P.Altmetrics:An Alternate Perspective on Research Evaluation[J].ScieCom Info, 2013,9(2):5-9.
15 Wilsdon J, Bar-Ilan J, Frodeman R, et al. Next-Generation Metrics: Responsible Metrics and Evaluation for Open Science. Report of the European Commission Expert Group on Altmetrics[EB/OL]. [2019-01-23]. https://www.researchgate.net/publication/315385216_Next-generation_metrics_responsible_metrics_and_evaluation_for_open_science.
16 李宏,王海南,由庆斌.补充计量学的实证研究现状及面临挑战[J].情报理论与实践,2018,41(12):76-81.
17 余以胜,刘鑫艳.Altmetrics现存问题及未来应用领域研究[J].图书情报知识,2017(6):35-41.
18 郭飞,游滨,薛婧媛.Altmetrics热点论文传播特性及影响力分析[J].图书情报工作,2016,60(15):86-93.
19 刘春丽.Altmetrics工具的发展、现况及相关问题[J].图书情报工作,2016,60(5):87-92,117.
20 Robinsongarcia N, Costas R, Isett K, et al. The Unbearable Emptiness of Tweeting—aabout Journal Articles[J]. Plos One, 2017, 12(8):e0183551.
23 Alexandra Jobmann, Christian P. Hoffmann, et al. Altmetrics for Large, Multidisciplinary Research Groups: Comparison of Current Tools [J]. Bibliometrie: Praxis und Forschung, 2014, 3(1):1-19.
25 Gamble J M, Traynor R L, Gruzd A, et al. Measuring the Impact of Pharmacoepidemiologic Research Using Altmetrics: a Case Study of a CNODES Drug‐safety Article[J]. Pharmacoepidemiology and Drug Safety, 2018,27(S1):1-10.