Altmetrics指标评价科研产出社会影响力研究现状及应用挑战

doi:10.13998/j.cnki.issn1002-1248.2019.05.19-0465

摘要/Abstract

摘要： 科研产出的社会影响力评价是政府及基金组织关注的重要课题。Altmetrics一直被公认为具有测度社会影响力的潜力,但其在科研产出社会影响力评价领域的应用仍处于理论和实证探索阶段。首先,笔者阐释了科研产出的社会影响力评价的概念与内涵,常用方法及国际上的典型社会影响力评价项目;其次,总结归纳了国内外关于Altmetrics指标在评价科研产出社会影响力方面的研究现状;最后,从基于国内数据源的Altmetrics平台与指标的开发、本土化Altmetrics指标的数据追踪和收集框架构建、Altmetrics指标的归一化处理及社会影响力的多维度细分4个方面指出altmetrics在社会影响力评价应用方面的未来挑战。

关键词: Altmetrics, 社会影响力, 维度, 科研产出

Abstract: The evaluation of the social influence of scientific research output is an important topic concerned by the government and the fund. Altmetrics has long been recognized as having the potential to measure social impact, but its application in the field of scientific output social impact assessment is still in the theoretical and empirical exploration stage. Firstly, this paper explains the concept and connotation of social impact assessment of scientific research output, common methods and typical international social impact assessment projects. Secondly, the research status of Altmetrics in evaluating the social impact of scientific research output is summarized. Finally, the future challenges of Altmetrics in the application of social impact assessment are pointed out from four aspects: the development of Altmetrics platform and indicators based on domestic data sources, the construction of the data tracking and collection framework for localizing Altmetrics, the normalization of Altmetrics and the multi-dimensional subdivision of social impact.

Key words: Altmetrics, societal impact, dimension, research outputs

中图分类号:

G250.73

刘春丽, 刘丽萍, 马凤毛. Altmetrics指标评价科研产出社会影响力研究现状及应用挑战[J]. 农业图书情报, 2019, 31(5): 13-20.

LIU Chunli, LIU Liping, MA Fengmao. Research Status and Application Challenges of Altmetrics to Evaluate the Social Impact of Scientific Research Output[J]. Agricultural Library and Information, 2019, 31(5): 13-20.

参考文献

[1] 刘春丽. Altmetrics 指标在科研评价与管理方面的应用——争议、评论和评估[J]. 科学学与科学技术管理,2016,37(06):13-22.
[2] Bornmann L.What is societal impact of research and how can it be assessed? A literature survey[J]. Journal of the American Society for Information Science and Technology, 2013, 64(2): 217-233.
[3] Spaapen J, Van Drooge L.Introducing ‘productive interactions’ in social impact assessment[J]. Research evaluation, 2011, 20(3): 211-218.
[4] Wilsdon J., Allen L., Belfiore E., Campbell P., Curry S., Hill S., et al.The metric tide: Report of the independent review of the role of metrics in research assessment and management[J]. Bristol: Higher Education Funding Council for England (HEFCE), 2015.
[5] Parker J, Van Teijlingen E.The Research Excellence Framework (REF): Assessing the impact of social work research on society[J]. Practice, 2012, 24(1): 41-52.
[6] Toole A A.The impact of public basic research on industrial innovation: Evidence from the pharmaceutical industry[J]. Research Policy, 2012, 41(1): 1-12.
[7] Narin F., Hamilton K.S., & Olivastro, D. The increasing linkage between US technology and public science[J]. Research Policy, 1997, 26(3):317-330.
[8] Grant J.Evaluating the outcomes of biomedical research on healthcare[J].Research Evaluation, 1999, 8(1):33-38.
[9] Bozeman B.,& Sarewitz, D. Public value mapping and science policy evaluation[J]. Minerva, 2011, 49(1):1-23.
[10] Spaapen J, Van Drooge L.Introducing ‘productive interactions’ in social impact assessment[J]. Research evaluation, 2011, 20(3): 211-218.
[11] SIAMPI[EB/OL]. http://www.siampi.eu/.
[12] Joly P B, Gaunand A, Colinet L, et al.ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization[J]. Research Evaluation, 2015, 24(4): 440-453.
[13] REF2014[EB/OL]. REFhttps://www.ref.ac.uk/2014/about/.
[14] Thelwall M, Haustein S, Larivière V, et al.Do altmetrics work? Twitter and ten other social web services[J]. PloS one, 2013, 8(5): e64841.
[15] Bornmann, Lutz.Measuring the societal impact of research[J]. EMBO reports, 2012, 13(8):673-676.
[16] Pernille G.Rasmussen,Jens Peter Andersen. Altmetrics: an alternate perspective on research evaluation.[EB/OL]. https://0277.ch/ojs/index.php/cdrs_0277/article/view/167/369.
[17] Bornmann L .Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics[J]. Journal of Informetrics, 2014, 8(4):895-903.
[18] Bornmann L.Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime[J]. Journal of Informetrics, 2014, 8(4): 935-950.
[19] Robinson-Garcia N, van Leeuwen T N, Rafols I. Using altmetrics for contextualised mapping of societal impact: From hits to networks[J]. Science and Public Policy, 2018, 45(6): 815-826.
[20] Bornmann L, Haunschild R, Adams J.Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK Research Excellence Framework (REF)[J]. Journal of Informetrics, 2018.
[21] Reale E, Avramov D, Canhial K, et al.A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research[J]. Research Evaluation, 2017, 27(4): 298-308.
[22] Fini R, Rasmussen E, Siegel D, et al.Rethinking the commercialization of public science: From entrepreneurial outcomes to societal impacts[J]. Academy of Management Perspectives, 2018, 32(1): 4-20.
[23] Pulido C M, Redondo-Sama G, Sordé-Martí T, et al.Social impact in social media: A new method to evaluate the social impact of research[J]. PloS one, 2018, 13(8): e0203117.
[24] Bornmann L, Haunschild R, Marx W.Policy documents as sources for measuring societal impact: how often is climate change research mentioned in policy-related documents?[J]. Scientometrics, 2016, 109(3): 1477-1495.
[25] 程爱娟. 基于Altmetrics的单篇论文影响力评价研究[D].湘潭大学,2017.
[26] 杨思洛,程爱娟,袁庆莉.基于Altmetrics的论文影响力三维测度方法研究[J].农业图书情报学刊,2018,30(10):5-12.
[27] 赵蓉英,王旭.引入Altmetrics指标的学术期刊影响力评价研究——以国际图书情报学期刊为例[J].图书与情报,2018(05):1-10.
[28] 李勇,邵钟钰,赵星.Altmetrics背景下的期刊多维度测评指标研究[J].情报学报,2017,36(02):190-196.
[29] 王妍. 学者影响力二维测度方法研究[J].情报理论与实践,2015,38(12):88-92.
[30] 杨柳,丁楠,田稷.Altmetrics视角下机构知识库学者影响力评价研究[J].情报理论与实践,2017,40(06):104-110.
[31] 姜春林,魏庆肖.融合补充计量指标的人文社科专著影响力评价指标体系研究[J].情报杂志,2018,37(12):65-71+77.
[32] 肖其师,吴春莹,孙志庆.基于Altmetrics的科技项目立项社会影响力评价框架研究及实证分析[J].图书馆杂志,2019,38(05):79-87.
[33] 徐英祺,杨志萍.Altmetrics用于生物多样性论文的社会影响力评价[J].评价与管理,2017,15(03):55-57.
[34] 彭秋茹,阎素兰,杨波,黄水清.融合引文与Altmetrics的报纸论文影响力综合评价方法研究[J].图书与情报,2018(05):11-21+28.
[35] 段庆锋,冯珍.多级学科视角下我国在线学术社交模式实证研究:以科学网为例[J].图书情报工作,2019,63(6):85-95.
[36] 宋丽萍,王建芳.基于学科规范引文影响力与同行评议相关性的科学评价实证研究[J].图书情报工作,2018,62(18):122-128.
[37] 王睿,胡文静,郭玮.高Altmetrics指标科技论文学术影响力研究[J].图书情报工作,2014,58(21):92-98.
[38] 刘红煦,王铮.基于“公平性测试”的Altmetrics学术质量评价方法研究[J].图书情报工作,2018,62(16):102-110.