中文    English

Agricultural Library and Information ›› 2019, Vol. 31 ›› Issue (5): 13-20.doi: 10.13998/j.cnki.issn1002-1248.2019.05.19-0465

• Altmetrics • Previous Articles     Next Articles

Research Status and Application Challenges of Altmetrics to Evaluate the Social Impact of Scientific Research Output

LIU Chunli, LIU Liping, MA Fengmao   

  1. Library of China Medical University, Liaoning Shenyang 110122, China
  • Received:2019-05-27 Online:2019-05-05 Published:2019-05-05

Abstract: The evaluation of the social influence of scientific research output is an important topic concerned by the government and the fund. Altmetrics has long been recognized as having the potential to measure social impact, but its application in the field of scientific output social impact assessment is still in the theoretical and empirical exploration stage. Firstly, this paper explains the concept and connotation of social impact assessment of scientific research output, common methods and typical international social impact assessment projects. Secondly, the research status of Altmetrics in evaluating the social impact of scientific research output is summarized. Finally, the future challenges of Altmetrics in the application of social impact assessment are pointed out from four aspects: the development of Altmetrics platform and indicators based on domestic data sources, the construction of the data tracking and collection framework for localizing Altmetrics, the normalization of Altmetrics and the multi-dimensional subdivision of social impact.

Key words: Altmetrics, societal impact, dimension, research outputs

CLC Number: 

  • G250.73
[1] 刘春丽. Altmetrics 指标在科研评价与管理方面的应用——争议、评论和评估[J]. 科学学与科学技术管理,2016,37(06):13-22.
[2] Bornmann L.What is societal impact of research and how can it be assessed? A literature survey[J]. Journal of the American Society for Information Science and Technology, 2013, 64(2): 217-233.
[3] Spaapen J, Van Drooge L.Introducing ‘productive interactions’ in social impact assessment[J]. Research evaluation, 2011, 20(3): 211-218.
[4] Wilsdon J., Allen L., Belfiore E., Campbell P., Curry S., Hill S., et al.The metric tide: Report of the independent review of the role of metrics in research assessment and management[J]. Bristol: Higher Education Funding Council for England (HEFCE), 2015.
[5] Parker J, Van Teijlingen E.The Research Excellence Framework (REF): Assessing the impact of social work research on society[J]. Practice, 2012, 24(1): 41-52.
[6] Toole A A.The impact of public basic research on industrial innovation: Evidence from the pharmaceutical industry[J]. Research Policy, 2012, 41(1): 1-12.
[7] Narin F., Hamilton K.S., & Olivastro, D. The increasing linkage between US technology and public science[J]. Research Policy, 1997, 26(3):317-330.
[8] Grant J.Evaluating the outcomes of biomedical research on healthcare[J].Research Evaluation, 1999, 8(1):33-38.
[9] Bozeman B.,& Sarewitz, D. Public value mapping and science policy evaluation[J]. Minerva, 2011, 49(1):1-23.
[10] Spaapen J, Van Drooge L.Introducing ‘productive interactions’ in social impact assessment[J]. Research evaluation, 2011, 20(3): 211-218.
[11] SIAMPI[EB/OL]. http://www.siampi.eu/.
[12] Joly P B, Gaunand A, Colinet L, et al.ASIRPA: a comprehensive theory-based approach to assessing the societal impacts of a research organization[J]. Research Evaluation, 2015, 24(4): 440-453.
[13] REF2014[EB/OL]. REFhttps://www.ref.ac.uk/2014/about/.
[14] Thelwall M, Haustein S, Larivière V, et al.Do altmetrics work? Twitter and ten other social web services[J]. PloS one, 2013, 8(5): e64841.
[15] Bornmann, Lutz.Measuring the societal impact of research[J]. EMBO reports, 2012, 13(8):673-676.
[16] Pernille G.Rasmussen,Jens Peter Andersen. Altmetrics: an alternate perspective on research evaluation.[EB/OL]. https://0277.ch/ojs/index.php/cdrs_0277/article/view/167/369.
[17] Bornmann L .Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics[J]. Journal of Informetrics, 2014, 8(4):895-903.
[18] Bornmann L.Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime[J]. Journal of Informetrics, 2014, 8(4): 935-950.
[19] Robinson-Garcia N, van Leeuwen T N, Rafols I. Using altmetrics for contextualised mapping of societal impact: From hits to networks[J]. Science and Public Policy, 2018, 45(6): 815-826.
[20] Bornmann L, Haunschild R, Adams J.Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK Research Excellence Framework (REF)[J]. Journal of Informetrics, 2018.
[21] Reale E, Avramov D, Canhial K, et al.A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research[J]. Research Evaluation, 2017, 27(4): 298-308.
[22] Fini R, Rasmussen E, Siegel D, et al.Rethinking the commercialization of public science: From entrepreneurial outcomes to societal impacts[J]. Academy of Management Perspectives, 2018, 32(1): 4-20.
[23] Pulido C M, Redondo-Sama G, Sordé-Martí T, et al.Social impact in social media: A new method to evaluate the social impact of research[J]. PloS one, 2018, 13(8): e0203117.
[24] Bornmann L, Haunschild R, Marx W.Policy documents as sources for measuring societal impact: how often is climate change research mentioned in policy-related documents?[J]. Scientometrics, 2016, 109(3): 1477-1495.
[25] 程爱娟. 基于Altmetrics的单篇论文影响力评价研究[D].湘潭大学,2017.
[26] 杨思洛,程爱娟,袁庆莉.基于Altmetrics的论文影响力三维测度方法研究[J].农业图书情报学刊,2018,30(10):5-12.
[27] 赵蓉英,王旭.引入Altmetrics指标的学术期刊影响力评价研究——以国际图书情报学期刊为例[J].图书与情报,2018(05):1-10.
[28] 李勇,邵钟钰,赵星.Altmetrics背景下的期刊多维度测评指标研究[J].情报学报,2017,36(02):190-196.
[29] 王妍. 学者影响力二维测度方法研究[J].情报理论与实践,2015,38(12):88-92.
[30] 杨柳,丁楠,田稷.Altmetrics视角下机构知识库学者影响力评价研究[J].情报理论与实践,2017,40(06):104-110.
[31] 姜春林,魏庆肖.融合补充计量指标的人文社科专著影响力评价指标体系研究[J].情报杂志,2018,37(12):65-71+77.
[32] 肖其师,吴春莹,孙志庆.基于Altmetrics的科技项目立项社会影响力评价框架研究及实证分析[J].图书馆杂志,2019,38(05):79-87.
[33] 徐英祺,杨志萍.Altmetrics用于生物多样性论文的社会影响力评价[J].评价与管理,2017,15(03):55-57.
[34] 彭秋茹,阎素兰,杨波,黄水清.融合引文与Altmetrics的报纸论文影响力综合评价方法研究[J].图书与情报,2018(05):11-21+28.
[35] 段庆锋,冯珍.多级学科视角下我国在线学术社交模式实证研究:以科学网为例[J].图书情报工作,2019,63(6):85-95.
[36] 宋丽萍,王建芳.基于学科规范引文影响力与同行评议相关性的科学评价实证研究[J].图书情报工作,2018,62(18):122-128.
[37] 王睿,胡文静,郭玮.高Altmetrics指标科技论文学术影响力研究[J].图书情报工作,2014,58(21):92-98.
[38] 刘红煦,王铮.基于“公平性测试”的Altmetrics学术质量评价方法研究[J].图书情报工作,2018,62(16):102-110.
[1] LI Xiaohui, WANG Jue, LANG Linfang. Academic Impact of Retracted Dissertations and Theses [J]. Journal of Library and Information Science in Agriculture, 2021, 33(7): 46-53.
[2] LAN Xue, HAN Yi. Data Usability of Book Rating Scores on Social Reading Platform from the Perspective of Altmetrics Evaluation: A Case Study of Douban Reading [J]. Journal of Library and Information Science in Agriculture, 2021, 33(11): 74-82.
[3] CHEN Yunwei. Review on Quantitative Methods of Science and Technology Evaluation [J]. Journal of Library and Information Science in Agriculture, 2020, 32(8): 4-11.
[4] YANG Siluo, YU Yonghao. Comparison of Artificial Intelligence Papers and Books Based on Citation and Altmetric Indicators [J]. Agricultural Library and Information, 2019, 31(5): 5-12.
[5] YU Houqiang, YIN Zihan, LI Longfei, CHANG Mengli. Study of Ways of Scientific Usage of Altmetrics Data Based on User Cases [J]. Agricultural Library and Information, 2019, 31(5): 21-27.
[6] YU Yisheng, LIU Xinyan. Research on the Influence Evaluation of Altmetrics Hot Papers from the Perspective of Citation Indicators [J]. Agricultural Library and Information, 2019, 31(5): 28-36.
[7] ZHANG Yao. Research on Altmetric Indicators Evaluation system Model Based on Highly Cited Papers in Chinese Journals [J]. Agricultural Library and Information, 2019, 31(5): 37-42.
[8] ZHANG Yang, YU Yanhui, HUANG Danqing. Comparison between High Attention Papers and ESI Hot Papers: A Case Study of Clinical Medicine [J]. , 2018, 30(10): 13-22.
[9] YANG Siluo, CHENG Aijuan, YUAN Qingli. Research on Three Dimensional Measuring Method of Papers' Influence Based on Altmetrics [J]. , 2018, 30(10): 5-12.
[10] SHANG Zheng. Characteristics and Dimensions of Library and Information work Innovation in China [J]. , 2017, 29(8): 109-111.
[11] GUO Minghuan, LV Yajuan. Design on the Three-dimensional Marketing mode for University Library under the Background of "Internet+" [J]. , 2017, 29(7): 10-12.
[12] HOU Zhiai. Research on the User Education and Evaluation of University Libraries in Beijing-Tianjin-Hebei [J]. , 2017, 29(5): 121-124.
[13] SHI Hongqing, ZHANG Junying. Hotspot and Tendency of Forestry Science Research in China in Recent Years——Co-word Analysis Based on Keywords of Scientia Silvae Sinicae from 2005 to 2015 [J]. , 2017, 29(2): 94-102.
[14] SHEN Yunxia. Research on Multidimensional Security Assurance System of Library Open Data in Big Data Era [J]. , 2017, 29(12): 56-59.
[15] ZHU Aibing, DING Qing. Research on the Application of Wechat Public Platform in University Library Access System [J]. , 2017, 29(10): 36-39.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!