中文    English

Journal of Library and Information Science in Agriculture ›› 2021, Vol. 33 ›› Issue (6): 30-39.doi: 10.13998/j.cnki.issn1002-1248.21-0391

;

• Bibliometrics • Previous Articles     Next Articles

Review on the Theory, Method and Model of Policy Performance Evaluation

ZHANG Min1,2, CHEN Yunwei1,2,*   

  1. 1. Chengdu Library and Information Center, Chinese Academy of Sciences, Chengdu 610041;
    2. Department of Library, Information and Archives Management, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190
  • Received:2021-05-01 Online:2021-06-05 Published:2021-06-15

Abstract: [Purpose/Significance] This paper analyzes and compares the application direction and development trend of the existing domestic and foreign research theories and methods related to the performance evaluation of science and technology policy, so as to provide reference for the performance evaluation of science and technology policy. [Method/Process] This paper summarizes the origin and development of the performance evaluation of science and technology policy, the application of theoretical methods and models, and the use of metrological evaluation methods. It summarizes the stages of the development of science and technology policy evaluation, compares the characteristics of different theoretical methods, discusses the shortcomings of existing research and prospects the future development. [Results/Conclusions] The existing researches on the performance evaluation of science and technology policy mainly refer to the relevant methods of metrology in the use of methods and models, and combine with the characteristics of policy evaluation to improve, focusing on the use of quantitative methods and the construction of models. Suggestions: (1) The performance evaluation of science and technology policy should be diversified. (2) The performance evaluation methods of science and technology policy need to be diversified. (3) The performance evaluation process of science and technology policy should be intelligent. (4) The credibility of science and technology policy performance evaluation results needs to be improved. In the future, we can choose different evaluation methods according to different types and fields of policies.

Key words: science and technology policy, performance, evaluation

CLC Number: 

  • G353.1
[1] 刘朋朋, 贠杰. 中国政府绩效评估领域研究述评[J]. 甘肃行政学院学报, 2017(3): 18-27.
LIU P P, YUN J.Review on the research of Chinese government performance evaluation[J]. Journal of Gansu administration institute, 2017(3): 18-27.
[2] 中国行政管理学会课题组, 贾凌民. 政府公共政策绩效评估研究[J]. 中国行政管理, 2013(3): 20-23.
Research group of CPAS, JIA L M. Research on the performance eval-uation of government public policy[J]. Chinese public administration, 2013(3): 20-23.
[3] 赵蓉英, 王旭, 王建品, 等. 中国科技评价研究态势与推进策略[J]. 情报科学, 2019, 37(5): 7-12.
ZHAO R Y, WANG X, WANG J P, et al.Research situation and prompting strategies of S & T evaluation in China[J]. Information science, 2019, 37(5): 7-12.
[4] CRONBACH L J, et al.Toward reform of program evaluation[M]. San Francisco: Jossey-bass, 1980.
[5] POLSTER T H.Public program analysis: Applied methods[Z]. Baltlmore, University park press, 19789.
[6] LIBECAP G D.Economic variables and law development: A case of western mineral property[J]. Economic history journal, 1978, 38(2).
[7] CHARNES A, COOPER W W, RHODES E.Measuring the efficiency of decision making units[J]. European journal of operational research, 1978(2): 429-444.
[8] 张永安, 郄海拓, 颜斌斌. 基于两阶段DEA模型的区域创新投入产出评价及科技创新政策绩效提升路径研究——基于科技创新政策情报的分析[J]. 情报杂志, 2018, 37(1): 198-207.
ZHANG Y A, QIE H T, YAN B B.Regional input-output evaluation and ascension path of scientific and technological innovation policy performance based on the two-stage DEA model-Analysis based on scientific and technological innovation policy information[J]. Journal of intelligence, 2018, 37(1): 198-207.
[9] PAPPAS R, REMER D.Measuring R & D productivity[J]. Research management, 1985(2): 15-22.
[10] FREEMAN C.Technology policy and economic performance: Experience from Japan[M]. 南京: 东南大学出版社, 2008.
FREEMAN C.Technology policy and economic performance: Experience from japan[M]. Nanjing: Southeast university press, 2008.
[11] DRONGELEN K V, COOK A.Design principles for the development of measurement systems for research and development processes[J]. R & D management, 1997, 27(4): 345-357.
[12] WARDA J.Measuring the Value of R & D Tax Provisions[C]. OECD: Fiscal measures to promote R & D and innovation, Paris, 1996.
[13] VAN POTTELSBERGHE B, CAPRON H.The public support to busi-ness research and development: An integrated assessment scheme and some additional quantitative evidence[C]. OECD conference on "Policy evaluation in innovation and technology", Paris, France, 1997.
[14] BONNAL L, FOUGERE D, SERANDON A.Evaluating the impact of French employment policies on individual labour market histories[J]. Review of economic studies, 1997, 64(4): 683-713.
[15] VAN TONGEREN F W. Microsimulation of corporate response to investment subsidies[J]. Journal of policy modeling, 1998, 20(1): 55-75.
[16] 姚刚. 国外公共政策绩效评估研究与借鉴[J]. 深圳大学学报(人文社会科学版), 2008(4): 80-85.
YAO G.A study of the assessment of the overseas public policy achievements: Its use for reference[J]. Journal of Shenzhen university(humanities & social sciences), 2008(4): 80-85.
[17] 谭春辉, 谢荣, 刘倩. 政策工具视角下的我国科技评估政策文本量化研究[J]. 情报杂志, 2020, 39(10): 181-190.
TAN C H, XIE R, LIU Q.A quantitative study of Chinese science and technology evaluation policy text from the perspective of policy instrument[J]. Journal of intelligence, 2020, 39(10): 181-190.
[18] CONGRESS T U.National science and technology policy, organization and priorities act (PL 94-282)[S]. Washington, DC: US congress, 1976.
[19] CONGRESS R U.The government performance and results act (PL 103-62)[S]. Washington, DC: US congress, 1993.
[20] DEGEORGES O J.Speaking power to truth: The politics of implementing policy evaluation in France//An account of the late French national evaluation policy(NEP), 1988-1993[D]. New York: New York university, 1997.
[21] GAME C.Comprehensive performance assessment in English local government[J]. International journal of productivity & performance
management, 2006, 55(6): 466-479.
[22] 朱雪飞, 曾乐民, 卢进. 韩国科技评估现状分析及借鉴[J]. 科技管理研究, 2006(2): 45-47.
ZHU X F, ZENG L M, LU J.Analysis and reference of the current situation of science and technology evaluation in South Korea[J]. Science and technology management research, 2006(2): 45-47.
[23] 英城水間. 科学技術基本法について[J]. 情報管理, 1996, 38(12): 1080-1093.
HIDEKI M.About the basic law on science and technology[J]. In-formation management, 1996, 38(12): 1080-1093.
[24] 杨宏山. 政府绩效评估的国际比较及启示——以美国、英国、日本和韩国为例[J]. 北京电子科技学院学报, 2015, 23(1): 26-34.
YANG H S.Institutional comparison of government performance evaluation systems and its enlightenment to China: A case study of USA, UK, Japan And Korea[J]. Journal of Beijing electronic science and technology institute, 2015, 23(1): 26-34.
[25] 谈毅, 仝允桓. 韩国国家科技计划评估模式分析与借鉴[J]. 外国经济与管理, 2004(6): 46-49.
TAN Y, TONG Y H.Analysis and reference of evaluation mode of South Korea's national science and technology plan[J]. Foreign eco-nomics & management, 2004(6): 46-49.
[26] 马蔡琛, 赵笛. 公共支出政策绩效评价的国际经验与改革建议[J]. 地方财政研究, 2018(1): 100-106.
MA C C, ZHAO D.International experience and reform suggestions of public expenditure policy performance evaluation[J]. Sub national fiscal research, 2018(1): 100-106.
[27] TZELEPIS D, SKURAS D.The effects of regional capital subsidies on firm performance: An empirical study[J]. Journal of small busi-ness and enterprise development, 2004, 11(1): 121-129.
[28] CZARNITZKI D, LICHT G.Additionality of public R & D grants in a transition economy: The case of eastern Germany[J]. Economics of transition, 2006, 14(1): 101-131.
[29] CZARNITZKI D, EBERSBERGER B, FIER A.The relationship be-tween R & D collaboration, subsidies and R & D performance: Em-pirical evidence from Finland and Germany[J]. Journal of applied-econometrics, 2007, 22(7): 1347-1366.
[30] RUEGG R, JORDAN G.Overview of evaluation methods for R & D programs. A directory of evaluation methods relevant to technology development programs[R]. Sandia national laboratories, 2007.
[31] CZARNITZKI D, HOTTENROTT H.R & D investment and financ-ing constraints of small and medium-sized firms[J]. Small business economics, 2009, 36: 65-83.
[32] CATOZZELLA A, VIVARELLI M.Assessing the impact of public support on innovative productivity[J]. DISCE-quaderni del dipartimento di scienze economiche e sociali, 2011.
[33] MOTOHASHI K, MURAMATSU S.Examining the university industry collaboration policy in Japan: Patent analysis[J]. Technology in soci-ety, 2012, 34(2): 149-162.
[34] SAMARA E, GEORGIADIS P, BAKOUROS I.The impact of innovation policies on the performance of national innovation systems: A system dynamics analysis[J]. Technovation, 2012, 32(11): 624-638.
[35] 马海群, 吕红. 高校信息公开政策实施效果评价体系构建研究[J]. 情报科学, 2013, 31(7): 3-9.
MA H Q, LV H.Construction of evaluation system on implementation effect of university information disclosure policy[J]. Information science, 2013, 31(7): 3-9.
[36] BARJAK F, ES-SADKI N, ARUNDEL A.The effectiveness of policies for formal knowledge transfer from European universities and public research institutes to firms[J]. Research evaluation, 2015, 24(1): 4-18.
[37] 杨思洛, 沈小雯, 欧佳. 新时期"五计学"的研究内容与趋势——以第16届ISSI会议为视角[J]. 图书情报知识, 2019(1): 67-80.
YANG S L, SHEN X W, OU J.The research contents and trends of "five metrics" in the new period: From the perspective of the 16th ISSI conference[J]. Documentation, information & knowledge, 2019(1): 67-80.
[38] 彭纪生, 仲为国, 孙文祥. 政策测量、政策协同演变与经济绩效: 基于创新政策的实证研究[J]. 管理世界, 2008(9): 25-36.
PENG J S, ZHONG W G, SUN W X.Policy measurement, policy co evolution and economic performance: An empirical study based on innovation policy[J]. Management world, 2008(9): 25-36.
[39] 王帮俊, 朱荣. 产学研协同创新政策效力与政策效果评估——基于中国2006~2016年政策文本的量化分析[J]. 软科学, 2019, 33(3): 30-35.
WANG B J, ZHU R.Evaluation on policy efficacy and effect of industry-university-research cooperative innovation - Policy quantification in china from 2006 to 2016[J]. Soft science, 2019, 33(3): 30-35.
[40] 张宝建, 李鹏利, 陈劲, 等. 国家科技创新政策的主题分析与演化过程——基于文本挖掘的视角[J]. 科学学与科学技术管理, 2019, 40(11): 15-31.
ZHANG B J, LI P L, CHEN J, et al.Thematic analysis and evolu-tion process of national science and technology[J]. Science of sci-ence and management of S & T, 2019, 40(11): 15-31.
[41] 赵婷茹, 李世杰, 朱沛祺. 基于实验设计的政策绩效评估计量方法述评[J]. 统计与决策, 2021, 37(4): 170-175.
ZHAO T R, LI S J, ZHU P Q.A review of measurement methods of policy performance evaluation based on experimental design[J]. Statistics & decision, 2021, 37(4): 170-175.
[42] THISTLETHWAITE D L, CAMPBELL D T.Regression-discontinuity analysis: An alternative to the ex post facto experiment[J]. Journal of educational psychology, 1960, 51(6).
[43] 王钊, 王良虎. 税收优惠政策对高技术产业创新效率的影响——基于断点回归分析[J]. 科技进步与对策, 2019, 36(11): 109-116.
WANG Z, WANG L H.Research on the impact of tax preferential policies on the innovation efficiency of high-tech industry - Based on breakpoint regression analysis[J]. Science & technology progress and policy, 2019, 36(11): 109-116.
[44] ASHENFELTER O.Estimating the effect of training programs on earning[J]. The review of econoics and statistics, 1978, 60(1): 47-57.
[45] BLOOM H S.Estimating the effect of Job-training programs, using longitudinal data: Ashenfelter’s findings reconsidered[J]. 1984, 19(4): 544-556.
[46] CARD D, KATZ L F, KRUEGER A B.Comment on David Neumark and William Wascher, "employment effects of minimum and subminimum wages: Panel data on state minimum wage laws"[J]. Industrial & amp; labor relations review, 1994, 47(3).
[47] MEYER B D, VISCUSI W K, DURBIN D L.Workers' compensation and injury duration: Evidence from a natural experiment[J]. The American economic review, 1995, 85(3): 322-340.
[48] HECKMAN J J, SMITH J A.The pre-programme earnings dip and the determinants of participation in a social programme. Implica-tions for simple programme evaluation strategies[J]. The economic journal, 1999, 109(457).
[49] PUHANI P A.Poland on the dole: the effect of reducing the unem-ployment benefit entitlement period during transition[J]. Journal of population economics, 2000, 13(1).
[50] STEWART M B.The employment effects of the national minimum wage[J]. The economic journal, 2004, 114(494).
[51] HECKMAN J, ICHIMURA H, TODD P.Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme[J]. Review of economic studies, 1997, 64(4): 605-654.
[52] CARBONI O A.R & D subsidies and private R & D expenditures: Evidence from Italian manufacturing data[J]. International review of applied economics, 2011, 25(4): 419-439.
[53] 陈玲, 段尧清. 政务大数据政策的技术创新效应分析——基于PSM-DID方法的估计[J]. 图书情报工作, 2020, 64(20): 96-105.
CHEN L, DUAN Y Q.Technological innovation effect analysis of government big data policy - Estimation based on PSM-DID method[J]. Library and information service, 2020, 64(20): 96-105.
[1] ZHANG Wenjun. Conception of Academic Coin Circulation System Based on Blockchain [J]. Journal of Library and Information Science in Agriculture, 2022, 34(8): 42-51.
[2] XIAO Shiyi, WEN Tingxiao. Reform and Implementation Path of University Evaluation under the Internet Environment [J]. Journal of Library and Information Science in Agriculture, 2022, 34(7): 98-106.
[3] WANG Jian, GAO Feng, FENG Jianzhong. Impact Mechanism of Information Service Supply on Entrepreneurship Performance under Rural Revitalization [J]. Journal of Library and Information Science in Agriculture, 2022, 34(6): 50-60.
[4] SONG Shanshan, BAI Wenlin. A Review of Big Data Governance Research in China [J]. Journal of Library and Information Science in Agriculture, 2022, 34(4): 4-17.
[5] MA Yunzhe, CUI Xu, ZHANG Xiaoyi. 24-Hour Service Quality Evaluation System of a Self-Service Library under the Background of Normal State of COVID-19 Epidemic Prevention and Control [J]. Journal of Library and Information Science in Agriculture, 2022, 34(3): 68-80.
[6] WAN Hao, ZHANG Fujun, LV Qianqian. The Validity of Peer Review Results of DEA Based Super Efficiency Projects [J]. Journal of Library and Information Science in Agriculture, 2022, 34(2): 88-101.
[7] XIONG Tao, LIU Wenjiang. Hot Topics and Frontier Evolution of Studies on Domestic Migrant Workers [J]. Journal of Library and Information Science in Agriculture, 2021, 33(8): 45-62.
[8] SHI Hongqing. Analysis of the Achievements and the Goal and Path of Building the World-Class S&T Journals in China [J]. Journal of Library and Information Science in Agriculture, 2021, 33(7): 54-62.
[9] GUAN Peng, WANG Yuefen, HUANG Qin, YE Longsheng, FU Zhu. Research on the Impact of Regional Innovation Cooperation Network on Technological Innovation Performance: Based on the Yangtze River Delta [J]. Journal of Library and Information Science in Agriculture, 2021, 33(6): 40-53.
[10] LI Feifan, LIU Caie, LI Yongfang. The Evaluation Method of University Research Performance and Disciplinary Development Potential [J]. Journal of Library and Information Science in Agriculture, 2021, 33(4): 68-77.
[11] MENG Yintao, ZHAO Leixia, YU Qianqian. Scientific Data Evaluation Index System for Scientific Data Preservation [J]. Journal of Library and Information Science in Agriculture, 2021, 33(12): 48-59.
[12] XIA Dong, XU Yingqi, WANG Chao, LI Bei. Review of the Evaluation of Scientific and Technical Novelty Search Service in China [J]. Journal of Library and Information Science in Agriculture, 2021, 33(11): 16-27.
[13] LAN Xue, HAN Yi. Data Usability of Book Rating Scores on Social Reading Platform from the Perspective of Altmetrics Evaluation: A Case Study of Douban Reading [J]. Journal of Library and Information Science in Agriculture, 2021, 33(11): 74-82.
[14] YANG Yiming, ZHANG Xinglong, ZHANG Hongyan, GUO Chunyang. The Evaluation of Librarians' Ability under the Environment of Smart University Libraries: Based on AHP and TOPSIS [J]. Journal of Library and Information Science in Agriculture, 2021, 33(11): 83-94.
[15] LIU Qian, ZHENG Sijia, GUI Chenjun, WANG Xuefeng. Analysis of Scholars' Comments on Breaking Through the Evaluation Criteria Based on"Four Only" [J]. Journal of Library and Information Science in Agriculture, 2021, 33(10): 46-58.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!