中文    English

Journal of Library and Information Science in Agriculture ›› 2023, Vol. 35 ›› Issue (7): 75-84.doi: 10.13998/j.cnki.issn1002-1248.23-0303

Previous Articles     Next Articles

Key Parameter Optimization Design of Self-organizing Peer Review in National Preprint Publishing Platform Based on Response Surface Analysis

WNAG Lingfeng, WANG Shenpeng   

  1. Business School, Guilin University of Electronic Technology, Guilin 541004
  • Received:2023-05-16 Online:2023-07-05 Published:2023-09-20

Abstract: [Purpose/Significance] The National Preprint Publishing Platform of China had been put into operation by the end of 2022. In order to ensure the quality of papers posted on the Platform and encourage a large number of researchers to submit articles to the Platform, it is necessary to introduce a paper quality assurance mechanism into the Platform. There are deficiencies in existing quality assurance mechanism for a preprint publishing platform. Self-organizing peer review has gradually attracted attention in recent years. In order to achieve the performance expected by the management agency of the National Preprint Publishing Platform, it is necessary to study the optimization design of key parameters of self-organizing peer review. [Method/Process] Design-expert software has been used for Box Behnken experimental design. The number of papers submitted by authors within a year, the distribution of review time, and the parameters of article review time are randomly set. The total number of papers is calculated according to the parameters of Lotka's law, and is not included in the Box-Behnken experimental sampling. We selected four key parameters of rest time, rejection rate, number of researchers, and review qualification ratio as independent variables, took three levels for each variable, and used -1, 0, +1 for coding, representing three levels of low, medium, and high, respectively. The three dependent variables for self-organizing peer review performance evaluation are the completion rate of paper review (CR), the balance of reviewer task allocation (TBD), and the average review time of the paper (A_r_time). A Box-Behnken experiment table was designed separately for each Lotka's law parameter, three repeated experiments were conducted on each key parameter combination in the table, and the summary() function and mean() function in R language were used to calculate the average performance indicators of each key parameter combination. Then, the response surface analysis was carried out on the Box-Behnken sampling data, and the quantitative relationship expression between the dependent variable of performance evaluation and the independent variable of key parameters was obtained. [Results/Conclusions] The ratio of review qualifications and reviewer rest time have greater impact on the performance of self-organized peer review, especially the ratio of review qualifications is much more important than other three key parameters. By combining different values of key parameter independent variables, the National Preprint Publishing Platform can achieve the expected self-organized peer review performance, ensuring the average quality of papers published by the Platform. In addition, because of our limited knowledge of computational resources, there is still room for improvement in simulation accuracy. If equipped with more powerful computational resources, more precise simulation calculation can be carried out based on the methods and parameters proposed in this paper.

Key words: National Pre-print Publishing Platform, paper quality, self-organizing peer review, box-behnken design, response surface analysis

CLC Number: 

  • G35
[1] 李广建. 对国家科研论文和科技信息高端交流平台的理解及研究建议[J]. 图书与情报, 2021(6): 1-4.
LI G J.Understanding and research suggestions on the high-end exchange platform of national scientific research papers and scientific and technological information[J]. Library & information, 2021(6): 1-4.
[2] 孙异凡, 陈一, 蒋子可, 等. 开放科学视域下预印本认可政策研究[J]. 数字图书馆论坛, 2021(6): 2-12.
SUN Y F, CHEN Y, JIANG Z K, et al.Research on the recognition policy of preprints from the perspective of open science[J]. Digital library forum, 2021(6): 2-12.
[3] 王凌峰, 程灵慧. 预印本与期刊: 互补合作到优势融合[J/OL]. 情报杂志: 1-7[2023-06-19]. http://kns.cnki.net/kcms/detail/61.1167.G3.20230714.1106.006.html.
WANG L F, CHENG L H. Preprint and journal: Complementary co-operation to advantage integration[J/OL]. Journal of intelligence: 1-7[2023-08-19].http://kns.cnki.net/kcms/detail/61.1167.G3.20230714.1106.006.html.
[4] 唐碧群, 王凌峰. 预印本2.0应用于国家科研论文高端交流平台建设的设想[J]. 图书情报导刊, 2021, 6(9): 20-24.
TANG B Q, WANG L F.A proposal of preprint 2.0 applied to national high-level scientific paper platform construction[J]. Journal of library and information science, 2021, 6(9): 20-24.
[5] 宋永辉, 马廷灿, 刘静羽. 志愿者参与下国际预印本平台学术质量控制方法调研与启示——以arXiv与RePEc平台为例[J]. 中国科技期刊研究, 2023, 34(2): 119-126.
SONG Y H, MA T C, LIU J Y.Roles of volunteers in academic quality control of international preprint platforms: Taking arXiv and RePEc as examples[J]. Chinese journal of scientific and technical periodicals, 2023, 34(2): 119-126.
[6] 祝忠明. 国家高端交流平台建设体系及其开放科学实践策略[J]. 图书与情报, 2021(6): 21-30.
ZHU Z M.Open science platforms for the development of high-end communication platforms in China[J]. Library & information, 2021(6): 21-30.
[7] 唐碧群, 王凌峰. 自组织同行评议: 技术赋能同行评议的产生、设计与多场景应用[J]. 图书情报导刊, 2022, 7(11): 63-68.
TANG B Q, WANG L F.Self-organized peer review: The generation, design and multi-scenario applications of technology-enpowered peer review[J]. Journal of library and information science, 2022, 7(11): 63-68.
[8] 王凌峰, 孙英潮. E-prints预印本数据库的自组织同行评议模式设计[J]. 现代情报, 2016, 36(5): 9-15.
WANG L F, SUN Y C.Design of self-organizing peer review mechanism under E-prints database environment[J]. Journal of modern information, 2016, 36(5): 9-15.
[9] 唐碧群, 杨硕, 王凌峰. 自组织同行评议在预印本数据库中的应用——以“中国科技论文在线”为例[J]. 图书情报导刊, 2018, 3(4): 26-31.
TANG B Q, YANG S, WANG L F.Application of self-organizing peer review in preprint database: Taking "Chinese science papers online" as an example[J]. Journal of library and information science, 2018, 3(4): 26-31.
[10] WANG L F, ZHAN Y Q.A conceptual peer review model for arXiv and other preprint databases[J]. Learned publishing, 2019(3): 213-219.
[11] 石进, 苗杰, 李明. 面向预印本系统的自组织同行评议及激励机制研究[J]. 现代情报, 2019, 39(12): 88-100.
SHI J, MIAO J, LI M.Research on self-organization peer review and incentive mechanism for pre-printed system[J]. Journal of modern information, 2019, 39(12): 88-100.
[12] 付江阳, 贺颖. 预印本自组织同行评议的通证激励机制研究[J]. 中国科技期刊研究, 2021, 32(1): 23-27.
FU J Y, HE Y.Token incentive mechanism of self-organizing peer review in preprint[J]. Chinese journal of scientific and technical periodicals, 2021, 32(1): 23-27.
[13] PUBLONS. Publons' global state of peer review 2018[R]. Global State of peer review report - Clarivate, London, UK: Publons, 2018.
[14] 张贤澳, 李美文. 广义洛特卡定律参数特征的研究[J]. 情报探索, 1996(2): 10-15.
ZHANG X A, LI M W.Study on parameter characteristics of generalized lotca's law[J]. Information research, 1996(2): 10-15.
[15] 郭勤涛, 张令弥, 费庆国. 用于确定性计算仿真的响应面法及其试验设计研究[J]. 航空学报, 2006, 27(1): 55-61.
GUO Q T, ZHANG L M, FEI Q G.Response surface method and its experimental design for deterministic computer simulation[J]. Acta aeronautica et astronautica Sinica, 2006, 27(1): 55-61.
[16] 王永菲, 王成国. 响应面法的理论与应用[J]. 中央民族大学学报(自然科学版), 2005, 14(3): 236-240.
WANG Y F, WANG C G.The application of response surface methodology[J]. Journal of the central university for nationalities (natural science edition), 2005, 14(3): 236-240.
[1] LIU Ting, ZHAO Yajuan. Review and Prospect of Research on Technology Opportunity Identification [J]. Journal of Library and Information Science in Agriculture, 2023, 35(7): 4-17.
[2] LUO Wen, HU Zhigang. Definition and Measurement of Core Collaborators in Scientific Research Collaboration: A Measurement Methodology Based on the H-Index [J]. Journal of Library and Information Science in Agriculture, 2023, 35(4): 48-58.
[3] WANG Jinfei, SUN Wei, ZHANG Xuefu, YANG Lu. Interdisciplinarity Measurement Method of Scientific Research Papers based on Adaptive Feature Selection [J]. Journal of Library and Information Science in Agriculture, 2023, 35(3): 52-70.
[4] CHAI Xuefei, XING Fei. Health Information Needs and Service of the Elderly Under Major Public Health Emergencies [J]. Journal of Library and Information Science in Agriculture, 2023, 35(1): 99-107.
[5] YU Liping, PAN Weibo. Key Indicators of Journal Evaluation Based on K-means and PLS-DA [J]. Journal of Library and Information Science in Agriculture, 2022, 34(12): 55-64.
[6] WANG Xin, LU Yao, YUAN Xue, ZHAO Wanjing, CHEN Li, LIU Minjuan. A Survey of Author Name Disambiguation Techniques of Academic Papers [J]. Journal of Library and Information Science in Agriculture, 2022, 34(10): 82-90.
[7] ZHAO Youlin, CAO Hongnan. Government Microblog Information Exchange Efficiency and Its Influencing Factors for Emergency Management [J]. Journal of Library and Information Science in Agriculture, 2022, 34(9): 72-85.
[8] XIAO Shiyi, WEN Tingxiao. Reform and Implementation Path of University Evaluation under the Internet Environment [J]. Journal of Library and Information Science in Agriculture, 2022, 34(7): 98-106.
[9] FU Lihong, HAN Lu. The Influencing Mechanism of Postgraduates' Trust in Academic Information Consumption and Intensification Strategy [J]. Journal of Library and Information Science in Agriculture, 2022, 34(6): 72-82.
[10] HUANG Yichun. Research on the Development Trend of Crop Breeding in China from the Supply of Innovative Elements [J]. Journal of Library and Information Science in Agriculture, 2022, 34(5): 31-46.
[11] MAO Jin, CHEN Ziyang. A Deep Learning Based Approach to Structural Function Recognition of Scientific Literature Abstracts [J]. Journal of Library and Information Science in Agriculture, 2022, 34(3): 15-27.
[12] CHAI Miaoling, ZOU Yixing, TAN Rongzhi, ZENG Yi, REN Yunyue. Research and Practice on Association of Scientific Data and Scientific Literature Oriented to Knowledge Service of Agricultural Industry [J]. Journal of Library and Information Science in Agriculture, 2022, 34(3): 37-50.
[13] ZHAO Lili, ZHANG Xinmin. Analysis of Research Status and Frontier Hotspots in Soil Microorganism Field [J]. Journal of Library and Information Science in Agriculture, 2022, 34(2): 75-87.
[14] WAN Hao, ZHANG Fujun, LV Qianqian. The Validity of Peer Review Results of DEA Based Super Efficiency Projects [J]. Journal of Library and Information Science in Agriculture, 2022, 34(2): 88-101.
[15] LIN Zhuo, HUANG Haohai. Top Experts Identification and Evaluation of International Cooperation on Artificial Intelligence in China [J]. Journal of Library and Information Science in Agriculture, 2022, 34(1): 86-95.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!