中文    English

Agricultural Library and Information ›› 2019, Vol. 31 ›› Issue (4): 77-84.doi: 10.13998/j.cnki.issn1002-1248.2019.04.18-1850

• Applied practice • Previous Articles    

University Library Digital Resource Sharing Based on Hadoop

GAO Yaping, NIU KangKang   

  1. Library, Shanghai University, Shanghai 200444, China
  • Received:2018-12-05 Online:2019-04-05 Published:2019-06-21

Abstract: In view of the low exchange of big data shared resource in libraries domestic and foreign, and the lack of one-stop service platform crossing all standalone system, this paper his paper is focused on improving the sharing and utilization of digital resources from the technical aspect, proposes a structure model for the sharing of library digital resource based on Hadoop to solve the problem of low sharing performance and the lack of systematic management. Moreover, it provides readers with a multi-faceted service.The system uses MapReduce distributed computing framework and a resource management system to process digital resource data in parallel to achieve fast correlation search and processing of digital resources, and introduces a composite library big data storage system based on HDFS which can guarantee the storage requirements of the resource sharing system, effectively improve the access efficiency for the readers, and solve the scalability problems faced by the traditional storage technologies.

Key words: digital resource sharing, Hadoop, MapReduce, HDFS

CLC Number: 

  • G250.73
[1] 文化部印发《“十三五”时期公共数字文化建设规划》[EB/OL]. [2018-01-07].http://www.ndcnd.gov.cn/zixun/yaowen/201708/t20170803_1350560.htm.
[2] 肖希明,刘巧园.国外公共数字文化资源整合研究进展[J].中国图书馆学报,2015(5):63-75.
[3] World Digital Library [EB/OL].[2018-10-30].https://www.wdl.org/en/.
[4] Digital Public Library of America [EB/O L].[2018-10-30]. https://dp.la/.
[5] Europeana Digital Library [EB/OL].[20 18-10-30].http://www.Theeuropean library. or g /tel4/.
[6] What is Culture Online? [EB/OL].[2018-1030]https://aboutus.com/CultureOnline. gov.uk.
[7] Lee Hyuk-jin.Collaboration in Cultural Herit age Digitizaitionin East Asia[J]. Program:Electronic Library and Infor mation on Systems,2010(4):357-373.
[8] 肖荻昱. 我国“互联网+图书馆”研究的现状与趋势探析——基于CNKI数据库核心期刊[J].当代图书馆,2019(01):49-55.
[9] 陈颖,李景,李国鹏.国家科技图书文献中心(NSTL)数据加工数量统计与分析(2010~2015年)[J].标准科学, 2016(12):46-50.
[10] 陈凌. CALIS 20年:从共建共享走向融合开放[J].数字图书馆论坛, 2018(12):1.
[11] 范晨晓. “基于CADAL平台的资源共享与应用”国际研讨会综述[J].大学图书馆学报,2017,35(05):5-9.
[12] Renaud J,Britton S,Wang D,et al.Mining library and university data to understand library use patterns[J].The Electronic Library,2015,33(3):355-372.
[13] Williams K,Wu J,Choudhury SR,et al.Scholarly big data information extraction and integration in the CiteSeerx digital library[C]//Data Engineering Workshop (ICDEW), 2014 IEEE 30th International Conference, 2014:68-73.
[14] 鲁焱. 大数据共享平台的系统架构与建设思路[J].图书馆理论与实践,2017(04):86-90.
[15] 宋玲玲. 大数据时代图书馆数字学术中心服务探析——以北美高校图书馆为例[J].图书馆理论与实践,2018(08):92-97.
[16] Hashem I A T, Yaqoob I, Anuar N B, et al. The rise of “big data” on cloud computing: Review and open research issues[J]. Information Systems, 2015, 47: 98-115.
[17] Ghazi MR, Gangodkar D.Hadoop, MapReduceand HDFS:a developResper spectiv[J]. Procedia Computer Science, 2015, 48: 45-50.
[18] Eldawy A, Mokbel MF.Spatialhadoop:A mapreduce framework for spatial data[C] //Data Engineering (ICDE), 2015 IEEE 31st International Conference on. IEEE, 2015: 1352-1363.
[19] ZorichD M,Waibel G,Erway R. Beyond the Silos of the LAMs Collaboration among Libraries,Archives and Museumss [EB/O L].[2018-02-27].
[20] 王燕红. 国内基于关联数据的资源整合研究述评[J].图书馆理论与实践,2018(06):36-40.
[21] 李强. 基于关联数据的数字图书馆资源聚合及资源服务平台设计研究[J].图书馆理论与实践,2017(07):93-97.
[22] 刘爱琴,于贾燕,尚珊.基于语义的文献资源发现服务体系构建[J].图书馆理论与实践,2018(08):104-107.
[23] 陈臣. 一种基于新型存储的数字图书馆分布式大数据存储架构[J].现代情报,2015,35(01):100-103.
[24] 曹健,秦荣环,孙会清,毕长泉.基于Hadoop的高校图书馆数字资源整合利用研究[J].图书馆工作与研究,2018(03):74-78,101.
[25] 柳益君,何胜,冯新翎,武群辉,熊太纯.大数据挖掘在高校图书馆个性化服务中应用研究[J].图书馆工作与研究,2017(05):23-29.
[26] 张红. 基于大数据技术的资源发现平台构建——以国家图书馆“文津搜索”系统为例[J].数字图书馆论坛,2016(01):61-67.
[27] 刘海鸥,陈晶,孙晶晶,张亚明.面向大数据的移动数字图书馆情境化推荐系统研究[J].图书馆工作与研究,2018(09):58-64.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!