中文    English

Journal of Library and Information Science in Agriculture ›› 2020, Vol. 32 ›› Issue (9): 6-14.doi: 10.13998/j.cnki.issn1002-1248.2020.09.20-0411

;

• Research on Digital Humanities from a technical perspective • Previous Articles     Next Articles

Semantic Annotation of Image Resources in Digital Humanities

CHEN Tao1,*, SHAN Rongrong2, LI Hui1,3   

  1. 1. Shanghai Library/Institute of Scientific & Technical Information of Shanghai, Shanghai 201100;
    2. Department of Library, Information and Archives, Shanghai University, Shanghai 200444;
    3. Department of Information Management, Nanjing University, Nanjing 210046
  • Received:2020-01-08 Online:2020-09-05 Published:2020-09-30

Abstract: [Purpose/Significance] A large number of image resources in digital humanities have not been in effective use for a long time, and the phenomenon of "isolated image islands" is intensifying. The International Image Interoperability Framework (IIIF) opens a new window for more in-depth interactions with image applications. Image annotation is the key to breaking image islands and enhancing image recognition. [Method/Process] Based on IIIF framework, this paper proposes three dimensions of image annotation: image-level metadata injection, object-level content transcription, and semantic-level deep annotation connection. At the same time, the ontology management platform built in the paper provides ontology support for semantic annotation of image resources. [Results/Conclusions] This paper takes Night-Shining White, a monochrome ink-on-paper painting by Han Gan, as an example. In this case, the paper discusses the new interactive experience and research mode brought by the use of image annotation and IIIF technology in semantic enhancement of images, object tag clustering and precise associations of resources. It indicates that the combination of IIIF, linked data and artificial intelligence (AI) is bound to open a new era of digital humanities research.

Key words: international image interoperability framework (IIIF), semantic annotation, ontology, linked data, digital humanities

CLC Number: 

  • G250
[1] 马林青, 韩若画(译). 数字人文: 改变知识创新与分享的游戏规则[M]. 北京: 中国人民大学出版社, 2018.
[2] 大卫·M 贝里, 安德斯·费格约德. 数字人文: 数字时代的知识与批判[M]. 王晓光, 译. 大连: 东北财经大学出版社, 2019.
[3] ALBERTO S.International image interoperability framework(IIIF): A panoramic view[J]. JLIS. it, 2017, 8(1): 50-66.
[4] STUART S, ROBERT S, TOM C.The international image interoperability framework(IIIF): A community & technology approach for web-based images[J]. Society for imaging science and technology, 2015, 8: 16-21.
[5] SARAH A L.Review: International image interoperability framework(IIIF)[J]. Journal of the American musicological society, 2018, 71(2): 561-572.
[6] ANDY C.IIIF: Unshackle your images[C]. MW2016: Museums and the Web 2016, Los Angeles, USA, 2016.
[7] TRISTAN R, ROB L, JEFFREY C S C, et al. IIIF at Scale[EB/OL].[2020-04-04]. https://mw20.museweb.net/paper/iiif-at-scale/.
[8] JULIEN A R.Suggested measures for deploying IIIF in swiss cultural heritage institutions[EB/OL]. [2020-04-05].https://www.researchgate.net/publication/340966631_Swiss_institutions_climbing_up_the_IIIF_ladder.
[9] IIIF collections in Japan[EB/OL]. [2020-04-04].https://www.kanzaki.com/works/2016/pub/image-annotator?u=https://nakamura196.github.io/iiif/data/collection/collection.json.
[10] 耿曼曼. 图书馆图像资源开发利用: 国际图像互操作框架[J]. 图书馆学研究, 2019, 18: 37-45.
[11] 张轶. 国际图像互操作框架及其应用分析[J]. 数字图书馆论坛,2019, 5: 42-49.
[12] 付跃安. 国际图像互操作框架(IIIF)及在数字资源集成中的应用[J]. 图书馆论坛, 2020, 4: 159-166.
[13] GRASSI M, MORBIDONI C, NUCCI M, et al.Pundit: Creating, exploring and consuming semantic annotations[C]. In proceedings of the 3rd international workshop on semantic digital archives, Valletta, Malta, 2013.
[14] SIMON R, BARKER E, ISAKSEN L, et al.Linked data annotation without the pointy brackets: Introducing recogito[J]. Journal of map & geography libraries: Advances in geospatial information, collections & archives, 2017, 13(1): 111-132.
[15] LAURA H, GUUS S, JAN W, et al.Semantic annotation of image collections[EB/OL]. [2020-05-10].https://www.cs.vu.nl/~guus/papers/Hollink03b.pdf.
[16] ZHENG Y Z, LI Z X, ZHANG C L.A hybrid architecture based on CNN for image semantic annotation[C]. 9th international conference on intelligent information processing(IIP), Melbourne, Australia. 2016,11: 81-90.
[17] STORK L, WEBER A, GASSZOM E, et al.Semantic annotation of natural history collections[J]. Web semantics, 2019, 59: 100462.
[18] PIERRE A, ILYA Z, JUAN P.A Classification of Semantic Annotation Systems[J]. Semantic Web, 2012, 3: 223-248.
[19] 王晓光, 徐雷, 李纲. 敦煌壁画数字图像语义描述方法研究[J]. 中国图书馆学报, 2014, 40(1): 50-59.
[20] WANG X G, SONG N Y, ZHANG L, et al.Understanding subjects contained in Dunhuang mural images for deep semantic annotation[J]. Journal of documentation, 2018, 74(2): 333-353.
[21] 徐雷, 王晓光. 叙事型图像语义标注模型研究[J]. 中国图书馆学报, 2017, 43(5): 70-83.
[22] 陈金菊, 欧石燕. 数字图像语义标注模型比较与分析[J]. 图书情报工作, 2018, 62(6): 116-124.
[23] 陈涛, 张永娟, 刘炜, 等. 关联数据发布的若干规范及建议[J]. 中国图书馆学报, 2019, 45(1): 34-46.
[24] ADRIAN R.YOLO object detection with OpenCV[EB/OL]. [2020-04-18].https://www.pyimagesearch.com/2018/11/12/yolo-object-detection-with-opencv/.
[25] GONZALO V-C, NIELS D L, MUBARAK S.Holistic object detection and image understanding[J]. Computer vision and image understanding, 2019, 181: 1-13.
[26] FILESTACK. Comparing image tagging services: Google vision, Microsoft cognitive services, amazon rekognition and clarifai[EB/OL].[2020-05-20]. https://blog.filestack.com/thoughts-and-knowledge/comparing-google-vision-microsoft-cognitive-amazon-rekognition-clarifai/.
[1] HUANG Shuiqing, WANG Xiaoguang, XIA Cuijuan, OUYANG Jiang. Advancing the Work on Ancient Classics in the New Era and Accelerating Innovative and Intelligent Development [J]. Journal of Library and Information Science in Agriculture, 2022, 34(5): 4-20.
[2] CHAI Miaoling, ZOU Yixing, TAN Rongzhi, ZENG Yi, REN Yunyue. Research and Practice on Association of Scientific Data and Scientific Literature Oriented to Knowledge Service of Agricultural Industry [J]. Journal of Library and Information Science in Agriculture, 2022, 34(3): 37-50.
[3] SHANG Hongli, ZHANG Sijie, WEI Zhipeng, YANG Kehu, ZHOU Wenjie. Evidence Integration Framework of Evidence-based Digital Humanities [J]. Journal of Library and Information Science in Agriculture, 2022, 34(11): 38-47.
[4] AI Yuxi, XU Jian, HE Lin, QI Yun. A Construction Method of the Classification System Oriented to Content Analysis of Ancient Books [J]. Journal of Library and Information Science in Agriculture, 2021, 33(9): 18-26.
[5] ZHU Suoling, BAO Ping. Practice and Thoughts on Digital Humanities in the Research of Chinese Agricultural History: Taking the Digital Humanities Project of the Chinese Academy of Agricultural Civilization as an Example [J]. Journal of Library and Information Science in Agriculture, 2021, 33(8): 79-87.
[6] LI Hui, CHEN Tao, SHAN Rongrong. Conversations across Time and Space: Constructing Memory Chains of Calligraphies and Paintings on the Basis of IIIF-IIP Platform [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 15-21.
[7] JIA Xiaoshuang, YAO Jing. The Analysis of the Role of Digital Humanities in Sudden Public Crises: Taking COVID-19 as an Example [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 22-30.
[8] PENG Xia, LIU Min, YANG Li, FAN Shan. The Geographical Distribution and Causes of the Female Writers during Ming and Qing Dynasties in Spatial Horizon: A Case Study of Songjiang Prefecture [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 31-38.
[9] ZHAO Shenghui, HU Ying. The Multi-lingual Knowledge Fusion Framework for Digital Humanities in Tibetan Studies Humanities in Tibetan Studies [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 39-49.
[10] XIAO Peng. From "Building the Ecosystem" to "Driven by Demand": How to Meet the Digital Scholarship Needs of Humanities Scholars [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 50-57.
[11] CAI Siming. Construction of Academic Libraries Supporting Security Systems of Digital Academic Resources [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 58-67.
[12] XIAO Peng, XIAO Jiu, HE Yali. Leading Academic Library in the Exploration of Digital Humanities Strategy: Mission and Direction [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 67-76.
[13] ZENG Wen. The Neglected Majority: The Development Strategy of Basic Academic Libraries in Digital Humanistic Ecosystem [J]. Journal of Library and Information Science in Agriculture, 2020, 32(9): 77-82.
[14] JIANG Yuyan, LI Yaru. An Analysis of the "Emotion Space Time" Model from the Perspective of Digital Humanity [J]. Journal of Library and Information Science in Agriculture, 2020, 32(6): 23-33.
[15] LYU Lucheng, HAN Tao. Artificial Intelligence Empowers Library and Information Service ——Review of Forums about Information Technology for Library 2019 [J]. Journal of Library and Information Science in Agriculture, 2020, 32(5): 13-18.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!