中文    English

Journal of library and information science in agriculture

   

Human-AI Configuration Differences in Online Reference Services between Chinese and International Academic Libraries: Evidence from "Double First-Class" and U.S. News Top 100 Universities

WANG Chao1, CHEN Jie2(), HOU Hui2   

  1. 1. Library of Liaoning University of Technology, Jinzhou 121001
    2. Library of Guilin University of Technology, Guilin 541004
  • Received:2025-12-19 Online:2026-02-13
  • Contact: CHEN Jie

Abstract:

[Purpose/Significance] Against the global surge of generative artificial intelligence (GenAI) and large language models (LLMs), academic libraries are undergoing a critical paradigm shift in their reference services. While "AI Virtual Librarians" (AIVL) are increasingly adopted to enhance efficiency, cross-national evidence regarding how they are configured alongside traditional "Human Live Reference" (HLR) remains scarce. This study aims to reveal the structural differences in human-AI configurations between Chinese and international top-tier university libraries. It seeks to identify the divergence between "technology-driven" and "human-centric" service models and proposes a governance-oriented hybrid pathway to inform the digital transformation of academic libraries. [Method/Process] The study established two high-resource samples: 42 libraries from China's "Double First-Class" universities and 94 libraries from the U.S. News Top 100 World Universities. A systematic website investigation and standardized interaction tests were conducted to collect data on service availability and deployment models. The study not only quantified the deployment of HLR and AIVL (classified into rule-based and LLM-based) but also qualitatively evaluated the "Core Service Contents" and "Linkage Mechanisms" (e.g., traceability, boundaries, and human fallback). Chi-square tests were employed for statistical analysis, and robustness checks were performed using both broad and strict counting rules to ensure validity. [Results/Conclusions] Results indicate that while the overall service coverage is similar across groups (approx. 74%), the service structure diverges significantly. International libraries predominantly rely on the "Human-only" mode (66.0%), prioritizing deep research support, academic integrity, and privacy protection. In contrast, Chinese libraries show a significantly higher adoption of AIVL (57.1% vs. 8.5%) and LLMs (26.2% vs. 1.1%), with 52.4% operating in an "AI-only" mode. Content analysis reveals that Chinese AIVLs focus on transactional efficiency and 24/7 accessibility, whereas international counterparts focus on distinct research guides and governance. The study identifies a critical trade-off: China's aggressive AI adoption enhances accessibility but faces challenges regarding answer hallucinations and the lack of human fallback mechanisms. To address these challenges, the paper recommends a "Human-AI Collaborative Loop" model. Key strategies include: 1) Implementing risk-tiered routing, where low-risk transactional queries are handled by AI and high-risk research inquiries are directed to humans; 2) Optimizing AI reliability through Retrieval-Augmented Generation (RAG) and controlled knowledge bases to ensure traceability; 3) Establishing clear governance boundaries and stratified implementation paths for libraries with different resource levels, ensuring a balance between technological innovation and service ethics.

Key words: AI virtual librarian, large language models, human-AI collaboration, academic libraries, online reference services, retrieval-augmented generation (RAG), comparative study

CLC Number: 

  • G252.6

Table 1

Operational definitions and coding scheme"

变量代码 变量名称 定义说明 编码/计算方式
ORS 在线咨询覆盖率 官网是否提供任一形式的远程咨询服务(人工或AI) ORS=1(若HLR=1或AIVL=1)
HLR 馆员在线咨询 馆员提供的实时在线服务 有=1,无=0
口径A(宽口径) 包含官网即时咨询(Chat)及微信公众号人工客服 用于主文分析(反映实际服务能力)
口径B(严口径) 仅统计官网集成的即时咨询窗口,排除微信渠道 用于稳健性检验(反映官网建设水平)
AIVL AI虚拟馆员 能够自动回复提问的智能系统 有=1,无=0
Rule-AI 规则型AI 基于FAQ库、脚本或关键词匹配的机器人 有=1,无=0
LLM-AI 大模型AI 基于大语言模型(GPT/GLM等)的生成式对话助手 有=1,无=0
Mode 服务模式 基于人工与AI的有无组合划分的四象限模式 1=仅人工;2=仅AI;3=人+AI;4=皆无
Privacy 隐私声明 咨询界面是否提供隐私/数据使用提示 有=1,无=0

Table 2

Comparison of online consultation and AI deployment"

指标 国内组(N=42)n(%) 国际组(N=94)n(%) 差异检验(χ²/Fisher) 显著性(p值) 相对风险(RR) 优势比(OR)
ORS(在线咨询总覆盖率) 31(73.8%) 70(74.5%) 0.007 0.932 0.99 0.97
HLR(馆员在线咨询-口径A) 9(21.4%) 69(73.4%) 31.841 <0.001*** 0.29 0.10
AIVL(AI虚拟馆员) 24(57.1%) 8(8.5%) 35.539 <0.001*** 6.71 14.33
Rule-AI(规则型) 13(31.0%) 7(7.4%) 10.970 0.001*** 4.16 5.57
LLM-AI(大模型) 11(26.2%) 1(1.1%) Fisher精确检验 <0.001*** 24.62 33.00
隐私声明(Privacy Notice) 0(0.0%) 7(7.4%) Fisher精确检验 0.091 0.15* 0.14*

Table 3

Distribution of human-AI service configurations"

服务模式 模式定义 国内组(N=42)n(%) 国际组(N=94)n(%)
合计 42(100%) 94(100%)
仅人工(Only Human) HLR=1且AIVL=0 7(16.7%) 62(66.0%)
仅AI(Only AI) HLR=0且AIVL=1 22(52.4%) 1(1.1%)
人+AI(Human+AI) HLR=1且AIVL=1 2(4.8%) 7(7.4%)
皆无(None) HLR=0且AIVL=0 11(26.2%) 24(25.5%)

Table 4

Robustness checks under different counting rules"

比较维度 统计口径 国内组数据(N=42)/% 国际组数据(N=94)/% 差异显著性(p值) 结论变化
HLR(馆员在线) 口径A(宽口径) 21.40 73.40 <0.001 显著低于国际
口径B(严口径) 4.80 73.40 <0.001 差距进一步拉大
ORS(总覆盖率) 口径A(宽口径) 73.80 74.50 >0.05 无显著差异
口径B(严口径) 57.10 74.50 0.047 国内略低(p<0.05)
仅人工模式 口径A(宽口径) 16.70 66.00 <0.001 显著低于国际
口径B(严口径) 0.00 66.00 <0.001 国内官网完全缺失该模式
仅AI模式 口径A/B 52.40 1.10 <0.001 结论稳健:国内高度依赖AI

Table 5

Coding dimensions and criteria for core service contents and linkage mechanisms of AI virtual librarians"

维度 判据(官网信息/交互实测) 对应价值/风险
事务性规则问答 可回答开放时间、证件办理、借阅规则、预约/缴费等常见问题 提升覆盖率;低风险但需保证及时更新
资源发现与检索引导 可指向馆藏/数据库/校外访问入口;必要时给出检索路径 决定“能否找得到”;避免误导
学术研究支持 可提供检索式构建、引用规范、研究流程建议等 高价值但高风险;需强约束与转人工
可追溯输出 回答中提供来源链接/馆内指南依据;可核验 降低幻觉与责任风险;提升可信度
边界与不确定性提示 明确“仅供参考/以官网为准/不适用情形” 合规与风险管理;提升用户预期一致性
转人工与闭环机制 一键转接/工单/明确人工入口;支持反馈与复盘 保障复杂问题质量;支持持续迭代
[1]
徐星, 薛婷彦. 华东师大: 数智精准赋能, 打造“一站式”学生智慧社区[J]. 上海教育, 2025(15): 37.
Xu Xing, Xue Tingyan. East China normal university: Empowering mathematical intelligence accurately and building a "one-stop" student wisdom community[J]. Shanghai Education, 2025(15): 37.
[2]
洪敦明. 2020年数字出版与数字图书馆融合发展国际研讨会(2020CDPDL)两岸图书馆服务融合创新分会Ⅱ[EB/OL]. (2020-07-24)[2025-12-18].
[3]
Yoon J, Andrews J E, Ward H L. Perceptions on adopting artificial intelligence and related technologies in libraries: Public and academic librarians in North America[J]. Library Hi Tech, 2022, 40(6): 1893-1915.
[4]
唐琼. 图书馆参考咨询分层设置研究[J]. 图书馆研究与工作, 2022(8): 59-64, 69.
Tang Qiong. A study on tiered reference in libraries[J]. Library Science Research & Work, 2022(8): 59-64, 69.
[5]
王世强, 侯滨, 王珂, 等. 数字化转型背景下图书馆数智技术应用框架构建——基于18家图书馆的实践分析 [J/OL]. 图书馆, 1-9[2025-12-18].
Wang Shiqiang, Hou Bin, Wang Ke, et al. Framework for intelligent digital technology applications in libraries under digital transformation: Evidence from practices of 18 libraries[J/OL]. Library, 1-9[2025-12-18].
[6]
张毅. 高校图书馆AI虚拟馆员服务框架与实施路径研究[J]. 图书馆杂志, 2026, 45(1): 49-60, 123.
Zhang Yi. Research on AI virtual librarian service framework and implementation path in university libraries[J]. Library Journal, 2026, 45(1): 49-60, 123.
[7]
Huang Y H. Exploring the implementation of artificial intelligence applications among academic libraries in Taiwan[J]. Library Hi Tech, 2024, 42(3): 885-905.
[8]
Lo L S. AI policies across the globe: Implications and recommendations for libraries[J]. IFLA Journal, 2023, 49(4): 645-649.
[9]
Huang Yingshen, Cox A M, Cox J. Artificial Intelligence in academic library strategy in the United Kingdom and the Mainland of China[J]. The Journal of Academic Librarianship, 2023, 49(6): 102772.
[10]
卿毅. 人工智能大模型嵌入高校图书馆: 赋能场景、风险样态与规制路径[J]. 图书馆工作与研究, 2025(8): 15-22.
Yi Qing. Artificial intelligence large models embedded in university libraries: Empowering scenarios, risk patterns and regulatory paths[J]. Library Work and Study, 2025(8): 15-22.
[11]
Clarivate. Pulse of the library 2025: Reflecting the voices of librarians worldwide[R/OL]. London: Clarivate, 2025[2025-12-18].
[12]
周纲, 朱雯晶, 张磊. 以大模型重构下一代图书馆服务平台[J]. 信息与管理研究, 2024, 9(6): 14-23.
Zhou Gang, Zhu Wenjing, Zhang Lei. Reconstructing the next-generation library service platform with large language models[J]. Journal of Information and Management, 2024, 9(6): 14-23.
[13]
江京泽, 周天旻, 李妹, 等. 高校图书馆智能化转型中的复合型AI馆员核心能力模型的探索与研究[J]. 农业图书情报学报, 2025, 37(9): 97-109.
Jiang Jingze, Zhou Tianmin, Li Mei, et al. A study of the core competence model of compound AI librarians in the intelligent transformation of university libraries[J]. Journal of Library and Information Science in Agriculture, 2025, 37(9): 97-109.
[14]
同济大学图书馆. 图书馆AI智能助手“智小图”上线啦![EB/OL]. (2025-01-19)[2026-01-26].
TONGJI UNIVERSITY LIBRARY. Library AI assistant "Zhi Xiaotu" launched[EB/OL]. (2025-01-19)[2026-01-26].
[15]
湖南省文化和旅游厅. 湖南图书馆上线DeepSeek-R1大模型——湘图AI馆员“湘湘”开启智慧服务新时代[EB/OL]. (2025-02-25)[2026-01-26].
HUNAN PROVINCIAL DEPARTMENT OF CULTURE AND TOURISM. Hunan Library launched DeepSeek-R1-AI librarian "Xiangxiang" enters service[EB/OL]. (2025-02-25)[2026-01-26].
[16]
Library Harvard. Artificial intelligence for research and scholarship[EB/OL]. (2025-06-13)[2025-11-26].
[17]
Harvard medical school research administration. university guidelines: AI tools[EB/OL].(2023-07-20)[2025-11-26].
[1] CHEN Jiayong, GONG Jiaoteng, WANG Yuyi. Research of Interdisciplinary Comparison and Collaborative Paradigm on the Concept of Agent in Library Science [J]. Journal of library and information science in agriculture, 2025, 37(5): 27-39.
[2] ZHANG Li, WANG Bo, JING Shui. Generative AI-Driven Resource Discovery in Public Libraries: Service Optimization Based on a Dynamic Evaluation Model [J]. Journal of library and information science in agriculture, 2025, 37(5): 58-71.
[3] SANG Yuanyuan. Multimodal Learning Technology Aimed at Exploring the Innovative Path of Library Intelligence Service [J]. Journal of library and information science in agriculture, 2025, 37(3): 42-52.
[4] CAI Yiran, HU Zhengyin, LIU Chunjiang. Analysis of Progress in Data Mining of Scientific Literature Using Large Language Models [J]. Journal of library and information science in agriculture, 2025, 37(2): 4-22.
[5] Haoxian WANG, Ziming ZHOU, Feifei DING, Chengfu WEI. Digital Humanities & Large Language Models: Practice and Research in Semantic Retrieval of Ancient Documents [J]. Journal of library and information science in agriculture, 2024, 36(9): 89-101.
[6] GUO Pengrui, WEN Tingxiao. Research of the Impact of LLMs on Information Retrieval Systems and Users' Information Retrieval Behavior [J]. Journal of library and information science in agriculture, 2023, 35(11): 13-22.
[7] YANG Xuehong, HE Bin, WANG Luyan. Circulation Services Based on an Intelligent Library Management System: A Case Study in the CAU Library [J]. Journal of library and information science in agriculture, 2021, 33(7): 92-99.
[8] CAI Siming. Construction of Academic Libraries Supporting Security Systems of Digital Academic Resources [J]. Journal of library and information science in agriculture, 2020, 32(9): 58-67.
[9] YAO Min. Comparative Study of Document Acquisition Model in Domestic Libraries under Network Environment [J]. Journal of library and information science in agriculture, 2018, 30(8): 156-159.
[10] TENG Da. Comparative Study on the Integration Model of Open Access Resource in Domestic University Libraries [J]. Journal of library and information science in agriculture, 2017, 29(9): 29-32.
[11] LIU Xiaolin. A Comparative Study of Information Commons Service Model in China’s University Libraries [J]. Journal of library and information science in agriculture, 2017, 29(8): 160-163.
[12] LIU Xueying. Comparative Study on the Reading and Promoting Service Modes in Domestic Libraries [J]. Journal of library and information science in agriculture, 2017, 29(1): 166-169.
[13] YAO Jia. Comparison of Chinese and Foreign University Library Service [J]. Journal of library and information science in agriculture, 2016, 28(7): 185-188.
[14] ZHANG Jin. Study on Maker Space Construction in Academic Libraries [J]. Journal of library and information science in agriculture, 2016, 28(6): 42-44.
[15] QIU Meng-wen, NIU Xiao-hong. Comparative Study of Institutional Repositories Between China and Japan [J]. Journal of library and information science in agriculture, 2016, 28(2): 125-128.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!