农业图书情报学报

• •    

大语言模型辅助检索降低了大学生认知负荷吗?——基于眼动实验分析

侯丽琴   

  1. 山西财经大学 图书馆,太原 030006
  • 收稿日期:2026-06-15 出版日期:2026-09-20
  • 作者简介:

    侯丽琴(1980- ),女,硕士研究生,山西财经大学图书馆,研究方向为图书馆情报学

  • 基金资助:
    山西省高校哲学社会科学研究项目“基于山西优秀文化下高职院校培育大学生文化自信研究与实践”(2022ZSSZSX237)

Large Language Model-Assisted Retrieval Reduces College Students' Cognitive Load: A Behavioral and Eye-Tracking Experiment Based on DeepSeek

HOU Liqin   

  1. Library of Shanxi University of Finance and Economics, Taiyuan 030006
  • Received:2026-06-15 Online:2026-09-20

摘要:

[目的/意义] 大学生学术检索长期面临两类压力,一类来自信息数量的持续增加,另一类来自检索、筛选、核验与整合过程本身的高强度认知投入;DeepSeek等大语言模型进入学术检索场景后,使用者得以绕开部分传统检索环节、直接面对模型整合后的文本输出。本研究旨在从主观与客观两个层面判断这一变化是否真正降低了大学生的认知负荷。 [方法/过程] 采用工具类型(DeepSeek与传统数据库,被试间)与任务复杂度(低、高,被试内)相结合的2×2混合实验设计,招募60名大学生,将DeepSeek与传统数据库置于同一框架下比较,结合NASA-TLX量表与基线校正瞳孔直径、总注视时间、回视率、目标兴趣区停留比例等眼动指标,以2×2混合方差分析考察大语言模型辅助检索对认知负荷的影响。 [结果/结论] DeepSeek条件下的主观负荷更低,基线校正瞳孔直径、总注视时间与回视率同步下降,目标兴趣区停留比例上升,检索报告质量未见下降;任务复杂度的调节作用主要体现在总注视时间与回视率上,在主观负荷与瞳孔指标上未达到显著水平;DeepSeek组的模型输出质量更高,学生核验质量却有所下降。大语言模型有助于减轻学术检索中的部分外在认知负荷,其作用主要体现于信息筛选、反复比较与跨文本整合等环节,但伴随来源核验投入的弱化;据此从工具设计与信息素养教育两个层面,提出降负荷与防依赖并重的建议。

关键词: 大语言模型, DeepSeek, 认知负荷, 眼动追踪, 信息检索

Abstract:

[Purpose/Significance] In the digital intelligence era, the way college students seek academic information is shaped by two distinct pressures: the continuously growing volume of information, and the high cognitive investment required for querying, screening, verifying and integrating sources. The advent of large language models (LLMs), such as DeepSeek, in academic information retrieval has transformed the ways users acquire information, allowing users to bypass part of the conventional retrieval process and to access the model's integrated textual output directly. However, whether the efficiency gains commonly attributed to such tools are genuinely accompanied by a reduction in cognitive load cannot be judged from self-report alone, because subjective ratings are susceptible to social desirability and post hoc rationalization. This study therefore sets out to examine whether LLM-assisted retrieval reduces the cognitive load experienced by college students experience across academic search tasks of varying complexity, from both subjective and objective perspectives. [Method/Process] A two-factor mixed experimental design was adopted, crossing tool type (DeepSeek versus a conventional academic database, a between-subjects factor) and task complexity (low versus high, a within-subjects factor). Sixty college students, balanced across disciplines and gender, were recruited. Each completed both a low-complexity fact-finding task and a high-complexity review-type task, with task order counterbalanced to control for practice and fatigue effects. Subjective load was measured with the NASA-TLX scale, and objective load with a set of eye-tracking indicators, including baseline-corrected pupil diameter, total fixation time, fixations per unit time, regression rate, and dwell proportion in the target area of interest. Retrieval report quality was scored by two blind raters and further decomposed into model-output quality, student-processing quality and student-verification quality, so that any reduction in verification effort could be observed separately. The data were analyzed with a 2 × 2 mixed-design analysis of variance, with partial η² as the effect-size index and simple-effect analyses following significant interactions. [Results/Conclusions] Compared to the conventional database, retrieval with DeepSeek produced statistically significant reduction in subjective load (tool main effect F(1,58)=14.0, p<0.001, partial η²=0.19), a significantly smaller baseline-corrected pupil diameter, a shorter total fixation time, a lower regression rate, and a higher proportion of time spent in the target area of interest. Retrieval report quality did not decline. The moderating effect of task complexity was statistically significant for total fixation time and regression rate (interaction F=13.9 and 5.7, respectively), where DeepSeek's advantage was larger in high-complexity tasks, but was not statistically significant for subjective load or pupil diameter. Notably, although model-output quality was higher in the DeepSeek group, student verification quality was about three points lower than in the conventional group, indicating that the reduction in load was accompanied by a contraction of verification effort. LMMs help to relieve part of the extraneous cognitive load in academic information retrieval, mainly at the stages of information screening, repeated comparison and cross-text integration, while leaving largely unchanged the intrinsic load of comprehending content. The benefit is double-edged: cognitive offloading may weaken memory retention and critical verification. The paper discusses the measurement validity of eye-tracking indicators and offers suggestions for tool design and information literacy education, arguing that the evaluation of retrieval tools should extend beyond efficiency and load to encompass knowledge retention, source verification and critical processing.

Key words: large language model (LLM), DeepSeek, cognitive load, eye-tracking, information retrieval

中图分类号:  G252.0,B842.1

引用本文

侯丽琴. 大语言模型辅助检索降低了大学生认知负荷吗?——基于眼动实验分析[J/OL]. 农业图书情报学报. https://doi.org/10.13998/j.cnki.issn1002-1248.26-0411.

HOU Liqin. Large Language Model-Assisted Retrieval Reduces College Students' Cognitive Load: A Behavioral and Eye-Tracking Experiment Based on DeepSeek[J/OL]. Journal of library and information science in agriculture. https://doi.org/10.13998/j.cnki.issn1002-1248.26-0411.