基于眼动追踪技术的 VR 学习环境优化设计

Optimization design of VR learning environment based on eye-tracking technology

摘要

为系统评估虚拟现实(virtual reality,VR)学习环境中不同交互方式对学习者认知负荷的优化效果,设计了一套适用于 VR 学习环境的二维眼动数据可视化管道.研究招募了30名非历史专业本科生,在虚拟博物馆学习环境中开展随机对照实验,结合知识水平前后测问卷与1128378份瞳孔直径数据,对基于眼动追踪的视觉引导与反馈机制进行验证.结果显示:在知识水平方面,实验组被试的后测成绩显著优于对照组(P<0.05);在认知负荷与注意力表现方面,2组被试的瞳孔平均直径及变化幅度均存在极显著差异(P<0.001),表明优化后的交互设计能有效调节学习者的认知努力程度.可见,基于眼动追踪的 VR 学习环境优化设计能显著提升学习者知识习得效率并改善其认知体验,为沉浸式学习环境的设计与教学应用提供了实证依据.

Abstract

To systematically evaluate the optimization effects of different interaction methods on learners' cognitive load in a virtual reality (VR) learning environment, this study designed an eye-tracking data visualization pipeline suitable for VR learning environments. Thirty non-history major undergraduates were recruited to conduct a randomized controlled experiment in a virtual museum learning environment. The visual guidance and feedback mechanism based on eye-tracking was validated using pre-and post-test knowledge questionnaires and 1128378 pupil diameter data points. The results showed that in terms of knowledge acquisition, the post-test scores of the experimental group were significantly higher than those of the control group (P<0.05). In terms of cognitive load and attention performance, there were extremely significant differences in both the mean pupil diameter and the amplitude of change between the two groups (P<0.001), indicating that the optimized interaction design can effectively regulate learners' cognitive effort. Thus, the optimization design of VR learning environments based on eye-tracking can significantly enhance knowledge acquisition efficiency and improve cognitive experience, providing practical evidence for the design and instructional application of immersive learning environments.

关键词

眼动追踪 / 虚拟现实 / 学习分析 / 数据可视化

Key words

eye-tracking / virtual reality / learning analytics / data visualization

参考文献

[1] CHECA D, BUSTILLO A. Advantages and limits of virtual reality in learning processes: briviesca in the fifteenth century[J]. Virtual Reality, 2020, 24(1): 151-161.

[2] LOPEZ M, ARRIAGA J G C, NIGENDA ÁLVAREZ J P, et al. Virtual reality vs traditional education: Is there any advantage in human neuroanatomy teaching?[J]. Computers & Electrical Engineering, 2021, 93: 107282.

[3] ALEXANDER B, ASHFORD-ROWE K, BARAJAS-MURPHY N, et al. EDUCAUSE horizon report: 2019 higher education edition[EB/OL]. [2025-04-28]. https://eprints.qut.edu.au/233648/1/2019horizonreport.pdf.

[4] RAPPANA A, LEDGER S, TEO T, et al. The use of eye tracking technology to explore learning and performance within virtual reality and mixed reality settings: a scoping review[J]. Interactive Learning Environments, 2022, 30(7): 1338-1350.

[5] JEONG D, JEONG M, YANG U, et al. Eyes on me: investigating the role and influence of eye-tracking data on user modeling in virtual reality[J]. PLoS One, 2022, 17(12): e0278970.

[6] SHI Y M, DU J, WORTHY D A. The impact of engineering information formats on learning and execution of construction operations: a virtual reality pipe maintenance experiment[J]. Automation in Construction, 2020, 119: 103367.

[7] 刘妍, 胡碧皓, 尹欢欢, 等. 虚拟现实(VR)沉浸式环境如何实现深度取向的学习投入?:复杂任务情境中的学习效果研究[J]. 远程教育杂志, 2021, 39(4): 72-82.

[8] 李迎静. 基于用户认知负荷理论的虚拟现实在线教育多通道交互研究[D].南京:东南大学, 2022.

[9] SHADIEV R, LI D D. A review study on eye-tracking technology usage in immersive virtual reality learning environments[J]. Computers & Education, 2023, 196: 104681.

[10] 高楠, 刘革平, 谢涛, 等. 沉浸式虚拟现实对学习者知识迁移效果及效率的影响研究[J]. 远程教育杂志, 2023, 41(1): 91-101.

[11] 杨清. 打开注意力“黑盒”:虚拟现实学习环境中的眼动追踪技术开发与应用[D].杭州:杭州师范大学, 2024.

[12] ZHOU Y Z, FENG T, SHUAI S H, et al. EDVAM: a 3D eye-tracking dataset for visual attention modeling in a virtual museum[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(1): 101-112.

[13] 程时伟, 孙凌云. 眼动数据可视化综述[J]. 计算机辅助设计与图形学学报, 2014, 26(5): 698-707.

[14] UGWITZ P, KVARDÁ O, JURÍKOVÁ Z, et al. Eye-tracking in interactive virtual environments: implementation and evaluation[J]. Applied Sciences, 2022, 12(3): 1027.

[15] RADIANTI J, MAJCHRZAK T A, FROMM J, et al. A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda[J]. Computers & Education, 2020, 147: 103778.

[16] 王国华, 田梁浩, 聂胜欣, 等. 多媒体学习中表征认知负荷的眼动指标研究[J]. 电化教育研究, 2023, 44(10): 54-62.

[17] JUST M A, CARPENTER P A. The intensity dimension of thought: pupillometric indices of sentence processing[J]. Revue Canadienne de Psychologie Expérimentale, 1993, 47(2): 310-339.

[18] 李金波. 网络学习环境中影响学习者认知负荷的因素[J]. 电化教育研究, 2009, 30(9): 37-41.

[19] HAHNEMANN D, BEATTY J. Pupillary responses in a pitch-discrimination task[J]. Perception & Psychophysics, 1967, 2(3): 101-105.

[20] MAYER R E. Multimedia learning[M]. Cambridge: Cambridge University Press, 2001: 85-139.