The effective assessment of normal university students’ competence in ideological and political education is a key factor in safeguarding the quality of curriculum-based ideological and political reform in basic education. In response to the lack of an indicator system for ideological and political education competence of normal university students, insufficient digital and intelligent evaluation methods, and a lack of digital evaluation platforms, this article first constructs an evaluation indicator system for ideological and political education competence of normal university students, and designs a corresponding evaluation questionnaire for ideological and political education competence. Next, a digital evaluation method for ideological and political education competence of normal university students is constructed. Based on the evaluation results, a BERT-TextCNN cascaded feature enhancement network (BERT-CFEN) and an educational intelligent agent for analyzing ideological and political education competence have been built, respectively. Furthermore, a dual-channel evaluation model for ideological and political education competence has been proposed to be established to enable quantitative assessment of ideological and political education competence of normal university students. The test on the constructed AIPEA dataset shows that the F1 of our method in identifying educational elements is 95.45%. Finally, a digital platform is constructed for the digital evaluation and visual analysis of ideological and political education competence of normal university students, and the evaluation method and platform are applied to evaluate the ideological and political education competence of three different grades of normal university students, verifying the effectiveness of the proposed method in evaluating the ideological and political education competence of normal university students.
由于目前没有用于思政育人能力测评的文本数据集,本研究构建了思政育人能力测评(Assessment of Ideological and Political Education Ability, AIPEA)数据集。AIPEA数据集共收集了11个学科的273份优秀教学范例,对其进行识别、提取和标注,最终得到了包含育人目标的定位与设计(B6)、育人资源的选取与组织(B7)、育人内容与课堂教学融合(B8)、育人方法的设计与创新(B9)、培育新型师生关系的能力(B10)、引导学生成为主体的能力(B11)、改进思政育人效果的能力(B13)7种能力的2 166条文本数据及对应类别标注。在标注中使用了以下三种方法:
LIX D. Cultivating a new generation capable of shouldering the mission of national rejuvenation: Progress and policy analysis of China’s six-year implementation of the fundamental task of fostering virtue through education [J]. People’s Education, 2024(17): 16-19 (Ch).
LIUJ X, WEIX D. Development and psychometric properties of an evaluation scale of curriculum ideological and political competence of medical professional course teachers[J]. Journal of Nursing Science, 2024, 39(13): 89-92. DOI: 10.3870/j.issn.1001-4152.2024.13.089(Ch ).
SUNL J, LIQ. An empirical study of foreign language teachers’ teaching competence in curriculum-based ideological education in intelligent era[J]. Technology Enhanced Foreign Language Education, 2024(5): 87-92. DOI: 10.20139/j.issn.1001-5795.20240513 (Ch ).
XINGF, CHENK, RONGC, et al. Research on the current situation and improvement strategies of curriculum ideological and political consciousness and ability of teaching innovation teams for higher vocational college teachers[J]. Chinese Vocational and Technical Education, 2024(17): 78-87 (Ch).
GAOY L, ZHANGZ Y. Toward a structural model of college English teachers' teaching competence in curriculum—Based political and virtuous awareness[J]. Technology Enhanced Foreign Language Education, 2022(1): 8-14 (Ch).
GONGL P. Model construction of physical education teacher’s ideological and political ability[J]. Journal of Chengdu Sport University, 2022, 48(5): 111-116. DOI: 10.15942/j.jcsu.2022.05.018 Ch .
LINN. Design and implementation of the index system for the cultivating of “ideological-political education” literacy of teachers in preschool education[J]. Journal of Shaanxi Xueqian Normal University, 2023, 39(7): 111-116. DOI: 10.11995/j.issn.2095-770X.2023.07.014(Ch ).
ZHANGY F. The connotation, value, and enhancement of middle-school ideological and political teachers’ educative capacity [J]. Teaching Reference of Middle School Politics, 2023(31): 63-66 (Ch).
CHENS W. The elements composition and modeling of curriculum ideological and political literacy of professional course teachers in vocational colleges[J]. Journal of Vocational Education, 2023, 39(10): 115-122 (Ch).
DONGC X, FANS M, GAOY L. Theoretical basis and structural system construction of the curriculum ideological and political elements in physical education major[J]. Journal of Physical Education, 2021, 28(1): 7-13. DOI: 10.16237/j.cnki.cn44-1404/g8.2021.01.001(Ch ).
LIUG C, CHENJ Y, CHENY Z. The construction concept, practical path, and effectiveness evaluation of ideological and political education in the course of “Auditing” [J]. Communication of Finance and Accounting, 2024(5): 160-165. DOI: 10.16144/j.cnki.issn1002-8072.2024.05.026(Ch ).
LIUZ Y, DONGB R, WANGR. Research on the evaluation of the effectiveness of course ideological and political con-struction: A case study of the “accounting” course at Nanjing Audit University [J]. Communication of Finance and Accounting, 2022(22): 42-46. DOI: 10.16144/j.cnki.issn1002-8072.2022.22.028(Ch ).
XUX Y, WANGJ J. The construction of the comprehenive evaluation index system for curriculum ideological and political education in colleges and universities: Based on the theoretical framework of the CIPP evaluation model[J]. Journal of Higher Education Management, 2022, 16(1): 47-60. DOI: 10.13316/j.cnki.jhem.20211224.005(Ch ).
WEIP W, ZHUK, YEH Z, et al. Construction of precision teaching ability evaluation model for college teachers based on BP neural network[J]. Journal of Henan Normal University (Natural Science Edition), 2024, 52(5): 108-116. DOI: 10.16366/j.cnki.1000-2367.2023.12.05.0001(Ch ).
ZHANGY C, TANGL, MAC L. Research on the path and countermeasures of artificial intelligence to facilitate teacher development[J]. e⁃Education Research, 2023, 44(10): 104-111. DOI: 10.13811/j.cnki.eer.2023.10.014(Ch ).
YANGK F, JIANGX W, SHIZ Y. “Five-in-one” practice mode for training it teachers’ instructional skills based on mobile learning[J]. Computer Education, 2023(4): 92-96. DOI: 10.16512/j.cnki.jsjjy.2023.04.001(Ch ).
YANGK F, LIJ C, XUY, et al. Virtual interactive teaching skills training mode for normal students in educational metaverse perspective[J]. Computer Science, 2024, 51(10): 144-152. DOI: 10.11896/jsjkx.240400120 (Ch ).
SUNF Q, XUX X, SHENX J, et al. The practice research of teachers portrait under the background of AI-based precision teaching research[J]. China Educational Technology, 2024(10): 112-119. DOI: 10.3969/j.issn.1006-9860.2024.10.015(Ch ).
[39]
RINJENIT P, INDRIAWANA, RAKHMAWATIN A. Matching scientific article titles using cosine similarity and jaccard similarity algorithm[J]. Procedia Computer Science, 2024, 234: 553-560. DOI: 10.1016/j.procs.2024.03.039 .
[40]
CHAABIY, ATAA ALLAHF. Amazigh spell checker using Damerau-Levenshtein algorithm and N-gram[J]. Journal of King Saud University - Computer and Information Sciences, 2022, 34(8): 6116-6124. DOI: 10.1016/j.jksuci.2021.07.015 .
DAIX L, LIUS F, GONGD Q. Text similarity detection method based on NLP[J]. Journal on Communications, 2021, 42(10): 173-181. DOI: 10.11959/j.issn.1000.436.2021192(Ch ).
[43]
DODIAS, SPOORTHYV, CHANDAKT. Machine learning-based automated system for subjective answer evaluation[C]//2023 IEEE International Conference on Electronics, Computing and Communication Technologies New York: IEEE Press, 2023: 1-6. DOI: 10.1109/CONECCT57959.2023.10234818 .
[44]
LINY H, SHENH Y. SmartQ: A question and answer system for supplying high-quality and trustworthy answers[C]//2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS). New York: IEEE Press, 2014: 744-751. DOI: 10.1109/PADSW.2014.7097877 .
CHENS, LIL. Enhanced data augmentation improves generalisation of automated short answer scoring[J]. Journal of Chinese Information Processing, 2022, 36(11): 110-120. DOI: 10.3969/j.issn.1003-0077.2022.11.011(Ch ).
WANGS J, GONGJ F, WANGY F, et al. Key points matching based scoring method for liberal arts subjective questions[J]. Journal of Chinese Information Processing, 2023, 37(6): 165-178. DOI: 10.3969/j.issn.1003-0077.2023.06.020(Ch ).
[49]
SAATYR W. The analytic hierarchy process—What it is and how it is used[J]. Mathematical Modelling, 1987, 9(3/4/5): 161-176. DOI: 10.1016/0270-0255(87)90473-8 .
GES L. Determination of functional evaluation coefficient by 1-9 scale method[J]. Value Engineering, 1989, 8(1): 33-34. DOI: 10.14018/j.cnki.cn13-1085/n.1989.01.014(Ch ).
TIANP F, LIUH Y, GAOF, et al. Judicial named entity recognition by ontology prompt guidance based on large language model[J]. Journal of Wuhan University (Natural Science Edition), 2025, 71(2): 219-231. DOI: 10.14188/j.1671-8836.2024.0027(Ch ).
[54]
DEVLINJ, CHANGM W, LEEK, et al. BERT: Pre-training of deep bidirectional transformers for language understanding[C]// Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Stroudsburg:Association for Computational Linguistics, 2019:4171-4186. DOI: 10.18653/v1/N19-1423 .
[55]
KIMY. Convolutional neural networks for sentence classification[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Stroudsburg: Association for Computational Linguistics, 2014: 1746-1751. DOI: 10.3115/v1/d14-1181 .