Tracing Knowledge States through Student Assessment in a Blended Learning Environment

Indriana Hidayah(1), Ebedia Hilda Am(2),

DOI: https://doi.org/10.15294/jte.v15i2.47861


(1) Universitas Gadjah Mada, Indonesia
(2) Universitas Gadjah Mada, Indonesia

Abstract

Blended learning has recently acquired popularity in a variety of educational settings. This approach has the advantage of being able to autonomously monitor students' knowledge states using the collected learning data. Moodle is the most widely used learning management system in blended learning environments. Students can access Moodle to obtain supplementary materials, exercises, and assessments to complement their face-to-face meetings. However, its performance can be improved by more effectively tailoring students' skills and pace of learning. Several studies have been conducted on knowledge tracing; however, we have not discovered any studies that particularly investigate knowledge tracing in a blended learning setting with Moodle as a component. This study proposes a scheme for assessment using the features of the Moodle quiz platform. The assessment data is used to conduct knowledge tracing with the Bayesian Knowledge Tracing (BKT) model, which improves interpretability. The aforementioned data were collected from information engineering undergraduate students who completed 88 exercises that assessed 23 knowledge components within the course. We measure RMSE and MAE to evaluate the performance of the BKT model on our dataset. Furthermore, we compare the knowledge tracing performance to other well-known datasets. Our results show that the BKT model performed better with our dataset, with an RMSE of 0.314 and an MAE of 0.197. Moreover, the BKT model can be used to assess student performance and determine the level of mastery for each knowledge component. Thus, the outcomes can be applied to personalized learning in the future.

Keywords

bayesian knowledge tracing; blended learning; knowledge state; Moodle

Full Text:

PDF

References

X. Li, Y. Yang, S. K. W. Chu, Z. Zainuddin, and Y. Zhang, “Applying blended synchronous teaching and learning for flexible learning in higher education: an action research study at a university in Hong Kong,” Asia Pacific J. Educ., vol. 42, no. 2, pp. 211–227, 2022, doi: 10.1080/02188791.2020.1766417.

L. J. López-Reyes, A. L. Jiménez-Gutiérrez, and D. Costilla-López, “The Effects of Blended Learning on the Performance of Engineering Students in Mathematical Modeling,” Educ. Sci., vol. 12, no. 12, 2022, doi: 10.3390/educsci12120931.

H. C. Wei, Y. H. Lin, and L. H. Chang, “The Effectiveness of a Blended Learning-Based Life Design Course: Implications of Instruction and Application of Technology,” SN Comput. Sci., vol. 4, no. 4, pp. 1–13, 2023, doi: 10.1007/s42979-023-01730-3.

D. Evenhouse, Y. Lee, E. Berger, J. F. Rhoads, and J. DeBoer, “Engineering student experience and self-direction in implementations of blended learning: a cross-institutional analysis,” Int. J. STEM Educ., vol. 10, no. 1, pp. 1–22, 2023, doi: 10.1186/s40594-023-00406-x.

D. Adinda and N. Mohib, “Teaching and instructional design approaches to enhance students’ self-directed learning in blended learning environments,” Electron. J. e-Learning, vol. 18, no. 2, pp. 162–174, 2020, doi: 10.34190/EJEL.20.18.2.005.

C. C. Y. Yang and H. Ogata, “Personalized learning analytics intervention approach for enhancing student learning achievement and behavioral engagement in blended learning,” Educ. Inf. Technol., vol. 28, no. 3, pp. 2509–2528, 2023, doi: 10.1007/s10639-022-11291-2.

E. Ameloot, T. Rotsaert, and T. Schellens, “The supporting role of learning analytics for a blended learning environment: Exploring students’ perceptions and the impact on relatedness,” J. Comput. Assist. Learn., vol. 38, no. 1, pp. 90–102, 2022, doi: 10.1111/jcal.12593.

J. Mandlazi, A. Jadhav, and R. Ajoodha, “Educational data mining: Using knowledge tracing as a tool for student success,” 2021 3rd Int. Multidiscip. Inf. Technol. Eng. Conf. IMITEC 2021, pp. 1–7, 2021, doi: 10.1109/IMITEC52926.2021.9714608.

L. Meng, M. Zhang, W. Zhang, and Y. Chu, “CS-BKT: introducing item relationship to the Bayesian knowledge tracing model,” Interact. Learn. Environ., vol. 29, no. 8, pp. 1393–1403, 2019, doi: 10.1080/10494820.2019.1629600.

H. Wan, Z. Zhong, L. Tang, and X. Gao, “Pedagogical Interventions in SPOCs: Learning Behavior Dashboards and Knowledge Tracing Support Exercise Recommendation,” IEEE Trans. Learn. Technol., vol. 16, no. 3, pp. 431–442, 2023, doi: 10.1109/TLT.2023.3242712.

G. Abdelrahman, Q. Wang, and B. Nunes, “Knowledge Tracing: A Survey,” ACM Comput. Surv., vol. 55, no. 11, pp. 1–37, 2023, doi: 10.1145/3569576.

Y. Mao, C. Lin, and M. Chi, “Deep Learning vs. Bayesian Knowledge Tracing: Student Models for Interventions,” J. Educ. data Min., vol. 10, no. 2, pp. 28–54, 2018.

K. Zhang and Y. Yao, “A three learning states Bayesian knowledge tracing model,” Knowledge-Based Syst., vol. 148, pp. 189–201, 2018, doi: 10.1016/j.knosys.2018.03.001.

Z. Jin, K. Ma, K. Liu, and K. Ji, “Exercises Recommendation in Adaptive Learning System,” in Proceedings of the 2nd International Conference on Big Data Technologies, 2019, pp. 97–100.

X. Ding and E. C. Larson, “Why deep knowledge tracing has less depth than anticipated,” EDM 2019 - Proc. 12th Int. Conf. Educ. Data Min., no. Edm, pp. 282–287, 2019.

S. Pandey and G. Karypis, “A self-attentive model for knowledge tracing,” EDM 2019 - Proc. 12th Int. Conf. Educ. Data Min., pp. 384–389, 2019.

X. Ding and E. C. Larson, “Incorporating uncertainties in student response modeling by loss function regularization,” Neurocomputing, vol. 409, pp. 74–82, Oct. 2020, doi: 10.1016/j.neucom.2020.05.035.

W. Gan, Y. Sun, X. Peng, and Y. Sun, “Modeling learner’s dynamic knowledge construction procedure and cognitive item difficulty for knowledge tracing,” Appl. Intell., vol. 50, no. 11, pp. 3894–3912, 2020, doi: 10.1007/s10489-020-01756-7.

M. Khajah, R. V Lindsey, and M. C. Mozer, “How Deep is Knowledge Tracing?,” arXiv preprint arXiv:1604.02416, 2016.

S. Minn, “AI-assisted knowledge assessment techniques for adaptive learning environments,” Comput. Educ. Artif. Intell., vol. 3, no. July 2021, p. 100050, 2022, doi: 10.1016/j.caeai.2022.100050.

F. Liu, X. Hu, C. Bu, and K. Yu, “Fuzzy Bayesian Knowledge Tracing,” IEEE Trans. Fuzzy Syst., vol. 30, no. 7, pp. 2412–2425, 2022, doi: 10.1109/TFUZZ.2021.3083177.

Q. Liu, S. Shen, Z. Huang, E. Chen, and Y. Zheng, “A Survey of Knowledge Tracing,” IEEE Trans. Knowl. Data Eng., pp. 1–20, 2021.

A. Abyaa, M. Khalidi, and I. Samir, “Learner modelling : systematic review of the literature from the last 5 years,” Educ. Technol. Res. Dev., vol. 67, no. 5, pp. 1105–1143, 2019, doi: 10.1007/s11423-018-09644-1.

R. Pelánek, “Bayesian knowledge tracing, logistic models, and beyond : an overview of learner modeling techniques,” User Model. User-adapt. Interact., vol. 27, no. 3, pp. 313–350, 2017, doi: 10.1007/s11257-017-9193-2.

J. Zu, Q. Li, J. Lu, P. LV, and G. Yu, “Leveraging Cognitive Diagnosis to Improve Peer Assessment in MOOCs,” IEEE Access, vol. 9, pp. 50466–50484, 2021, doi: 10.1109/ACCESS.2021.3069055.

Refbacks

  • There are currently no refbacks.


Bookmark and Share