Evaluation of the STEM Training Program Implementation in Riau Province: Analysis of Participant Responses in 2023 and 2024

Abstract

This study evaluates a collaborative STEM training program conducted by the Southeast Asian Ministers of Education Organization Regional Centre for Quality Improvement of Teachers and Education Personnel in Science (SEAQIS) in partnership with PT Pertamina Hulu Rokan (PT PHR) during 2023 and 2024. Utilizing a mixed-methods comparative cross-sectional design, data were collected via purposive sampling from 116 teachers, principals, and supervisors (comprising independent cohorts of n=58 in 2023 and n=58 in 2024) across four regencies in Riau Province. Quantitative data, gathered via a highly reliable Likert-scale questionnaire ( = 0.945), were analyzed using percentages and the non-parametric Mann-Whitney U test to evaluate differences between the two independent cohorts. Qualitative, open-ended responses were analyzed thematically. The findings reveal that the program was well received, with over 90% of participants reporting positive outcomes. Statistical analysis indicated no significant differences across all aspects (p > 0.05), including training materials, pedagogical impact, facilitator performance and time allocation, demonstrating highly consistent program effectiveness. However, qualitative findings identified the need for extended duration for complex content, more robust discussion sessions, and continuous follow-up activities to ensure effective classroom application. Ultimately, this study contributes to the discourse on STEM-based Teacher Professional Development (TPD) in developing countries by demonstrating how longitudinal public-private partnerships can provide consistent professional growth, while highlighting the necessity of sustained post-training support to bridge the gap between teacher perception and practical implementation.