Evaluating Reproductive and Sexual Health Training for Red Cross Youth: The Kirkpatrick Model
DOI:
https://doi.org/10.15294/jone.v10i1.1803Keywords:
adolescent, reproductive, health, training, evaluationAbstract
In Indonesia, where cultural sensitivities and varying levels of awareness about sexual health exist, the need for tailored, culturally appropriate education is paramount. The Indonesian Red Cross (PMI) plays a pivotal role in community health initiatives, including sexual reproductive health education, by leveraging its wide network of volunteers. These volunteers are often on the frontline, engaging directly with the community, including adolescents, who are at a critical stage of developing attitudes and behaviors regarding their health. This study aims to evaluate the effectiveness of a sexual reproductive health training program for Indonesian Red Cross (PMI) volunteers in Langkat and Jombang districts, employing a mixed-methods approach based on the Kirkpatrick four-level evaluation model. The study utilizes an evaluative methodology with the Kirkpatrick model, involving data collection techniques through surveys, tests, interviews, and observations. It applies purposive sampling to 65 training participants, focusing on individuals who meet specific and relevant criteria. Data analysis is tailored to each level of Kirkpatrick's evaluation: Reaction, Learning, Behavior, and Results. Findings indicate a high level of participant satisfaction with the training material and its delivery, as well as an increase in knowledge and skills regarding adolescent sexual reproductive health. Despite significant improvements, the study identifies areas requiring enhancement. Evaluation success criteria were set using a Likert scale, allowing for objective and standardized measurement. The training program successfully enhanced the awareness and skills of PMI volunteers in addressing adolescent sexual reproductive health issues. This study provides essential insights for future improvements and development of training programs, emphasizing the importance of a comprehensive approach that involves technical, interpersonal, cultural aspects, and self-reflection in adolescent reproductive health education.
References
Adekola, A. P., & Mavhandu-Mudzusi, A. H. (2023). Addressing Learner-Centred Barriers to Sexuality Education in Rural Areas of South Africa: Learners’ Perspectives on Promoting Sexual Health Outcomes. Sexuality Research and Social Policy, 20(1). https://doi.org/10.1007/s13178-021-00651-1
Andoh, R. P. K., Annan-Prah, E. C., Owusu, E. A., & Agyei, P. M. (2023). Trainees’ aversions of employee training programs. European Journal of Training and Development, 47(7–8). https://doi.org/10.1108/EJTD-02-2022-0022
Baig, M. U. A., & Naqvi, S. M. M. R. (2023). Why trainees evaluate the same trainer differently? Examining a dual-process model of training effectiveness. European Journal of Training and Development, 47(1–2). https://doi.org/10.1108/EJTD-04-2021-0047
Belay, H. G., Arage, G., Degu, A., Getnet, B., Necho, W., Dagnew, E., Melkie, A., Seid, T., Bezie, M., Nibret, G., & Worke, M. D. (2021). Youth-friendly sexual and reproductive health services utilization and its determinants in Ethiopia: A systematic review and meta-analysis. Heliyon, 7(12). https://doi.org/10.1016/j.heliyon.2021.e08526
Bernardino, G., & Curado, C. (2020). Training evaluation: a configurational analysis of success and failure of trainers and trainees. European Journal of Training and Development, 44(4–5). https://doi.org/10.1108/EJTD-10-2019-0177
Bo, L., Cheng, S., & Li, D. (2020). Establishment and application of fuzzy comprehensive evaluation of green building design based on data mining. Journal of Intelligent and Fuzzy Systems, 38(6). https://doi.org/10.3233/JIFS-179759
BPS Indonesia, 2022. (2022). BPS Indonesia. Badan Statistik Indonesia, 2022, 1101001.
Cahapay, M. (2021). Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation. International Journal of Assessment Tools in Education, 8(1). https://doi.org/10.21449/ijate.856143
Cameron, A., Smith, E., Mercer, N., & Sundstrom, B. (2020). ‘It is our duty:’ understanding parents’ perspectives on reproductive and sexual health education. Sex Education, 20(5). https://doi.org/10.1080/14681811.2019.1704720
Cheng, Y., Cai, Y., Chen, H., Cai, Z., Wu, G., & Huang, J. (2021). A Cognitive Level Evaluation Method Based on a Deep Neural Network for Online Learning: From a Bloom’s Taxonomy of Cognition Objectives Perspective. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.661235
Corcoran, J. L., Davies, S. L., Knight, C. C., Lanzi, R. G., Li, P., & Ladores, S. L. (2020). Adolescents’ perceptions of sexual health education programs: An integrative review. In Journal of Adolescence (Vol. 84). https://doi.org/10.1016/j.adolescence.2020.07.014
D. Darmawan; D.Yatimah; K. Sasmita; R. Syah. (2020). Analysis of non-formal education tutor capabilities in exploring assessment for science learning. Jurnal Pendidikan IPA Indonesia, 9(2), 70–78. https://doi.org/10.15294/jpii.v9i2.24025
Dalimunthe, S., Toni, N., & Edward, Y. R. (2023). The Influence of Career Development and Training on Work Achievement with Work Motivation as an Intervening Variable (Case Study: Labuhan Batu District). International Journal of Research and Review, 10(2). https://doi.org/10.52403/ijrr.20230272
Darmawan, D., Kustandi, C., Syah, R., & Wasan, A. (2021). Implementation of Web-Based SECI Knowledge Management Model For Coastal Communities. Journal of Nonformal Education, 7(2), 166–172. https://doi.org/https://doi.org/10.15294/jne.v7i2.28056
Dewi, L. R., & Kartowagiran, B. (2018). An evaluation of internship program by using Kirkpatrick evaluation model. Research and Evaluation in Education, 4(2). https://doi.org/10.21831/reid.v4i2.22495
El Nsouli, D., Nelson, D., Nsouli, L., Curtis, F., Ahmed, S. I., McGonagle, I., Kane, R., & Ahmadi, K. (2023). The Application of Kirkpatrick’s Evaluation Model in the Assessment of Interprofessional Simulation Activities Involving Pharmacy Students: A Systematic Review. In American journal of pharmaceutical education (Vol. 87, Issue 8). https://doi.org/10.1016/j.ajpe.2023.02.003
Elangovan, N., & Rajendran, S. (2020). Impact of functional interdependency on employee satisfaction with performance appraisal in the real estate industry. Problems and Perspectives in Management, 18(4). https://doi.org/10.21511/ppm.18(4).2020.19
Envuladu, E. A., Massar, K., & de Wit, J. (2023). Healthcare workers’ delivery of adolescent responsive sexual and reproductive healthcare services: an assessment in Plateau state, Nigeria. BMC Women’s Health, 23(1). https://doi.org/10.1186/s12905-023-02288-1
Finlay, J. E., Assefa, N., Mwanyika-Sando, M., Dessie, Y., Harling, G., Njau, T., Chukwu, A., Oduola, A., Shah, I., Adanu, R., & Bukenya, J. (2020). Sexual and reproductive health knowledge among adolescents in eight sites across sub-Saharan Africa. Tropical Medicine and International Health, 25(1). https://doi.org/10.1111/tmi.13332
Fombona, J., Fombona-Pascual, A., & Vazquez-Cano, E. (2023). References on innovative methodologies for adult training. Studies in the Education of Adults, 55(1). https://doi.org/10.1080/02660830.2023.2166740
Fubam, R. M., Tendongfor, N., Olayemi, O., & Odukogbe, A. T. A. (2022). Sexual and reproductive health knowledge of secondary school adolescents in Fako, Cameroon. The Pan African Medical Journal, 41. https://doi.org/10.11604/pamj.2022.41.340.31686
Grosser, J., Bientzle, M., & Kimmerle, J. (2020). A literature review on the foundations and potentials of digital teaching scenarios for interprofessional health care education. In International Journal of Environmental Research and Public Health (Vol. 17, Issue 10). https://doi.org/10.3390/ijerph17103410
Jadwin-Cakmak, L., Bauermeister, J. A., Cutler, J. M., Loveluck, J., Kazaleh Sirdenis, T., Fessler, K. B., Popoff, E. E., Benton, A., Pomerantz, N. F., Gotts Atkins, S. L., Springer, T., & Harper, G. W. (2020). The Health Access Initiative: A Training and Technical Assistance Program to Improve Health Care for Sexual and Gender Minority Youth. Journal of Adolescent Health, 67(1). https://doi.org/10.1016/j.jadohealth.2020.01.013
Janighorban, M., Boroumandfar, Z., Pourkazemi, R., & Mostafavi, F. (2022). Barriers to vulnerable adolescent girls’ access to sexual and reproductive health. BMC Public Health, 22(1). https://doi.org/10.1186/s12889-022-14687-4
Jannat, S., Sifat, R. I., & Khisa, M. (2023). Sexual and Reproductive Health Conditions of Women: Insights from Rohingya Refugee Women in Bangladesh. Sexuality Research and Social Policy, 20(3). https://doi.org/10.1007/s13178-022-00758-z
Karanikola, Z., & Panagiotopoulos, G. (2023). Adult Education and Globally Engaged Trainers: The Case of Vocational Training Institutes. Education Sciences, 13(4). https://doi.org/10.3390/educsci13040362
Kaufman, R., & Keller, J. M. (1994). Levels of evaluation: Beyond Kirkpatrick. Human Resource Development Quarterly. https://doi.org/10.1002/hrdq.3920050408
Kemigisha, E., Bruce, K., Ivanova, O., Leye, E., Coene, G., Ruzaaza, G. N., Ninsiima, A. B., Mlahagwa, W., Nyakato, V. N., & Michielsen, K. (2019). Evaluation of a school based comprehensive sexuality education program among very young adolescents in rural Uganda. BMC Public Health, 19(1). https://doi.org/10.1186/s12889-019-7805-y
Keuroghlian, A. S., Mujugira, A., & Mayer, K. H. (2021). Healthcare worker training to improve quality of care for sexual and gender minority people in sub-Saharan Africa: learning from efforts in Uganda. In Journal of the International AIDS Society (Vol. 24, Issue S3). https://doi.org/10.1002/jia2.25728
Koppenhafer, L., Scott, K., Weaver, T., & Mulder, M. (2023). The service empowerment model: a collaborative approach to reducing vulnerability. Journal of Services Marketing, 37(7). https://doi.org/10.1108/JSM-10-2022-0317
Kulkova, I. A., Plutova, M. I., & Kuryachaya, E. A. (2019). The Effectiveness Assessment of Health Care Provider’s Additional Professional Training. IOP Conference Series: Earth and Environmental Science, 272(3). https://doi.org/10.1088/1755-1315/272/3/032212
Lee, S. H., Yeo, K. J., & Handayani, L. (2022). Development and validation of a sexual and reproductive health knowledge scale. International Journal of Public Health Science, 11(3). https://doi.org/10.11591/ijphs.v11i3.21570
Liang, M., Simelane, S., Fortuny Fillo, G., Chalasani, S., Weny, K., Salazar Canelos, P., Jenkins, L., Moller, A. B., Chandra-Mouli, V., Say, L., Michielsen, K., Engel, D. M. C., & Snow, R. (2019). The State of Adolescent Sexual and Reproductive Health. In Journal of Adolescent Health (Vol. 65, Issue 6). https://doi.org/10.1016/j.jadohealth.2019.09.015
Matondang, Z., Sitompul, H., & Wijaya, K. (2023). Implementation of Evaluation of Kirkpatrick Model in Statistics Course Based on Case Method at the Department of Building Engineering. Jurnal Penelitian Pendidikan IPA, 9(5). https://doi.org/10.29303/jppipa.v9i5.3371
Niati, D. R., Siregar, Z. M. E., & Prayoga, Y. (2021). The Effect of Training on Work Performance and Career Development: The Role of Motivation as Intervening Variable. Budapest International Research and Critics Institute (BIRCI-Journal): Humanities and Social Sciences, 4(2). https://doi.org/10.33258/birci.v4i2.1940
Nyanja, N., Nyamu, N., Nyaga, L., Chabeda, S., Lusambili, A., Temmerman, M., Mantel, M., & Ngugi, A. (2021). Application of the Ultra-Poverty Graduation Model in understanding community health volunteers’ preferences for socio-economic empowerment strategies to enhance retention: a qualitative study in Kilifi, Kenya. Human Resources for Health, 19(1). https://doi.org/10.1186/s12960-021-00645-5
O’Higgins, A., Sebba, J., & Luke, N. (2015). What is the relationship between being in care and the educational outcomes of children? Child and Family Social Work.
Olímpio, L. M., Spessoto, L. C. F., & Fácio, F. N. (2020). Sexual health education among undergraduate students of medicine. Translational Andrology and Urology, 9(2). https://doi.org/10.21037/tau.2020.02.13
Retnowati, E., Sutisna, A., & Warokka, A. (2023). Self-Capacity Development of Family Welfare Program Cadres in the E-Commerce Era. Journal of Nonformal Education, 9(1). https://doi.org/10.15294/jne.v9i1.39732
Sahni, J. (2020). Managerial training effectiveness: An assessment through Kirkpatrick framework. TEM Journal, 9(3). https://doi.org/10.18421/TEM93-51
Sasmita, K., Retnowati, E., Azizi, M. K., Hadiyanti, P., & Kuswantono, S. (2022). Empowerment of Youth Organizations in Building Awareness of a Clean and Healthy Environment Through Waste Banks. Journal of Nonformal Education, 8(1). https://doi.org/https://dx.doi.org/10.15294/jne.v8i1.34276
Savul, S., Ikram, A., Khan, M. A., & Khan, M. A. (2021). Evaluation of Infection Prevention and Control Training Workshops Using Kirkpatrick’s Model. International Journal of Infectious Diseases, 112. https://doi.org/10.1016/j.ijid.2021.09.005
S.E.U., K., M.D., P., S.C., W., A.R., L., T.J., C., E.J., B., CDC, Virginia Department of Education, Kolawole, A., Jaycox, L. H., McCaffrey, D. F., Ocampo, B. W., Shelley, G. A., Blake, S. M., Peterson, D. J., Richmond, L. S., Kub, J. E., Kivimäki, H., Saaristo, V., … Hall, J. (2018). Adolescent use of school-based health centers and high school dropout. Archives of Pediatrics and Adolescent Medicine, 5(1).
siga sumutpro.go.id. (2022). Data Kekerasan. Http://Siga.Sumutprov.Go.Id/Media/Data-Kekerasan/Kekerasan-Terhadap-Perempuan-Dan-Anak.
Somko, M. L., & Migda, N. S. (2023). Improving the staff training methodology. SHS Web of Conferences, 164. https://doi.org/10.1051/shsconf/202316400044
Stokking, K. M. (1996). Levels of evaluation: Kirkpatrick, Kaufman and Keller, and Beyond. Human Resource Development Quarterly, 7(2). https://doi.org/10.1002/hrdq.3920070208
Sutisna, A. (2015). Pengembangan model bimbingan teknis berkelanjutan dalam meningkatkan kompetensi tutor paket C. JIV-Jurnal Ilmiah Visi, 10(2). https://doi.org/10.21009/jiv.1002.4
Tamsuri, A. (2022). Literatur Review Penggunaan Metode Kirkpatrick untuk Evaluasi Pelatihan di Indonesia. Jurnal Inovasi Penelitian, 2(8).
Tilahun, T., Bekuma, T. T., Getachew, M., & Seme, A. (2021). Assessment of access and utilization of adolescent and youth sexual and reproductive health services in western Ethiopia. Reproductive Health, 18(1). https://doi.org/10.1186/s12978-021-01136-5
Todesco, M., Breman, J., Haryanto, N. N., Kok, G., & Massar, K. (2023). Effect evaluation of a comprehensive sexuality education intervention based on socio-emotional learning among adolescents in Jakarta, Indonesia. Front Public Health. 2023 Oct 2;11:1254717. Doi: 10.3389/Fpubh. https://doi.org/doi: 10.3389/fpubh.2023.1254717
Urbancová, H., Vrabcová, P., Hudáková, M., & Petrů, G. J. (2021). Effective training evaluation: The role of factors influencing the evaluation of effectiveness of employee training and development. Sustainability (Switzerland), 13(5). https://doi.org/10.3390/su13052721
Weyant, E. (2022). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 5th Edition. Journal of Electronic Resources in Medical Libraries, 19(1–2). https://doi.org/10.1080/15424065.2022.2046231
World Health Organization. (2021). Investing in our future: a comprehensive agenda for the health and well-being of children and adolescents. In Investing in our future: a comprehensive agenda for the health and well-being of children and adolescents. (Issue 11).
Yao, J., Ziapour, A., Abbas, J., Toraji, R., & NeJhaddadgar, N. (2022). Assessing puberty-related health needs among 10–15-year-old boys: A cross-sectional study approach. Archives de Pediatrie, 29(4). https://doi.org/10.1016/j.arcped.2021.11.018
Yurkofsky, M. M., Peterson, A. J., Mehta, J. D., Horwitz-Willis, R., & Frumin, K. M. (2020). Research on Continuous Improvement: Exploring the Complexities of Managing Educational Change. Review of Research in Education, 44(1). https://doi.org/10.3102/0091732X20907363
Downloads
Article ID
Published
Issue
Section
License
Copyright (c) 2024 Journal of Nonformal Education
This work is licensed under a Creative Commons Attribution 4.0 International License.
