An In-Depth Analysis of the Students' Perceptions of How the Final Exam Administered in Package C Program

Authors

  • Evy Ratna Kartika Waty Universitas Sriwijaya, Indonesia Author
  • Yanti Karmila Nengsih Universitas Sriwijaya, Indonesia Author
  • Ciptro Handrianto Universitas Negeri Padang, Indonesia Author
  • Shahid Rasool Florida Gulf Coast University, United States Author

DOI:

https://doi.org/10.15294/jone.v10i2.9960

Keywords:

Assessment, Students’ Perceptions, Limitation, Test Development, Test Administration, Test Evaluation, Final Examination

Abstract

Assessments are essential in influencing students' academic results, but there are still worries about the equity and thoroughness of tests created by tutors for different subjects. This research examines how students view these assessments in Citizenship Education, Islamic Religious Education, and History Education. The main goal is to investigate how Package C Program students view the distribution and quality of final exam questions and evaluate their preparedness and performance. This qualitative study used thematic analysis on interviews with 20 randomly chosen Package C Program students in Palembang. The information was examined to find common themes on how feel about their readiness and the tutors' involvement in creating exams. The results suggest that students believe the exam questions do not accurately represent their understanding or what they have learned. Numerous individuals are unhappy with mistakes in the test questions, which hinder their success. The study also identifies differences between students' anticipations and the real exam material. Prejudiced evaluation methods and varying test creation by educators can greatly harm student learning and the development of future educational policies. Improvements are necessary in exam design to guarantee fairness and accuracy. This research offers fresh perspectives on how the quality of exams affects student performance and highlights the necessity of inclusive test development with input from various parties to prevent biases.

References

Abdillah, F., Azmi, K., Hafizah, C. V., Anisha, D., Bintang, N. D., & Mulyani, S. (2023). Strategi Pelaksanaan Evaluasi Program Pendidikan Terhadap Kualitas Belajar Siswa di Sekolah. Jurnal Bintang Pendidikan Indonesia, 1(2), 13-23. https://doi.org/10.55606/jubpi.v1i2.1190

Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, Measurement, and Evaluation: Understanding and Use of the Concepts in Education. International Journal of Evaluation and Research in Education, 9(1), 109-119. https://doi.org/ 10.11591/ijere.v9i1.20457

Bhat, N., Deo, S. K., & Gurung, S. (2023). Assessing the quality of multiple-choice questions in allied health science summative exams: A retrospective analysis. Journal of Gandaki Medical College-Nepal, 16(2), 111-117. https://doi.org/10.3126/jgmcn.v16i2.55893

Bowman, T. G., Thrasher, A. B., Kasamatsu, T. M., & Lyons, S. M. (2024). Multistakeholder perceptions of young professionals’ integration during role transition. Journal of Athletic Training, 59(1), 99–110. https://doi.org/10.4085/1062-6050-0505.22

Braun, V., Clarke, V., Hayfield, N., Davey, L., Jenkinson, E. (2022). Doing Reflexive Thematic Analysis. In: Bager-Charleson, S., McBeath, A. (eds) Supporting Research in Counselling and Psychotherapy. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-13942-0_2

Brennan, R. L. (Ed.). (2023). Educational measurement. Rowman & Littlefield. https://eduq.info/xmlui/handle/11515/34503

Clayson, D. E. (2020). A comprehensive critique of student evaluation of teaching: Critical perspectives on validity, reliability, and impartiality. New York: Routledge. https://doi.org/10.4324/9781003091462

Cloutier, C., & Ravasi, D. (2021). Using tables to enhance trustworthiness in qualitative research. Strategic Organization, 19(1), 113–133. https://doi.org/10.1177/1476127020979329

Deterding, N. M., & Waters, M. C. (2021). Flexible coding of in-depth interviews: A twenty-first-century approach. Sociological methods & research, 50(2), 708-739. https://doi.org/10.1177/0049124118799377

Fatimah, S., & Rinawati, A. (2022). Pelatihan Penyusunan Instrumen Evaluasi Berbasis Higher Order Thinking Skills (HOTs) Untuk Guru MI di Kebumen. BERNAS: Jurnal Pengabdian Kepada Masyarakat, 3(2), 152-161. https://doi.org/10.31949/jb.v3i2.2190

Hirai, A., Oka, H., Kato, T., & Maeda, H. (2022). Development and validation of an English test measuring EFL learners’ critical thinking skills. Language Testing in Asia, 12(1), 45. https://doi.org/10.1186/s40468-022-00193-2

Hadi, D. A. (2020). Implementasi Model Pembelajaran Discovery Learning Berorientasi HOTS Pada Mata Pelajaran Matematika di SMK Negeri 7 Mataram. SUPERMAT: Jurnal Pendidikan Matematika, 4(1), 22-32. https://doi.org/10.33627/sm.v4i1.356

Hernon, O., McSharry, E., MacLaren, I., & Carr, P. J. (2023). The use of educational technology in teaching and assessing clinical psychomotor skills in nursing and midwifery education: A state-of-the-art literature review. Journal of Professional Nursing, 45, 35–50. https://doi.org/10.1016/j.profnurs.2023.01.005

Hidayat, M. S., Fitra, D., Susetyo, A. M., Amarulloh, R. R., & Ardiansyah, R. (2023). Pengantar Evaluasi Pendidikan. Penerbit Widina. https://books.google.hu/books?id=EgvYEAAAQBAJ&lpg=PA6&ots=yWjpygo_5h&lr&hl=id&pg=PA6#v=onepage&q&f=false

Kilag, O. K. T., Evangelista, T. P., Sasan, J. M., Librea, A. M., Zamora, R. M. C., Ymas, S. B., & Alestre, N. A. P. (2023). Promising Practices for a Better Tomorrow: A Qualitative Study of Successful Practices in Senior High School Education. Journal of Elementary and Secondary School, 1(1), 16-28. https://doi.org/10.31098/jess.v1i1.1379

Kubiszyn, T., & Borich, G. D. (2024). Educational testing and measurement. John Wiley & Sons. https://www.wiley.com/en-ae/Educational+Testing+and+Measurement%2C+11th+Edition-p-9781119228097

LaBelle, S., & Wozniak, T. (2023). Academic beliefs and prescription stimulant misuse among college students: Investigating academic locus of control, grade orientation, and academic entitlement. Journal of American College Health, 71(8), 2370-2379. https://doi.org/10.1080/07448481.2021.1968408

Leavy, P. (2022). Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. Guilford Publications. https://www.guilford.com/books/Research-Design/Patricia-Leavy/9781462548972

Liu, Z. Y., Lomovtseva, N., & Korobeynikova, E. (2020). Online learning platforms: Reconstructing modern higher education. International Journal of Emerging Technologies in Learning (iJET), 15(13), 4-21. Retrieved September 13, 2024 from https://www.learntechlib.org/p/217605/.

Luo, W., & Lim, S. Q. W. (2024). Perceived formative assessment and student motivational beliefs and self-regulation strategies: a multilevel analysis. Educational Psychology, 1–19. https://doi.org/10.1080/01443410.2024.2354686

Maldonado, J. E., & De Witte, K. (2022). The effect of school closures on standardised student test outcomes. British Educational Research Journal, 48(1), 49-94. https://doi.org/10.1002/berj.3754

Manfaat, B., Nurazizah, A., & Misri, M. A. (2021). Analysis of mathematics test items quality for high school. Jurnal Penelitian dan Evaluasi Pendidikan, 25(1), 108-117. http://dx.doi.org/10.21831/pep.v25i1.39174

Marjanovic-Shane, A., Kullenberg, T., & Gradovski, M. (2023). Scandinavian Experiments in Democratic Education. Dialogic Pedagogy, 11(2). 94-132. https://doi.org/10.5195/dpj.2023.477

Marzuki, I. (2024). Implementasi prinsip-prinsip evaluasi pembelajaran pada mata pelajaran Pendidikan Agama Islam. Tadarus Tarbawy: Jurnal Kajian Islam dan Pendidikan, 6(1). 91–97. http://dx.doi.org/10.31000/jkip.v6i1.11821

McHaney, R. (2023). The new digital shoreline: How Web 2.0 and millennials are revolutionising higher education. Taylor & Francis. https://dl.acm.org/doi/abs/10.5555/2018755

Meisuri, M., Nuswantoro, P., Mardikawati, B., & Judijanto, L. (2023). Technology Revolution in Learning: Building the Future of Education. Journal of Social Science Utilizing Technology, 1(4), 214-226. https://doi.org/10.70177/jssut.v1i4.660

Mohan, R. (2023). Measurement, evaluation and assessment in education. PHI Learning Pvt. Ltd.. https://www.alibris.com/Measurement-Evaluation-and-Assessment-in-Education-Radha-Mohan/book/35257945

Nartin, N., Faturrahman, F., Deni, A., Santoso, Y. H., Paharuddin, P., Suacana, I., ... & Eliyah, E. (2024). Metode penelitian kualitatif. Cendikia Mulia Mandiri. http://eprints2.ipdn.ac.id/1373/1/Metode%20Penelitian%20Kualitatif%20%28cover%20dan%20daftar%20isi%29.pdf

Nguyen, D., Harris, A., & Ng, D. (2020). A review of the empirical research on teacher leadership (2003–2017) Evidence, patterns and implications. Journal of educational administration, 58(1), 60–80. https://doi.org/10.1108/JEA-02-2018-0023

Park, B., & Cho, J. (2023). How does grade inflation affect student evaluation of teaching?. Assessment & Evaluation in Higher Education, 48(5), 723-735. https://doi.org/10.1080/02602938.2022.2126429

Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage publications. https://cir.nii.ac.jp/crid/1130282272245558272

Pratiwi, S. N., Prasetia, I., & Gajah, N. (2022). Literacy Culture in Elementary Schools: The Impact of the Literacy Movement Program and Library Facilities. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 8(3), 786-794. https://doi.org/10.33394/jk.v8i3.5559

Purwanto, A. (2020). University students online learning system during Covid-19 pandemic: Advantages, constraints and solutions. Sys Rev Pharm, 11(7), 570–576. Available at SSRN: https://ssrn.com/abstract=3986850

Rimfeld, K., Malanchini, M., Hannigan, L. J., Dale, P. S., Allen, R., Hart, S. A., & Plomin, R. (2019). Teacher assessments during compulsory education are as reliable, stable, and heritable as standardised test scores. Journal of Child Psychology and Psychiatry, 60(12), 1278-1288. https://doi.org/10.1111/jcpp.13070

Roche, A., Gervasoni, A., & Kalogeropoulos, P. (2023). Factors that promote interest and engagement in learning mathematics for low-achieving primary students across three learning settings. Mathematics Education Research Journal, 35(3), 525–556. https://doi.org/10.1007/s13394-021-00402-w

Rose, J., & Johnson, C. W. (2020). Contextualising reliability and validity in qualitative research: Toward more rigorous and trustworthy qualitative social science in leisure research. Journal of leisure research, 51(4), 432–451. https://doi.org/10.1080/00222216.2020.1722042

Rusyid, H. K., Suryadi, D., Herman, T., Adnan, M., Lutfi, A., & Mukhibin, A. (2024). Rasch modelling approach to measure the quality of algebraic thinking test item for junior high school students. Beta: Jurnal Tadris Matematika, 17(1), 44-58. https://doi.org/10.20414/betajtm.v17i1.652

Santisteban, L., & Egues, A. L. (2022). How do student evaluations of teaching contribute to the hindrance of faculty diversity? Teaching and Learning in Nursing. https://doi.org/10.1016/j.teln.2022.04.007

Susongko, P., Sunu, H. W. D., & Arfiani, Y. (2022, January). Student Moral Quality Measurement Framework Based on Ancient Javanese Philosophy. In 2nd International Conference on Social Science, Humanities, Education and Society Development (ICONS 2021) (pp. 195-201). Atlantis Press. https://doi.org/10.2991/assehr.k.220101.029

Tanjung, E. F., Harfiani, R., & Sampedro Hartanto, H. (2021). Formation Of Soul Leadership Model In Indonesian Middle Schools. Kuram ve Uygulamada Eğitim Bilimleri/Educational Sciences: Theory And Practice, 21(1), 84-97. https://psycnet.apa.org/record/2021-77803-007

Trigueros, R., Padilla, A., Aguilar-Parra, J. M., Lirola, M. J., García-Luengo, A. V., Rocamora-Pérez, P., & López-Liria, R. (2020). The influence of teachers on motivation and academic stress and their effect on the learning strategies of university students. International Journal of Environmental Research and Public Health, 17(23), 9089. https://doi.org/10.3390/ijerph17239089

Van Groen, M. M., & Eggen, T. J. (2020). Educational test approaches: The suitability of computer-based test types for assessment and evaluation in formative and summative contexts. Journal of Applied Testing Technology, 21(1), 12-24. Retrieved from http://www.jattjournal.net/index.php/atp/article/view/146484

Wang, Y., Derakhshan, A., Pan, Z., & Ghiasvand, F. (2023). Chinese EFL teachers’ writing assessment feedback literacy: A scale development and validation study. Assessing Writing, 56, 100726. https://doi.org/10.1016/j.asw.2023.100726

Weng, F. (2023). EFL teachers’ writing assessment literacy: Surveying teachers’ knowledge, beliefs, and practises in China. Porta Linguarum Revista Interuniversitaria de Didáctica de las Lenguas Extranjeras, (40), 57-74. https://doi.org/10.30827/portalin.vi40.23812

Wilson, M. (2023). Constructing measures: An item response modeling approach. New York: Routledge. https://doi.org/10.4324/9781003286929

Yan, Z., & Boud, D. (2021). Conceptualising assessment-as-learning. In Assessment as learning (pp. 11-24). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9781003052081-2/conceptualising-assessment-learning-zi-yan-david-boud

Yan, Z., Panadero, E., Wang, X., & Zhan, Y. (2023). A systematic review on students’ perceptions of self-assessment: usefulness and factors influencing implementation. Educational Psychology Review, 35(3), 81. https://doi.org/10.1007/s10648-023-09799-1

Downloads

Article ID

9960

Published

2024-08-20

How to Cite

Kartika Waty, E. R., Nengsih, Y. K., Handrianto, C., & Rasool, S. . (2024). An In-Depth Analysis of the Students’ Perceptions of How the Final Exam Administered in Package C Program. Journal of Nonformal Education, 10(2), 435-445. https://doi.org/10.15294/jone.v10i2.9960