An In-Depth Analysis of the Students' Perceptions of How the Final Exam Administered in Package C Program
DOI:
https://doi.org/10.15294/jone.v10i2.9960Keywords:
Assessment, Students’ Perceptions, Limitation, Test Development, Test Administration, Test Evaluation, Final ExaminationAbstract
Assessments are essential in influencing students' academic results, but there are still worries about the equity and thoroughness of tests created by tutors for different subjects. This research examines how students view these assessments in Citizenship Education, Islamic Religious Education, and History Education. The main goal is to investigate how Package C Program students view the distribution and quality of final exam questions and evaluate their preparedness and performance. This qualitative study used thematic analysis on interviews with 20 randomly chosen Package C Program students in Palembang. The information was examined to find common themes on how feel about their readiness and the tutors' involvement in creating exams. The results suggest that students believe the exam questions do not accurately represent their understanding or what they have learned. Numerous individuals are unhappy with mistakes in the test questions, which hinder their success. The study also identifies differences between students' anticipations and the real exam material. Prejudiced evaluation methods and varying test creation by educators can greatly harm student learning and the development of future educational policies. Improvements are necessary in exam design to guarantee fairness and accuracy. This research offers fresh perspectives on how the quality of exams affects student performance and highlights the necessity of inclusive test development with input from various parties to prevent biases.
References
Abdillah, F., Azmi, K., Hafizah, C. V., Anisha, D., Bintang, N. D., & Mulyani, S. (2023). Strategi Pelaksanaan Evaluasi Program Pendidikan Terhadap Kualitas Belajar Siswa di Sekolah. Jurnal Bintang Pendidikan Indonesia, 1(2), 13-23. https://doi.org/10.55606/jubpi.v1i2.1190
Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, Measurement, and Evaluation: Understanding and Use of the Concepts in Education. International Journal of Evaluation and Research in Education, 9(1), 109-119. https://doi.org/ 10.11591/ijere.v9i1.20457
Bhat, N., Deo, S. K., & Gurung, S. (2023). Assessing the quality of multiple-choice questions in allied health science summative exams: A retrospective analysis. Journal of Gandaki Medical College-Nepal, 16(2), 111-117. https://doi.org/10.3126/jgmcn.v16i2.55893
Bowman, T. G., Thrasher, A. B., Kasamatsu, T. M., & Lyons, S. M. (2024). Multistakeholder perceptions of young professionals’ integration during role transition. Journal of Athletic Training, 59(1), 99–110. https://doi.org/10.4085/1062-6050-0505.22
Braun, V., Clarke, V., Hayfield, N., Davey, L., Jenkinson, E. (2022). Doing Reflexive Thematic Analysis. In: Bager-Charleson, S., McBeath, A. (eds) Supporting Research in Counselling and Psychotherapy. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-13942-0_2
Brennan, R. L. (Ed.). (2023). Educational measurement. Rowman & Littlefield. https://eduq.info/xmlui/handle/11515/34503
Clayson, D. E. (2020). A comprehensive critique of student evaluation of teaching: Critical perspectives on validity, reliability, and impartiality. New York: Routledge. https://doi.org/10.4324/9781003091462
Cloutier, C., & Ravasi, D. (2021). Using tables to enhance trustworthiness in qualitative research. Strategic Organization, 19(1), 113–133. https://doi.org/10.1177/1476127020979329
Deterding, N. M., & Waters, M. C. (2021). Flexible coding of in-depth interviews: A twenty-first-century approach. Sociological methods & research, 50(2), 708-739. https://doi.org/10.1177/0049124118799377
Fatimah, S., & Rinawati, A. (2022). Pelatihan Penyusunan Instrumen Evaluasi Berbasis Higher Order Thinking Skills (HOTs) Untuk Guru MI di Kebumen. BERNAS: Jurnal Pengabdian Kepada Masyarakat, 3(2), 152-161. https://doi.org/10.31949/jb.v3i2.2190
Hirai, A., Oka, H., Kato, T., & Maeda, H. (2022). Development and validation of an English test measuring EFL learners’ critical thinking skills. Language Testing in Asia, 12(1), 45. https://doi.org/10.1186/s40468-022-00193-2
Hadi, D. A. (2020). Implementasi Model Pembelajaran Discovery Learning Berorientasi HOTS Pada Mata Pelajaran Matematika di SMK Negeri 7 Mataram. SUPERMAT: Jurnal Pendidikan Matematika, 4(1), 22-32. https://doi.org/10.33627/sm.v4i1.356
Hernon, O., McSharry, E., MacLaren, I., & Carr, P. J. (2023). The use of educational technology in teaching and assessing clinical psychomotor skills in nursing and midwifery education: A state-of-the-art literature review. Journal of Professional Nursing, 45, 35–50. https://doi.org/10.1016/j.profnurs.2023.01.005
Hidayat, M. S., Fitra, D., Susetyo, A. M., Amarulloh, R. R., & Ardiansyah, R. (2023). Pengantar Evaluasi Pendidikan. Penerbit Widina. https://books.google.hu/books?id=EgvYEAAAQBAJ&lpg=PA6&ots=yWjpygo_5h&lr&hl=id&pg=PA6#v=onepage&q&f=false
Kilag, O. K. T., Evangelista, T. P., Sasan, J. M., Librea, A. M., Zamora, R. M. C., Ymas, S. B., & Alestre, N. A. P. (2023). Promising Practices for a Better Tomorrow: A Qualitative Study of Successful Practices in Senior High School Education. Journal of Elementary and Secondary School, 1(1), 16-28. https://doi.org/10.31098/jess.v1i1.1379
Kubiszyn, T., & Borich, G. D. (2024). Educational testing and measurement. John Wiley & Sons. https://www.wiley.com/en-ae/Educational+Testing+and+Measurement%2C+11th+Edition-p-9781119228097
LaBelle, S., & Wozniak, T. (2023). Academic beliefs and prescription stimulant misuse among college students: Investigating academic locus of control, grade orientation, and academic entitlement. Journal of American College Health, 71(8), 2370-2379. https://doi.org/10.1080/07448481.2021.1968408
Leavy, P. (2022). Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. Guilford Publications. https://www.guilford.com/books/Research-Design/Patricia-Leavy/9781462548972
Liu, Z. Y., Lomovtseva, N., & Korobeynikova, E. (2020). Online learning platforms: Reconstructing modern higher education. International Journal of Emerging Technologies in Learning (iJET), 15(13), 4-21. Retrieved September 13, 2024 from https://www.learntechlib.org/p/217605/.
Luo, W., & Lim, S. Q. W. (2024). Perceived formative assessment and student motivational beliefs and self-regulation strategies: a multilevel analysis. Educational Psychology, 1–19. https://doi.org/10.1080/01443410.2024.2354686
Maldonado, J. E., & De Witte, K. (2022). The effect of school closures on standardised student test outcomes. British Educational Research Journal, 48(1), 49-94. https://doi.org/10.1002/berj.3754
Manfaat, B., Nurazizah, A., & Misri, M. A. (2021). Analysis of mathematics test items quality for high school. Jurnal Penelitian dan Evaluasi Pendidikan, 25(1), 108-117. http://dx.doi.org/10.21831/pep.v25i1.39174
Marjanovic-Shane, A., Kullenberg, T., & Gradovski, M. (2023). Scandinavian Experiments in Democratic Education. Dialogic Pedagogy, 11(2). 94-132. https://doi.org/10.5195/dpj.2023.477
Marzuki, I. (2024). Implementasi prinsip-prinsip evaluasi pembelajaran pada mata pelajaran Pendidikan Agama Islam. Tadarus Tarbawy: Jurnal Kajian Islam dan Pendidikan, 6(1). 91–97. http://dx.doi.org/10.31000/jkip.v6i1.11821
McHaney, R. (2023). The new digital shoreline: How Web 2.0 and millennials are revolutionising higher education. Taylor & Francis. https://dl.acm.org/doi/abs/10.5555/2018755
Meisuri, M., Nuswantoro, P., Mardikawati, B., & Judijanto, L. (2023). Technology Revolution in Learning: Building the Future of Education. Journal of Social Science Utilizing Technology, 1(4), 214-226. https://doi.org/10.70177/jssut.v1i4.660
Mohan, R. (2023). Measurement, evaluation and assessment in education. PHI Learning Pvt. Ltd.. https://www.alibris.com/Measurement-Evaluation-and-Assessment-in-Education-Radha-Mohan/book/35257945
Nartin, N., Faturrahman, F., Deni, A., Santoso, Y. H., Paharuddin, P., Suacana, I., ... & Eliyah, E. (2024). Metode penelitian kualitatif. Cendikia Mulia Mandiri. http://eprints2.ipdn.ac.id/1373/1/Metode%20Penelitian%20Kualitatif%20%28cover%20dan%20daftar%20isi%29.pdf
Nguyen, D., Harris, A., & Ng, D. (2020). A review of the empirical research on teacher leadership (2003–2017) Evidence, patterns and implications. Journal of educational administration, 58(1), 60–80. https://doi.org/10.1108/JEA-02-2018-0023
Park, B., & Cho, J. (2023). How does grade inflation affect student evaluation of teaching?. Assessment & Evaluation in Higher Education, 48(5), 723-735. https://doi.org/10.1080/02602938.2022.2126429
Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage publications. https://cir.nii.ac.jp/crid/1130282272245558272
Pratiwi, S. N., Prasetia, I., & Gajah, N. (2022). Literacy Culture in Elementary Schools: The Impact of the Literacy Movement Program and Library Facilities. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 8(3), 786-794. https://doi.org/10.33394/jk.v8i3.5559
Purwanto, A. (2020). University students online learning system during Covid-19 pandemic: Advantages, constraints and solutions. Sys Rev Pharm, 11(7), 570–576. Available at SSRN: https://ssrn.com/abstract=3986850
Rimfeld, K., Malanchini, M., Hannigan, L. J., Dale, P. S., Allen, R., Hart, S. A., & Plomin, R. (2019). Teacher assessments during compulsory education are as reliable, stable, and heritable as standardised test scores. Journal of Child Psychology and Psychiatry, 60(12), 1278-1288. https://doi.org/10.1111/jcpp.13070
Roche, A., Gervasoni, A., & Kalogeropoulos, P. (2023). Factors that promote interest and engagement in learning mathematics for low-achieving primary students across three learning settings. Mathematics Education Research Journal, 35(3), 525–556. https://doi.org/10.1007/s13394-021-00402-w
Rose, J., & Johnson, C. W. (2020). Contextualising reliability and validity in qualitative research: Toward more rigorous and trustworthy qualitative social science in leisure research. Journal of leisure research, 51(4), 432–451. https://doi.org/10.1080/00222216.2020.1722042
Rusyid, H. K., Suryadi, D., Herman, T., Adnan, M., Lutfi, A., & Mukhibin, A. (2024). Rasch modelling approach to measure the quality of algebraic thinking test item for junior high school students. Beta: Jurnal Tadris Matematika, 17(1), 44-58. https://doi.org/10.20414/betajtm.v17i1.652
Santisteban, L., & Egues, A. L. (2022). How do student evaluations of teaching contribute to the hindrance of faculty diversity? Teaching and Learning in Nursing. https://doi.org/10.1016/j.teln.2022.04.007
Susongko, P., Sunu, H. W. D., & Arfiani, Y. (2022, January). Student Moral Quality Measurement Framework Based on Ancient Javanese Philosophy. In 2nd International Conference on Social Science, Humanities, Education and Society Development (ICONS 2021) (pp. 195-201). Atlantis Press. https://doi.org/10.2991/assehr.k.220101.029
Tanjung, E. F., Harfiani, R., & Sampedro Hartanto, H. (2021). Formation Of Soul Leadership Model In Indonesian Middle Schools. Kuram ve Uygulamada Eğitim Bilimleri/Educational Sciences: Theory And Practice, 21(1), 84-97. https://psycnet.apa.org/record/2021-77803-007
Trigueros, R., Padilla, A., Aguilar-Parra, J. M., Lirola, M. J., García-Luengo, A. V., Rocamora-Pérez, P., & López-Liria, R. (2020). The influence of teachers on motivation and academic stress and their effect on the learning strategies of university students. International Journal of Environmental Research and Public Health, 17(23), 9089. https://doi.org/10.3390/ijerph17239089
Van Groen, M. M., & Eggen, T. J. (2020). Educational test approaches: The suitability of computer-based test types for assessment and evaluation in formative and summative contexts. Journal of Applied Testing Technology, 21(1), 12-24. Retrieved from http://www.jattjournal.net/index.php/atp/article/view/146484
Wang, Y., Derakhshan, A., Pan, Z., & Ghiasvand, F. (2023). Chinese EFL teachers’ writing assessment feedback literacy: A scale development and validation study. Assessing Writing, 56, 100726. https://doi.org/10.1016/j.asw.2023.100726
Weng, F. (2023). EFL teachers’ writing assessment literacy: Surveying teachers’ knowledge, beliefs, and practises in China. Porta Linguarum Revista Interuniversitaria de Didáctica de las Lenguas Extranjeras, (40), 57-74. https://doi.org/10.30827/portalin.vi40.23812
Wilson, M. (2023). Constructing measures: An item response modeling approach. New York: Routledge. https://doi.org/10.4324/9781003286929
Yan, Z., & Boud, D. (2021). Conceptualising assessment-as-learning. In Assessment as learning (pp. 11-24). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9781003052081-2/conceptualising-assessment-learning-zi-yan-david-boud
Yan, Z., Panadero, E., Wang, X., & Zhan, Y. (2023). A systematic review on students’ perceptions of self-assessment: usefulness and factors influencing implementation. Educational Psychology Review, 35(3), 81. https://doi.org/10.1007/s10648-023-09799-1
Downloads
Article ID
Published
Issue
Section
License
Copyright (c) 2024 Evy Ratna Kartika Waty, Yanti Karmila Nengsih, Ciptro Handrianto, Shahid Rasool (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
