Email this article Development of Four-tier Multiple-choices Test to Diagnose Student's Misconception
Abstract
Studies in Indonesia delineate that junior high school students in Indonesia have low mastery of circle material. Students with low mastery of the material tend to have misconceptions. The goal of this study is to develop a four-tier diagnostic test for circle material to identify the level of their understanding, including misconception in circle material. This development used the ADDIE model. It comprises four phases: Analysis, Design, Development, Implementation, and Evaluation. The test developed consists of 20 items which four experts in learning mathematics have validated. They are two lecturers and two teachers of mathematics who have teaching experience of more than ten years. The validated test was implemented on 34 grade 8 students in Yogyakarta. From the test results obtained information, of the 20 test items, on average, have an ideal difficulty level. All items have a good discriminant index. Test reliability was estimated using the Cronbach Alpha formula. The estimation results show a test reliability coefficient of 0.72. Students as test respondents stated that the tests developed contained easy-to-understand instructions, easy-to-understand language, sufficient test time, clear pictures, and enough items. This test can help junior high school mathematics teachers in Indonesia to identify their students' misconceptions and level of understanding, especially regarding circle material.
Hasil-hasil studi menunjukkan siswa sekolah menengah pertama di Indonesia memiliki penguasaan yang rendah pada materi lingkaran. Siswa dengan penguasaan materi yang rendah terindikasi mengalami miskonsepsi. Penelitian ini bertujuan untuk mengembangkan tes diagnostik tipe four-tier pada materi lingkaran untuk mendiagnosis level pemahaman siswa pada materi lingkaran, termasuk miskonsepsi yang dialami siswa. Pengembangan ini menggunakan model ADDIE (Analysis, Design, Devalopment, Implementation, Evaluation). Tes yang dikembangkan terdiri atas 20 butir yang telah divalidasi oleh 4 orang ahli dalam pembelajaran matematika yang terdiri atas 2 orang dosen pembelajaran matematika dan 2 orang guru matematika yang memiliki pengalaman mengajar lebih dari 10 tahun. Tes yang sudah divalidasi diujicobakan kepada 34 siswa kelas 8 di Yogyakarta. Dari hasil uji coba didapat informasi bahwa dari 20 butir soal tes rata-rata memiliki tingkat kesukaran yang ideal. Keseluruhan butir memiliki daya pembeda yang baik. Keandalan tes diestimasi dengan menggunakan formula Cronbach Alpha. Hasil estimasi menunjukkan koefisien reliabilitas tes sebesar 0,72. Siswa sebagai responden uji coba menyatakan bahwa tes yang dikembangkan memuat petunjuk yang mudah dimengerti, bahasa yang mudah dipahami, waktu tes yang cukup, gambar yang jelas, dan jumlah butir soal yang cukup. Tes yang dikembangkan ini dapat membantu guru matematika sekolah menengah pertama di Indonesia untuk mengidentifikasi miskonsepsi dan level pemahaman siswanya, khususnya pada materi lingkaran.
Keywords
References
Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education, 9(1), 109–119. https://doi.org/10.11591/ijere.v9i1.20457
Aldoobie, N. (2015). ADDIE Model. American International Journal of Contemporary Research, 5(6), 68–72.
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/J.SAPHARM.2018.03.066
Aydin, S., Keles, U., & Hasiloglu, A. (2012). Establishment for misconceptions that science teacher candidates have about geometric optics. The Online Journal of New Horizons in Education, 2(3), 7–15.
Bhat, B. A. (2019). Formative and Summative Evaluation Techniques for Improvement of Learning Process. European Journal of Business and Social Sciences, 7(5), 776–785.
Brothen, T. (2012). Time Limits on Tests: Updating the 1-Minute Rule. Teaching of Psychology, 39(4), 288–292. https://doi.org/10.1177/0098628312456630
Caleon, I., & Subramaniam, R. (2010a). Development and application of a three-tier diagnostic test to assess secondary students’ understanding of waves. International Journal of Science Education, 32(7), 939–961. https://doi.org/10.1080/09500690902890130
Caleon, & Subramaniam, R. (2010b). Do students know What they know and what they don’t know? Using a four-tier diagnostic test to assess the nature of students’ alternative conceptions. Research in Science Education, 40(3), 313–337. https://doi.org/10.1007/s11165-009-9122-4
Chesky, N. Z., & Wolfmeyer, M. R. (2015). Philosophy of STEM Education. Philosophy of STEM Education. https://doi.org/10.1057/9781137535467
Clay, B. (2001). Is This a Trick Question? Is This a Trick. Kansas: Kansas Curriculum Center.
Dhakne-Palwe, S., Gujarathi, A., & Almale, B. (2015). Item Analysis of MCQs and Correlation between Difficulty Index, Discrimination Index and Distractor Efficiency in a Formative Examination in Community Medicine. Journal of Research in Medical Education & Ethics, 5(3), 254–259. https://doi.org/10.5958/2231-6728.2015.00052.9
Fritz, A., Haase, V. G., & Rasanen, P. (2019). International handbook of mathematical learning difficulties. Cham, Switzerland: Springer.
Gugiu, C., & Gugiu, M. (2018). Determining the Minimum Reliability Standard Based on a Decision Criterion. Journal of Experimental Education, 86(3), 458–472. https://doi.org/10.1080/00220973.2017.1315712
Gurel, D. K., Eryilmaz, A., & McDermott, L. C. (2015). A review and comparison of diagnostic instruments to identify students’ misconceptions in science. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 989–1008. https://doi.org/10.12973/eurasia.2015.1369a
Hingorjo, M. R., & Jaleel, F. (2012). Analysis of one-best MCQs: The difficulty index, discrimination index and distractor efficiency. Journal of the Pakistan Medical Association, 62(2), 142–147.
Kaltakci-Gurel, D., Eryilmaz, A., & McDermott, L. C. (2017). Development and application of a four-tier test to assess pre-service physics teachers’ misconceptions about geometrical optics. ReseaRch in science & Technological educaTion, 35(2), 238-260.
Kusmaryono, I., Basir, M. A., & Saputro, B. A. (2020). Ontological Misconception in Mathematics. Infinity, 9(1), 15–30.
Kutluay, Y. (2005). Diagnosis of Eleventh Grade Students’ Misconceptions About Geometric Optic By a Three-Tier Test. Ankara: Middle East Technical University.
Lestari, P., Mardiyana, M., & Slamet, I. (2020). Practicality Analysis of PBL-Based Mathematics in Circle Material. Indonesian Journal of Science and Mathematics Education, 03(3), 282–291. https://doi.org/10.24042/ijsme.v3i2.7271
Li, Y., & Schoenfeld, A. H. (2019). Problematizing teaching and learning mathematics as “given” in STEM education. International Journal of STEM Education, 6(1), 1-13. https://doi.org/10.1186/s40594-019-0197-9
Lin, Y. C., Yang, D. C., & Li, M. N. (2016). Diagnosing students’ misconceptions in number sense via a web-based two-tier test. Eurasia Journal of Mathematics, Science and Technology Education, 12(1), 41–55. https://doi.org/10.12973/eurasia.2016.1420a
Lu, L., & Sides, M. L. C. (2022). Instructional Design for Effective Teaching: The Application of ADDIE Model in College Reading Lesson. NOSS Practitioner to Practitioner SPRING 2022, Spring, 4–12.
Mohajan, H. K. (2017). Two Criteria for Good Measurements in Research: Validity and Reliability. Annals of Spiru Haret University. Economic Series, 17(4), 59–82. https://doi.org/10.26458/1746
Musa, A., Shaheen, S., & Elmardi, A. (2018). Item difficulty & item discrimination as quality indicators of physiology MCQ examinations at the Faculty of Medicine Khartoum University. Khartoum Medical Journal, 11(2), 1477–1468.
Ojose, B. (2015). Students’ Misconceptions in Mathematics: Analysis of Remedies and What Research Says. Ohio Journal of School Mathematics, 72(Fall), 30–34.
Peterson, R. A. (1994). A Meta-Analysis of Cronbach’s Coefficient Alpha. Journal of Consumer Research, 21(2), 381-391. https://doi.org/10.1086/209405
Prabowo, A., Anggoro, R. P., Adiyanto, R., & Rahmawati, U. (2018). Interactive Multimedia-based Teaching Material for Trigonometry. In ICRIEMS 5 Journal of Physics: Conference Series (Vol. 1097, No. 1, p. 012138). IOP Publishing https://doi.org/10.1088/1742-6596/1097/1/012138
Prabowo, A., Rahmawati, U., & Anggoro, R. P. (2019). Android-based Teaching Material for Statistics Integrated with Social Media WhatsApp. International Journal on Emerging Mathematics Education, 3(1), 93–104. https://doi.org/https://doi.org/10.12928/ijeme.v3i1.11961
Quaigrain, K., & Arhin, A. K. (2017). Using reliability and item analysis to evaluate a teacher-developed test in educational measurement and evaluation. Cogent Education, 4(1), 1–11. https://doi.org/10.1080/2331186X.2017.1301013
Rawh, P., Samsudin, A., & Nugraha, M. G. (2020). Pengembangan Four-Tier Diagnostic Test untuk Mengidentifikasi Profil Konsepsi Siswa pada Materi Alat-Alat Optik. WaPFi (Wahana Pendidikan Fisika), 5(1), 84–89.
Rejeki, S., & Putri, R. I. I. (2018). Models to support students’ understanding of measuring area of circles. Journal of Physics: Conference Series (Vol. 948, No. 1, p. 012058). IOP Publishing. https://doi.org/10.1088/1742-6596/948/1/012058
Retnawati, H. (2016). Proving Content Validity of Self-Regulated Learning Scale (The Comparison of Aiken Index and Expanded Gregory Index). Research and Evaluation in Education, 2(2), 155–164.
Retnawati, H., Arlinwibowo, J., & Sulistyaningsih, E. (2017). The Students’ Difficulties in Completing Geometry Items of National Examination. International Journal on New Trends in Education and Their Implications, 8(4), 28–41.
Rudner, L., & Schafer, W. (2002). What Teachers Need to Know about Assessment. Student Assessment series. Washington: National Education Association.
Sayyah, M., Vakili, Z., Masoudi Alavi, N., Bigdeli, M., Soleymani, A., Assarian, M., & Azarbad, Z. (2012). An Item Analysis of Written Multiple-Choice Questions: Kashan University of Medical Sciences. Nursing and Midwifery Studies, 1(2), 83–87. https://doi.org/10.5812/nms.8738
Setiana, D. S., Ili, L., Rumasoreng, M. I., & Prabowo, A. (2020). Relationship between Cooperative learning method and Students’ Mathematics Learning Achievement: A Meta-Analysis Correlation. Al-Jabar : Jurnal Pendidikan Matematika, 11(1), 145–158. https://doi.org/10.24042/ajpm.v11i1.6620
Shete, A., Kausar, A., Lakhkar, K., & Khan, S. (2015). Item analysis: An evaluation of multiple choice questions in Physiology examination. Journal of Contemporary Medical Education, 3(3), 106-109. https://doi.org/10.5455/jcme.20151011041414
Shim, G. T. G., Shakawi, A. M. H. A., & Azizan, F. L. (2017). Relationship between Students’ Diagnostic Assessment and Achievement in a Pre-University Mathematics Course. Journal of Education and Learning, 6(4), 364–371. https://doi.org/10.5539/jel.v6n4p364
Sudihartinih, E., & Purniati, T. (2019). Using geogebra to develop students understanding on circle concept. Journal of Physics: Conference Series (Vol. 1157, No. 4, p. 042090). IOP Publishing. https://doi.org/10.1088/1742-6596/1157/4/042090
Swaranjit, K. (2015). Application of mathematics in sciences. International Journal of IT, Engineering and Applied Sciences Research, 4(6), 83–85.
Zaleha, Z., Samsudin, A., & Nugraha, M. G. (2017). Pengembangan Instrumen Tes Diagnostik VCCI Bentuk Four-Tier Test pada Konsep Getaran. Jurnal Pendidikan Fisika Dan Keilmuan (JPFK), 3(1), 36–42. https://doi.org/10.25273/jpfk.v3i1.980
Refbacks
- There are currently no refbacks.
