Developing Instrument of Essay Test to Measure the Problem-Solving Skill in Physics

A. Aristiawan(1), E. Istiyono(2),

DOI: https://doi.org/10.15294/jpfi.v16i2.24249


(1) Postgraduate Educational Research and Evaluation, Universitas Negeri Yogyakarta
(2) Postgraduate Educational Research and Evaluation, Universitas Negeri Yogyakarta, Indonesia

Abstract

This research was developmental research with the final product is test instrument to measure the students’ physics problem-solving skills of the Senior High School. The problem-solving aspects measured contained of understanding the problem, organizing the knowledge, carrying out the plan, and evaluating the solution. This research used a modified Oriondo & Dallo-Antonio Development model that comprised of (1) planning test, (2) trying out the test, (3) determining the validity, and (4) determining the reliability. This research was done in the Senior High School in Sleman regency. The result of this research showed that there were two packages of test of which each package consisted of 12 questions included 4 anchor questions. The test was an essay test which the scoring used PCM model based on the five categories of Polytomous data. The item analysis of the test was done first to prove the assumptions that became the basic theory of item response that were one dimensional, local independence, and invariance parameter. The quality of developed test item is good category which the range of mean square score is 0.96 – 1.08 and the difficulty level is -0.7 to 0.41. Based on the information score function and SEM, the developed instrument was good to be implemented for the test participant with the medium ability.

Keywords

developing test, essay test, physics problem-solving skills, partial credit model

Full Text:

PDF

References

Anderson, J. (2009). Mathematics Curriculum Development and the Role of Problem Solving. ASCA Conference, 1–8.

Argelagós, E., & Pifarré, M. (2012). Improving Information Problem Solving skills in Secondary Education through embedded instruction. Computers in Human Behavior, 28(2), 515–526. https://doi.org/10.1016/j.chb.2011.10.024

Baig, M., Ali, S. K., Ali, S., & Huda, N. (2014). Evaluation of Multiple Choice and Short Essay Question Items in Basic Medical Sciences. Pakistan Journal Medical Science, 30(1), 3–6. https://doi.org/10.12669/pjms.301.4458

Bashooir, K., & Supahar. (2018). Validitas dan Reliabilitas Instrumen Asesmen Kinerja Literasi Sains Pelajaran Fisika Berbasis STEM. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(2), 168–181. https://doi.org/10.21831/pep.v22i2.20270

Bond, T. G., & Christine M. Fox. (2007). Applying The Rasch Model: Fundamental Measurement in The Human Sciences (2nd ed.). Lawrence Erlbaum.

DeMars, C. (2010). Item Response Theory. Oxford University Press, Inc.

Docktor, J. L. (2009). Development and Validation of a Physics Problem-Solving Assessment Rubric [University of Minnesota]. ???

Esen, E., & Belgin, B. (2017). The Evaluation of The Problem Solving in Mathematics Course According to Student Views. ITM Web of Conferences, 13, 1–18. https://doi.org/10.1051/itmconf/20171301012

Gok, T., & Silay, I. (2008). The Effects of Problem-solving Strategies on Students’ Achievement, on the Cooperative Learning Groups in Physics Teaching. Journal of Education, 4(34), 116–126.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2009). Multivariate Data Analysis (7th Edition). Prentice Hall.

Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and Validating Test Items. Routledge.

Hambleton, R. K., & Swaminathan, H. (1985). Item Response Theory: Principles and Applications. In Applied Psychological Measurement (Vol. 9, Issue 3). Nijhoff Publishing. https://doi.org/10.1177/014662168500900315

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory Library. Sage Publications, Inc.

Hariadi, E. (2007). Penskalaan Butir Format Respons Pilihan dan Respons Bebas Berdasarkan Model Rasch dan Partial Credit. Jurnal Penelitian Dan Evaluasi Pendidikan, 9(1), 20–42.

Henderson, C., Heller, K., Heller, P., Kuo, V., & Yerushalmi, E. (2001). Instructors’ Ideas about Problem Solving Setting Goals. Physics Echration Research Conference., 2–5.

Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (PysTHOTS) Peserta Didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12. https://doi.org/10.21831/pep.v18i1.2120

Kastner, M., & Stang, B. (2011). Multiple Choice and Constructed Response Tests: Do Test Format and Scoring Matter? Procedia Social and Behavioral Sciences, 12, 263–273. https://doi.org/10.1016/j.sbspro.2011.02.035

Kubiszyn, T., & Borich, G. D. (2013). Educational Testing and Measurement: Classroom Application and Practise (10th ed.). NJ: Willey.

Mardapi, D. (2017). Pengukuran Penilaian dan Evaluasi Pendidikan. Parama Publishing.

Mason, A., & Singh, C. (2016). Using Categorization of Problems as an Instructional Tool to Help Introductory Students Learn Physics. Physics Education, 51, 1–5. https://doi.org/10.1088/0031-9120/51/2/025009

Memduhoglu, H. B., & Keles, E. (2016). Evaluation of the Relation between Critical-Thinking Tendency and Problem-Solving Skills of Pre-Service. Journal in Educational Sciences Research, 6(2), 75–94. https://doi.org/10.12973/jesr.2016.62.5

Miller, M. D., Linn, R. L., & Gronlund, N. E. (2009). Measurement and Assessment in Teaching (10th ed.). Pearson Education Inc.

Moeen-uz-Zafar-Khan, & Aljarallah, B. M. (2011). Evaluation of Modified Essay Questions (MEQ) and Multiple Choice Questions (MCQ) as a Tool for Assessing The Cognitive Skills of Undergraduate Medical Students. International Journal of Health Sciences, 5(1), 39–43.

Nadapdap, A. T. Y., & Istiyono, E. (2017). Developing Physics Problem-Solving Skill Test for Grade X Students of Senior High School. Research and Evaluation in Education, 3(2), 114–123. https://doi.org/10.21831/reid.v3i2.14982

Oriondo, L. L., & Dallo-Antonio, E. M. (1998). Evaluating Educational Outcome. Rex Printing Company Inc.

Polya, G. (1971). How to Solve It: A New Aspect of Mathematical Method. Princeton University Press.

Putri, R. Z., Jumadi, J., Ariswan, A., & Kuswanto, H. (2019). Mapping Students’ Problem-Solving Skills in Physics Subject After Inquiry Learning at Class X SMAN 1 Prambanan. Jurnal Pendidikan Fisika Indonesia, 15(2), 60–69. https://doi.org/10.15294/jpfi.v15i2.15246

Redish, E. F. (2005). Problem Solving and The Use of Math in Physics Courses. World View on Physics Education, 1–10.

Retnawati, H. (2014). Teori Respon Butir dan Penerapannya. Nuha Medika.

Retnawati, H. (2016). Validitas Reliabilitas dan Karakteristik Butir. Nuha Medika.

Sirait, J., Sutrisno, L., Balta, N., & Mason, A. (2017). The Development of Questıonnaıre to Investıgate Students’ Attıtudes and Approaches in Physıcs Problem Solvıng. Jurnal Pendidikan Fisika Indonesia, 13(2), 79–87. https://doi.org/10.15294/jpfi.v13i2.10152

Sujarwanto, E., & Hidayat, A. (2014). Kemampuan Pemecahan Masalah Fisika pada Modeling Instruction pada Siswa SMA Kelas XI. Jurnal Pendidikan IPA Indonesia, 3(1), 65–78.

Troyer, J. A. (2011). Conceptual change instruction : A method for facilitating consciousness in problem solving activities . Procedia - Social and Behavioral Sciences, 29, 33–38. https://doi.org/10.1016/j.sbspro.2011.11.202

Wagner, T. (2008). Rigor Redefined: Even Our “Best†Schools are Failing to Prepare Students for 21st-century Careers and Citizenship. Educational Leadership, October, 20–24.

Walsh, L. N., Howard, R. G., & Bowe, B. (2007). Phenomenographic study of students’ problem solving approaches in physics. Physical Review Special Topics - Physics Education Research, 3(2), 1–12. https://doi.org/10.1103/PhysRevSTPER.3.020108

Woolfolk, A. (2016). Educational Psychology (13th ed.). Person.

Refbacks



Bookmark and Share


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License