Assessing Prospective Physics Teachers' Inquiry Skills in Post-Pandemic: Rasch Analysis
DOI:
https://doi.org/10.15294/8xht0s38Keywords:
Rasch Analysis, Inquiry Skills, Prospective Physics TeachersAbstract
Inquiry skills are essential for prospective physics teachers. Inquiry skills are a necessary in the educational curriculum because they can help students construct scientific knowledge and skills, essential activities in science learning. This research aims to validate the scientific inquiry skills test used to evaluate the scientific inquiry skills of prospective physics teachers. This research used a quantitative method with a cross-sectional survey design. The adapted inquiry skills test questions consisted of 35 items covering nine aspects of inquiry skills. The participants in this research were 168 prospective physics teachers who were chosen randomly and came from educational institutions on the islands of Indonesia. The results show that the adapted inquiry skills test meets the validity and reliability criteria based on Rasch parameters. On average, students' skills are still low in answering inquiry skills test questions. Analysis of differential item function reveals that the inquiry skills test items contain minimal biases based on university category and gender but are slightly larger based on semester level. The inquiry skills scores of students in semesters II, IV, and VI were not significantly different. The inquiry skills scores of male students are significantly different from the inquiry skills scores of female students. The adapted inquiry skills test instrument has met the criteria of validity, reliability, and slight bias based on university category and gender. A small number of test items need to be corrected so they are not biased based on the student's semester level. The evaluation results show that male students show better inquiry skills than female students. Reorganization is needed in planning and implementing learning strategies that can facilitate the inquiry skills of prospective physics teachers.
References
Adams, D., Chuah, K. M., Mohamed, A., & Sumintono, B. (2021). Bricks to Clicks: Students’ Engagement in E-Learning during the COVID-19 Pandemic. Asia Pacific Journal of Educators and Education, 36(2), 99–117.
Aini, R. Q., Rachmatullah, A., & Ha, M. (2019). Indonesian primary school and middle school students’ attitudes toward science: Focus on gender and academic level. Journal of Baltic Science Education, 18(5), 654–667.
Altbach, P. G., & De Wit, H. (2020). Are we at a transformative moment for online learning? University World News. https://www.universityworldnews.com/post.php?story=20200427120502132.
Andrich, D. (2018). Advances in social measurement: A Rasch measurement theory. In F. Guillemin, A. Leplège, S. Briançon, E. Spitz, & J. Coste (Eds.), Perceived Health and Adaptation in Chronic Disease (1st ed., pp. 66–91). Routledge/Taylor & Francis Group.
Arnold, J. C., Boone, W. J., Kremer, K., & Mayer, J. (2018). Assessment of competencies in scientific inquiry through the application of rasch measurement techniques. Education Sciences, 8(4).
Azizan, N. H., Mahmud, Z., Rambli, A., & Hafizah Azizan, N. (2020). Rasch Rating Scale Item Estimates using Maximum Likelihood Approach: Effects of Sample Size on the Accuracy and Bias of the Estimates. International Journal of Advanced Science and Technology, 29(4s), 2526–2531. https://www.researchgate.net/publica-tion/343152554.
Bahasoan, A., Ayuandiani, W., & Mukhram, M. (2020). Effectiveness of Online Learning in Pandemic Covid-19. International Journal of Science, Technology & Management, 1(2), 100–106.
Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (4th ed.). Routledge.
Boone, W. J., & Staver, J. R. (2020). Advances in Rasch Analyses in the Human Sciences. Springer.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences (1st ed.). Springer.
Candra Wicaksono, A. G., & Korom, E. (2023). Atti-tudes towards science in higher education: Validation of questionnaire among science teacher candidates and engineering students in Indonesia. Heliyon, e20023.
Čipková, E., & Karolčík, Š. (2018). Assessing of Scien-tific Inquiry Skills Achieved by Future Biology Teachers. Chemistry-Didactics-Ecology-Metrology, 23(1–2), 71–80.
Connor, G. O., & Rosicka, C. (2020). Science inquiry skills. The Australian Council for Educational Research, 8.
Constantinou, C. P., Tsivitanidou, O. E., & Rybska, E. (2018). What Is Inquiry-Based Science Teaching and Learning? Contributions from Science Education Research, 5, 1–23.
Coramik, M., & Inanç, B. (2023). A physical pendulum experiment with Lego, Phyphox and Tracker. Physics Education, 58(055014), 1–8.
Creswell, J. W., & Guetterman, T. C. (2019). Education-al Research Planning, Conducting, and Evaluating Quantitative and Qualitative Research (- (ed.); 6th ed.). Pearson Education, Inc.
Egara, F. O. (2023). Gender difference in secondary school students’ retention in algebra: A computer simulation approach. EURASIA Journal of Mathematics, Science and Technology Education, 19(7).
Elisanti, E. (2020). Analysis of Students Inquiry Skills in Senior High School Though Learning Based on the Hierarchy of Inquiry Model. Advances in Social Science, Education and Humanities Re-search, 422(ICOPE 2019), 409–414.
Ezra, O., Cohen, A., Bronshtein, A., Gabbay, H., & Baruth, O. (2021). Equity factors during the COVID - 19 pandemic: Difficulties in emergency remote teaching (ert) through online learning. Education and Information Technologies, 7657–7681.
Fackler, A. K., & Sexton, C. M. (2020). Science Teacher Education in the Time of COVID-19: A Document Analysis. Electronic Journal for Research in Science & Mathematics Education, 24(3), 5–13.
Fan, C., Chang, K., Lee, K., Yang, W., & Pakpour, A. H. (2022). Rasch Modeling and Differential Item Functioning of the Self-Stigma Scale-Short Version among People with Three Different Psychiatric Disorders. International Journal of Environmental Research and Publich Health, 19(8843), 1–15.
Fauth, B., Decristan, J., Decker, A. T., Büttner, G., Hardy, I., Klieme, E., & Kunter, M. (2019). The effects of teacher competence on student outcomes in elementary science education: The mediating role of teaching quality. Teaching and Teacher Education, 86, 102882.
Firman, M. A., Ertikanto, C., & Abdurrahman, A. (2019). Description of meta-analysis of inquiry-based learning of science in improving students’ inquiry skills. Journal of Physics: Conference Series, 1157(2).
Gao, Z., Zhang, L., Ma, J., Sun, H., Hu, M., Wang, M., Liu, H., & Guo, L. (2023). Reliability and validity of the Chinese version of hte self-directed learning instrument in Chinese nursing students. BMC Nursing, 22(51), 1–9.
Goss-Sampson, M. A. (2020). Statistical Analysis in JASP: A Guide for Students (JASP v 0.140 (4th ed.). JASP.
Graham, S. R., & Tolar, A. (2020). Teaching Preservice Teachers about COVID-19 through Distance Learning. Electronic Journal for Research in Science & Mathematics Education, 24(3), 29–37.
Hoffmann, L. (2002). Promoting girls’ interest and achievement in physics classes for beginners. Learning and Instruction, 12(2002), 447–465.
Huang, F., Huang, L., & Oon, P.-T. (2020). Constructs Evaluation of Student Attitudes Toward Science—A Rasch Analysis. In Rasch Measurement(pp. 139–157). Springer Singapore.
JASP Team. (2023). JASP Software (Version 0.17.2)(0.17.2.1). University of Amsterdam. https://jasp-stats.org/
Ješková, Z., Balogová, B., & Kireš, M. (2018). Assessing inquiry skills of upper secondary school students. Journal of Physics: Conference Series, 1076(1).
Khalaf, M. A., Mohammed, E., & Omara, N. (2022). Rasch analysis and differential item functioning of English language anxiety scale (ELAS) across sex in Egyptian context. BMC Psychology, 1–16.
King, B. M., Rosopa, P., & Minium, E. W. (2018). Statistical reasoning in the behavioral sciences (7th ed.). Hoboken, NJ: John Wiley & Sons, Inc.
Koh, J. H. L., & Daniel, B. K. (2022). Shifting online during COVID-19: A systematic review of teaching and learning strategies and their out-comes. International Journal of Educational Technology in Higher Education, 19(56), 1–23.
Kuo, C. Y., Wu, H. K., Jen, T. H., & Hsu, Y. S. (2015). Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities. International Journal of Science Education, 37(14), 2326–2357.
Laliyo, L. A. R., Sumintono, B., & Panigoro, C. (2022). Measuring changes in hydrolysis concept of students taught by inquiry model: stacking and racking analysis techniques in Rasch model. Heliyon, 8(3), e09126.
Lamprianou, I. (2020). Applying the Rasch Model in Social Sciences Using R and BlueSky Statistics (1st ed.). Routledge/Taylor & Francis Group.
Linacre, J. M. (2023). A User’s Guide to WINSTEPS MINISTEP: Rasch-Model Computer Programs (Program manual 5.6.0). Winsteps®. https://www.winsteps.com/tutorials.htm.
Liu, X. (2020). Using and Developing Measurement Instruments in Science Education: A Rasch Modeling Approach (C. S. Kalman (ed.); 2nd ed.). Information Age Publishig, Inc.
Lou, Y., Blanchard, P., & Kennedy, E. (2015). Development and validation of a science inquiry skills assessment. Journal of Geoscience Education, 63(1), 73–75.
Lu, K., Pang, F., & Shadiev, R. (2021). Understanding the mediating effect of learning approach between learning factors and higher order thinking skills in collaborative inquiry-based learning. Educational Technology Research and Development, 69(5), 2475–2492.
Monteiro, M., Stari, C., & Marti, A. C. (2023). A home-lab experiment: resonance and sound speed using telescopic vacuum cleaner pipes. Physics Education, 58(013003), 1–4.
Morrell, P. D., Rogers, M. A. P., Pyle, E. J., Roehrig, G., Veal, W. R., Morrell, P. D., Rogers, M. A. P., Pyle, E. J., & Roehrig, G. (2020). Preparing Teachers of Science for 2020 and Beyond: Highlighting Changes to the NSTA / ASTE Standards for Science Teacher Preparation. Journal of Science Teacher Education, 31(1), 1–7.
Mubarokah, N., Permanasari, A., & Eliyawati, E. (2021). A case study of scientific literacy in natural science subject using rasch analysis model (RAM). Journal of Physics: Conference Series, 1806(1), 012144.
Murphy, E. (2009). Online synchronous communication in the second-language classroom. Canadian Journal of Learning and Technology, 35(3), 10–22.
National Research Council. (2014). Developing Assessments for the Next Generation Science Standards (J. W. Pellegrino, M. R. Wilson, J. A. Koenig, & A. S. Beatty (eds.)). The National Academies Press.
Nicol, C. B., Gakuba, E., & Habinshuti, G. (2022). Students’ perceived science inquiry process skills in relation to school type and gender. Perspectives in Education, 40(2), 159–174.
Novitra, F., Fastiyed, Yohandri, & Asrizal. (2021). Development of Online-based Inquiry Learning Model to Improve 21st-Century Skills of Physics Students in Senior High School. EURASIA Journal of Mathematics, Science and Technology Education, 17(22).
Özer, F., & Sarıbaş, D. (2022). Exploring Pre-service Science Teachers’ Understanding of Scientific Inquiry and Scientific Practices Through a Laboratory Course. In Science and Education (Issue 2022). Springer Netherlands.
Ozturk, E. (2021). The Effect of STEM Activities on the Scientific Inquiry Skills of Pre-service Primary School Teachers. Journal of Education in Science, Environment and Health, 7(4).
Purwati, R., Liestari, S. P., Suwandi, T., Wulan, A. R., & Utari, S. (2021). Profile of Learning Experiences and Students’ Scientific Inquiry Skills in Science Subjects. Proceedings of the International Conference on Educational Assessment and Policy (ICEAP 2020), 545(Iceap 2020), 22–28.
Rachmatullah, A., Octavianda, R. P., Ha, M., Rusta-man, N. Y., & Diana, S. (2017). Construct Validity of Science Motivation and Beliefs Instrument (SLA-MB): A Case study in Sumedang, Indonesia. Journal of Physics: Conference Series, 812, 012009.
Raof, S. A., Mustaâ, A. H., Zamzuri, F. K., & Salleh, M. H. (2021). Validity and reliability of students perceptions on OBE approach in Malaysian VC using Rasch model. Journal of Innovation in Educational and Cultural Research, 2(2), 44-50.
Sagala, R., Umam, R., Tahir, A., Saregar, A., & Wardani, I. (2019). The Effectiveness of STEM-Based on Gender Differences: The Impact of Physics Concept Understanding. European Journal of Educational Research, 8(3), 753–761.
Santos, C., Rybska, E., Klichowski, M., Jankowiak, B., Jaskulska, S., Domingues, N., Carvalho, D., Rocha, T., Paredes, H., Martins, P., & Rocha, J. (2023). Science education through project-based learning: a case study. Procedia Computer Science, 219(2022), 1713–1720.
Saputra, H., Suhandi, A., & Setiawan, A. (2019). Pro-file of inquiry skills pre-service physics teacher in Aceh. Journal of Physics: Conference Series, 1157(3).
Setiono, S., Rustaman, N. Y., Rahmat, A., & Anggraeni, S. (2019). Student’s inquiry skills and learning achievement in plant anatomy practical work using open-guided inquiry. Journal of Physics: Conference Series, 1157(2). https://doi.org/10.1088/1742-6596/1157/2/022089.
Soeharto, S., & Csapó, B. (2021). Evaluating item difficulty patterns for assessing student misconceptions in science across physics, chemistry, and biology concepts. Heliyon, 7(11).
Soeharto, S., & Csapó, B. (2022). Assessing Indonesian student inductive reasoning: Rasch analysis. Thinking Skills and Creativity, 46(November 2021).
Spronken‐Smith, R., & Walker, R. (2010). Can inquiry‐based learning strengthen the links between teaching and disciplinary research? Studies in Higher Education, 35(6), 723–740.
Sunjaya, D. K., Sumintono, B., Gunawan, E., Herawa-ti, D. M. D., & Hidayat, T. (2022). Online Mental Health Survey for Addressing Psychosocial Condition During the COVID-19 Pandemic in Indonesia: Instrument Evaluation. Psychology Research and Behavior Management, 15, 161–170.
Surahman, E., & Wang, T. H. (2023). In-service STEM teachers’ professional development programmes: A systematic literature review 2018–2022. Teaching and Teacher Education, 135(July), 104326.
Susongko, P., Arfiani, Y., & Kusuma, M. (2021). De-termination of Gender Differential Item Functioning in Tegal-Students’ Scientific Literacy Skills with Integrated Science (SLiSIS) Test Using Rasch Model. Jurnal Pendidikan IPA Indonesia, 10(2), 270–281.
Susongko, P., Kusuma, M., & Widiatmo, H. (2019). Using Rasch Model to Detect Differential Person Functioning and Cheating Behavior in Natural Sciences Learning Achievement Test. Jurnal Penelitian Dan Pembelajaran IPA, 5(2), 94.
Syawaludin, A., Prasetyo, Z. K., Safruddin, C., & Jabar, A. (2022). The Effect of Project-based Learning Model and Online Learning Settings on Analytical Skills of Discovery Learning, Interactive Demonstrations, and Inquiry Lessons. Journal of Turkish Science Education, 19(2), 608–621.
Tanak, A. (2020). Developing Pre-service Science Teachers’ Teaching Practices with an Emphasis on Higher Order Thinking. Science Education International, 31(3), 237–246.
Teig, N., & Nilsen, T. (2022). Profiles of instructional quality in primary and secondary education: Patterns, predictors, and relations to student achievement and motivation in science. Studies in Educational Evaluation, 74(September 2020), 101170.
Wang, Jiawen, Yang, M., & Maresova, P. (2020). Sustainable development at higher education in China: A comparative study of students’ perception in public and private universities. Sustainability (Switzerland), 12(6).
Wang, Jingying, Guo, D., & Jou, M. (2015). A study on the effects of model-based inquiry pedagogy on students’ inquiry skills in a virtual physics lab. Computers in Human Behavior, 49(2015), 658–669.
Wenning, C. J. (2007). Assessing inquiry skills as a component of scientific literacy. Journal of Physics Teacher Education Online, 4(2), 21–24.
Wenning, C. J. (2010). Levels of inquiry: Using inquiry spectrum learning sequences to teach science. Journal of Physics Teacher Education Online, 5(3), 11–20.
Wenning, C. J., & Vieyra, R. E. (2020). Teaching High School Physics: Interacting with Physics Students. In AAPT Physics Education(1st ed.). AIP Publishing LLC. https://doi.org/10.1063/9780735422056.
Wu, X. (2023). Fostering Chinese preservice teachers’ global competence through inquiry learning in glocalised educational contexts. Teaching and Teacher Education, 122.
