The Effectiveness of Dynamic Problem-Solving Strategy and Innovative Assessment Tools to Improve Students’ Higher-Order Thinking Skills
DOI:
https://doi.org/10.15294/jpii.v14i1.21433Keywords:
dynamic problem-solving, higher-order thinking skills, physics education, assessment toolsAbstract
Education in Indonesia continues to face challenges in developing students' Higher-Order Thinking Skills (HOTS) to achieve Sustainable Development Goals (SDGs) 4 on quality education, which requires new strategies such as Dynamic Problem Solving (DPS) and innovative assessment tools to improve critical and analytical reasoning. This study aims to measure the DPS strategy and innovative assessment tools in improving students' HOTS in physics learning. This research method uses a quasi-experiment with a posttest-only control group design. This study involved 120 high school students from four regencies/cities in South Sulawesi, Indonesia. Data on the effectiveness of the DPS strategy were collected and analyzed using an independent t-test, and data on innovative assessment tools were collected and analyzed through validity and reliability tests. The results of the HOTS test of students after participating in physics learning using the DPS strategy and innovative assessment tools showed that the experimental group was better than the control group. This study concludes that implementing the DPS strategy and innovative assessment tools effectively improves high school students' HOTS through physics learning. This research has an impact in encouraging critical and analytical thinking in students to solve real problems. In addition, this research also contributes to being a reliable and robust new pedagogical approach in physics learning under the demands of 21st century education.
References
Aderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. In Pearson Education.
Affandy, H., Sunarno, W., Suryana, R., & Harjana. (2024). Integrating creative pedagogy into problem-based learning: The effects on higher order thinking skills in science education. Thinking Skills and Creativity, 53(June), 101575.
Akimov, N., Kurmanov, N., Uskelenova, A., Aidargaliyeva, N., Mukhiyayeva, D., Rakhimova, S., Raimbekov, B., & Utegenova, Z. (2023). Components of education 4.0 in open innovation competence frameworks: Systematic review. Journal of Open Innovation: Technology, Market, and Complexity, 9(2), 100037.
AlAli, R. (2024). Enhancing 21St Century Skills Through Integrated Stem Education Using Project-Oriented Problem-Based Learning. Geojournal of Tourism and Geosites, 53(2), 421–430.
Alfaisal, R., Hashim, H., & Azizan, U. H. (2024). Metaverse system adoption in education: a systematic literature review. In Journal of Computers in Education (Vol. 11, No. 1). Springer Berlin Heidelberg.
Alt, D., Kapshuk, Y., & Dekel, H. (2023). Promoting perceived creativity and innovative behavior: Benefits of future problem-solving programs for higher education students. Thinking Skills and Creativity, 47(August 2022), 101201.
Baharum, H., Ismail, A., Awang, Z., McKenna, L., Ibrahim, R., Mohamed, Z., & Hassan, N. H. (2023). The Study Adapted Instruments Based on Confirmatory Factor Analysis (CFA) to Validate Measurement Models of Latent Constructs. International Journal of Environmental Research and Public Health, 20(4).
Baltikian, M., Kärkkäinen, S., & Kukkonen, J. (2024). Assessment of scientific literacy levels among secondary school students in Lebanon: Exploring gender-based differences. Eurasia Journal of Mathematics, Science and Technology Education, 20(3).
Bappenas. (2024). Metadata Indikator Tahun 2024 Pilar Pembangunan Sosial: Pelaksanaan Pencapaian Tujuan Pembangunan Berkelanjutan/ Sustainable Development Goals (SDGs) (K. P. P. Nasional (ed.)). Kedeputian Bidang Kemaritiman dan Sumber Daya Alam, Kementerian Perencanaan Pembangunan Nasional/ Badan Perencanaan Pembangunan Nasional.
Barati, M., Taheri-Kharameh, Z., Farghadani, Z., & Rásky, É. (2019). Validity and reliability evaluation of the persian version of the heart failure-specific health literacy scale. International Journal of Community Based Nursing and Midwifery, 7(3), 222–230.
Bhattacherjee, A. (2012). Social Science Research: Principles, Methods, and Practices. In University of South Florida (2nd ed.). University of South Florida.
Creswell, J., & Guetterman, T. (2018). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, 6th Edition.
Creswell, J. W. (2009). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. In SAGE Publications. SAGE Publications.
de Sa’, J. P. M. (2007). Applied Statistics: Using SPSS, STATISTICA, MATLAB, and R. Springer Berlin Heidelberg.
Ebel, R., Ahmed, S., Valley, W., Jordan, N., Grossman, J., Byker Shanks, C., Stein, M., Rogers, M., & Dring, C. (2020). Co-design of Adaptable Learning Outcomes for Sustainable Food Systems Undergraduate Education. Frontiers in Sustainable Food Systems, 4(September).
Ekolu, S. O., & Quainoo, H. (2019). Reliability of assessments in engineering education using Cronbach’s alpha, KR and split-half methods. Global Journal of Engineering Education, 21(1), 24–29.
Farrell, O., & Brunton, J. (2020). A balancing act: a window into online student engagement experiences. International Journal of Educational Technology in Higher Education, 17(1).
Gastwirth, J. L., Gel, Y. R., & Miao, W. (2009). The Impact of Levene’s Test of Equality of Variances on Statistical Theory and Practice. Statistical Science, 24(3), 343–360.
Gembong, S., Krisdiana, I., Suprapto, E., Setyansah, R. K., Widodo, S. A., & Murtafiah, W. (2022). The Effectiveness of Mathematics Learning Based on Javanese Vegetable Salad Context to Improving Students’ Higher Order Thinking Skills. Pegem Egitim ve Ogretim Dergisi, 13(1), 84–91.
González‐pérez, L. I., & Ramírez‐montoya, M. S. (2022). Components of Education 4.0 in 21st Century Skills Frameworks: Systematic Review. Sustainability (Switzerland), 14(3), 1–31.
González‐salamanca, J. C., Agudelo, O. L., & Salinas, J. (2020). Key competences, education for sustainable development and strategies for the development of 21st century skills. A systematic literature review. Sustainability (Switzerland), 12(24), 1–17.
Gosselin, R. D. (2024). Testing for normality: a user’s (cautionary) guide. Laboratory animals, 58(5), 433–437.
Hamzah, H., Hamzah, M. I., & Zulkifli, H. (2022). Systematic Literature Review on the Elements of Metacognition-Based Higher Order Thinking Skills (HOTS) Teaching and Learning Modules. Sustainability (Switzerland), 14(2), 1–15.
Hanafiah, S., & Suryani, I. (2021). The Effect of Science in Development of Student Character Education with the Application of HOTS. Linguistica Antverpiensia, 3, 2861-2873.
Haris, A., Jasruddin, Bundu, P., Mustafa, & Ali, S. (2024). The Effect of Dynamic Problem-Solving Learning Strategy on Students’ Critical Thinking Skills. Asian Journal of Education and Social Studies, 50(6), 418–432.
Haryani, E., Cobern, W. W., Pleasants, B. A. S., & Fetters, M. K. (2021). Analysis of teachers’ resources for integrating the skills of creativity and innovation, critical thinking and problem solving, collaboration, and communication in science classroom. Jurnal Pendidikan IPA Indonesia, 10(1), 92–102.
Haryono, H. E., Jatmiko, B., Prahani, B. K., Zayyadi, M., Kaniawati, I., & Kurtuluş, M. A. (2024). E-Learning-Based Collaborative As an Effort To Reduce High School Students’ Misconceptions of Heat. Jurnal Pendidikan IPA Indonesia, 13(4), 538–550.
Heilporn, G., Lakhal, S., & Bélisle, M. (2021). An examination of teachers’ strategies to foster student engagement in blended learning in higher education. International Journal of Educational Technology in Higher Education, 18(1).
Ismawati, E., Hersulastuti, Amertawengrum, I. P., & Anindita, K. A. (2023). Portrait of Education in Indonesia: Learning from PISA Results 2015 to Present. International Journal of Learning, Teaching and Educational Research, 22(1), 321–340.
Jamil, M., Hafeez, F. A., & Muhammad, N. (2024). Critical Thinking Development for 21st Century: Analysis of Physics Curriculum. Journal of Social & Organizational Matters, 3(1), 01–10.
Jong, T. De. (2019). Moving towards engaged learning in STEM domains; there is no simple answer, but clearly a road ahead. Journal of Computer Assisted Learning, 35(2), 153–167.
Kim, S., Raza, M., & Seidman, E. (2019). Improving 21st-century teaching skills: The key to effective 21st-century learners. Research in Comparative and International Education, 14(1), 99–117. 4
Kleinman, E., Shergadwala, M. N., Teng, Z., Villareale, J., Bryant, A., Zhu, J., & El-Nasr, M. S. (2022). Analyzing Students’ Problem-Solving Sequences: A Human-in-the-Loop Approach. Journal of Learning Analytics, 9(2), 138–160.
Komatsu, H., Rappleye, J., & Silova, I. (2021). Student-centered learning and sustainability: Solution or problem? Comparative Education Review, 65(1), 6–33.
Kwangmuang, P., Jarutkamolpong, S., Sangboonraung, W., & Daungtod, S. (2021). The development of learning innovation to enhance higher order thinking skills for students in Thailand junior high schools. Heliyon, 7(6), e07309.
Li, D. (2025). Unlocking Spatial Wisdom : A Polya-Inspired Approach to Strengthening Year 5 Students’ Higher-Order Thinking Skills. 18(2), 593–614.
Li, D., Fan, X., & Meng, L. (2024). Development and validation of a higher-order thinking skills (HOTS) scale for major students in the interior design discipline for blended learning. Scientific Reports, 14(1), 1–20.
Liu, J., Liu, Z., Wang, C., Xu, Y., Chen, J., & Cheng, Y. (2024). K-12 students’ higher-order thinking skills: Conceptualization, components, and evaluation indicators. Thinking Skills and Creativity, 52, 101551.
Maries, A., & Singh, C. (2023). Helping students become proficient problem solvers Part I: A brief review. Education Sciences.
Martín-Alguacil, N., & Avedillo, L. (2024). Student-Centered Active Learning Improves Performance in Solving Higher-Level Cognitive Questions in Health Sciences Education. 346–362.
Mayona, E. L., & Sutriadi, R. (2024). Ecological city concept: Challenge and future research agenda in urban ecology perspective. Journal of Infrastructure, Policy and Development, 8(5), 1–22.
Miller, J. L., Wentzel, M. T., Clark, J. H., & Hurst, G. A. (2019). Green Machine: A Card Game Introducing Students to Systems Thinking in Green Chemistry by Strategizing the Creation of a Recycling Plant. Journal of Chemical Education, 96(12), 3006–3013.
Misrom, N. S., Abdurrahman, M. S., Abdullah, A. H., Osman, S., Hamzah, M. H., & Fauzan, A. (2020). Enhancing students’ higher-order thinking skills (HOTS) through an inductive reasoning strategy using geogebra. International Journal of Emerging Technologies in Learning, 15(3), 156–179.
Nenohai, J. M. H., Samo, D. D., Garak, S. S., Rimo, I. H. E., & Soko, I. P. (2024). Preservice mathematics teacher knowledge of higher order thinking skills. Journal of Education and Learning, 18(2), 588–597.
Nilimaa, J. (2023). New Examination Approach for Real-World Creativity and Problem-Solving Skills in Mathematics. Trends in Higher Education, 2(3), 477–495.
Nugrahnastiti, N., & Kamaludin, A. (2024). Development of a Higher-Order Thinking Skills (HOTS) Test Instrument on Electrochemical Material for High School Students. Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran, 10(2), 451–466.
OECD. (2015). Education Policy Outlook 2015: Happen, Making Reforms. OECD Publishing.
Pan, G., Shankararaman, V., Koh, K., & Gan, S. (2021). Students’ evaluation of teaching in the project-based learning programme: An instrument and a development process. International Journal of Management Education, 19(2), 1–11.
Papadakis, S., Vaiopoulou, J., Kalogiannakis, M., & Stamovlasis, D. (2020). Developing and exploring an evaluation tool for educational apps (E.T.E.A.) targeting kindergarten children. Sustainability (Switzerland), 12(10), 1–10.
Pásztor-Kovács, A., Pásztor, A., & Molnár, G. (2023). Measuring collaborative problem solving: research agenda and assessment instrument. Interactive Learning Environments, 31(8), 5159–5179.
Patiño, A., Ramírez-Montoya, M. S., & Buenestado-Fernández, M. (2023). Active learning and education 4.0 for complex thinking training: analysis of two case studies in open education. Smart Learning Environments, 10(1).
Price, A. M., Kim, C. J., Burkholder, E. W., Fritz, A. V., & Wieman, C. E. (2021). A detailed characterization of the expert problem-solving process in science and engineering: Guidance for teaching and assessment. CBE Life Sciences Education, 20(3), 1–15.
Putranta, H., & Supahar. (2019). Development of physics-tier tests (PysTT) to measure students’ conceptual understanding and creative thinking skills: A qualitative synthesis. Journal for the Education of Gifted Young Scientists, 7(3), 747–775.
Rachmawati, D., Suharno, S., & Roemintoyo, R. (2023). The Effects of Learning Design on Learning Activities Based on Higher Order Thinking Skills in Vocational High Schools. Open Education Studies, 5(1).
Rahayu, R., Kartono, K., Dwijanto, D., & Agoestanto, A. (2022). The Effectiveness of Accelerated Problem Based Learning With Dynamic Assessment in Achieving Problem-Solving Skills. ISET: International Conference on Science, Education and Technology, 178–185.
Rojas, M., Sáez, C., Baier, J., Nussbaum, M., Guerrero, O., & Rodríguez, M. F. (2023). Using Automated Planning to Provide Feedback during Collaborative Problem-Solving. International Journal of Artificial Intelligence in Education, 33(4), 1057–1091.
Rosário, A. T., & Dias, J. C. (2024). Implementing Problem-Based Learning in Marketing Education: A Systematic Review and Analysis. Education Sciences, 14(11).
Sepriyanti, N., Nelwati, S., Kustati, M., & Afriadi, J. (2022). The Effect of 21st-Century Learning on Higher-Order Thinking Skills (HOTS) and Numerical Literacy of Science Students in Indonesia Based on Gender. Jurnal Pendidikan IPA Indonesia, 11(2), 314–321.
Shrotryia, V. K., & Dhanda, U. (2019). Content Validity of Assessment Instrument for Employee Engagement. SAGE Open, 9(1).
Škėrienė, S., & Jucevičienė, P. (2020). Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company’s public news and information platform. January.
Sliwka, A., Klopsch, B., Beigel, J., & Tung, L. (2024). Transformational leadership for deeper learning: shaping innovative school practices for enhanced learning. Journal of Educational Administration, 62(1), 103–121.
Sugiyono. (2013). Metode Penelitian Kuantitatif, Kualitatif dan R&D. Alfabeta.
Sürücü, L., & Maslakci, A. (2020). Validity and Reliability in Quantitative Research. Business & Management Studies: An International Journal, 8(3), 2694–2726.
Wu, H., & Molnár, G. (2022). Analysing Complex Problem-Solving Strategies from a Cognitive Perspective: The Role of Thinking Skills. Journal of Intelligence, 10(3).
Yurniwati, & Soleh, D. A. (2020). The effectiveness of computer-based problem solving to improve higher order thinking skills on prospective teachers. International Journal of Instruction, 13(2), 393–406.
Zulfiani, Suwarna, I. P., & Sumantri, M. F. (2020). Science adaptive assessment tool: Kolb’s learning style profile and student’s higher order thinking skill level. Jurnal Pendidikan IPA Indonesia, 9(2), 194–207.
