Transformative Assessment Innovation Based on Multiple Representations in Holistic Learning to Measure Logical and Analytical Thinking
DOI:
https://doi.org/10.15294/jpii.v15i1.35317Keywords:
chemistry education, transformative assessment, level representation, acid-base titration, HOTSAbstract
The focus of chemistry learning across multiple levels of representation is essential for developing students’ conceptual understanding of complex chemical phenomena. However, previous studies have predominantly emphasized the use of multiple representations as instructional strategies, while their application in assessment, particularly in acid-base chemistry, remains limited. Moreover, existing assessment instruments seldom integrate logical and analytical thinking skills simultaneously, and the use of Rasch model analysis for diagnostic assessment in this context is still relatively scarce. To address these gaps, this study aims to develop a Transformative Assessment Innovation Based on Multiple Representations integrated into Holistic Learning to measure students’ logical and analytical thinking skills. This research employed a Research and Development (R&D) approach using the ADDIE model. The participants were second-semester students enrolled in the Basic Analytical Chemistry course at Universitas Negeri Semarang. The assessment instrument was developed as multi-representational items encompassing definitional, macroscopic, submicroscopic, symbolic, and stoichiometric levels, aligned with holistic learning activities. The content validity and reliability of the instrument were analyzed using the Rasch model. The results showed that the developed assessment demonstrated high validity (CVR > 0.80) and excellent reliability (Cronbach’s α > 0.90). Furthermore, the implementation findings indicated that the transformative assessment effectively identified and enhanced students’ logical and analytical thinking skills while providing diagnostic and reflective feedback to support continuous learning. These findings suggest that transformative assessment integrated with multi-representational and holistic learning approaches offers a novel diagnostic framework for strengthening students’ higher-order thinking skills in chemistry education.
References
Al-Ajmi, B., & Abdullah, A. (2019). The level of scientific argumentation skills in chemistry subject among grade 11 students: The role of logical thinking. Science Education International, 33(1), 66–74.
Al-Ajmi, B., & Ambusaidi, A. (2022). The Level of Scientific Argumentation Skills in Chemistry Subject among Grade 11th Students: The Role of Logical Thinking. Science Education International, 33(1), 66-74.
Al Haq, F. N. H., & Raicudu, M. I. R. (2023). Pemahaman Konsep Peserta Didik Kelas VII Pada Materi Segiempat. Prosiding Seminar Nasional Pendidikan Matematika, Universitas Mulawarman, 3, 82–89.
Anggraini, D., & Irawan, E. (2021). Analisis Kemampuan Berpikir Logis Siswa Kelas VII pada Tema Pencemaran Lingkungan. Jurnal Tadris IPA Indonesia, 1(2), 228–238.
Apriani, R., Harun, A. I., Erlina, E., Sahputra, R., & Ulfah, M. (2021). Pengembangan modul berbasis multipel representasi dengan bantuan teknologi augmented reality untuk membantu siswa memahami konsep ikatan kimia. Jurnal IPA & Pembelajaran IPA, 5(4), 305-330.
Arikunto, S. (2015). Dasar-Dasar Evaluasi Pendidikan. Bumi Aksara.
Bond, T. G., & Fox, C. M. (2013). Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press.
Cooper, G. (2023). Examining Science Education in ChatGPT : An Exploratory Study of Generative Artificial Intelligence. Journal of Science Education and Technology, 32(3), 444–452.
Destiana, D., Suchyadi, Y., & Anjaswuri, F. (2020). Pengembangan instrumen penilaian untuk meningkatkan kualitas pembelajaran produktif di sekolah dasar. Jurnal Pendidikan Dan Pengajaran Guru Sekolah Dasar (JPPGuseda), 03(September), 119–123.
Dewi, C. A., Rahayu, S., Muntholib, M., & Parlan, P. (2025, July). Students’ chemical literacy through ORDIEC strategies (orientation, review, designing, investigation, evaluation and conclusion): Cases of acid-base topics. In AIP Conference Proceedings (Vol. 3206, No. 1, p. 070011). AIP Publishing LLC.
Elm, J. (2021). Toward a holistic understanding of the formation and growth of atmospheric molecular clusters: A quantum machine learning perspective. The Journal of Physical Chemistry A, 125(4), 895–902.
Facione, P. A. (1998). Critical Thinking : What It Is and Why It Counts. CA: Measured Reasons and the California Academic Press.
Fauziah, F., Suyanto, E., Wahyudi, I., & Herlina, K. (2022). Effect of Learning Model Application of Guided Laboratory Inquiry to Logical Thinking Ability of Students on Heat to Electricity Conversion Material. Jurnal Pendidikan Matematika Dan IPA, 13(1), 114–126.
Fitriani, F., Fadly, W., & Faizah, U. N. (2021). Analisis keterampilan berpikir analitis siswa pada tema pewarisan sifat. Jurnal Tadris IPA Indonesia, 1(1), 55-67.
Furqan, M., Karyanto, P., & Salma, S. (2016). The Implementation of E-Module Based on Problem-Based Learning to Improve the Analytical Thinking Abilities and Reduce Misconception of X MIA 1 of SMA Negeri 1 Banyudono Academic Year of 2014/2015. Proceeding Biology Education Conference: Biology, Science, Enviromental, and Learning, 12(1), 410–414.
Gil, V. S., Bran, A. M., Franke, M., Schlama, R., Luterbacher, J. S., & Schwaller, P. (2023). Holistic chemical evaluation reveals pitfalls in reaction prediction models. [email protected], 1–17.
Gilbert, J. K., & Treagust, D. F. (2009). Models and Modeling in Science Education. Springer.
Gunbatar, S. A., Sirin, G. T., Ilkyaz, O. C., & Mutlu, Y. (2025). Exploring the artificial intelligence interaction profiles of participants with different levels of teaching experience for lesson planning in the context of acids and bases. Chemistry Education Research and Practice, 26(4), 977–995.
Herunata, H., Rosyida, I., Sulistina, O., & Wijaya, H. W. (2021, March). Correlational analysis of conceptual understanding, chemical representation, and representational competence on chemistry equilibrium. In AIP Conference Proceedings (Vol. 2330, No. 1, p. 020016). AIP Publishing LLC.
Johnstone, A. H. (1993). The development of chemistry teaching: A changing response to changing demand. Journal of Chemical Education, 70(9), 701–705.
Köksa, D., & Ulum, Ö. G. (2018). Language assessment through Bloom’s Taxonomy. Journal of Language and Linguistic Studies, 14(2), 76–88.
Liang, P., Bommasani, R., Lee, T., Tsipras, D., Soylu, D., Yasunaga, M., Zhang, Y., Narayanan, D., Wu, Y., Kumar, A., New-, B., Yuan, B., Yan, B., Zhang, C., Cosgrove, C., Manning, C. D., Ré, C., Acosta-navas, D., Hudson, D. A., … Zhang, T. (2023). Holistic Evaluation of Language Models. Transactions on Machine Learning Research.
Linacre, J. M. (2009). A User’s guide to Winsteps-ministep: Rasch-model computer programs. Program Manual 3.68. 0. IL.
Mezirow, J. (2018). Transformative learning theory. In K. Illeris (Ed.), Contemporary theories of learning. Routledge.
Muin, W. A., & Kurniati, L. (2022). Improving critical thinking skills in writing essay. International Journal of Education, Information Technology and Others (IJEIT), 5(3), 102–106.
Netchinda, S., & Duangpummet, P. (2025, July). Development of a Measurement Instrument to Assess Students’ Conceptual Understanding in Three Levels of Chemical Representation of Galvanic Cells by Using the Rasch Model. In 2025 10th International STEM Education Conference (iSTEM-Ed) (pp. 1-6). IEEE.
Nurussaniah, N., Setyosari, P., Kuswandi, D., & Ulfa, S. (2025). Psychometric validation of an analytical skills test in physics using the Rasch model. Journal of Baltic Science Education, 24(3), 522–537.
OECD. (2023). PISA 2022 Results (Volume I): The State of Learning and Equity in Education: Vol. I. OECD Publishing.
Park, C., Kim, S., Choi, H., & Paik, S. (2019). Exploring Learning Progression of Logical Thinking in Acid and Base Chemical Reactions. Journal of the Korean Chemical Society, 63(5), 376–386.
Prastiwi, M. N. B., & Laksono, E. W. (2018). The ability of analytical thinking and chemistry literacy in high school students learning The ability of analytical thinking and chemistry literacy in high school students learning. Journal of Physics: Conference Series, 1–8.
Rahmawati, Y., Zulhipri, Hartanto, O., Falani, I., & Iriyadi, D. (2022). Students’ conceptual understanding in chemistry learning using PhET interactive simulations. Journal of Technology and Science Education, 12(2), 303–326.
Rakhmawan, A., Firman, H., Redjeki, S., & Mulyani, S. (2018). Contribution of Logical Thinking Ability to Student s ’ Achievement in Three Level of Representations in Chemical Dynamic Materials. Jurnal Penelitian Dan Pembelajaran IPA, 4(2), 116–126.
Rinta, C., & Fitriza, Z. (2022). Pengembangan Tes Diagnostik Esai Terstruktur Kimia Materi Titrasi Asam Basa Sebagai Instrumen Analisis Hasil Belajar Siswa. Edukimia, 4(2), 84–89.
Rokhim, D. A., Atikah, A., Vitarisma, I. Y., Rahayu, S., & Muntholib, M. (2023). Assessment of high school students’ ability to solve structured problems with ideal model on acid–base. Orbital: The Electronic Journal of Chemistry, 14(4), 276–284.
Safitri, N. C., Nursa’adah, E., & Wijayanti, I. E. (2019). Analisis Multipel Representasi Kimia Peserta Didik pada Konsep Laju Reaksi. EduChemia: Jurnal Kimia Dan Pendidikan, 4(1), 1–12.
Sepriyanti, N., Nelwati, S., Kustati, M., & Afriadi, J. (2022). The effect of 21st-century learning on higher-order thinking skills (HOTS) and numerical literacy of science students in Indonesia based on gender. Jurnal Pendidikan IPA Indonesia, 11(2), 314–321.
Setiaji, B., Adiningsih, E. T., Pebriana, I. N., Supahar, Kuswanto, H., Wilujeng, I., & Wiyatmo, Y. (2025). Facilitating students’ analytical thinking skill and scientific attitude in distance learning using local wisdom-based physics PBL e-module. Revista Mexicana de Física E, 22, 020216, December, 1–11.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Trim Komunikata.
Suparman, A. R., Rohaeti, E., & Wening, S. (2024). Student Misconception In Chemistry : A Systematic Literature Review. Pegem Journal of Education and Instruction, 14(2), 238–252.
Susilaningsih, E., Nuswowati, M., & Natasukma, M. M. (2020). Profile of misconception in particulate level of acid basic subjects. IOP Conference Series: Materials Science and Engineering, 830, 042082.
Susilaningsih, E., Wulandari, C., Supartono, Kasmui, & Alighiri, D. (2018). The use of multi representative learning materials : definitive , macroscopic , microscopic , symbolic , and practice in analyzing students ’ concept understanding. Journal of Physics: Conference Series, 983, 012165.
Susongko, P. (2021). The comparison of descriptive statistical parameter estimation stability using raw scores and Rasch model. Journal of Physics: Conference Series, 1918(4), 042026.
Taber, K. S. (2019). Alternative conceptions and the learning of chemistry. Israel Journal of Chemistry, 59, 450–469.
Talens, C. U., Ong, I., Chiu, M. H., & Sevilla, F. B. (2025). Assessing conceptual understanding in high school chemistry: Particulate nature of gas concept test (PNGCT) with Rasch modeling. Chemistry Teacher International, 88, 1–13.
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Wachidah, L. R., Laila, Y., Irmawati, A., & Amin, S. (2021). Implementasi Penggunaan Tes Essay dalam Evaluasi Pembelajaran Daring pada Siswa Kelas VII SMP Negeri 1 Tlanakan. Ghâncaran: Jurnal Pendidikan Bahasa Dan Sastra Indonesi, 16–27.
Widarti, H. R., Nazriati, N., & Yunitasari, I. (2020). Understanding of acid–base concept based on multiple representations on cross-class level in senior high school. AIP Conference Proceedings, 2215(1), 020026.
Widarti, H. R., Nazriati, N., & Yunitasari, I. (2023). Acid-base misconception using diagnostic test based multiple representation on different grades of university students Acid-Base Misconception Using Diagnostic Test Based Multiple Representation on Different Grades of University Students. AIP Conference Proceedings, 2569(1), 030002, 030002(January).
Widoyoko, E. P. (2014). Evaluasi Program Pembelajaran. Pustaka Pelajar.
Widyastuti, E., & Susiana, S. (2019, March). Using the ADDIE model to develop learning material for actuarial mathematics. In Journal of Physics: Conference Series (Vol. 1188, No. 1, p. 012052). IOP Publishing.
Zuhaida, A., & Imaduddin, M. (2019). Analisis Level Literasi Laboratorium Kimia dari Calon Guru IPA Tahun Pertama. Jurnal Inovas Pendidikan Kimia, 13(2), 2349 – 2359.
