Argumentation Skill Assessment for Diagnosing Students' Understanding of Factual, Conceptual, Procedural, and Metacognitive Knowledge: Characteristics of Initial Needs

A. Walid, E. W. Winarni, F. A. Yanti

Abstract

This study aims to synthesize the characteristics of the initial needs for argumentative skills assessment instruments to diagnose students’ understanding of factual, conceptual, procedural, and metacognitive knowledge. This study used a quasi-experimental method. The technique used was quantitative descriptive research. The research subjects were taken from 50 students who used argumentative patterns in problem-solving on aquatic ecology material so that they were synthesized using argumentation skill indicators. This research was quantitative, with instrument construct design criteria in the cognitive domain based on the taxonomy of science education. The data in the study were collected through several tests to determine argumentation skills. Supporting data were obtained through questionnaires to be analyzed regarding content and learning tools. The data analysis technique calculated the average score of the test questions with criteria according to the skills of argumentation and analysis in terms of content and learning tools. The result of this research is a matrix of rigid test areas with the achievement of indicators of a neatly arranged argumentation skill questionnaire and the results of content analysis and learning tools that support the argumentation instrument.

Keywords

argumentation skill; assessment instrument; cognitive ability

Full Text:

PDF

References

Acar, O., Patton, B. R., & White, A. L. (2015). Prospective secondary science teachers’ argumentation skills and the interaction of these skills with their conceptual knowledge.

Australian Journal of Teacher Education (Online), 40(9), 132–156.

Aditomo, A., & Klieme, E. (2020). Forms of inquiry-based science instruction and their relations with learning outcomes: evidence from high and low-performing education systems. International Journal of Science Education, 42(4), 504–525.

Al Musawi, A., Al-Ani, W., Amoozegar, A., & Al-Abri, K. (2022). Strategies for Attention to Diverse Education in Omani Society: Perceptions of Secondary School Students. Education Sciences, 12(6), 398.

Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019). Educational data mining and learning analytics for 21st century higher education: A review and synthesis. Telematics and Informatics, 37(April 2018), 13–49.

Allen-Zhu, Z. (2017). Katyusha: The first direct acceleration of stochastic gradient methods. The Journal of Machine Learning Research, 18(1), 8194–8244.

Almendingen, K., Sparboe-Nilsen, B., Kvarme, L. G., & Benth, J. S. (2021). Core competencies for interprofessional collaborative practice among teacher education, health and social care students in a large scaled blended learning course. Journal of Multidisciplinary Healthcare, 14(August), 2249–2260.

Amalia, N. F., & Susilaningsih, E. (2014). Pengembangan instrumen penilaian keterampilan berpikir kritis siswa SMA pada materi asam basa. Jurnal Inovasi Pendidikan Kimia, 8(2).

Amornchai, P., Songkhla, J. N., & Sujiva, S. (2015). An argument performance task in a virtual classroom for enhancing graduate students’ analytical reasoning. Procedia-Social and Behavioral Sciences, 174, 1031–1035.

Antwi, S. K., & Hamza, K. (2015). Qualitative and quantitative research paradigms in business research: A philosophical reflection. European Journal of Business and Management, 7(3), 217–225.

Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., Saldana, L., Shelton, R. C., Stirman, S. W., & Lane-Fall, M. B. (2022). Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem. Implementation Science : IS, 17(1), 55.

Belland, B. R., Walker, A. E., & Kim, N. J. (2017). A Bayesian Network Meta-Analysis to Synthesize the Influence of Contexts of Scaffolding Use on Cognitive Outcomes in STEM Education. Review of Educational Research, 87(6), 1042–1081.

Cavagnetto, A., & Hand, B. (2012). The importance of embedding argument within science classrooms. In Perspectives on scientific argumentation (pp. 39–53). Springer.

Ching, G. S., Chao, P. C., Kuo, Y. S., & Roberts, A. (2021). Effects of cognitive knowledge and intercultural behavioral skills on cultural stereotypes and intercultural affect: A case of elementary students’ perspective on islam. International Journal of Environmental Research and Public Health, 18(24).

Claro, M., Preiss, D. D., San Martín, E., Jara, I., Hinostroza, J. E., Valenzuela, S., Cortes, F., & Nussbaum, M. (2012). Assessment of 21st century ICT skills in Chile: Test design and results from high school level students. Computers & Education, 59(3), 1042–1053.

Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (Fourth Edi). SAGE Publications, Inc.

Cunha, M. E., Quental-Ferreira, H., Parejo, A., Gamito, S., Ribeiro, L., Moreira, M., Monteiro, I., Soares, F., & Pousão-Ferreira, P. (2019). Understanding the individual role of fish, oyster, phytoplankton and macroalgae in the ecology of integrated production in earthen ponds. Aquaculture, 512, 734297.

Douglas, K. A., Merzdorf, H. E., Hicks, N. M., Sarfraz, M. I., & Bermel, P. (2020). Challenges to assessing motivation in MOOC learners: An application of an argument-based approach. Computers and Education, 150(September 2019), 103829.

Ferretti, R. P., & Graham, S. (2019). Argumentative writing: theory, assessment, and instruction. Reading and Writing, 32(6), 1345–1357.

Gascón, J. Á. (2021). El problema de las falacias: objeciones a la utilidad de un concepto teórico. Cogency, 13(1), 125-146.

Goepfert, N. C., Conrad Von Heydendorff, S., Dreßing, H., & Bailer, J. (2019). Effects of stigmatizing media coverage on stigma measures, self-esteem, and affectivity in persons with depression - An experimental controlled trial. BMC Psychiatry, 19(1), 1–12.

Habernal, I., Hannemann, R., Pollak, C., Klamm, C., Pauli, P., & Gurevych, I. (2017). Argotario: Computational argumentation meets serious games. EMNLP 2017 - Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Proceedings, 7–12.

Hacıeminoğlu, E., & Yıldız, N. G. (2022). Interdisciplinary Use of Argumentation among Religious Education and Philosophy Teachers-in-Training. Religions, 13(5), 405.

Iordanou, K. (2022). Supporting strategic and meta-strategic development of argument skill: the role of reflection. Metacognition and Learning, 399–425.

Iordanou, K., Kuhn, D., Matos, F., Shi, Y., & Hemberger, L. (2019). Learning by arguing. Learning and Instruction, 63(May), 101207.

Jackson, S., & Jacobs, S. (1980). Structure of conversational argument: Pragmatic bases for the enthymeme. Quarterly Journal of Speech, 66(3), 251–265.

Janssens, L., Kuppens, T., Mulà, I., Staniskiene, E., & Zimmermann, A. B. (2022). Do European quality assurance frameworks support integration of transformative learning for sustainable development in higher education? International Journal of Sustainability in Higher Education, 23(8), 148–173.

Klein, P., Küchemann, S., Brückner, S., Zlatkin-Troitschanskaia, O., & Kuhn, J. (2019). Student understanding of graph slope and area under a curve: A replication study comparing first-year physics and economics students. Physical Review Physics Education Research, 15(2), 20116.

Komljenovic, J. (2022). The future of value in digitalised higher education: why data privacy should not be our biggest concern. Higher Education, 83(1), 119–135.

Lieber, L. S., Ibraj, K., Caspari-Gnann, I., & Graulich, N. (2022). Students’ Individual Needs Matter: A Training to Adaptively Address Students’ Argumentation Skills in Organic Chemistry. Journal of Chemical Education, 99(7), 2754–2761.

Luginbühl, M., & Müller-Feldmeth, D. (2022). Oral Argumentation Skills between Process and Product. Languages, 7(2), 139.

Mardapi, D., & Herawan, T. (2018). Assessing teacher competence and its follow-up to support professional development sustainability. Journal of Teacher Education for Sustainability, 20(1), 106.

Matsumoto-Royo, K., Ramírez-Montoya, M. S., & Glasserman-Morales, L. D. (2022). Lifelong Learning and Metacognition in the Assessment of Pre-service Teachers in Practice-Based Teacher Education. Frontiers in Education, 7(May), 1–13.

Meral, G., Ucar, S., & Demircioglu, T. (2022). Investigate the effect of argumentation-promoted interactive simulation applications on students ’ argumentation levels , academic achievements , and entrepreneurship skills in science classes. Thinking Skills and Creativity, 45(July), 101106.

Molina Saorín, J., Miralles Martínez, P., & Trigueros Cano, F. J. (2014). La evaluación en ciencias sociales, geografía e historia: Percepción del alumnado tras la aplicación de la escala EPEGEHI-1. Educacion XX1, 17(2), 289–311.

Nie, W., Tsai, H., Asadpour, R., Blancon, J.-C., Neukirch, A. J., Gupta, G., Crochet, J. J., Chhowalla, M., Tretiak, S., & Alam, M. A. (2015). High-efficiency solution-processed perovskite solar cells with millimeter-scale grains. Science, 347(6221), 522–525.

Osborne, J. F., Henderson, J. B., MacPherson, A., Szu, E., Wild, A., & Yao, S. (2016). The development and validation of a learning progression for argumentation in science. Journal of Research in Science Teaching, 53(6), 821–846.

Perelman, C., & Olbrechts-Tyteca, L. (1989). Tratado de la argumentación.

Ping, I. L. L., & Osman, K. (2019). Laboratory-modified argument driven inquiry (lab-madi) module: content validity process. Jurnal Pendidikan IPA Indonesia, 8(1), 129–140.

Priemer, B., Eilerts, K., Filler, A., Pinkwart, N., Rösken-Winter, B., Tiemann, R., & Zu Belzen, A. U. (2020). A framework to foster problem-solving in STEM and computing education. Research in Science and Technological Education, 38(1), 105–130.

Re, M. R., Amenduni, F., De Medio, C., & Valente, M. (2019). How to use assessment data collected through writing activities to identify participants’ critical thinking levels. Journal of E-Learning and Knowledge Society, 15(3), 117–132.

Sampson, V., & Blanchard, M. R. (2012). Science teachers and scientific argumentation: Trends in views and practice. Journal of Research in Science Teaching, 49(9), 1122–1148.

Scott, B. D. (2019). Argumentation and the challenge of time: Perelman, temporality, and the future of argument. In Place and Time in Argumentation (pp. 13–25). Springer.

Sengul, O., Enderle, P. J., & Schwartz, R. S. (2020). Science teachers’ use of argumentation instructional model: linking PCK of argumentation, epistemological beliefs, and practice. International Journal of Science Education, 42(7), 1068–1086.

Sukardi, I., Wigati, I., & Masripah, I. (2015). Pengaruh metode pembelajaran discovery learning terhadap hasil belajar siswa pada mata pelajaran biologi Kelas VII di MTs Patra Mandiri Plaju Palembang. Bioilmi, 1(1), 22–29.

Thyer, B. A. (2012). Quasi-Experimental Research Designs. Oxford University Press.

Tikva, C., & Tambouris, E. (2021). Mapping computational thinking through programming in K-12 education: A conceptual model based on a systematic literature Review. Computers & Education, 162, 104083.

Toulmin, S. E. (2003). The uses of argument. Cambridge university press.

Urcola-Pardo, F., Ruiz de Viñaspre, R., Orkaizagirre-Gomara, A., Jiménez-Navascués, L., Anguas-Gracia, A., & Germán-Bes, C. (2017). La escala CIBISA: herramienta para la autoevaluación del aprendizaje práctico de estudiantes de enfermería TT - The CIBISA scale: self-assessment tool for practical learning of nursing students. Index de Enfermería, 26(3), 226–230.

Viyanti, V., Cari, C., Sunarno, W., & Prasetyo, Z. K. (2016). Pemberdayaan keterampilan argumentasi mendorong pemahaman konsep siswa. Jurnal Penelitian Pembelajaran Fisika, 7(1), 43–48.

Vrindt, M. De, Noortgate, W. Van Den, & Debeer, D. (2022). Text Mining to Alleviate the Cold-Start Problem of Adaptive Comparative Judgments. 7(July), 1–16.

Wahdan, W. Z., Sulistina, O., & Sukarianingsih, D. (2017). Analisis kemampuan berargumentasi ilmiah materi ikatan kimia peserta didik SMA, MAN, dan perguruan tinggi tingkat I. J-PEK (Jurnal Pembelajaran Kimia), 2(2), 30–40.

Walton, D. (2012). Using argumentation schemes for argument extraction: A bottom-up method. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), 6(3), 33–61.

Wang, L. (2021). Critical thinking sub-skills in english debate. Theory and Practice in Language Studies, 11(12), 1630–1635.

Wikara, B., Sutarno, S., Suranto, S., & Sajidan, S. (2022). Implementation of 5E Plus Learning Model on Energy Subject Matter To Improve Students’ Argumentation Skills. Jurnal Pendidikan IPA Indonesia, 11(2), 237-245.

Xie, F., & Derakhshan, A. (2021). A Conceptual Review of Positive Teacher Interpersonal Communication Behaviors in the Instructional Context. Frontiers in Psychology, 12(July), 1–10.

Yılmaz-özcan, N., & Tabak, S. (2019). The effect of argumentation-based social studies teaching on academic achievement, attitude and critical thinking tendencies of students. International Electronic Journal of Elementary Education, 12(2), 213–222.

Refbacks

  • There are currently no refbacks.