Rasch Analysis to Evaluate the Psychometric Properties of Junior Metacognitive Awareness Inventory in the Indonesian Context
Abstract
Empirically, metacognitive awareness is one of the main contributors to students' academic success. At the beginning of its development, the Jr.MAI self-report questionnaire was intended to measure students' metacognitive awareness in the United States. However, the evaluation of the psychometric properties for Indonesian high school students is still limited. The original Jr.MAI cannot be applied in Indonesia. By evaluating students' metacognitive awareness using Jr.MAI, teachers can understand students' information and knowledge related to their learning strategies and behaviors. Therefore, this study aims to evaluate the psychometric properties of the Indonesian translation of the Junior Metacognitive Awareness Inventory (Jr.MAI) self-report questionnaire. The Jr.MAI questionnaire consists of 18 items and uses a 5-point Likert scale response. 296 students (Male = 45.9%; Female = 54.1%) of public senior high schools in Indonesia completed the Jr.MAI questionnaire. The Rasch model was used to evaluate the psychometric properties of Jr.MAI. The results showed that the 5-point rating scale with 18 items functioned properly with a good fit, no gender bias, and achieved unidimensionality and local independence assumptions. It proved that the Jr. MAI questionnaire defined the latent variables and classified persons and items properly. Therefore, we concluded that the developed Jr.MAI questionnaire had good psychometric properties to be used by teachers and counselors for measuring and mapping the metacognitive characteristics at the senior high school level.
Keywords
Full Text:
PDFReferences
Abdellah, R. (2015). Metacognitive Awareness and its Relation to Academic Achievement and Teaching Performance of Pre-service Female Teachers in Ajman University in UAE. Procedia - Social and Behavioral Sciences, 174, 560–567.
Ahdhianto, E., Marsigit, Haryanto, & Santi, N. N. (2020). The Effect of Metacognitive-Based Contextual Learning Model on Fifth-Grade Students' Problem-Solving and Mathematical Communication Skills. European Journal of Educational Research, 9(2), 753–764.
Alindra, D., Fauzan, A., & Asmar, A. (2019). Metacognitive Awareness and Its Effect on Students' Problem Solving Ability in Implementing RME Approach. Proceedings of the 1st International Conference on Innovation in Education (ICoIE 2018), 178(ICoIE 2018), 318–322.
Allen, B. A., & Armour-Thomas, E. (1993). Construct Validation of Metacognition. The Journal of Psychology, 127(2), 203–211.
Amin, A. M., Corebima, A. D., Zubaidah, S., & Mahanal, S. (2020). The Correlation between Metacognitive Skills and Critical Thinking Skills at the Implementation of Four Different Learning Strategies in Animal Physiology Lectures. European Journal of Educational Research, 9(1), 143–163.
Andrich, D. (2017). Advances in social measurement: A Rasch measurement theory. In Perceived health and adaptation in chronic disease (pp. 66-91). Routledge.
Andrich, D., & Marais, I. (2019). A course in Rasch measurement theory. D. Andrich y I. Marais (Coords.), Measuring in the Educational, Social and Health Sciences, 41-53.
Aydin, U., & Ubuz, B. (2010). Turkish Version of the Junior Metacognitive Awareness Inventory: An Exploratory and Confirmatory Factor Analysis Bilişüstü Yetiler Envanteri’nin Türkçeye Uyarlanması: Açımlayıcı ve Doğrulayıcı Faktör Analizi. Education and Science, 35(157), 32–47.
Bahari, M., Widodo, A., & Winarno, N. (2020). Using Self-Regulated Learning to Promote Students ‘Metacognitive Awareness in Learning Electricity.
Blanc, A., & Rojas, A. J. (2018). Use of Rasch person-item maps to validate a theoretical model for measuring Attitudes toward Sexual Behaviors. PloS one, 13(8), e0202551.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd ed.). Psychology Press.
Boone, W. J., & Noltemeyer, A. (2017). Rasch Analysis: A Primer for School Psychology Researchers and Practitioners. Cogent Education, 4(1), 1416898.
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer.
Brown, A. L. (1978). Knowing when, where, and how to remember; a problem of metacognition. Advances in instructional psychology, 1.
Burin, D. I., Gonzalez, F. M., Barreyro, J. P., & Injoque-Ricle, I. (2020). Metacognitive Regulation Contributes to Digital Text Comprehension in E-learning. Metacognition and Learning, 15(3), 391–410.
Chen, W.-H., Lenderking, W., Jin, Y., Wyrwich, K. W., Gelhorn, H., & Revicki, D. A. (2014). Is Rasch Model Analysis Applicable in Small Sample Size Pilot Studies for Assessing Item Characteristics? An Example using PROMIS Pain Behavior Item Bank Data. Quality of Life Research, 23(2), 485–493.
Chou, Y.-T., & Wang, W.-C. (2010). Checking Dimensionality in Item Response Models with Principal Component Analysis on Standardized Residuals. Educational and Psychological Measurement, 70(5), 717–731.
Craig, K., Hale, D., Grainger, C., & Stewart, M. E. (2020). Evaluating Metacognitive Self-Reports: Systematic Reviews of the Value of Self-Report in Metacognitive Research. Metacognition and Learning, 15(2), 155–213.
Didino, D., Taran, E. A., Barysheva, G. A., & Casati, F. (2019). Psychometric Evaluation of the Russian Version of the Flourishing Scale in a Sample of Older Adults Living in Siberia. Health and Quality of Life Outcomes, 17(1), 1–12.
Fauzi, A., & Sa'diyah, W. (2019). The Metacognition of Pre-Service Biology Teachers: Awareness, Skills, Understanding, and Practices. Proceedings of the 6th International Conference on Community Development (ICCD 2019), January, 26–32.
Flavell, J. H. (1979). Metacognition and Cognitive Monitoring: A New Area of Cognitive–Developmental Inquiry. American Psychologist, 34(10), 906–911.
Harrison, G. M., & Vallin, L. M. (2018). Evaluating the Metacognitive Awareness Inventory using Empirical Factor-Structure Evidence. Metacognition and Learning, 13(1), 15–38.
Herlanti, Y. (2015). Kesadaran Metakognitif dan Pengetahuan Metakognitif Peserta Didik Sekolah Menengah Atas dalam Mempersiapkan Ketercapaian Standar Kelulusan pada Kurikulum 2013. Cakrawala Pendidikan, 34(3), 357–367.
Hidayat, R., Zulnaidi, H., & Zamri, S. N. A. S. (2018). Roles of Metacognition and Achievement Goals in Mathematical Modeling Competency: A Structural Equation Modeling Analysis. PLoS ONE, 13(11), e0206211.
Kim, B., Zyromski, B., Mariani, M., Lee, S. M., & Carey, J. C. (2017). Establishing the Factor Structure of the 18-Item Version of the Junior Metacognitive Awareness Inventory. Measurement and Evaluation in Counseling and Development, 50(1–2), 48–57.
Lee, W. L., Chinna, K., & Sumintono, B. (2020). Psychometrics Assessment of HeartQol Questionnaire: A Rasch Analysis. European Journal of Preventive Cardiology, 2047487320902322.
Maryati, M., Prasetyo, Z. K., Wilujeng, I., & Sumintono, B. (2019). Measuring Teachers' Pedagogical Content Knowledge using Many-Facet Rasch Model. Cakrawala Pendidikan, 38(3), 452–464.
Morphew, J. W. (2021). Changes in Metacognitive Monitoring Accuracy in an Introductory Physics Course. Metacognition and Learning, 16(1), 89–111.
Muñiz, J., Elosua, P., Padilla, J.-L., & Hambleton, R. K. (2016). Test Adaptation Standards for Cross-Lingual Assessment. In C. S. Wells, M. Faulkner-Bond, & E. Hambleton (Eds.), Educational Measurement: From Foundations to Future (pp. 291–304). The Guilford Press.
Muñoz, C. P., & Nieto, B. B. (2019). Spanish Version of the Flourishing Scale (FS) on the Parents of Children With Cancer: A Validation Through Rasch Analysis. Frontiers in Psychology, 10(35), 1–8.
Ning, H. K. (2018). A Rasch Analysis of the Junior Metacognitive Awareness Inventory with Singapore Students. Measurement and Evaluation in Counseling and Development, 51(2), 84–91.
Ning, H. K. (2019). The Bifactor Model of the Junior Metacognitive Awareness Inventory (Jr. MAI). Current Psychology, 38(2), 367–375.
Papini, N., Kang, M., Ryu, S., Griese, E., Wingert, T., & Herrmann, S. (2020). Rasch Calibration of the 25-Item Connor-Davidson Resilience Scale. Journal of Health Psychology, 135910532090476.
Rahayu, W., Putra, M. D. K., Iriyadi, D., Rahmawati, Y., & Koul, R. B. (2020). A Rasch and Factor Analysis of an Indonesian version of the Student Perception of Opportunity Competence Development (SPOCD) Questionnaire. Cogent Education, 7(1), 1721633.
Rusch, T., Lowry, P. B., Mair, P., & Treiblmaier, H. (2017). Breaking Free from the Limitations of Classical Test Theory: Developing and Measuring Information Systems Scales using Item Response Theory. Information & Management, 54(2), 189–203.
Schraw, G., & Dennison, R. S. (1994). Assessing Metacognitive Awareness. Contemporary Educational Psychology, 19(4), 460–475.
Sperling, R. A., Howard, B. C., Miller, L. A., & Murphy, C. (2002). Measures of Children's Knowledge and Regulation of Cognition. Contemporary Educational Psychology, 27(1), 51–79.
Sukarelawan, M. I., & Sriyanto, S. (2019). Mapping of Profile Students’ Metacognitive Awareness in Yogyakarta, Indonesia. Jurnal Riset Dan Kajian Pendidikan Fisika, 6(2), 56.
Sumintono, B., & Widhiarso, W. (2014). Aplikasi Model Rasch untuk Penelitian Ilmu-ilmu Sosial. Trim Komunikata.
Taasoobshirazi, G., Bailey, M., & Farley, J. (2015). Physics Metacognition Inventory Part II: Confirmatory Factor Analysis and Rasch Analysis. International Journal of Science Education, 37(17), 2769–2786.
Taasoobshirazi, G., & Farley, J. (2013). Construct Validation of the Physics Metacognition Inventory. International Journal of Science Education, 35(3), 447–459.
Van Zile-Tamsen, C. (2017). Using Rasch Analysis to Inform Rating Scale Development. Research in Higher Education, 58(8), 922–933.
Wind, S. A., & Gale, J. D. (2015). Rasch Measurement in the Context of a Misconceptions-Based Physical Science Assessment. Science Education, 99(4), 721–741.
Wright, B. D., & Stone, M. H. (1979). Best test design.
Wright, B., & Linacre, J. M. (1994). Reasonable Mean-Square Fit Values. Rasch Measurement Transactions, 8(3), 370.
Yasir, M., Fikriyah, A., Qomaria, N., & Al Haq, A. T. (2020). Metacognitive skill on students of science education study program: Evaluation from answering biological questions. JPBI (Jurnal Pendidikan Biologi Indonesia), 6(1), 157–164.
Zwick, R., Thayer, D. T., & Lewis, C. (1999). An Empirical Bayes Approach to Mantel‐Haenszel DIF Analysis. Journal of Educational Measurement, 36(1), 1–28.
Refbacks
- There are currently no refbacks.
