Using Multilevel Modelling to Evaluate Science Literacy and Technology Course of the Indonesian Non-Science Students
Abstract
In this paper, a science literacy and technology course has been designed and implemented to strengthen the national initiative empowering scientifically literate Indonesian society. This paper is intended to evaluate to what degree non-science undergraduate students can perform this course. The diverse background of non-science students who participated in this study led to the challenge to evaluate their performance more comprehensively contemplating the nested structure of students’ department and faculty setting. In light of the hierarchical nature of the student data, multilevel modelling was used to conduct the analysis. The first level of analysis involved students’ performance and affective attributes measured using demonstrated science literacy assessment (SLA-D) and motivational beliefs (SLA-MB) respectively. Then, the subsequent level of analysis comprised demographic factors gathered from the institutional record. Findings demonstrated that the impact of demographic factors on the students’ performance of science literacy was not substantial. Different settings of students’ department and faculty level drove the association between affective factors and the learning process toward science literacy courses substantially. The multilevel approach controlled the equitable student assessment within the nature of students’ data structure. This paper suggests an implication of advancement regarding educational data analysis and examines the effectiveness of science literacy courses for higher institutions specifically for non-science majors.
Keywords
Full Text:
PDFReferences
Afriana, J., Permanasari, A., & Fitriani, A. (2016). Project-based learning integrated to stem to enhance elementary school students’ scientific literacy. Jurnal Pendidikan IPA Indonesia, 5(2).
Ahied, M., Muharrami, L. K., Fikriyah, A., & Rosidi, I. (2020). Improving students’ scientific literacy through distance learning with augmented reality-based multimedia amid the covid-19 pandemic. Jurnal Pendidikan IPA Indonesia, 9(4), 499-511.
Akram, S., & Pervaiz, Z. (2020). Mother’s education as a predictor of individual’s opportunities to learn and earn. Elementary Education Online, 19(4), 879-884.
BAKK UNY. (2019). Structure of Curriculum. UNY. http://bakk.uny.ac.id/informasi/peraturan-akademik/struktur-kurikulum
Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1).
Bellová, R., Balážová, M., & Tomčík, P. (2021). Are attitudes towards science and technology related to critical areas in science education? Research in Science & Technological Education, 1-16.
Briones, S. K. F., Dagamac, R. J. R., David, J. D., & Landerio, C. A. B. (2022). Factors Affecting the Students’ Scholastic Performance: A Survey Study. Indonesian Journal of Educational Research and Technology, 2(2), 97-102.
Cheema, J. R. (2017). Cross-country gender DIF in PISA science literacy items. European Journal of Developmental Psychology, 16(2), 152–166.
Creswell, J. C. (2015). Research Design: Qualitative, Quantitative, and Mixed Method Approaches. Sage Publications.
Dewi, C. A., Khery, Y., & Erna, M. (2019). An ethnoscience study in chemistry learning to develop scientific literacy. Jurnal Pendidikan IPA Indonesia, 8(2), 279-287.
Ding, L. (2019). Theoretical perspectives of quantitative physics education research. Physical Review Physics Education Research, 15(2).
Efthimiou, C. J., & Llewellyn, R. A. (2004). Cinema as a tool for science literacy. ArXiv Preprint Physics/0404078.
Ersan, O., & Rodriguez, M. C. (2020). Socioeconomic status and beyond a multilevel analysis of TIMSS mathematics achievement given student and school context in Turkey. Large-Scale Assessments in Education, 8(1), 1–32.
Fakhriyah, F., Masfuah, S., Roysa, M., Rusilowati, A., & Rahayu, E. S. (2017). Student’s science literacy in the aspect of content science?. Jurnal Pendidikan IPA Indonesia, 6(1).
Finch, W. H., Bolin, J. E., & Kelley, K. (2016). Multilevel Modeling Using R. CRC Press.
Fives, H., Huebner, W., Birnbaum, A. S., & Nicolich, M. (2014). Developing a Measure of Scientific Literacy for Middle School Students. Science Education, 98(4), 549-580.
Fortus, D., Lin, J., Neumann, K., & Sadler, T. D. (2022). The role of affect in science literacy for all. International Journal of Science Education, 44(4), 535–555.
Güre, Ö. B., Kayri, M., & Erdoğan, F. (2020). Analysis of Factors Affecting PISA 2015 Mathematics Literacy via Educational Data Mining. Ted Eğitim Ve Bilim. 45(1).
Hamper, B. C., & Meisel, J. W. (2020). Introducing Nonscience Majors to Science Literacy via a Laboratory and Lecture Beer Brewing Course. Journal of Chemical Education, 97(5), 1289–1294.
Hastuti, P. W., Setianingsih, W., & Anjarsari, P. (2020). How to develop students’ scientific literacy through the integration of local wisdom in Yogyakarta on science learning? Journal of Physics: Conference Series, 1440(1).
Hobson, A. (2003). Designing Science Literacy Course. In T. M. Cooney (Ed.), Teaching Science in the Two-year College (pp. 45–46). NSTA Press.
Hobson, A. (2008). The Surprising Effectiveness of College Scientific Literacy Courses. The Physics Teacher, 46(7), 404-406.
Impey, C. (2013). Science literacy of undergraduates in the United States. Organizations, People and Strategies in Astronomy, 2(2), 353–364.
Impey, C., Buxner, S., Antonellis, J., Johnson, E., & King, C. (2011). A twenty-year survey of science literacy among college undergraduates. Journal of College Science Teaching, 40(4), 31–37.
Kamba, A.H., Oladayo, A.A., & Fakai A.A. (2020). Factors and Effect of Poor Background on the Students’ Academic Performance in Physics at Senior Secondary School in Birnin Kebbi Metropolis. Saudi Journal of Engineering and Technology, 5(3), 114-119.
Kanim, S., & Cid, X. C. (2020). Demographics of physics education research. Physical Review Physics Education Research, 16(2).
Luo, W., Li, H., Baek, E., Chen, S., Lam, K. H., & Semma, B. (2021). Reporting Practice in Multilevel Modeling: A Revisit After 10 Years. Review of Educational Research, 91(3), 311-355.
Mahmudah, U., Lola, S. M., Fatimah, S., & Suryandari, K. C. (2022). Academic Resilience and Science Academic Emotion in Numeration under Online Learning: Predictive Capacity of an Artificial Neural Network. Jurnal Pendidikan IPA Indonesia, 11(4).
Mahmudah, U., Chamdani, M., Tarmidzi, T., & Fatimah, S. (2020). Robust regression for estimating the impact of students’ social behaviors on scientific literacy. Cakrawala Pendidikan, 39(2), 293-304.
Marzulina, L., Pitaloka, N. L., Herizal, H., Holandyah, M., Erlina, D., & Lestari, I. T. (2018). Looking at the Link between Parents’ Educational Backgrounds and Students’ English Achievement. Indonesian Research Journal in Education (IRJE), 2(1), 51–60.
Masud, S., Mufarrih, S. H., Qureshi, N. Q., Khan, F., Khan, S., & Khan, M. N. (2019). Academic Performance in Adolescent Students: The Role of Parenting Styles and Socio-Demographic Factors – A Cross-Sectional Study from Peshawar, Pakistan. Frontiers in Psychology, 10.
Matuschek, H., Kliegl, R., Vasishth, S., Baayen, H., & Bates, D. (2017). Balancing Type I error and power in linear mixed models. Journal of memory and language, 94, 305-315.
Miller, J. D. (1998). The measurement of civic scientific literacy. Public understanding of science, 7(3), 203.
Mohammadpour, E., Shekarchizadeh, A., & Kalantarrashidi, S. A. (2015). Multilevel modeling of science achievement in the TIMSS participating countries. The Journal of Educational Research, 108(6), 449-464.
Nurjati, N., Rahayu, E. Y., & Khabib, S. (2022). Technical Guidance for The Preparation Of AKM-Based National Assessment of English Learning for State Senior High School Teachers In Surabaya. Kanigara, 2(1), 216–224.
Odden, T. O. B., Marin, A., & Rudolph, J. L. (2021). How has Science Education changed over the last 100 years? An analysis using natural language processing. Science Education, 105(4), 653-680.
Parkinson, J., & Adendorff, R. (2004). The use of popular science articles in teaching scientific literacy. English for Specific Purposes, 23(4), 379-396.
Parno, Yuliati, L., Hermanto, F. M., & Ali, M. (2020). A case study on comparison of high school students scientific literacy competencies domain in physics with different methods: PBL-stem education, PBL, and conventional learning. Jurnal Pendidikan IPA Indonesia, 9(2), 159-168.
Priyambodo, E. (2016). The effectiveness of collaborative academic online based learning through students’ self-regulated learning. Journal of Education and Learning (EduLearn), 10(4), 405-410.
Pujawan, I.G.N., Rediani, N.N., Antara, I.G.W.S., Putri, N.N.C.A., & Bayu, G.W. (2022). Revised Bloom Taxonomy-Oriented Learning Activities to Develop Scientific Literacy and Creative Thinking Skills. Jurnal Pendidikan IPA Indonesia. 11(1), 47-60.
Queiruga-Dios, M. Á., López-Iñesta, E., Diez-Ojeda, M., Sáiz-Manzanares, M. C., & Dorrío, J. B. V. (2020). Citizen Science for Scientific Literacy and the Attainment of Sustainable Development Goals in Formal Education. Sustainability, 12(10), 4283.
Rachman, T. A., Latipah, E., Zaqiah, Q. Y., & Erihadiana, M. (2021). Curriculum Innovation to Improve Indonesian Education in PISA International Assessment in Disruptive Education Era. ACM International Conference Proceeding Series.
Ramdani, A., Jufri, A. W., Gunawan, G., Fahrurrozi, M., & Yustiqvar, M. (2021). Analysis of Students’ Critical Thinking Skills in terms of Gender Using Science Teaching Materials Based on The 5E Learning Cycle Integrated with Local Wisdom. Jurnal Pendidikan IPA Indonesia, 10(2), 187-199.
Ratini, M. H., Suparman, MA, Tamuri, AH, & Susanto, E. (2018). The influence of learning models and learning reliance. Jurnal Pendidikan IPA Indonesia, 7(4), 458-466.
Rofieq, A., & Fauzi, A. (2022). Students’ Knowledge and Attitudes toward Science: Its Correlation on Students’ Disbelief in Non-Scientific Misinformation. Jurnal Pendidikan IPA Indonesia, 11(2).
Romero, R., & De las Heras, M. A. (2020). One step closer to understanding motivation in scientific education: The incorporation of science textbooks as a predictor, together with motivational climate and basic psychological needs. Jurnal Pendidikan IPA Indonesia, 9(4), 590-599.
Ross, K., Hooten, M. A., & Cohen, G. (2013). Promoting Science Literacy through an Interdisciplinary Approach. Bioscene: Journal of College Biology Teaching, 39(1), 21-26.
Rudolph, J. L. (2020). The lost moral purpose of science education. Science Education, 104(5), 895-906.
Salamah, A., Prastowo, T., & Hariyono, E. (2022). The Development Research: Assessment Instruments of Science Literacy Based on Minimum Competency Assessment (AKM) Level 4th for Solar System Concepts. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 8(1), 115–124.
Salehi, S., Burkholder, E., Lepage, G. P., Pollock, S., & Wieman, C. (2019). Demographic gaps or preparation gaps?: The large impact of incoming preparation on performance of students in introductory physics. Physical Review Physics Education Research, 15(2), 020114.
Santoso, P. H., Istiyono, E., Haryanto, & Hidayatulloh, W. (2022). Thematic Analysis of Indonesian Physics Education Research Literature Using Machine Learning. Data, 7(11), 147.
Simmons, A. B., & Heckler, A. F. (2020). Grades, grade component weighting, and demographic disparities in introductory physics. Physical Review Physics Education Research, 16(2).
Sjöström, J., & Eilks, I. (2018). Reconsidering Different Visions of Scientific Literacy and Science Education Based on the Concept of Bildung. In Y. J. Dori, Z. R. Mevarech, & D. R. Baker (Eds.), Cognition, Metacognition, and Culture in STEM Education: Learning, Teaching and Assessment (pp. 65–88). Springer International Publishing.
Sumarti, S. S., Aris, S. R. S., & Aini, R. N. (2018). Chemoentrepreneurship with Cooperative Integrated Process Inquiry Strategy to Increase Students’ Entrepreneurial Interest and Learning Motivation. Jurnal Pendidikan IPA Indonesia, 7(2), 172-180.
Surjono, H. D., Muhtadi, A., & Wahyuningsih, D. (2017). The implementation of blended learning in multimedia courses for undergraduate students in Indonesia. International Journal of Information and Education Technology, 7(10), 783–786.
Surpless, B., Bushey, M., & Halx, M. (2018). Developing Scientific Literacy in Introductory Laboratory Courses: A Model for Course Design and Assessment. Journal of Geoscience Education, 62(2), 244–263.
Susongko, P., Arfiani, Y., & Kusuma, M. (2021). Determination of gender differential item functioning in tegal-students’ scientific literacy skills with integrated science (Slisis) test using Rasch model. Jurnal Pendidikan IPA Indonesia, 10(2), 270-281.
Suwono, H., Pratiwi, H. E., Susanto, H., & Susilo, H. (2017). Enhancement of students’ biological literacy and critical thinking of biology through socio-biological case-based learning. Jurnal Pendidikan IPA Indonesia, 6(2), 213-220.
Ustun, U., Cansiz, M., Ozdemir, E., & Cansiz, N. (2022). Student and school-level factors to predict science literacy for two top-performing countries in PISA 2015: Finland and Singapore. International Journal of Science Education, 44(4), 579–603.
Widiana, I. W., Hermayuni, T. D., Sastra Agustika, G. N., & Kusumastuti, F. A. (2020). The effect of literacy based on the exploration of science with cultural insights on thematic content mastery and social attitude. Jurnal Pendidikan IPA Indonesia, 9(4), 521-531.
Widodo, W., Sudibyo, E., Suryanti, Sari, D. A. P., Inzanah, & Setiawan, B. (2020). The effectiveness of gadget-based interactive multimedia in improving generation z’s scientific literacy. Jurnal Pendidikan IPA Indonesia, 9(2), 248-256.
You, H. S., Park, S., & Delgado, C. (2021). A closer look at US schools: What characteristics are associated with scientific literacy? A multivariate multilevel analysis using PISA 2015. Science Education, 105(2), 406-437.
Refbacks
- There are currently no refbacks.
