Impact of Integrating Science and Engineering Teaching Approach on Students Achievement: A Meta Analysis

A. M. Arshad, L. Halim, N. M. Nasri

Abstract

STEM teaching approach has attracted the attention of science educators as a panacea in addressing the deteriorating interest in STEM learning. However, the impact of STEM teaching approach on students’ achievement is scarcely discussed. Thus, this study aimed to explore the impact of integrating Science and Engineering teaching approach on the achievement of students. This meta-analysis was conducted systematically on articles published between January 2000 to January 2020 which were retrieved from five databases (EBSCOhost, Emerald, Scopus, Web of Science and ERIC).  Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were applied to ensure a rigorous selection of the desired research articles. The data were then assessed using two online statistical effect size calculators. A total of 14 effect sizes were calculated. The overall mean effect size obtained was of high effect (es=2.61).  The Engineering Design Process (EDP)(es=3.26, high effect) was the most effective teaching approach in enhancing students’ understanding, as opposed to design-based learning.   An implication of the study is that EDP should be the basis for other teaching approaches in SE. Solving and creating tasks encourage application of concepts that then lead to enhancement of achievement.

Keywords

integrated STEM; teaching approach; meta analysis

Full Text:

PDF

References

Alemdar, M., Moore, R. A., Lingle, J. A., Rosen, J., Gale, J., & Usselman, M. C. (2018). The impact of a middle school engineering course on students’ academic achievement and non-cognitive skills. International Journal of Education in Mathematics, Science and Technology, 6(4), 363–380.

Apedoe, X. S., Reynolds, B., Ellefson, M. R., & Schunn, C. D. (2008). Bringing engineering design into high school science classrooms: The heating/cooling unit. Journal of Science Education and Technology, 17(5), 454–465.

Arshad, A. Y. M. (2021). A Systematic Review: Issues in Implementation of Integrated STEM Education. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(9), 1124-1133.

Asghar, A., Ellington, R., Rice, E., Johnson, F., & Prime, G. M. (2012). Supporting STEM education in secondary science contexts. Interdisciplinary Journal of Problem-Based Learning, 6(2), 4.

Bagiati, A., & Evangelou, D. (2015). Engineering curriculum in the preschool classroom: the teacher's experience. European Early Childhood Education Research Journal, 23(1), 112-128.

Baker, C. K., & Galanti, T. M. (2017). Integrating STEM in elementary classrooms using model-eliciting activities: responsive professional development for mathematics coaches and teachers. International Journal of STEM Education, 4(1), 1-15.

Banks, F., & Barlex, D. (2020). Teaching STEM in the secondary school: Helping teachers meet the challenge. Routledge.

Barth, K. N. (2013). An investigation of the effects of integrating science and engineering content and pedagogy in an elementary school classroom.

Becker, K., & Park, K. (2011). Effects of integrative approaches among science, technology, engineering, and mathematics (STEM) subjects on students' learning: A preliminary meta-analysis. Journal of STEM Education: Innovations & Research, 12(5), 23–37.

Bertoni, A. (2019). Introducing value driven design in engineering education: teaching the use of value models in preliminary design. International Journal of Technology and Design Education, 30(3), 1-22.

Brown, J. C. (2017). A metasynthesis of the complementarity of culturally responsive and inquiry‐based science education in K‐12 settings: Implications for advancing equitable science teaching and learning. Journal of Research in Science Teaching, 54(9), 1143-1173.

Bryan, L. A., Moore, J. T., Johnson, C. C., & Roehrig, G. H. (2016). Integrated STEM education. In Johnson, C. C, Peters-Burton, E. E., & Moore, T. J. (Eds.), STEM Road Map: A Framework for Integrated STEM Education (pp. 23-37). Routledge, Taylor & Francis Group.

Chesky, N. Z., & Wolfmeyer, M. R. (2015). Philosophy of STEM education: A critical investigation. Springer.

Christian, K. B., Kelly, A. M., & Bugallo, M. F. (2021). NGSS-based teacher professional development to implement engineering practices in STEM instruction. International Journal of STEM Education, 8(1), 1-18.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Abingdon. England: Routledge.

Cronbach, L. J., & Shapiro, K. (1982). Designing evaluations of educational and social programs. Jossey-Bass.

Cross Francis, D., Tan, V., & Nicholas, C. (2019). Supporting disciplinary and interdisciplinary knowledge development and design thinking in an informal, pre‐engineering program: A Workplace Simulation Project. School Science and Mathematics, 119(7), 382-395.

Cunningham, C. M., Lachapelle, C. P., Brennan, R. T., Kelly, G. J., Tunis, C. S. A., & Gentry, C. A. (2020). The impact of engineering curriculum design principles on elementary students’ engineering and science learning. Journal of Research in Science Teaching, 57(3), 423-453.

Cunningham, C. M., & Carlsen, W. S. (2014). Precollege engineering education. In Handbook of Research on Science Education, Volume II (pp. 761-772). Routledge.

Dare, E. A., Ellis, J. A., & Roehrig, G. H. (2014). Driven by beliefs: Understanding challenges physical science teachers face when integrating engineering and physics. Journal of Pre-College Engineering Education Research (J-PEER), 4(2), 5.

Dong, Y., Wang, J., Yang, Y., & Kurup, P. M. (2020). Understanding intrinsic challenges to STEM instructional practices for Chinese teachers based on their beliefs and knowledge base. International Journal of STEM Education, 7(1), 1-12.

Doppelt, Y., Mehalik, M. M., Schunn, C. D., Silk, E., & Krysinski, D. (2008). Engagement and achievements: A case study of design-based learning in a science context. Journal of technology education, 19(2), 22-39.

EL-Deghaidy, H., Mansour, N., Alzaghibi, M., & Alhammad, K. (2017). Context of STEM Integration in Schools: Views from In-Service Science Teachers. EURASIA Journal of Mathematics, Science & Technology Education, 13(6), 2459-2484.

English, L. D., & Kirshner, D. (2015). 1 Changing Agendas in International Research in Mathematics Education. Handbook of international research in mathematics education, 1.

Fortus, D., Krajcik, J., Dershimer, R. C., Marx, R. W., & Mamlok‐Naaman, R. (2005). Design‐based science and real‐world problem‐solving. International Journal of Science Education, 27(7), 855-879.

Fortus, D., Dershimer, R. C., Krajcik, J., Marx, R. W., & Mamlok‐Naaman, R. (2004). Design‐based science and student learning. Journal of Research in Science Teaching, 41(10), 1081-1110.

Foster, M. C. H. (2013). Engineering solar energy in the fourth grade science classroom. age, 23, 1.

Goldstein, M., Loy, B., & Purzer, Ş. (2017). Designing a sustainable neighborhood. Science Scope, 41(1), 32.

Goodpaster, K. P., Adedokun, O. A., & Weaver, G. C. (2012). Teachers' perceptions of rural STEM teaching: Implications for rural teacher retention. The Rural Educator, 33(3), 9-22.

Gresnigt, R., Taconis, R., van Keulen, H., Gravemeijer, K., & Baartman, L. (2014). Promoting science and technology in primary education: A review of integrated curricula. Studies in Science Education, 50(1), 47-84.

Guzey, S. S., Moore, T. J., & Harwell, M. (2016). Building up STEM: An analysis of teacher-developed engineering design-based STEM integration curricular materials. Journal of Pre-College Engineering Education Research (J-PEER), 6(1), 2.

Halim, L., Abdullah, S. I. S. S., & Meerah, T. S. M. (2014). Students’ perceptions of their science teachers’ pedagogical content knowledge. Journal of Science Education and Technology, 23(2), 227-237.

Han, S., Capraro, R., & Capraro, M. M. (2015). How science, technology, engineering, and mathematics (STEM) project-based learning (PBL) affects high, middle, and low achievers differently: The impact of student factors on achievement. International Journal of Science and Mathematics Education, 13(5), 1089-1113.

Hattie, J. (2009). The black box of tertiary assessment: An impending revolution. Tertiary assessment & higher education student outcomes: Policy, Practice & Research, 259, 275.

Hattie, J., Rogers, H. J., & Swaminathan, H. (2014). The role of meta-analysis in educational research. In A companion to research in education (pp. 197-207). Springer, Dordrecht.

Honey, M., Pearson, G., & Schweingruber, H. A. (Eds.). (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research (Vol. 500). Washington, DC: National Academies Press.

Householder, D. L., & Hailey, C. E. (2012). Incorporating engineering design challenges into STEM courses.

Kang, N. H. (2019). A review of the effect of integrated STEM or STEAM (science, technology, engineering, arts, and mathematics) education in South Korea. Asia-Pacific Science Education, 5(1), 1-22.

Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM education, 3(1), 1-11.

Kim, E., Oliver, J. S., & Kim, Y. A. (2019). Engineering design and the development of knowledge for teaching among preservice science teachers. School Science and Mathematics, 119(1), 24-34.

Korur, F., Vargas, R. V., & Serrano, N. T. (2016). Attitude toward science teaching of Spanish and Turkish in-service elementary teachers: Multi-group confirmatory factor analysis. Eurasia Journal of Mathematics, Science & Technology Education, 12(2) 303-320.

Lachapelle, C. P., & Cunningham, C. M. (2014). Engineering in elementary schools. Engineering in pre-college settings: Synthesizing research, policy, and practices, 61-88.

LaForce, M., Noble, E., King, H., Century, J., Blackwell, C., Holt, S., ... & Loo, S. (2016). The eight essential elements of inclusive STEM high schools. International Journal of STEM Education, 3(1), 1-11.

Margot, K. C., & Kettler, T. (2019). Teachers’ perception of STEM integration and education: a systematic literature review. International Journal of STEM Education, 6(1), 1-16.

Martín‐Páez, T., Aguilera, D., Perales‐Palacios, F. J., & Vílchez‐González, J. M. (2019). What are we talking about when we talk about STEM education? A review of literature. Science Education, 103(4), 799-822.

Mathis, C. A., Siverling, E. A., Glancy, A. W., Guzey, S. S., & Moore, T. J. (2016, June). Students' use of evidence-based reasoning in K-12 engineering: A case study (fundamental). In 2016 ASEE Annual Conference & Exposition.

Mehalik, M. M., Doppelt, Y., & Schuun, C. D. (2008). Middle‐school science through design‐based learning versus scripted inquiry: Better overall science concept learning and equity gap reduction. Journal of engineering education, 97(1), 71-85.

Meyer, D. K., Turner, J. C., & Spencer, C. A. (1997). Challenge in a mathematics classroom: Students' motivation and strategies in project-based learning. The Elementary School Journal, 97(5), 501-521.

Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Prisma Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine, 6(7), e1000097.

Moore, T. J., Stohlmann, M. S., Wang, H. H., Tank, K. M., Glancy, A. W., & Roehrig, G. H. (2014). Implementation and integration of engineering in K-12 STEM education. In Engineering in pre-college settings: Synthesizing research, policy, and practices (pp. 35-60). Purdue University Press.

Moore, T. J., Tank, K. M., Glancy, A. W., Kersten, J. A., & Stohlmann, M. S. (2013). A framework for implementing engineering standards in K-12. In Annual Meeting of the Association of Science Teacher Educators. Charleston: South Carolina.

Mustafa, N., Ismail, Z., Tasir, Z., & Mohamad Said, M. N. H. (2016). A meta-analysis on effective strategies for integrated STEM education. Advanced Science Letters, 22(12), 4225-4228.

National Research Council. (2009). Engineering in K-12 education: Understanding the status and improving the prospects. National Academies Press.

National Research Council (2014). STEM learning is everywhere: Summary of a convocation on building learning systems. National Academies Press.

NGSS Lead States (2013). Next generation science standards: for states, by states. National Academies Press.

Ong, E. T., Aminah, A. Y. O. B., Ibrahim, N., Adnan, M., Shariff, J., & Ishak, N. M. (2016). Integrating STEM into Early Childhood Education: Is it feasible?. The Eurasia Proceedings of Educational and Social Sciences, 4, 336-341.

Ozcan, H., & Koca, E. (2019). Turkish adaptation of the attitude towards STEM scale: A validity and reliability study. Hacettepe University Journal of Education, 34(2), 387-401.

Permanasari, A., Rubini, B., & Nugroho, O. (2021). STEM Education in Indonesia: Science Teachers’ and Students’ Perspectives. Journal of Innovation in Educational and Cultural Research, 2(1), 7-16.

Purzer, S. (2017). Engineering approaches to problem solving and design in secondary school science: Teachers as design coaches. A Paper Commissioned by the National Academies of Sciences, Engineering, and Medicine Science Investigations and Engineering Design for Grades 6, 12.

Rethwisch, D. (2014). A study of the impact of project lead the way on achievement outcomes in Iowa.

Riskowski, J. L., Todd, C. D., Wee, B., Dark, M., & Harbor, J. (2009). Exploring the effectiveness of an interdisciplinary water resources engineering module in an eighth-grade science course. International Journal of Engineering Education, 25(1), 181–195.

Sakiz, G. (2017). Perceived teacher affective support in relation to emotional and motivational variables in elementary school science classrooms in Turkey. Research in Science & Technological Education, 35(1), 108-129.

Shahali, E. H. M., Halim, L., Rasul, S., Osman, K., Ikhsan, Z., & Rahim, F. (2015). Bitara-STEMTM training of trainers’ programme: impact on trainers’ knowledge, beliefs, attitudes and efficacy towards integrated stem teaching. Journal of Baltic Science Education, 14(1), 85.

Shahali, E. H. M., Halim, L., Rasul, M. S., Osman, K., & Zulkifeli, M. A. (2016). STEM learning through engineering design: Impact on middle secondary students’ interest towards STEM. EURASIA Journal of Mathematics, Science and Technology Education, 13(5), 1189-1211.

Shahali, E. H. M., Halim, L., Rasul, M. S., Osman, K., & Mohamad Arsad, N. (2019). Students’ interest towards STEM: A longitudinal study. Research in Science & Technological Education, 37(1), 71-89.

Soylu, Ş. (2016). Stem education in early childhood in Turkey. Journal of Educational & Instructional Studies in the World, 6.

Standish, N., Christensen, R., Knezek, G., Kjellstrom, W., & Bredder, E. (2016). The effects of an engineering design module on student learning in a middle school science classroom. International Journal of Learning, Teaching and Educational Research, 15(6), 156-174.

Starr, C. R., Hunter, L., Dunkin, R., Honig, S., Palomino, R., & Leaper, C. (2020). Engaging in science practices in classrooms predicts increases in undergraduates' STEM motivation, identity, and achievement: A short‐term longitudinal study. Journal of Research in Science Teaching, 57(7), 1093-1118.

Thibaut, L., Ceuppens, S., De Loof, H., De Meester, J., Goovaerts, L., Struyf, A., & Hellinckx, L. (2018). Integrated STEM education: A systematic review of instructional practices in secondary education. European Journal of STEM Education, 3(1), 2.

Tran, N. A., & Nathan, M. J. (2010). Pre‐college engineering studies: An investigation of the relationship between pre‐college engineering studies and student achievement in science and mathematics. Journal of Engineering Education, 99(2), 143-157.

Vallera, F. L., & Bodzin, A. M. (2020). Integrating STEM with AgLIT (Agricultural Literacy Through Innovative Technology): The Efficacy of a Project-Based Curriculum for Upper-Primary Students. International Journal of Science and Mathematics Education, 18(3), 419-439.

Vasquez, J. A., Sneider, C. I., & Comer, M. W. (2013). STEM lesson essentials, grades 3-8: Integrating science, technology, engineering, and mathematics (pp. 58-76). Portsmouth, NH: Heinemann.

Walkington, C., Nathan, M., Wolfgram, M., Alibali, M., & Srisurichan, R. (2011). Bridges and barriers to constructing conceptual cohesion across modalities and temporalities: Challenges of STEM integration in the precollege engineering classroom. Engineering in Precollege settings: research into practice, 183-210.

Wang, H. H., Moore, T. J., Roehrig, G. H., & Park, M. S. (2011). STEM integration: Teacher perceptions and practice. Journal of Pre-College Engineering Education Research (J-PEER), 1(2), 2.

White, D. W. (2014). What is STEM education and why is it important? Florida Association of Teacher Educators Journal, 1(14), 1-9.

Wyss, V. L., Heulskamp, D., & Siebert, C. J. (2012). Increasing middle school student interest in STEM careers with videos of scientists. International Journal of Environmental and Science Education, 7(4), 501-522.

Yaki, A. A., Saat, M. R., Sathasivam, V. R., & Zulnaidi, H. (2019). Enhancing science achievement utilising an integrated STEM approach. Malaysian Journal of Learning and Instruction, 16(1), 181-205.

Refbacks

  • There are currently no refbacks.