Academic Self-Efficacy Inventory: Using Rasch Analysis to Develop and Evaluate Self-Efficacy Rating Scales
Abstract
As many studies have proven, self-efficacy positively affects learning performance. Therefore, many instruments have been developed to measure self-efficacy. To be used for educational purposes, the instrument must be proven valid and reliable. This study aims to develop and evaluate the Academic Self-Efficacy Inventory (ASEI) that meets the criteria to be applied as a self-efficacy instrument. This research is a two-phase study designed following the recommendations for scale design and development.A total of 505 Indonesian high school students majoring in science were involved as respondents to test the 20-item rating scale. As a result, all questionnaire items met the fit category with an item reliability score of 0.94, and the unidimensionality scale also met the variance value explained by measures and unexplained variance criteria. Thus, ASEI is declared suitable, reliable, and valid for measuring students' self-efficacy on the topic of light and sound waves. This research provides results in the form of a self-efficacy instrument on the topic of light and sound waves and a validity test with a high value, which is useful for readers to have confidence in the quality of the study results.
Keywords
Full Text:
PDFReferences
Abduh, A., Jayadi, K., Anshari, Basri, M., & Arham, M. (2022). Self-Efficacy in Speaking Based Activities for Art and Design Students. International Journal of Language Education, 6(1), 91–100.
Aguilera-Hermida, A. P. (2020). College students’ use and acceptance of emergency online learning due to COVID-19. International journal of educational research open, 1, 100011.
Ayllón, S., Alsina, Á., & Colomer, J. (2019). Teachers’ involvement and students’ self-efficacy: Keys to achievement in higher education. PLoS ONE, 14(5), 1–11.
Bandura, A., Freeman, W. H., & Lightsey, R. (1997). Self-efficacy: The exercise of control. NY: Freeman.
Bergqvist, E., Tossavainen, T., & Johansson, M. (2020). An analysis of high and low intercorrelations between mathematics self-efficacy, anxiety, and achievement variables: A prerequisite for a reliable factor analysis. Education Research International, 2020.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd Ed.). Erlbaum.
Bond, T., Yan, Z., & Heene, M. (2020). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Routledge.
Boone, W. J., & Noltemeyer, A. (2017). Rasch analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4(1).
Brann, K. L., Boone, W. J., Splett, J. W., Clemons, C., & Bidwell, S. L. (2021). Development of the School Mental Health Self-Efficacy Teacher Survey Using Rasch Analysis. Journal of Psychoeducational Assessment, 39(2), 197–211.
Bureau of Labor Statistics. (2022). Fastest growing occupations: 20 occupations with the highest projected percent change of employment between 2021-31. U.S. Bureau of Labor Statistics.
Burnette, J. L., Pollack, J. M., Forsyth, R. B., Hoyt, C. L., Babij, A. D., Thomas, F. N., & Coy, A. E. (2020). A Growth Mindset Intervention: Enhancing Students’ Entrepreneurial Self-Efficacy and Career Development. Entrepreneurship: Theory and Practice, 44(5), 878–908.
Cai, S., Liu, C., Wang, T., Liu, E., & Liang, J. C. (2021). Effects of learning physics using Augmented Reality on students’ self-efficacy and conceptions of learning. British Journal of Educational Technology, 52(1), 235–251.
Chan, S. W., Looi, C. K., Ho, W. K., Huang, W., Seow, P., & Wu, L. (2021). Learning number patterns through computational thinking activities: A Rasch model analysis. Heliyon, 7(9), e07922.
Chrisnayanti, N. (2021). The use of formative assessment toward EFL students to enhance students’ self-efficacy in learning English. Journal of English Language Learning (JELL), 5(1), 1–23.
Chui, H., Li, H., & Ngo, H. Y. (2022). Linking Protean Career Orientation with Career Optimism: Career Adaptability and Career Decision Self-Efficacy as Mediators. Journal of Career Development, 49(1), 161–173.
Creely, E., Henriksen, D., Crawford, R., & Henderson, M. (2021). Exploring creative risk-taking and productive failure in classroom practice. A case study of the perceived self-efficacy and agency of teachers at one school. Thinking Skills and Creativity, 42(December).
Dellafiore, F., Pittella, F., Arrigoni, C., Baroni, I., Conte, G., Di Pasquale, C., Casole, L., Villa, G., & Caruso, R. (2020). A multi-phase study for the development of a self-efficacy measuring scale for ostomy care nursing management. Journal of Advanced Nursing, 76(1), 409–419.
Dewi, F. H., Samsudin, A., & Chandra, D. T. (2021). Developing FD-MT to investigate students’ mental model on fluid dynamic concept: a Rasch model analysis. Journal of Physics: Conference Series, 2098(1).
Donnelly, R., & Patrinos, H. A. (2021). Learning loss during Covid-19: An early systematic review. Prospects, 51(4), 601–609.
Dorfman, B. S., & Fortus, D. (2019). Students’ self-efficacy for science in different school systems. Journal of Research in Science Teaching, 56(8), 1037–1059.
Dubina, K. S., Kim, L., Colato, J., & Rieley, M. J. (2022). Projections overview and highlights, 2021-31. Monthly Labor Review, November, 19.
El-Hassan, K., & Ghalayini, N. (2020). Parental attachment bonds, dysfunctional career thoughts and career exploration as predictors of career decision-making self-efficacy of Grade 11 students. British Journal of Guidance and Counselling, 48(5), 597–610.
Elliot, M., Fairweather, I., Olsen, W., & Pampaka, M. (2016). A Dictionary of Social Research Methods (First Edit). Oxford University Press.
Emmons, C. L., & Zager, D. (2018). Increasing Collaboration Self-Efficacy to Improve Educational Programming for Students with Autism. Focus on Autism and Other Developmental Disabilities, 33(2), 120-128.
Falco, L. D., & Summers, J. J. (2019). Improving Career Decision Self-Efficacy and STEM Self-Efficacy in High School Girls: Evaluation of an Intervention. Journal of Career Development, 46(1), 62–76.
Fernanda, J. W., & Hidayah, N. (2020). Classical Test Theory dan Rasch Model. SQUARE : Journal of Mathematics and Mathematics Education, 2(1), 49–60.
Fidan, M., & Tuncel, M. (2021). Developing a self-efficacy scale toward physics subjects for lowe-secondary school students. Journal of Baltic Science Education2, 20(1), 38–49.
Frith, E., Elbich, D. B., Christensen, A. P., Rosenberg, M. D., Chen, Q., Kane, M. J., Silvia, P. J., Seli, P., & Beaty, R. E. (2020). Intelligence and creativity share a common cognitive and neural basis. Journal of Experimental Psychology: General, 150(4), 609–632.
Galla, B. M., Wood, J. J., Tsukayama, E., Har, K., Chiu, A. W., & Langer, D. A. (2014). A longitudinal multilevel model analysis of the within-person and between-person effect of effortful engagement and academic self-efficacy on academic performance. Journal of School Psychology, 52(3), 295–308.
Gao, J. (2021). Exploring children’s well-being and creativity in Chinese folk music lessons. Thinking Skills and Creativity, 41.
Guo, Y. M., Klein, B. D., & Ro, Y. K. (2020). On the effects of student interest, self-efficacy, and perceptions of the instructor on flow, satisfaction, and learning outcomes. Studies in Higher Education, 45(7), 1413–1430.
Guzey, S. S., & Jung, J. Y. (2021). Productive Thinking and Science Learning in Design Teams. International Journal of Science and Mathematics Education, 19(2), 215–232.
Hendrickson, P. (2021). Effect of Active Learning Techniques on Student Excitement, Interest, and Self-Efficacy. Journal of Political Science Education, 17(2), 311–325.
Huang, X., Zhang, J., & Hudson, L. (2019). Impact of math self-efficacy, math anxiety, and growth mindset on math and science career interest for middle school students: the gender moderating effect. European Journal of Psychology of Education, 34(3), 621–640.
Koçak, O., Ak, N., Erdem, S. S., Sinan, M., Younis, M. Z., & Erdoğan, A. (2021). The role of family influence and academic satisfaction on career decision-making self-efficacy and happiness. International Journal of Environmental Research and Public Health, 18(11).
Kok, M., Komen, A., van Capelleveen, L., & van der Kamp, J. (2020). The effects of self-controlled video feedback on motor learning and self-efficacy in a Physical Education setting: an exploratory study on the shot-put. Physical Education and Sport Pedagogy, 25(1), 49–66.
Koutroubas, V., & Galanakis, M. (2022). Bandura’s Social Learning Theory and Its Importance in the Organizational Psychology Context. Journal of Psychology Research, 12(6).
Linacre, J. M. (2010). Winsteps® Rasch measurement computer program. Winsteps. https://winsteps.com
Linacre, J. M. (2018). Rating Scale Instrument Quality Criteria. Rasch Org. https://www.rasch.org/rmt/rmt211m.htm
Lipovetsky, S. (2021). Handbook of Item Response Theory, Volume 1, Models. Technometrics, 63(3), 428–431.
Ma, K., Chutiyami, M., Zhang, Y., & Nicoll, S. (2021). Online teaching self-efficacy during COVID-19: Changes, its associated factors and moderators. Education and Information Technologies, 26(6), 6675–6697.
Magni, F., & Manzoni, B. (2020). When Thinking Inside the Box Is Good: The Nuanced Relationship between Conformity and Creativity. European Management Review, 17(4), 961–975.
Mohd Dzin, N. H., & Lay, Y. F. (2021). Validity and reliability of adapted self-efficacy scales in Malaysian context using pls-sem approach. Education Sciences, 11(11).
Nasir, M., & Iqbal, S. (2019). Academic Self Efficacy as a Predictor of Academic Achievement of Students in Pre-Service Teacher Training Programs. Bulletin of Education and Research, 41(1), 33–42.
Nurdini, N., Suhandi, A., Ramalis, T., & Samsudin, A. (2020). Developing Multitier Instrument of Fluids Concepts (MIFO) to Measure Student’s Conception: A Rasch Analysis Approach. Journal of Advanced Research in Dynamical and Control Systems, 12(6), 3069–3083.
Özer Akçay, Ş. (2021). Self-Efficacy Beliefs of Vocational Music Education Students on Instrument Perfo. International Journal of Education Technology and Scientific Researches, 6(15), 1571–1609.
Öztürk, M., Akkan, Y., & Kaplan, A. (2020). Reading comprehension, Mathematics self-efficacy perception, and Mathematics attitude as correlates of students’ non-routine Mathematics problem-solving skills in Turkey. International Journal of Mathematical Education in Science and Technology, 51(7), 1042–1058.
Pajares, F., & Miller, M. D. (1995). Mathematics self-efficacy and mathematics performances: The need for specificity of assessment. APA PsycNet, 42(2), 190–198.
Peura, P., Aro, T., Räikkönen, E., Viholainen, H., Koponen, T., Usher, E. L., & Aro, M. (2021). Trajectories of change in reading self-efficacy: A longitudinal analysis of self-efficacy and its sources. Contemporary Educational Psychology, 64(January).
Qian, M., & Wang, X. (2020). Illustration of Multilevel Explanatory IRT Model DIF Testing with the Creative Thinking Scale. Journal of Creative Behavior, 54(4), 1021–1027.
Rattray, J., & Jones, M. C. (2007). Essential elements of questionnaire design and development. Journal of Clinical Nursing, 16(2), 234–243.
Renko, M., Bullough, A., & Saeed, S. (2021). How do resilience and self-efficacy relate to entrepreneurial intentions in countries with varying degrees of fragility? A six-country study. International Small Business Journal: Researching Entrepreneurship, 39(2), 130–156.
Saline, S. (2021). Thriving in the New Normal: How COVID-19 has Affected Alternative Learners and Their Families and Implementing Effective, Creative Therapeutic Interventions. Smith College Studies in Social Work, 91(1), 1–28.
Scherrer, V., & Preckel, F. (2019). Development of Motivational Variables and Self-Esteem During the School Career: A Meta-Analysis of Longitudinal Studies. Review of Educational Research, 89(2), 211–258.
Slater, E. V., Norris, C. M., & Morris, J. E. (2021). The validity of the science teacher efficacy belief instrument (STEBI-B) for postgraduate, pre-service, primary teachers. Heliyon, 7(9), e07882.
Stolz, R. C., Blackmon, A. T., Engerman, K., Tonge, L., & A.McKayle, C. (2022). Poised for creativity: Benefits of exposing undergraduate students to creative problem-solving to moderate change in creative self-efficacy and academic achievement. Journal of Creativity, 32(2).
Supandi, S., Suyitno, H., Sukestiyarno, Y. L., & Dwijanto, D. (2021). Self-efficacy and the ability to think creatively by prospective mathematics teachers based on learning barriers. Journal of Educational and Social Research, 11(2), 94–105.
Supratman, S., Zubaidah, S., Corebima, A. D., & Ibrohim. (2021). The effect size of different learning on critical and creative thinking skills of biology students. International Journal of Instruction, 14(3), 187–206.
Tangkeallo, G. A., Purbojo, R., & Sitorus, K. S. (2014). Hubungan Antara Self-Efficacy dengan Orientasi Masa Depan Mahasiswa Tingkat Akhir. Jurnal Psikologi, 10(1).
Taylor, K. M., & Betz, N. E. (1983). Applications of self-efficacy theory to the understanding and treatment of career indecision. Journal of Vocational Behavior, 22(1), 63–81.
Teng, L. S. (2021). Individual differences in self-regulated learning: Exploring the nexus of motivational beliefs, self-efficacy, and SRL strategies in EFL writing. Language Teaching Research, April.
Torres, J., & Alieto, E. (2019). English learning motivation and self-efficacy of Filipino senior high school students. Asian EFL Journal, 22(1), 51-72.
Tus, J. (2020). Self–Concept, Self–Esteem, Self–Efficacy and Academic Performance of the Senior High School Students. International Journal Of Research Culture Society, 4(10), 45–59.
Usher, E. L., Ford, C. J., Li, C. R., & Weidner, B. L. (2019). Sources of math and science self-efficacy in rural Appalachia: A convergent mixed methods study. Contemporary Educational Psychology, 57, 32–53.
Wade, A., Dixon, J., Gao, Y., Walker, L., Knight, E., Tham, M., Williams, M., & Newman, G. (2022). Skills and Jobs for Melbourne’s West (Issue March).
Wei, X., Lin, L., Meng, N., Tan, W., Kong, S. C., & Kinshuk. (2021). The effectiveness of partial pair programming on elementary school students’ Computational Thinking skills and self-efficacy. Computers and Education, 160, 104023.
Wright, B. D. (1996). Reliability and separation. Rasch Org.
Xin, L., Tang, F., Li, M., & Zhou, W. (2020). From school to work: Improving graduates’ career decision-making self-efficacy. Sustainability (Switzerland), 12(3), 1–16.
Yadav, A., Mayfield, C., Moudgalya, S. K., Kussmaul, C., & Hu, H. H. (2021). Collaborative Learning, Self-Efficacy, and Student Performance in CS1 POGIL. SIGCSE 2021 - Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, 775–781.
Yasin, R. M., Yunus, F. A. N., Rus, R. C., Ahmad, A., & Rahim, M. B. (2015). Validity and Reliability Learning Transfer Item Using Rasch Measurement Model. Procedia - Social and Behavioral Sciences, 204(November 2014), 212–217.
Yavuzalp, N., & Bahcivan, E. (2020). The online learning self-efficacy scale: Its adaptation into Turkish and interpretation according to various variables. Turkish Online Journal of Distance Education, 21(1), 31-44.
Yeager, D. S., Hanselman, P., Walton, G. M., Murray, J. S., Crosnoe, R., Muller, C., Tipton, E., Schneider, B., Hulleman, C. S., Hinojosa, C. P., Paunesku, D., Romero, C., Flint, K., Roberts, A., Trott, J., Iachan, R., Buontempo, J., Yang, S. M., Carvalho, C. M., … Dweck, C. s. (2019). A national experiment reveals where a growth mindset improves achievement. Nature, 573, 364–369.
You, H. S., Kim, K., Black, K., & Min, K. W. (2018). Assessing science motivation for college students: Validation of the science motivation questionnaire II using the Rasch-Andrich rating scale model. Eurasia Journal of Mathematics, Science and Technology Education, 14(4), 1161–1173.
Yuen, M., Gysbers, N. C., Hui, E. K. P., Leung, T. K. M., Lau, P. S. Y., Chan, R. M. C., Shea, P. M. K., & Ke, S. S. Y. (2004). Academic Development Self-Efficacy Inventory. Life Skills Development Project, Faculty of Education, University of Hong Kong.
Zhang, X., & Ardasheva, Y. (2019). Sources of college EFL learners’ self-efficacy in the English public speaking domain. English for Specific Purposes, 53, 47–59.
Zhang, X., Ardasheva, Y., & Austin, B. W. (2020). Self-efficacy and English public speaking performance: A mixed method approach. English for Specific Purposes, 59, 1–16.
Zorkić, T. J., Mićić, K., & Cerović, T. K. (2021). Lost trust? The experiences of teachers and students during schooling disrupted by the COVID-19 pandemic. Center for Educational Policy Studies Journal, 11(Special Issue), 195–218.
Refbacks
- There are currently no refbacks.
