THE EFFECTIVENESS OF RATER TRAINING IN IMPROVING THE SELF-ASSESSMENT INTRA-RATER RELIABILITY OF ENGLISH SPEAKING PERFORMANCE
##plugins.themes.academic_pro.article.main##
Abstract
This quantitative study is an attempt to estimate the intra-rater reliability ofstudent self-assessment of their speaking performances and to find outwhether there is significant difference between the self-assessment intra-raterreliability of speaking performance without training and that of with training.The rater training used is adapted from the model developed by Herman,Aschbacher and Winters (1992). This study which employed equivalent timesamplesdesign collected data by asking 45 students to conduct selfassessmenton their six speaking performances. It was found that the range ofrs was 0.611 to 0.752 which means the consistency within students inassessing their own speaking performance was moderate high to high. Theintra-rater reliability of the self assessment after the treatments is higher thanthat of other experience being available in the absence of the treatment. It isconcluded that rater training improves the intra-rater reliability. Therefore, itis suggested to train the students on how to assess before employing selfassessmentin speaking instructions.
##plugins.themes.academic_pro.article.details##
References
Bachman, L. 2004. Statistical analyses for language assessment. Cambridge: Cambridge University Press.
Brown, H.D. 2004. Language Assessment Principles and Classroom Practices. New York: Pearson Education, Inc.
Bygate, M. 1987. Speaking. Chandin, C.N. & H.G. Widdowson (Eds). New York: Oxford University Press.
Carroll, B.J. and P.J. Hall. 1985. Make your Own Language Tests. Oxford: Pergamon Press Limited.
de Wet, F., Van der Walt, C, and Niesler, T.R., 2009. Automatic assessment of oral language proficiency and listening comprehension. Speech Communication, Volume 51, Issue 10, October 2009, Pages 864-87. Available at http://www.sciencedirect.com [accessed 10/20/09]
Hadley, G. and Mort, J. 1999. An Investigation of Interrater Reliability in Oral Testing. .On line at http://www.informaworld.com/smpp/conte^ 13696212 [accessed 01/20/09]
Hughes, A. 2003. Testing for Language Teachers. (2nd Ed.). New York: Cambridge University Press.
Johnston, B. 1987. Assessing English: Helping Students to Reflect on Their Work. Philadelphia: Open University Press.
Liu, Q., and Li, W. 2008. A Portfolio Approach to Oral English Assessment for English Majors in China. 6th Asia TEFL. 2008.1nternational Conferences. Denpasar: TEFLIN
O'Malley, J.M and L.V. Pierce. 1996. Authentic Assessment for English Language Learners: Practical Approaches for Teachers. London: Longman
Richards, J.C. 2008. Teaching Listening and Speaking from Theory to Practice. Cambridge: Cambridge University Press.
Richards, J.C, Hull, J. and Proctor, S. 1997. The New Interchange Book 2. Cambridge: Cambridge University Press.
Sawyer, W., Watson, K. and Adams, A (eds). 1989. English Teaching from A-Z. Philadelphia: Open University Press.
Singarimbun, M. and Effendi, S. (ed). 1989. Metode Penelitian Survai. (Revised Ed.). Jakarta: LP3ES.
Tuckman, B.W. 1978. Conducting Educational Research (2nd Ed.). New York:Harcourt Brace Jovanovich Publishers.
Weir, C.J. 1990. Communicative Language Testing. New York: Prentice Hall.