Non-Native English Teachers Interpretation of Rubrics Used for Assessing Students’ Writing
DOI:
https://doi.org/10.17501/26307413.2020.3202Keywords:
rubrics, interpretation of rubrics, non-native teachers, English writing, writing assessmentAbstract
The benefits of rubrics as teaching learning tools have been identified specifically for performance-based assessment in language. In Indonesia, the ability to produce quality written work has become a necessity to complete higher education but it remained unclear how learning and assessment on this area were conducted. This paper focused on exploring the use of rubrics by four non-native teachers’ working for a private ESL school in Indonesia for assessing students’ writing tasks. The study investigated how the teachers’ current practice and how they approached rubrics for assessing writing by means of both closed and open-ended surveys. Additionally, an analysis of the assessed essay against the rubrics was conducted to identify interrater reliability. The results showed that the teachers had positive attitude towards rubrics, used rubrics regularly and approached rubrics in a similar fashion which was to use them as an assessment tool but not learning tool. There was an identified interrater inconsistency in the scoring results. Additionally, the teachers put a lot more focus on Grammar, Spelling and Punctuation category than on the other two categories (Function & Content, and Cohesion & Coherence). The implication of the study calls for more effective use of rubrics as teaching and learning tools by the teachers as well as the provision of teacher training which enable the teachers to do so and consequently resulting in improvement of interrater reliability
Downloads
References
Andrade, H. G. (2000). Using Rubrics to Promote Thinking and Learning. Educational Leadership, 58(3
SUPPL.), 22–26.
Arindra, M. Y., & Ardi, P. (2020). The correlation between students’ writing anxiety and the use of writing
assessment rubrics. LEARN Journal: Language Education and Acquisition Research Network, 13(1).
Atkinson, D., & Lim, S. L. (2013). Improving assessment processes in higher education: Student and teacher
perceptions of the effectiveness of a rubric embedded in a LMS. Australasian Journal of Educational
Technology, 29(5), 651–666. https://doi.org/10.14742/ajet.526
Beck, S. W. (2009). Composition across secondary and post-secondary contexts: Cognitive, textual and social
dimensions. Cambridge Journal of Education, 39(3). https://doi.org/10.1080/03057640903103710
Broad, B. (2003). What we really value: Beyond Rubrics in teaching and assessing writing. In What We Really
Value: Beyond Rubrics in Teaching and Assessing Writing.
Brooks, G. (2013). Assessment and Academic Writing : A Look at the Use of Rubrics in the Second Language
Writing Classroom. Kwansei Gakuin University Humanities Review, 17(17), 227–240.
http://kgur.kwansei.ac.jp/dspace/handle/10236/10548
Caban, H. L. (2003). Rater Group Bias in the Speaking Assessment of Four L1 Japanese ESL Students. Second
Language Studies, 21(2), 1–44. http://www.hawaii.edu/sls/sls/wp-content/uploads/2011/06/Caban.pdf
Cohen, L., Lawrence, M., & Morrison, K. (2017). Research methods in education. Routledge.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative
research. In Educational Research (Vol. 4). https://doi.org/10.1017/CBO9781107415324.004
Davies, A. (2007). An introduction to applied linguistics. Edinburgh University Press Ltd.
https://doi.org/10.1093/elt/cci013
Dornyei Zoltan. (2007). Research methods in applied linguistics: Quantitative, qualitative, and mixed
methodologies. Oxford university Press.
Hunt, T., Carper, J., Lasley, T., Raisch, C., & Bowman, C. L. (2013). National Council of Teachers of English.
Encyclopedia of Educational Reform and Dissent, 97(4), 87–92. https://doi.org/10.4135/9781412957403.n296
Ismail, I., Jabri, U., Rahmat, & Musdalifah. (2017). Rubrics-Based Assessment as a Teaching Strategy of
Writing Journal for Novice Authors. International Conference on Education, 1(1).
Jeong, H. (2015). Rubrics in the classroom: do teachers really follow them? Language Testing in Asia, 5(1).
https://doi.org/10.1186/s40468-015-0013-5
Johnson, R. B., & Christenen, L. (2014). Educational Research :Quantitative, Qualitative, and Mixed Methods
Approaches. In SAGE Publications, Inc.
Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational
consequences. In Educational Research Review (Vol. 2, Issue 2). https://doi.org/10.1016/j.edurev.2007.05.002
Lovorn, M. G., & Rezaei, A. R. (2011). Assessing the assessment: Rubrics training for pre-service and new inservice teachers. Practical Assessment, Research and Evaluation, 16(16).
Miller, M.D., Linn, R.L., Gronlund, N. . (2014). Measurement and assessment in teaching. Igarss 2014, 1.
Qasim, A., & Candidate, P. (2015). Using Rubrics to Assess Writing: Pros and Cons in Pakistani Teachers’
Opinions. Journal of Literature Journal, 16, 51–58.
http://www.iiste.org/Journals/index.php/JLLL/article/viewFile/27152/27835
Sitorus / Non-Native English Teachers Interpretation of Rubrics Used for….
Ratnawati, R., Faridah, D., Anam, S., & Retnaningdyah, P. (2018). Exploring Academic Writing Needs of
Indonesian EFL Undergraduate Students. Arab World English Journal, 9(4), 420–432.
https://doi.org/10.24093/awej/vol9no4.31
Razi, A. (2016). Homeschooling: an Alternative Education in Indonesia. International Journal of Nusantara
Islam, 4(2), 75–84. https://doi.org/10.15575/ijni.v4i2.973
Razı, S. (2015). Development of a Rubric to Assess Academic Writing Incorporating Plagiarism Detectors.
SAGE Open, 5(2). https://doi.org/10.1177/2158244015590162
Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking
and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1).
https://doi.org/10.1186/s40594-020-00208-5
Rochmyaningsih, D. (2012). Indonesia Makes Research Publication A Graduation Requirement For All
Students - Asian Scientist Magazine. https://www.asianscientist.com/2012/03/academia/indonesia-dikti-aptisipublication-a-graduation-requirement-for-all-students-2012/
Singer, E. ;, & Couper, M. P. (2017). Some Methodological Uses of Responses to Open Questions and other
Verbatim Comments in Quantitative Surveys. Methods, Data, Analyses, 11(2).
Stevens, D. D., & Levi, A. (2006). Essays on Teaching Excellence Leveling the Field : Using Rubrics to
Achieve Greater Equity in Teaching and Grading. Development, 17(1), 2005–2006.
Sundeen, T. H. (2014). Instructional rubrics: Effects of presentation options on writing quality. Assessing
Writing, 21. https://doi.org/10.1016/j.asw.2014.03.003
Toba, R., Noor, W. N., & Sanu, L. O. (2019). The Current Issues of Indonesian EFL Students’ Writing Skills:
Ability, Problem, and Reason in Writing Comparison and Contrast Essay. Dinamika Ilmu, 19(1), 57–73.
https://doi.org/10.21093/di.v19i1.1506
Tsang, A. (2017). EFL/ESL Teachers’ General Language Proficiency and Learners’ Engagement. RELC
Journal, 48(1). https://doi.org/10.1177/0033688217690060
Wang, B. (2010). On Rater Agreement and Rater Training. English Language Teaching, 3(1).
https://doi.org/10.5539/elt.v3n1p108
Wilson, M. (2007). Why I Won’t Be Using Rubrics to Respond to Students’ Writing. English Journal, 96, 62.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Mei Lusiana Sitorus
This work is licensed under a Creative Commons Attribution 4.0 International License.