Non-Native English Teachers Interpretation of Rubrics Used for Assessing Students’ Writing

  • Mei Lusiana Sitorus
Keywords: rubrics, interpretation of rubrics, non-native teachers, English writing, writing assessment

Abstract

The benefits of rubrics as teaching learning tools have been identified specifically for performance-based assessment in language. In Indonesia, the ability to produce quality written work has become a necessity to complete higher education but it remained unclear how learning and assessment on this area were conducted. This paper focused on exploring the use of rubrics by four non-native teachers’ working for a private ESL school in Indonesia for assessing students’ writing tasks. The study investigated how the teachers’ current practice and how they approached rubrics for assessing writing by means of both closed and open-ended surveys. Additionally, an analysis of the assessed essay against the rubrics was conducted to identify interrater reliability. The results showed that the teachers had positive attitude towards rubrics, used rubrics regularly and approached rubrics in a similar fashion which was to use them as an assessment tool but not learning tool. There was an identified interrater inconsistency in the scoring results. Additionally, the teachers put a lot more focus on Grammar, Spelling and Punctuation category than on the other two categories (Function & Content, and Cohesion & Coherence). The implication of the study calls for more effective use of rubrics as teaching and learning tools by the teachers as well as the provision of teacher training which enable the teachers to do so and consequently resulting in improvement of interrater reliability

References

Andrade, H. G. (2000). Using Rubrics to Promote Thinking and Learning. Educational Leadership, 58(3

SUPPL.), 22–26.

Arindra, M. Y., & Ardi, P. (2020). The correlation between students’ writing anxiety and the use of writing

assessment rubrics. LEARN Journal: Language Education and Acquisition Research Network, 13(1).

Atkinson, D., & Lim, S. L. (2013). Improving assessment processes in higher education: Student and teacher

perceptions of the effectiveness of a rubric embedded in a LMS. Australasian Journal of Educational

Technology, 29(5), 651–666. https://doi.org/10.14742/ajet.526

Beck, S. W. (2009). Composition across secondary and post-secondary contexts: Cognitive, textual and social

dimensions. Cambridge Journal of Education, 39(3). https://doi.org/10.1080/03057640903103710

Broad, B. (2003). What we really value: Beyond Rubrics in teaching and assessing writing. In What We Really

Value: Beyond Rubrics in Teaching and Assessing Writing.

Brooks, G. (2013). Assessment and Academic Writing : A Look at the Use of Rubrics in the Second Language

Writing Classroom. Kwansei Gakuin University Humanities Review, 17(17), 227–240.

http://kgur.kwansei.ac.jp/dspace/handle/10236/10548

Caban, H. L. (2003). Rater Group Bias in the Speaking Assessment of Four L1 Japanese ESL Students. Second

Language Studies, 21(2), 1–44. http://www.hawaii.edu/sls/sls/wp-content/uploads/2011/06/Caban.pdf

Cohen, L., Lawrence, M., & Morrison, K. (2017). Research methods in education. Routledge.

Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative

research. In Educational Research (Vol. 4). https://doi.org/10.1017/CBO9781107415324.004

Davies, A. (2007). An introduction to applied linguistics. Edinburgh University Press Ltd.

https://doi.org/10.1093/elt/cci013

Dornyei Zoltan. (2007). Research methods in applied linguistics: Quantitative, qualitative, and mixed

methodologies. Oxford university Press.

Hunt, T., Carper, J., Lasley, T., Raisch, C., & Bowman, C. L. (2013). National Council of Teachers of English.

Encyclopedia of Educational Reform and Dissent, 97(4), 87–92. https://doi.org/10.4135/9781412957403.n296

Ismail, I., Jabri, U., Rahmat, & Musdalifah. (2017). Rubrics-Based Assessment as a Teaching Strategy of

Writing Journal for Novice Authors. International Conference on Education, 1(1).

Jeong, H. (2015). Rubrics in the classroom: do teachers really follow them? Language Testing in Asia, 5(1).

https://doi.org/10.1186/s40468-015-0013-5

Johnson, R. B., & Christenen, L. (2014). Educational Research :Quantitative, Qualitative, and Mixed Methods

Approaches. In SAGE Publications, Inc.

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational

consequences. In Educational Research Review (Vol. 2, Issue 2). https://doi.org/10.1016/j.edurev.2007.05.002

Lovorn, M. G., & Rezaei, A. R. (2011). Assessing the assessment: Rubrics training for pre-service and new inservice teachers. Practical Assessment, Research and Evaluation, 16(16).

Miller, M.D., Linn, R.L., Gronlund, N. . (2014). Measurement and assessment in teaching. Igarss 2014, 1.

Qasim, A., & Candidate, P. (2015). Using Rubrics to Assess Writing: Pros and Cons in Pakistani Teachers’

Opinions. Journal of Literature Journal, 16, 51–58.

http://www.iiste.org/Journals/index.php/JLLL/article/viewFile/27152/27835

Sitorus / Non-Native English Teachers Interpretation of Rubrics Used for….

Ratnawati, R., Faridah, D., Anam, S., & Retnaningdyah, P. (2018). Exploring Academic Writing Needs of

Indonesian EFL Undergraduate Students. Arab World English Journal, 9(4), 420–432.

https://doi.org/10.24093/awej/vol9no4.31

Razi, A. (2016). Homeschooling: an Alternative Education in Indonesia. International Journal of Nusantara

Islam, 4(2), 75–84. https://doi.org/10.15575/ijni.v4i2.973

Razı, S. (2015). Development of a Rubric to Assess Academic Writing Incorporating Plagiarism Detectors.

SAGE Open, 5(2). https://doi.org/10.1177/2158244015590162

Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking

and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1).

https://doi.org/10.1186/s40594-020-00208-5

Rochmyaningsih, D. (2012). Indonesia Makes Research Publication A Graduation Requirement For All

Students - Asian Scientist Magazine. https://www.asianscientist.com/2012/03/academia/indonesia-dikti-aptisipublication-a-graduation-requirement-for-all-students-2012/

Singer, E. ;, & Couper, M. P. (2017). Some Methodological Uses of Responses to Open Questions and other

Verbatim Comments in Quantitative Surveys. Methods, Data, Analyses, 11(2).

Stevens, D. D., & Levi, A. (2006). Essays on Teaching Excellence Leveling the Field : Using Rubrics to

Achieve Greater Equity in Teaching and Grading. Development, 17(1), 2005–2006.

Sundeen, T. H. (2014). Instructional rubrics: Effects of presentation options on writing quality. Assessing

Writing, 21. https://doi.org/10.1016/j.asw.2014.03.003

Toba, R., Noor, W. N., & Sanu, L. O. (2019). The Current Issues of Indonesian EFL Students’ Writing Skills:

Ability, Problem, and Reason in Writing Comparison and Contrast Essay. Dinamika Ilmu, 19(1), 57–73.

https://doi.org/10.21093/di.v19i1.1506

Tsang, A. (2017). EFL/ESL Teachers’ General Language Proficiency and Learners’ Engagement. RELC

Journal, 48(1). https://doi.org/10.1177/0033688217690060

Wang, B. (2010). On Rater Agreement and Rater Training. English Language Teaching, 3(1).

https://doi.org/10.5539/elt.v3n1p108

Wilson, M. (2007). Why I Won’t Be Using Rubrics to Respond to Students’ Writing. English Journal, 96, 62.

https://doi.org/10.2307/30047167

Published
2021-08-22
How to Cite
Sitorus, M. (2021). Non-Native English Teachers Interpretation of Rubrics Used for Assessing Students’ Writing. Proceedings of the International Conference on Future of Education, 3(2), 16-25. https://doi.org/10.17501/26307413.2020.3202