Assessing learners writing skills in a SLA study: Validating the rating process across tasks, scales and languages
Huhta, A., Alanen, R., Tarnanen, M., Martin, M., & Hirvelä, T. (2014). Assessing learners’ writing skills in a SLA study: Validating the rating process across tasks, scales and languages. Language Testing, 31 (3), 307-328. doi:10.1177/0265532214526176
Published inLanguage Testing
© Sage Publications. This is a final draft version of an article whose final and definitive form has been published by Sage Publications.
There is relatively little research on how well the CEFR and similar holistic scales work when they are used to rate L2 texts. Using both multifaceted Rasch analyses and qualitative data from rater comments and interviews, the ratings obtained by using a CEFR-based writing scale and the Finnish National Core Curriculum scale for L2 writing were examined to validate the rating process used in the study of the linguistic basis of the CEFR in L2 Finnish and English. More specifically, we explored the quality of the ratings and the rating scales across different tasks and across the two languages. The relationship of task peformance across the scales and languages was also examined. The kinds of analyses reported here are relevant to other SLA studies that use rating scales in their data gathering process.