Assessing learners’ writing skills in a SLA study: Validating the rating process across tasks, scales and languages
Huhta, A., Alanen, R., Tarnanen, M., Martin, M., & Hirvelä, T. (2014). Assessing learners’ writing skills in a SLA study: Validating the rating process across tasks, scales and languages. Language Testing, 31(3), 307-328. https://doi.org/10.1177/0265532214526176
Published inLanguage Testing
© Sage Publications. This is a final draft version of an article whose final and definitive form has been published by Sage Publications.
There is relatively little research on how well the CEFR and similar holistic scales work when they are used to rate L2 texts. Using both multifaceted Rasch analyses and qualitative data from rater comments and interviews, the ratings obtained by using a CEFR-based writing scale and the Finnish National Core Curriculum scale for L2 writing were examined to validate the rating process used in the study of the linguistic basis of the CEFR in L2 Finnish and English. More specifically, we explored the quality of the ratings and the rating scales across different tasks and across the two languages. The relationship of task peformance across the scales and languages was also examined. The kinds of analyses reported here are relevant to other SLA studies that use rating scales in their data gathering process.
ISSN Search the Publication Forum0265-5322
Publication in research information system
MetadataShow full item record
Showing items with similar title or keywords.
Investigating Syntactic Complexity in EFL Learners' Writing across Common European Framework of Reference Levels A1, A2, and B1 Khushik, Ghulam Abbas; Huhta, Ari (Oxford University Press, 2020)The study investigates the linguistic basis of Common European Framework of Reference (CEFR) levels in English as a foreign language (EFL) learners’ writing. Specifically, it examines whether CEFR levels can be distinguished ...
Frequency Change Patterns across Proficiency Levels in Japanese EFL Learner Speech Abe, Mariko (Centre for Applied Language Studies, University of Jyväskylä, 2014)This study investigated the overall patterns of variation across seven oral proficiency levels of 1,263 Japanese EFL learners and native English speakers. The methodological approach combined a learner corpus, language ...
Grappling with the Oral Skills: The learning processes of the low-educated adult second language and literacy learner Strube, Susanna; van de Craats, Ineke; van Hout, Roeland. (Centre for Applied Language Studies at the University of Jyväskylä, 2013)This paper focuses on the learning processes in L2 literacy classes in the Netherlands, discussing specifically possible influences of the learning processes during the practice of the oral skills. To achieve a better ...
Using Automatic Morphological Tools to Process Data from a Learner Corpus of Hungarian Durst, Péter; Szabó, Martina Katalin; Vincze, Veronica; Zsibrita, János (Centre for Applied Language Studies, University of Jyväskylä, 2014)The aim of this article is to show how automatic morphological tools originally used to analyze native speaker data can be applied to process data from a learner corpus of Hungarian. We collected written data from 35 ...
Assessing the effectiveness of a game‐based phonics intervention for first and second grade English language learners in India : A randomized controlled trial Patel, Priyanka; Torppa, Minna; Aro, Mikko; Richardson, Ulla; Lyytinen, Heikki (John Wiley & Sons, 2022)Background In 2018, it was found that only a quarter of Grade 3 children in India were reading at grade level. A growing demand for English education has further limited children's literacy achievement. Despite a strong ...