Näytä suppeat kuvailutiedot

dc.contributor.authorNeittaanmäki, Reeta
dc.contributor.authorLamprianou, Iasonas
dc.date.accessioned2024-04-30T10:58:29Z
dc.date.available2024-04-30T10:58:29Z
dc.date.issued2024
dc.identifier.citationNeittaanmäki, R., & Lamprianou, I. (2024). Communal factors in rater severity and consistency over time in high-stakes oral assessment. <i>Language Testing</i>, <i>OnlineFirst</i>. <a href="https://doi.org/10.1177/02655322241239363" target="_blank">https://doi.org/10.1177/02655322241239363</a>
dc.identifier.otherCONVID_213171164
dc.identifier.urihttps://jyx.jyu.fi/handle/123456789/94601
dc.description.abstractThis article focuses on rater severity and consistency and their relation to major changes in the rating system in a high-stakes testing context. The study is based on longitudinal data collected from 2009 to 2019 from the second language (L2) Finnishspeaking subtest in the National Certificates of Language Proficiency in Finland. We investigated whether rater severity and consistency changed over that period and whether the changes could be explained by major changes in the rating system, such as the change of lead examiner, the modus of rating and training (on-site or remote), and the composition of the rater group. The data consisted of 45 rating sessions with 104 raters and 59,899 examinees and were analysed using the Many-Facets Rasch model and generalized linear mixed models. The analyses indicated that raters as a group became somewhat more lenient over time. In addition, the results showed that the rater community and its practices, the lead examiners, and the modus of rating and training can influence the rating behaviour. Finally, we elaborate on implications for both research and practice.en
dc.format.mimetypeapplication/pdf
dc.language.isoeng
dc.publisherSAGE Publications
dc.relation.ispartofseriesLanguage Testing
dc.rightsCC BY 4.0
dc.subject.othergeneralized linear mixed model
dc.subject.otherlead examiner
dc.subject.otherMany-Facets Rasch model
dc.subject.otheron-site rating
dc.subject.otherrater consistency
dc.subject.otherrater severity
dc.subject.otherremote rating
dc.subject.otherspeaking assessment
dc.titleCommunal factors in rater severity and consistency over time in high-stakes oral assessment
dc.typearticle
dc.identifier.urnURN:NBN:fi:jyu-202404303228
dc.contributor.laitosSoveltavan kielentutkimuksen keskusfi
dc.contributor.laitosCentre for Applied Language Studiesen
dc.type.urihttp://purl.org/eprint/type/JournalArticle
dc.type.coarhttp://purl.org/coar/resource_type/c_2df8fbb1
dc.description.reviewstatuspeerReviewed
dc.relation.issn0265-5322
dc.relation.volumeOnlineFirst
dc.type.versionpublishedVersion
dc.rights.copyright© 2024 the Authors
dc.rights.accesslevelopenAccessfi
dc.subject.ysokielitaito
dc.subject.ysoarviointi
dc.subject.ysokieli ja kielet
dc.format.contentfulltext
jyx.subject.urihttp://www.yso.fi/onto/yso/p5797
jyx.subject.urihttp://www.yso.fi/onto/yso/p7413
jyx.subject.urihttp://www.yso.fi/onto/yso/p556
dc.rights.urlhttps://creativecommons.org/licenses/by/4.0/
dc.relation.doi10.1177/02655322241239363
dc.type.okmA1


Aineistoon kuuluvat tiedostot

Thumbnail

Aineisto kuuluu seuraaviin kokoelmiin

Näytä suppeat kuvailutiedot

CC BY 4.0
Ellei muuten mainita, aineiston lisenssi on CC BY 4.0