Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista

Abstract
This paper focuses on raters’ beliefs and views of assessment and the factors influencing their judgments and performance as raters in the National Certificates of Language Proficiency (NCLP) Finnish language test. Data were collected using semi-structured interviews (N=18) and content analysis was used to classify the responses. Findings suggest that raters’ experience and training have positive effects on rater performance and the use of assessment criteria. Experienced raters seem to be more familiar with different language proficiency levels and their view of language is more holistic today than during the first years of their rating experience. There are some external factors and linguistic features that affect raters’ performance, such as pronunciation, handwriting and the test-taker’s personality. In these cases, self-reflection helps raters to strive for objectivity in their evaluations.
Main Author
Format
Books Book part
Published
2016
Series
Subjects
Publication in research information system
Publisher
Suomen soveltavan kielitieteen yhdistys
Original source
http://journal.fi/afinla/article/view/60848
The permanent address of the publication
https://urn.fi/URN:NBN:fi:jyu-201704041887Use this for linking
Parent publication ISBN
978-951-9388-64-9
Review status
Peer reviewed
ISSN
1798-7822
Language
Finnish
Published in
AFinLA-e : soveltavan kielitieteen tutkimuksia
Is part of publication
Kielitaidon arviointitutkimus 2000-luvun Suomessa
Citation
  • Ahola, S. (2016). Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista. In A. Huhta, & R. Hildén (Eds.), Kielitaidon arviointitutkimus 2000-luvun Suomessa (pp. 89-109). Suomen soveltavan kielitieteen yhdistys. AFinLA-e : soveltavan kielitieteen tutkimuksia, 9. http://journal.fi/afinla/article/view/60848
License
Open Access
Copyright© Ahola & Suomen soveltavan kielitieteen yhdistys, 2016.

Share

_version_ 1824577764076814336
accesslevel_txtF openAccess
author Ahola, Sari
author_facet Ahola, Sari
departments_txtF_mv Soveltavan kielentutkimuksen keskus Centre for Applied Language Studies
description This paper focuses on raters’ beliefs and views of assessment and the factors influencing their judgments and performance as raters in the National Certificates of Language Proficiency (NCLP) Finnish language test. Data were collected using semi-structured interviews (N=18) and content analysis was used to classify the responses. Findings suggest that raters’ experience and training have positive effects on rater performance and the use of assessment criteria. Experienced raters seem to be more familiar with different language proficiency levels and their view of language is more holistic today than during the first years of their rating experience. There are some external factors and linguistic features that affect raters’ performance, such as pronunciation, handwriting and the test-taker’s personality. In these cases, self-reflection helps raters to strive for objectivity in their evaluations.
digitoitu_txtF no
editors_txtF_mv Huhta, Ari Hildén, Raili
files_txt [{"restricted": "no", "bundleName": "THUMBNAIL", "format": "JPEG", "mimeType": "image/jpeg", "name": "aholapuhetta.pdf.jpg", "description": "Generated Thumbnail", "retrieveLink": "/rest/bitstreams/ac7d1ac1-58db-46b9-b9fc-6fd1b1e53d34/retrieve"}, {"restricted": "no", "bundleName": "ORIGINAL", "format": "Adobe PDF", "mimeType": "application/pdf", "name": "aholapuhetta.pdf", "description": "Publisher's PDF", "retrieveLink": "/rest/bitstreams/aa92caaf-ddb2-4eaa-b620-572b65ba48be/retrieve"}, {"restricted": "no", "bundleName": "LICENSE", "format": "License", "mimeType": "text/plain", "name": "license.txt", "description": null, "retrieveLink": "/rest/bitstreams/be916790-0346-434d-92af-944aa9dfa691/retrieve"}, {"restricted": "no", "bundleName": "TEXT", "format": "Text", "mimeType": "text/plain", "name": "aholapuhetta.pdf.txt", "description": "Extracted text", "retrieveLink": "/rest/bitstreams/ecf23242-5ce2-42b4-9f9d-115892ee3648/retrieve"}]
format 0/Kirja/ 1/Kirja/book part/
fullrecord
key : dc.contributor.author
value : Ahola, Sari
language :
element : contributor
qualifier : author
schema : dc
key : dc.contributor.editor
value : Huhta, Ari
language :
element : contributor
qualifier : editor
schema : dc
key : dc.contributor.editor
value : Hildén, Raili
language :
element : contributor
qualifier : editor
schema : dc
key : dc.date.accessioned
value : 2017-04-07T06:25:00Z
language :
element : date
qualifier : accessioned
schema : dc
key : dc.date.available
value : 2017-04-07T06:25:00Z
language :
element : date
qualifier : available
schema : dc
key : dc.date.issued
value : 2016
language :
element : date
qualifier : issued
schema : dc
key : dc.identifier.citation
value : Ahola, S. (2016). Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista. In A. Huhta, & R. Hildén (Eds.), Kielitaidon arviointitutkimus 2000-luvun Suomessa (pp. 89-109). Suomen soveltavan kielitieteen yhdistys. AFinLA-e : soveltavan kielitieteen tutkimuksia, 9. http://journal.fi/afinla/article/view/60848
language :
element : identifier
qualifier : citation
schema : dc
key : dc.identifier.other
value : jyu-pub.26563178
language :
element : identifier
qualifier : other
schema : dc
key : dc.identifier.uri
value : https://jyx.jyu.fi/handle/123456789/53518
language :
element : identifier
qualifier : uri
schema : dc
key : dc.description.abstract
value : This paper focuses on raters’ beliefs and views of assessment and the factors influencing their judgments and performance as raters in the National Certificates of Language Proficiency (NCLP) Finnish language test. Data were collected using semi-structured interviews (N=18) and content analysis was used to classify the responses. Findings suggest that raters’ experience and training have positive effects on rater performance and the use of assessment criteria. Experienced raters seem to be more familiar with different language proficiency levels and their view of language is more holistic today than during the first years of their rating experience. There are some external factors and linguistic features that affect raters’ performance, such as pronunciation, handwriting and the test-taker’s personality. In these cases, self-reflection helps raters to strive for objectivity in their evaluations.
language :
element : description
qualifier : abstract
schema : dc
key : dc.format.extent
value : 225
language :
element : format
qualifier : extent
schema : dc
key : dc.language.iso
value : fin
language :
element : language
qualifier : iso
schema : dc
key : dc.publisher
value : Suomen soveltavan kielitieteen yhdistys
language :
element : publisher
qualifier :
schema : dc
key : dc.relation.ispartof
value : Kielitaidon arviointitutkimus 2000-luvun Suomessa
language :
element : relation
qualifier : ispartof
schema : dc
key : dc.relation.ispartofseries
value : AFinLA-e : soveltavan kielitieteen tutkimuksia
language :
element : relation
qualifier : ispartofseries
schema : dc
key : dc.relation.uri
value : http://journal.fi/afinla/article/view/60848
language :
element : relation
qualifier : uri
schema : dc
key : dc.subject.other
value : arvioijat
language :
element : subject
qualifier : other
schema : dc
key : dc.subject.other
value : arvioijakoulutus
language :
element : subject
qualifier : other
schema : dc
key : dc.subject.other
value : language testing
language :
element : subject
qualifier : other
schema : dc
key : dc.subject.other
value : raters
language :
element : subject
qualifier : other
schema : dc
key : dc.subject.other
value : assessment
language :
element : subject
qualifier : other
schema : dc
key : dc.subject.other
value : rater training
language :
element : subject
qualifier : other
schema : dc
key : dc.subject.other
value : experiences
language :
element : subject
qualifier : other
schema : dc
key : dc.title
value : Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
language :
element : title
qualifier :
schema : dc
key : dc.type
value : book part
language :
element : type
qualifier :
schema : dc
key : dc.identifier.urn
value : URN:NBN:fi:jyu-201704041887
language :
element : identifier
qualifier : urn
schema : dc
key : dc.contributor.department
value : Soveltavan kielentutkimuksen keskus
language : fi
element : contributor
qualifier : department
schema : dc
key : dc.contributor.department
value : Centre for Applied Language Studies
language : en
element : contributor
qualifier : department
schema : dc
key : dc.subject.discipline
value : Soveltava kielitiede
language :
element : subject
qualifier : discipline
schema : dc
key : dc.type.uri
value : http://purl.org/eprint/type/BookItem
language :
element : type
qualifier : uri
schema : dc
key : dc.date.updated
value : 2017-04-04T09:15:27Z
language :
element : date
qualifier : updated
schema : dc
key : dc.relation.isbn
value : 978-951-9388-64-9
language :
element : relation
qualifier : isbn
schema : dc
key : dc.type.coar
value : http://purl.org/coar/resource_type/c_3248
language :
element : type
qualifier : coar
schema : dc
key : dc.description.reviewstatus
value : peerReviewed
language :
element : description
qualifier : reviewstatus
schema : dc
key : dc.format.pagerange
value : 89-109
language :
element : format
qualifier : pagerange
schema : dc
key : dc.relation.issn
value : 1798-7822
language :
element : relation
qualifier : issn
schema : dc
key : dc.type.version
value : publishedVersion
language :
element : type
qualifier : version
schema : dc
key : dc.rights.copyright
value : © Ahola & Suomen soveltavan kielitieteen yhdistys, 2016.
language :
element : rights
qualifier : copyright
schema : dc
key : dc.rights.accesslevel
value : openAccess
language : fi
element : rights
qualifier : accesslevel
schema : dc
key : dc.type.publication
value : bookPart
language :
element : type
qualifier : publication
schema : dc
key : dc.subject.yso
value : kielitaito
language :
element : subject
qualifier : yso
schema : dc
key : dc.subject.yso
value : arviointi
language :
element : subject
qualifier : yso
schema : dc
key : dc.subject.yso
value : kokemukset
language :
element : subject
qualifier : yso
schema : dc
key : jyx.subject.uri
value : http://www.yso.fi/onto/yso/p5797
language :
element : subject
qualifier : uri
schema : jyx
key : jyx.subject.uri
value : http://www.yso.fi/onto/yso/p7413
language :
element : subject
qualifier : uri
schema : jyx
key : jyx.subject.uri
value : http://www.yso.fi/onto/yso/p3209
language :
element : subject
qualifier : uri
schema : jyx
key : dc.type.okm
value : A3
language :
element : type
qualifier : okm
schema : dc
files : [{"restricted":"no","bundleName":"THUMBNAIL","format":"JPEG","mimeType":"image\/jpeg","name":"aholapuhetta.pdf.jpg","description":"Generated Thumbnail","retrieveLink":"\/rest\/bitstreams\/ac7d1ac1-58db-46b9-b9fc-6fd1b1e53d34\/retrieve"},{"restricted":"no","bundleName":"ORIGINAL","format":"Adobe PDF","mimeType":"application\/pdf","name":"aholapuhetta.pdf","description":"Publisher's PDF","retrieveLink":"\/rest\/bitstreams\/aa92caaf-ddb2-4eaa-b620-572b65ba48be\/retrieve"},{"restricted":"no","bundleName":"LICENSE","format":"License","mimeType":"text\/plain","name":"license.txt","description":null,"retrieveLink":"\/rest\/bitstreams\/be916790-0346-434d-92af-944aa9dfa691\/retrieve"},{"restricted":"no","bundleName":"TEXT","format":"Text","mimeType":"text\/plain","name":"aholapuhetta.pdf.txt","description":"Extracted text","retrieveLink":"\/rest\/bitstreams\/ecf23242-5ce2-42b4-9f9d-115892ee3648\/retrieve"}]
id jyx_123456789_53518
ispartofseries_txtF_mv AFinLA-e : soveltavan kielitieteen tutkimuksia
issn 1798-7822
language_txtF_mv fin
okm_txtF A3
online_urls_str_mv URN:NBN:fi:jyu-201704041887
publishDate 2016
publisher_txtF_mv Suomen soveltavan kielitieteen yhdistys
reviewstatus_txtF peerReviewed
series AFinLA-e : soveltavan kielitieteen tutkimuksia
spellingShingle Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista Ahola, Sari arvioijat arvioijakoulutus language testing raters assessment rater training experiences kielitaito arviointi kokemukset AFinLA-e : soveltavan kielitieteen tutkimuksia
thumbnail https://jyx.jyu.fi/bitstreams/ac7d1ac1-58db-46b9-b9fc-6fd1b1e53d34/download.jpg?sequence=99
title Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
title_full Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
title_fullStr Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
title_full_unstemmed Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
title_short Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
title_sort Puhetta arvioinnista yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
topic arvioijat arvioijakoulutus language testing raters assessment rater training experiences kielitaito arviointi kokemukset