Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista

Ahola, Sari

Publisher's PDF

Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista

Abstract

This paper focuses on raters’ beliefs and views of assessment and the factors influencing their judgments and performance as raters in the National Certificates of Language Proficiency (NCLP) Finnish language test. Data were collected using semi-structured interviews (N=18) and content analysis was used to classify the responses. Findings suggest that raters’ experience and training have positive effects on rater performance and the use of assessment criteria. Experienced raters seem to be more familiar with different language proficiency levels and their view of language is more holistic today than during the first years of their rating experience. There are some external factors and linguistic features that affect raters’ performance, such as pronunciation, handwriting and the test-taker’s personality. In these cases, self-reflection helps raters to strive for objectivity in their evaluations.

Main Author

Ahola, Sari

Format

Books Book part

Published

2016

Series

AFinLA-e : soveltavan kielitieteen tutkimuksia

Subjects

arvioijat

arvioijakoulutus

language testing

raters

assessment

rater training

experiences

kielitaito

arviointi

kokemukset

Publication in research information system

https://converis.jyu.fi/converis/portal/detail/Publication/26563178

Publisher

Suomen soveltavan kielitieteen yhdistys

Original source

http://journal.fi/afinla/article/view/60848

The permanent address of the publication

https://urn.fi/URN:NBN:fi:jyu-201704041887Use this for linking

Parent publication ISBN

978-951-9388-64-9

Review status

Peer reviewed

ISSN

1798-7822

Language

Finnish

Published in

AFinLA-e : soveltavan kielitieteen tutkimuksia

Is part of publication

Kielitaidon arviointitutkimus 2000-luvun Suomessa

Citation

Ahola, S. (2016). Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista. In A. Huhta, & R. Hildén (Eds.), Kielitaidon arviointitutkimus 2000-luvun Suomessa (pp. 89-109). Suomen soveltavan kielitieteen yhdistys. AFinLA-e : soveltavan kielitieteen tutkimuksia, 9. http://journal.fi/afinla/article/view/60848

License

_version_

1824577764076814336

accesslevel_txtF

openAccess

author

Ahola, Sari

author_facet

Ahola, Sari

departments_txtF_mv

Soveltavan kielentutkimuksen keskus Centre for Applied Language Studies

description

digitoitu_txtF

editors_txtF_mv

Huhta, Ari Hildén, Raili

files_txt

[{"restricted": "no", "bundleName": "THUMBNAIL", "format": "JPEG", "mimeType": "image/jpeg", "name": "aholapuhetta.pdf.jpg", "description": "Generated Thumbnail", "retrieveLink": "/rest/bitstreams/ac7d1ac1-58db-46b9-b9fc-6fd1b1e53d34/retrieve"}, {"restricted": "no", "bundleName": "ORIGINAL", "format": "Adobe PDF", "mimeType": "application/pdf", "name": "aholapuhetta.pdf", "description": "Publisher's PDF", "retrieveLink": "/rest/bitstreams/aa92caaf-ddb2-4eaa-b620-572b65ba48be/retrieve"}, {"restricted": "no", "bundleName": "LICENSE", "format": "License", "mimeType": "text/plain", "name": "license.txt", "description": null, "retrieveLink": "/rest/bitstreams/be916790-0346-434d-92af-944aa9dfa691/retrieve"}, {"restricted": "no", "bundleName": "TEXT", "format": "Text", "mimeType": "text/plain", "name": "aholapuhetta.pdf.txt", "description": "Extracted text", "retrieveLink": "/rest/bitstreams/ecf23242-5ce2-42b4-9f9d-115892ee3648/retrieve"}]

format

0/Kirja/ 1/Kirja/book part/

fullrecord

key :	dc.contributor.author
value :	Ahola, Sari
language :
element :	contributor
qualifier :	author
schema :	dc
key :	dc.contributor.editor
value :	Huhta, Ari
language :
element :	contributor
qualifier :	editor
schema :	dc
key :	dc.contributor.editor
value :	Hildén, Raili
language :
element :	contributor
qualifier :	editor
schema :	dc
key :	dc.date.accessioned
value :	2017-04-07T06:25:00Z
language :
element :	date
qualifier :	accessioned
schema :	dc
key :	dc.date.available
value :	2017-04-07T06:25:00Z
language :
element :	date
qualifier :	available
schema :	dc
key :	dc.date.issued
value :	2016
language :
element :	date
qualifier :	issued
schema :	dc
key :	dc.identifier.citation
value :	Ahola, S. (2016). Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista. In A. Huhta, & R. Hildén (Eds.), Kielitaidon arviointitutkimus 2000-luvun Suomessa (pp. 89-109). Suomen soveltavan kielitieteen yhdistys. AFinLA-e : soveltavan kielitieteen tutkimuksia, 9. http://journal.fi/afinla/article/view/60848
language :
element :	identifier
qualifier :	citation
schema :	dc
key :	dc.identifier.other
value :	jyu-pub.26563178
language :
element :	identifier
qualifier :	other
schema :	dc
key :	dc.identifier.uri
value :	https://jyx.jyu.fi/handle/123456789/53518
language :
element :	identifier
qualifier :	uri
schema :	dc
key :	dc.description.abstract
value :	This paper focuses on raters’ beliefs and views of assessment and the factors influencing their judgments and performance as raters in the National Certificates of Language Proficiency (NCLP) Finnish language test. Data were collected using semi-structured interviews (N=18) and content analysis was used to classify the responses. Findings suggest that raters’ experience and training have positive effects on rater performance and the use of assessment criteria. Experienced raters seem to be more familiar with different language proficiency levels and their view of language is more holistic today than during the first years of their rating experience. There are some external factors and linguistic features that affect raters’ performance, such as pronunciation, handwriting and the test-taker’s personality. In these cases, self-reflection helps raters to strive for objectivity in their evaluations.
language :
element :	description
qualifier :	abstract
schema :	dc
key :	dc.format.extent
value :	225
language :
element :	format
qualifier :	extent
schema :	dc
key :	dc.language.iso
value :	fin
language :
element :	language
qualifier :	iso
schema :	dc
key :	dc.publisher
value :	Suomen soveltavan kielitieteen yhdistys
language :
element :	publisher
qualifier :
schema :	dc
key :	dc.relation.ispartof
value :	Kielitaidon arviointitutkimus 2000-luvun Suomessa
language :
element :	relation
qualifier :	ispartof
schema :	dc
key :	dc.relation.ispartofseries
value :	AFinLA-e : soveltavan kielitieteen tutkimuksia
language :
element :	relation
qualifier :	ispartofseries
schema :	dc
key :	dc.relation.uri
value :	http://journal.fi/afinla/article/view/60848
language :
element :	relation
qualifier :	uri
schema :	dc
key :	dc.subject.other
value :	arvioijat
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.subject.other
value :	arvioijakoulutus
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.subject.other
value :	language testing
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.subject.other
value :	raters
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.subject.other
value :	assessment
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.subject.other
value :	rater training
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.subject.other
value :	experiences
language :
element :	subject
qualifier :	other
schema :	dc
key :	dc.title
value :	Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
language :
element :	title
qualifier :
schema :	dc
key :	dc.type
value :	book part
language :
element :	type
qualifier :
schema :	dc
key :	dc.identifier.urn
value :	URN:NBN:fi:jyu-201704041887
language :
element :	identifier
qualifier :	urn
schema :	dc
key :	dc.contributor.department
value :	Soveltavan kielentutkimuksen keskus
language :	fi
element :	contributor
qualifier :	department
schema :	dc
key :	dc.contributor.department
value :	Centre for Applied Language Studies
language :	en
element :	contributor
qualifier :	department
schema :	dc
key :	dc.subject.discipline
value :	Soveltava kielitiede
language :
element :	subject
qualifier :	discipline
schema :	dc
key :	dc.type.uri
value :	http://purl.org/eprint/type/BookItem
language :
element :	type
qualifier :	uri
schema :	dc
key :	dc.date.updated
value :	2017-04-04T09:15:27Z
language :
element :	date
qualifier :	updated
schema :	dc
key :	dc.relation.isbn
value :	978-951-9388-64-9
language :
element :	relation
qualifier :	isbn
schema :	dc
key :	dc.type.coar
value :	http://purl.org/coar/resource_type/c_3248
language :
element :	type
qualifier :	coar
schema :	dc
key :	dc.description.reviewstatus
value :	peerReviewed
language :
element :	description
qualifier :	reviewstatus
schema :	dc
key :	dc.format.pagerange
value :	89-109
language :
element :	format
qualifier :	pagerange
schema :	dc
key :	dc.relation.issn
value :	1798-7822
language :
element :	relation
qualifier :	issn
schema :	dc
key :	dc.type.version
value :	publishedVersion
language :
element :	type
qualifier :	version
schema :	dc
key :	dc.rights.copyright
value :	© Ahola & Suomen soveltavan kielitieteen yhdistys, 2016.
language :
element :	rights
qualifier :	copyright
schema :	dc
key :	dc.rights.accesslevel
value :	openAccess
language :	fi
element :	rights
qualifier :	accesslevel
schema :	dc
key :	dc.type.publication
value :	bookPart
language :
element :	type
qualifier :	publication
schema :	dc
key :	dc.subject.yso
value :	kielitaito
language :
element :	subject
qualifier :	yso
schema :	dc
key :	dc.subject.yso
value :	arviointi
language :
element :	subject
qualifier :	yso
schema :	dc
key :	dc.subject.yso
value :	kokemukset
language :
element :	subject
qualifier :	yso
schema :	dc
key :	jyx.subject.uri
value :	http://www.yso.fi/onto/yso/p5797
language :
element :	subject
qualifier :	uri
schema :	jyx
key :	jyx.subject.uri
value :	http://www.yso.fi/onto/yso/p7413
language :
element :	subject
qualifier :	uri
schema :	jyx
key :	jyx.subject.uri
value :	http://www.yso.fi/onto/yso/p3209
language :
element :	subject
qualifier :	uri
schema :	jyx
key :	dc.type.okm
value :	A3
language :
element :	type
qualifier :	okm
schema :	dc
files :	[{"restricted":"no","bundleName":"THUMBNAIL","format":"JPEG","mimeType":"image\/jpeg","name":"aholapuhetta.pdf.jpg","description":"Generated Thumbnail","retrieveLink":"\/rest\/bitstreams\/ac7d1ac1-58db-46b9-b9fc-6fd1b1e53d34\/retrieve"},{"restricted":"no","bundleName":"ORIGINAL","format":"Adobe PDF","mimeType":"application\/pdf","name":"aholapuhetta.pdf","description":"Publisher's PDF","retrieveLink":"\/rest\/bitstreams\/aa92caaf-ddb2-4eaa-b620-572b65ba48be\/retrieve"},{"restricted":"no","bundleName":"LICENSE","format":"License","mimeType":"text\/plain","name":"license.txt","description":null,"retrieveLink":"\/rest\/bitstreams\/be916790-0346-434d-92af-944aa9dfa691\/retrieve"},{"restricted":"no","bundleName":"TEXT","format":"Text","mimeType":"text\/plain","name":"aholapuhetta.pdf.txt","description":"Extracted text","retrieveLink":"\/rest\/bitstreams\/ecf23242-5ce2-42b4-9f9d-115892ee3648\/retrieve"}]

jyx_123456789_53518

ispartofseries_txtF_mv

AFinLA-e : soveltavan kielitieteen tutkimuksia

issn

1798-7822

language_txtF_mv

fin

okm_txtF

online_urls_str_mv

URN:NBN:fi:jyu-201704041887

publishDate

2016

publisher_txtF_mv

Suomen soveltavan kielitieteen yhdistys

reviewstatus_txtF

peerReviewed

series

AFinLA-e : soveltavan kielitieteen tutkimuksia

spellingShingle

Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista Ahola, Sari arvioijat arvioijakoulutus language testing raters assessment rater training experiences kielitaito arviointi kokemukset AFinLA-e : soveltavan kielitieteen tutkimuksia

thumbnail

https://jyx.jyu.fi/bitstreams/ac7d1ac1-58db-46b9-b9fc-6fd1b1e53d34/download.jpg?sequence=99

title