International Education Studies: Increasing Their Linguistic Comparability by Developing Judgmental Reviews
Arffman, I. (2012). International Education Studies: Increasing Their Linguistic Comparability by Developing Judgmental Reviews. ISRN (International Scholarly Research Network) Education, 2012 (2012). doi:10.5402/2012/179824
Authors
Date
2012Copyright
Copyright © 2012 Inga Arffman. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
In international education studies, the different-language test versions need to be equally difficult to read and answer for the test to be valid. To ensure comparability, several quality control procedures have been developed. Among these, surprisingly little attention has been paid to judgmental reviews and their ability to identify language-related sources of bias. Also, the reviews have often failed in identifying biases. This paper explored whether it is possible to improve the ability of judgmental reviews to identify language-related sources of bias. A new review was made of two Finnish items which in the PISA (Programme for International Student Assessment) 2000 reading test showed differential item functioning but for which no clear language-related explanations were found in the review in 2000. The items were compared systematically, at all linguistic levels, to the corresponding items in the English and French source versions, at the same time taking into account the cognitive processes required to answer them and students’ written responses to them. Language-related explanations were found for both items which may have led to differences in performance, suggesting that it is possible to make judgmental reviews better able to identify language-related bias. Suggestions are given on how to do this.
...
Publisher
International Scholarly Research NetworkKeywords
Original source
http://www.isrn.com/journals/education/2012/179824/Metadata
Show full item recordCollections
License
Except where otherwise noted, this item's license is described as Copyright © 2012 Inga Arffman. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Related items
Showing items with similar title or keywords.
-
Problems and Issues in Translating International Educational Achievement Tests
Arffman, Inga (Wiley-Blackwell, 2013)The article reviews research and findings on problems and issues faced when translating international academic achievement tests. The purpose is to draw attention to the problems, to help to develop the procedures followed ... -
Unwanted literal translation : An underdiscussed problem in international achievement studies
Arffman, Inga (Hindawi Publishing Corporation, 2012)In international achievement studies, a common test is typically used which is translated into the languages of the participating countries. For the test to be valid, all the translations and different-language test versions ... -
The problem of equivalence in translating texts in international reading literacy studies : a text analytic study of three English and Finnish texts used in the PISA 2000 reading texts
Arffman, Inga (Institute for Educational Research, 2007)Tutkimuksessa tarkasteltiin ongelmia, joita kansainvälisissä lukukokeissa on käännettäessä lukukoetekstejä osallistujamaiden kielille ja pyrittäessä samalla pitämään tekstien vaikeustaso muuttumattomana – sillä elleivät ... -
Translating international achievement tests : translators’ view
Arffman, Inga (Jyväskylän yliopisto, Koulutuksen tutkimuslaitos, 2012)Kansainväliset arviointitutkimukset edellyttävät laajaa käännöstyötä, koska kaikki koemateriaalit on käännettävä kunkin osallistujamaan kielille. Kaikkien erikielisten koeversioiden on lisäksi oltava keskenään vertailukelpoisia, ... -
In search of equivalence - translation problems in international literacy studies
Arffman, Inga (2002)