A cautionary note on the finite sample behavior of maximal reliability
Aguirre-Urreta, M. I., Rönkkö, M., & McIntosh, C. N. (2019). A cautionary note on the finite sample behavior of maximal reliability. Psychological Methods, 24(2), 236-252. https://doi.org/10.1037/met0000176
Julkaistu sarjassa
Psychological MethodsPäivämäärä
2019Tekijänoikeudet
© American Psychological Association, 2018.
Several calls have been made for replacing coefficient α with more contemporary model-based reliability coefficients in psychological research. Under the assumption of unidimensional measurement scales and independent measurement errors, two leading alternatives are composite reliability and maximal reliability. Of these two, the maximal reliability statistic, or equivalently Hancock's H, has received a significant amount of attention in recent years. The difference between composite reliability and maximal reliability is that the former is a reliability index for a scale mean (or unweighted sum), whereas the latter estimates the reliability of a scale score where indicators are weighted differently based on their estimated reliabilities. The formula for the maximal reliability weights has been derived using population quantities; however, their finite-sample behavior has not been extensively examined. Particularly, there are two types of bias when the maximal reliability statistic is calculated from sample data: (a) the sample maximal reliability estimator is a positively biased estimator of population maximal reliability, and (b) the true reliability of composites formed with maximal reliability weights calculated from sample data is on average less than the population reliability. Both effects are more pronounced in small-sample scenarios (e.g., <100). We also demonstrate that the composite reliability estimator for equally weighted composite exhibits substantially less bias, which makes it a more appropriate choice for the small-sample case.
...
Julkaisija
American Psychological AssociationISSN Hae Julkaisufoorumista
1082-989XAsiasanat
Julkaisu tutkimustietojärjestelmässä
https://converis.jyu.fi/converis/portal/detail/Publication/28231311
Metadata
Näytä kaikki kuvailutiedotKokoelmat
Rahoittaja(t)
Suomen AkatemiaRahoitusohjelmat(t)
Tutkijatohtori, SALisätietoja rahoituksesta
This research was supported in part by a grant from the Academy of Finland (grant 311309). Parts of this research were carried out while Mikko Rönkkö was at the Department of Industrial Engineering and Management, Aalto University. We acknowledge the computational resources provided by the Aalto Science-IT project.Lisenssi
Samankaltainen aineisto
Näytetään aineistoja, joilla on samankaltainen nimeke tai asiasanat.
-
Test-retest reliability of survey items on ownership and use of physical activity trackers
Ng, Kwok W.; Badura, Petr; Dzielska, Anna; Kokko, Sami; Woods, Catherine B.; Hamrik, Zdenek (Palacký University Olomouc, 2019)Background: Researchers are interested in using digital tools, such as physical activity trackers (PAT), to promote and measure physical activity. PAT is a fast-growing research area that measures movement therefore, ... -
Reliability of upper-limb diaphyseal mineral and soft-tissue measurements using peripheral Quantitative Computed Tomography (pQCT)
Jenkins, Mark A.; Hart, Nicolas H.; Rantalainen, Timo; Chivers, Paola; Newton, Robert U.; Nimphius, Sophia (Hylonome Publications, 2018)Objectives: To quantify between-day reliability of upper-body diaphyseal measurements (radius, ulna, humerus) using peripheral Quantitative Computed Tomography (pQCT). - Methods: Fourteen males (age: 25.8±2.3 years,) ... -
Reliability and Validity Study of the Finnish Adaptation of Scoliosis Research Society Questionnaire Version SRS-30
Kyrölä, Kati; Järvenpää, Salme; Ylinen, Jari; Mecklin, Jukka-Pekka; Repo, Jussi Petteri; Häkkinen, Arja (Lippincott Co., 2017)Study Design. A prospective clinical study to test and adapt a Finnish version of the Scoliosis Research Society 30 (SRS-30) questionnaire. Objective. To perform cross-cultural adaptation and evaluate the validity of the ... -
Personnel analysis and its reliability
Härkönen, Kari (2014)Tässä tutkimuksessa selvitetään rekrytointi- ja henkilöarviointiyritys MindFit Consulting Oy:n työnhakijoista tekemien henkilöanalyysiraporttien, MindFitin henkilöanalyysien, luotettavuutta. Tarkoitus on tutkia, kuinka ... -
Reliability and validity of the Finnish version of the Visual Analogue Scale Foot and Ankle (VAS-FA)
Repo, Jussi P.; Tukiainen, Erkki J.; Roine, Risto P.; Kautiainen, Hannu; Lindahl, Jan; Ilves, Outi; Järvenpää, Salme; Häkkinen, Arja (Elsevier Ltd, 2018)Background There have previously been no validated foot and ankle-specific patient-reported outcome measures in Finnish. Methods The Visual Analogue Scale Foot and Ankle (VAS-FA) was translated and adapted into Finnish. ...
Ellei toisin mainittu, julkisesti saatavilla olevia JYX-metatietoja (poislukien tiivistelmät) saa vapaasti uudelleenkäyttää CC0-lisenssillä.