A cautionary note on the finite sample behavior of maximal reliability
Aguirre-Urreta, M. I., Rönkkö, M., & McIntosh, C. N. (2019). A cautionary note on the finite sample behavior of maximal reliability. Psychological Methods, 24(2), 236-252. https://doi.org/10.1037/met0000176
Julkaistu sarjassa
Psychological MethodsPäivämäärä
2019Tekijänoikeudet
© American Psychological Association, 2018.
Several calls have been made for replacing coefficient α with more contemporary model-based reliability coefficients in psychological research. Under the assumption of unidimensional measurement scales and independent measurement errors, two leading alternatives are composite reliability and maximal reliability. Of these two, the maximal reliability statistic, or equivalently Hancock's H, has received a significant amount of attention in recent years. The difference between composite reliability and maximal reliability is that the former is a reliability index for a scale mean (or unweighted sum), whereas the latter estimates the reliability of a scale score where indicators are weighted differently based on their estimated reliabilities. The formula for the maximal reliability weights has been derived using population quantities; however, their finite-sample behavior has not been extensively examined. Particularly, there are two types of bias when the maximal reliability statistic is calculated from sample data: (a) the sample maximal reliability estimator is a positively biased estimator of population maximal reliability, and (b) the true reliability of composites formed with maximal reliability weights calculated from sample data is on average less than the population reliability. Both effects are more pronounced in small-sample scenarios (e.g., <100). We also demonstrate that the composite reliability estimator for equally weighted composite exhibits substantially less bias, which makes it a more appropriate choice for the small-sample case.
...
Julkaisija
American Psychological AssociationISSN Hae Julkaisufoorumista
1082-989XAsiasanat
Julkaisu tutkimustietojärjestelmässä
https://converis.jyu.fi/converis/portal/detail/Publication/28231311
Metadata
Näytä kaikki kuvailutiedotKokoelmat
Rahoittaja(t)
Suomen AkatemiaRahoitusohjelmat(t)
Tutkijatohtori, SALisätietoja rahoituksesta
This research was supported in part by a grant from the Academy of Finland (grant 311309). Parts of this research were carried out while Mikko Rönkkö was at the Department of Industrial Engineering and Management, Aalto University. We acknowledge the computational resources provided by the Aalto Science-IT project.Lisenssi
Samankaltainen aineisto
Näytetään aineistoja, joilla on samankaltainen nimeke tai asiasanat.
-
Reliability and validity of a new accelerometer-based device for detecting physical activities and energy expenditure
Yang, Yanxiang; Schumann, Moritz; Le, Shenglong; Cheng, Sulin (PeerJ Inc., 2018)Background Objective assessments of sedentary behavior and physical activity (PA) by using accelerometer-based wearable devices are ever expanding, given their importance in the global context of health maintenance. This ... -
The reliability and validity of the sport engagement instrument in the Finnish dual career context
Kuokkanen, Joni; Virtanen, Tuomo; Hirvensalo, Mirja; Romar, Jan-Erik (Routledge, 2022)Although engagement is key to predicting burnout and dropout, few existing instruments measure this phenomenon in the sports context. As part of a larger three-year Lower Secondary Sports Schools Pilot Project (LSSSPP) in ... -
Test–retest reliability of cortico-spinal measurements in the rectus femoris at different contraction levels
Gomez-Guerrero, Gonzalo; Avela, Janne; Enroth, Miro; Häkkinen, Ella; Ansdell, Paul; Howatson, Glyn; Walker, Simon (Frontiers Media SA, 2023)Single-pulse Transcranial Magnetic Stimulation (TMS) and, very recently, lumbar stimulation (LS) have been used to measure cortico-spinal excitability from various interventions using maximal or submaximal contractions in ... -
Test−Retest Reliability of Isokinetic Ankle, Knee and Hip Strength in Physically Active Adults Using Biodex System 4 Pro
Tuominen, Juho; Leppänen, Mari; Jarske, Heidi; Pasanen, Kati; Vasankari, Tommi; Parkkari, Jari (MDPI AG, 2023)Background: The isokinetic dynamometry is considered a gold standard in muscle strength testing. The reliability of lower limb isokinetic strength measurements has not been thoroughly evaluated. Objective: To examine the ... -
Dimensionality, reliability, and validity of the Finnish version of the pain catastrophizing scale in chronic low back pain
Mikkonen, Jani; Leinonen, Ville; Lähdeoja, Tuomas; Holopainen, Riikka; Ekström, Kristian; Koho, Petteri; Airaksinen, Olavi; Luciano, Juan V.; Navarrete, Jaime; Neblett, Randy (De Gruyter, 2024)Objectives The 13-item pain catastrophizing scale (PCS) is the most commonly used measure of pain catastrophizing. A validated Finnish version of the PCS has previously been unavailable. The objectives were to translate ...
Ellei toisin mainittu, julkisesti saatavilla olevia JYX-metatietoja (poislukien tiivistelmät) saa vapaasti uudelleenkäyttää CC0-lisenssillä.