Methodological issues regarding power of classical test theory (CTT) and item response theory (IRT)-based approaches for the comparison of patient-reported outcomes in two groups of patients--a simulation study. - Université de Nantes Accéder directement au contenu
Article Dans Une Revue BMC Medical Research Methodology Année : 2010

Methodological issues regarding power of classical test theory (CTT) and item response theory (IRT)-based approaches for the comparison of patient-reported outcomes in two groups of patients--a simulation study.

Résumé

BACKGROUND: Patients-Reported Outcomes (PRO) are increasingly used in clinical and epidemiological research. Two main types of analytical strategies can be found for these data: classical test theory (CTT) based on the observed scores and models coming from Item Response Theory (IRT). However, whether IRT or CTT would be the most appropriate method to analyse PRO data remains unknown. The statistical properties of CTT and IRT, regarding power and corresponding effect sizes, were compared. METHODS: Two-group cross-sectional studies were simulated for the comparison of PRO data using IRT or CTT-based analysis. For IRT, different scenarios were investigated according to whether items or person parameters were assumed to be known, to a certain extent for item parameters, from good to poor precision, or unknown and therefore had to be estimated. The powers obtained with IRT or CTT were compared and parameters having the strongest impact on them were identified. RESULTS: When person parameters were assumed to be unknown and items parameters to be either known or not, the power achieved using IRT or CTT were similar and always lower than the expected power using the well-known sample size formula for normally distributed endpoints. The number of items had a substantial impact on power for both methods. CONCLUSION: Without any missing data, IRT and CTT seem to provide comparable power. The classical sample size formula for CTT seems to be adequate under some conditions but is not appropriate for IRT. In IRT, it seems important to take account of the number of items to obtain an accurate formula.
Fichier principal
Vignette du fichier
1471-2288-10-24.pdf (239.32 Ko) Télécharger le fichier
1471-2288-10-24-S1.DOC (69 Ko) Télécharger le fichier
1471-2288-10-24-S2.DOC (68.5 Ko) Télécharger le fichier
1471-2288-10-24-S3.DOC (54.5 Ko) Télécharger le fichier
1471-2288-10-24-S4.DOC (25.5 Ko) Télécharger le fichier
1471-2288-10-24.xml (57.99 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Format : Autre
Format : Autre
Format : Autre
Format : Autre
Format : Autre
Loading...

Dates et versions

inserm-00663905 , version 1 (27-01-2012)

Identifiants

Citer

Véronique Sébille, Jean-Benoit Hardouin, Tanguy Le Néel, Gildas Kubis, François Boyer, et al.. Methodological issues regarding power of classical test theory (CTT) and item response theory (IRT)-based approaches for the comparison of patient-reported outcomes in two groups of patients--a simulation study.. BMC Medical Research Methodology, 2010, 10 (1), pp.24. ⟨10.1186/1471-2288-10-24⟩. ⟨inserm-00663905⟩
142 Consultations
183 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More