White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Evaluating and extending statistical methods for estimating the construct-level predictive validity of selection tests

Mwandigha, Lazaro Mwakesi (2017) Evaluating and extending statistical methods for estimating the construct-level predictive validity of selection tests. PhD thesis, University of York.

[img]
Preview
Text
Lazaro_Mwakesi_Mwandigha_PhD_thesis.pdf - Examined Thesis (PDF)
Available under License Creative Commons Attribution-Noncommercial-No Derivative Works 2.0 UK: England & Wales.

Download (3020Kb) | Preview

Abstract

Background: In this thesis the problem of range restriction was addressed using the United Kingdom Clinical Aptitude Test (UKCAT) and Professional and Linguistic Assessments Board (PLAB) test in the selection of undergraduate medical school entrants and International Medical Graduates (IMGs) in the UK as motivating examples. Methods for correcting for bias in the estimate of predictive validity due to range restriction (particularly Multiple Imputation (MI) and Full Information Maximum Likelihood (FIML)) were evaluated for the predictive validity, single hurdle concurrent and multiple hurdle validity designs under varying degrees of strictness in selection. For MI, the impact of the composition of the imputation model was also investigated. Methods: The performance of MI and FIML was tested through Monte Carlo simulations and validated using PLAB data. Results: Generally, MI and FIML were found to be equivalent in performance and superior to other methods of correcting for range restriction bias for selection ratios of ≤ 20% only in instances where data were multivariate normal. The inclusion of highly predictive variables in the imputation model increased the precision of MI. Conclusion: MI and FIML are viable alternatives for tackling bias in the estimate of predictive validity for direct range restricted data that satisfies the assumption of multivariate normality. Caution should be taken to avoid their application in instances where the assumption of multivariate normality is violated.

Item Type: Thesis (PhD)
Related URLs:
Academic Units: The University of York > Health Sciences (York)
Depositing User: Mr Lazaro Mwakesi Mwandigha
Date Deposited: 28 Aug 2018 14:52
Last Modified: 10 Aug 2020 00:18
URI: http://etheses.whiterose.ac.uk/id/eprint/21267

You do not need to contact us to get a copy of this thesis. Please use the 'Download' link(s) above to get a copy.
You can contact us about this thesis. If you need to make a general enquiry, please see the Contact us page.

Actions (repository staff only: login required)