Stability of validity indices through test score ranges
Article Abstract:
Effects of correction for restriction in range and variability of validity evidence throughout the predictor range were examined in a sample of 16,230 inexperienced life insurance agents. The predictor variable was the Aptitude Index Battery (a biographical inventory) and the criterion was 1-year objective sales production. Data displayed nonlinearity and heteroscedasticity. Although variations in the validity coefficients and the slopes within the restricted samples were observed, these were generally accounted for by sampling error. When analyzed with linear regression techniques, data showed stronger relationships between the predictor and criterion at the upper score range; however, when analyzed with techniques appropriate for nonlinear, heteroscedastic data, validity evidence indicated better predictability at lower score ranges. Increasing the truncation of the distribution yielded increasingly overestimated slopes and corrected correlations. Influences of nonlinearity and heteroscedasticity and implications for the use of the direct restriction of range correction formula are discussed. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1988
User Contributions:
Comment about this article or add new information about this topic:
What is the interpretation of the validity generalization estimate s, super 2, p = S, super 2, r - s, super 2, e?
Article Abstract:
The estimate of s, super 2, p is difficult to interpret; it is not a simple variance estimate. Its expectation under the hypothesis that all population correlation coefficients are equal is about zero, but it can be negative and depends on unknown constant population correlation coefficient. The probability distribution of s, super 2, p can have large negative probability mass even if its expectation is positive. Observed estimates of s, super 2, p, even if negative, cannot be taken as unqualified evidence supporting the validity generalization hypothesis because expectations under certain alternative hypotheses may have smaller expectations than under certain validity generalization hypotheses. It appears virtually impossible to provide a general hypothesis-testing framework that distinguishes between validity specificity and generalizability on s, super 2, p. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1988
User Contributions:
Comment about this article or add new information about this topic:
Artifactual reliability of forced-choice scales
Article Abstract:
The possibility of artifactual reliability of multiple scales embedded in a single forced-choice instrument was examined. It was demonstrated that, by introducing one perfectly reliable scale in an instrument when responses to all of the remaining scales were random, considerable internal consistency reliability was generated in the remaining scales. The findings cast doubt on the advisability of the practice of making construct-oriented interpretation of ipsative scores from multiple-scale instruments. Alternative procedures for obtaining the reliability estimates necessary for demonstration of construct validity of the scales are recommended. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1988
User Contributions:
Comment about this article or add new information about this topic:
- Abstracts: Evaluation of three circadian rhythm questionnaires with suggestions for an improved measure of morningness
- Abstracts: The facilitation of organizational change: an empirical study of factors predicting change agents' effectiveness
- Abstracts: The facilitation of organizational change: an empirical study of factors predicting change agents' effectiveness. part 2
- Abstracts: Promotion interest and willingness to sacrifice for promotion in a government agency. Effects of management policies on unauthorized absence behavior
- Abstracts: Structure of drug use behaviors and consequences among young adults: multitrait-multimethod assessment of frequency, quantity, work site, and problem substance use. part 2