Diaries, checklists, evaluations, and contrast effects in measurement of behavior
Article Abstract:
Two studies addressed three research questions. (a) Are behavioral diaries or checklists susceptible to between-ratee contrast effects? The studies found that both diaries and checklists are susceptible to between-rateecontrast effects. (b) Can diaries or checklists help reduce between-ratee contrast effects on corresponding performance evaluations? Study 1 illustrated that diaries not only may be ineffective at reducing contrast effects on corresponding ratings but also may actually strengthen those effects. In Study 2, although checklists compared favorably with diaries in their impact on contrast effects on corresponding evaluations, checklists did not eliminate thecontrast effect on evaluations. (c) What are the directional influences of context behavior when contrast effects are observed? Siginificant contrast effects were consistent with the traditional conception of this effect: upward in a poor context and downward in a good context. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1993
User Contributions:
Comment about this article or add new information about this topic:
Positive-findings bias, and measuring methodological rigor, in evaluations of organization development
Article Abstract:
According to the positive-findings bias hypothesis, there is a negative relationship between the methodological rigor of evaluations of organization development interventions and the reported success of those interventions. We performed three basic analyses of this issue. The first indicated no differences in rigor across intervention categories. The second indicated no significant negative correlations between rigor and reported success, for the overall sample or for any category of intervention or outcome variable. The third analysis indicated that the rigor measure used in the first two analyses, and in previous research, is problematic. Further analyses, with alternative rigor measures, indicated that results are quite sensitive to measure composition. There is a negative relationship between rigor and reported success for sampling criteria, and a positive relationship for measurement and analysis criteria. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1992
User Contributions:
Comment about this article or add new information about this topic:
Use of tests manifesting sex differences as measures of intelligence: implications for measurement bias
Article Abstract:
Very narrow tests measuring knowledge of specific information from Project TALENT were combined into two composites on the basis of between-group differences for high-school-age boys and girls. These composites were analyzed to determine what happens when specific, nontrait components of variance are included in measures of general intelligence. The two composites were heavily advantageous to either males of females and were made up of very narrow, mostly nonacademic, information-dependent subtests. Correlations were computed between the sex-advantage composites and general intelligence scores. Very large validities were obtained, indicating that the composites were acting as excellent measures of general intelligence for both sexes. Results are discussed in the framework of multiple determinants of responses and group differences in item and test performance. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1987
User Contributions:
Comment about this article or add new information about this topic:
- Abstracts: Self-generated validity and other effects of measurement on belief, attitude, intention, and behavior. Implicit personality and performance appraisal: the influence of trait inferences on evaluations of behavior
- Abstracts: Link, search, interact: the co-evolution of NGOs and interactive technology. Heterarchies of value in Manhattan-based new media firms
- Abstracts: Affective and Cognitive Factors in Soldiers' Reenlistment Decisions. Importance of specialized cognitive function in the selection of military pilots
- Abstracts: Toward a reconciliation of market power and information theories of advertising effects on price elasticity. A longitudinal study of the use of the elderly in magazine advertising
- Abstracts: Tax reform: a state housing finance agency perspective. Tax increment financing. Housing and community development in the nation's capital