Rating format research revisited: format effectiveness and acceptability depend on rater characteristics
Article Abstract:
Rating format research has largely been ignored since Landy and Farr's (1980)call for a moratorium over a decade ago. Their conclusion that ratings were notaffected by changes in scale format was based on research that treated all raters alike. However, individuals differ in the way in which they perceive andintegration information. This article investigates the proposition that differences in rating accuracy associated with different rating formats are contingent on rater characteristics. The study tested the rating accuracy and affective reactions toward performance appraisal of field-dependent (FD) and field-independent (FI) raters on four different performance measures. As hypothesized, FIs were more accurate raters than FDs only when scale formats were holistic, and only FDs' ratings were significantly affected by the level of structure in the scale format. FI raters were also more confident in their ratings and less frustrated and confused with the rating task than were FDs. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1993
User Contributions:
Comment about this article or add new information about this topic:
Improving the accuracy of performance evaluations: comparison of three methods of performance appraiser training
Article Abstract:
A total of 52 supervisory personnel were trained under one of three performance-appraisal training programs: rater error (response set) training, observation training, or decision-making training. Halo, leniency, range restriction, and accuracy measures were collected before and after training from the three training groups and a no-training control group. The results suggested that although the traditional rater error training, best characterized as inappropriate response set training, reduced the classic rater errors (or statistical effects), it also detrimentally affected rating accuracy. However, observation and decision-making training caused performance rating accuracy to increase after training, but did little to reduce classic rater effects. The need for a reconceptualization of rater training content and measurement focus was discussed in terms of the uncertain relations between statistical rating effects and accuracy. (Reprinted by permission of the publisher.)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1988
User Contributions:
Comment about this article or add new information about this topic:
- Abstracts: Excavating power: in search of frontier zones and new actors
- Abstracts: Market embeddedness and corporate instability: the ecology of inter-industrial networks. The organizational connection: social capital and the career expansion of directors of business groups in Israel
- Abstracts: Measuring Member Satisfaction with the Church. Job Attitude and Motivation Differences between Volunteers and Employees from Comparable Organizations
- Abstracts: Classical conditioning preferences for stimuli. Characteristics of Mexican American consumers. The Role of Products as Social Stimuli
- Abstracts: International Economic Relations and the Entrepreneurial State. Externalities, Information Costs and Social Benefit- Cost Analysis for Economic Development. An Example from Telecommunications