Handicapping Raters for Fairer Clinical Grading [microform] : A Practical Application / Gerald J. Cason and Others.
To minimize the effects of systematic differences in raters' standards of clinical competence, a handicapping system was applied to the ratings made by fourteen preceptors of 128 junior year medical students in a 6-week psychiatry clerkship at the University of Arkansas for Medical Sciences. Th...
Saved in:
| Online Access: |
Request ERIC Document |
|---|---|
| Main Author: | |
| Format: | Microfilm Book |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
1985.
|
| Subjects: |
| Summary: | To minimize the effects of systematic differences in raters' standards of clinical competence, a handicapping system was applied to the ratings made by fourteen preceptors of 128 junior year medical students in a 6-week psychiatry clerkship at the University of Arkansas for Medical Sciences. The handicap of a preceptor was the difference between the grand mean of all ratings and the mean of that preceptors ratings. The handicap was added to the preceptor's raw ratings. Final clerkship grades were based on weighted scores on the National Board of Medical Examiners psychiatry test, local psychiatry tests, and the rating. The observed range of preceptor handicaps (9 points) was quite large when compared to the observed range of raw ratings (16 points). Results showed that the adjusted ratings increased rater reliability by 25 to 35 percent. Adjusted ratings produced an increased correlation among the measures and a slight improvement in the adjusted total reliability when compared to the raw total. Thirteen percent of the students' grades changed one letter, depending on whether raw or adjusted scores were used. (Author/GDC) |
|---|---|
| Item Description: | ERIC Note: Paper presented at the Annual Meeting of the Association of Medical Colleges, Southern Group on Medical Education (San Juan, Puerto Rico, April 17-19, 1985). ERIC Document Number: ED261084. |
| Physical Description: | 20 pages |
| Reproduction Note: | Microfiche. |
| Action Note: | committed to retain |