An Evaluation of Methods for Setting Standards on the Essay Portion of the National Teacher Examinations [microform] / John Christian Busch and Richard M. Jaeger.
This study addressed seven questions regarding the methods used in setting passing scores on the essay subtest of the National Teacher Examinations (NTE) Communication Skills test for the North Carolina State Board of Education. North Carolina uses these tests to screen prospective applicants to tea...
Saved in:
| Online Access: |
Request ERIC Document |
|---|---|
| Main Author: | |
| Other Authors: | |
| Format: | Microfilm Book |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
1984.
|
| Subjects: |
| Summary: | This study addressed seven questions regarding the methods used in setting passing scores on the essay subtest of the National Teacher Examinations (NTE) Communication Skills test for the North Carolina State Board of Education. North Carolina uses these tests to screen prospective applicants to teacher education programs. The judges (five college faculty members and two public school teachers) rated two sets of eleven essay responses to a question from the 1982 national NTE administration provided by Educational Testing Service (ETS). The first essay set was presented in order of increasing ETS assigned scores, the second in random order. Judges rated the essays as "acceptable" or "unacceptable." They were given the ETS holistic scoring for each essay, decided which ETS rating represented a minimally acceptable essay, and rank ordered the essays. A minimal standard for each judge was computed by two methods. The resulting data were analyzed descriptively due to the small sample size. Results suggested that to produce the smallest variance among judges' standards, essays should be presented in increasing order of quality (as scored by ETS readers), but without prior knowledge of ETS ratings. Rating knowledge created an apparent positive bias in recommended standards. (BS) |
|---|---|
| Item Description: | ERIC Note: Paper presented at the Joint Annual Meeting of the American Educational Research Association and the National Council on Measurement in Education (New Orleans, LA, April 23-27, 1984). ERIC Document Number: ED248270. |
| Physical Description: | 20 pages |
| Audience: | Researchers. |
| Reproduction Note: | Microfiche. |
| Action Note: | committed to retain |