Effect of a Modified Angoff Strategy for Obtaining Item Performance Estimates in a Standard Setting Study [electronic resource] / Barbara S. Plake and Gerald Giraud.
In the traditional Angoff Standard Setting Method, experts are instructed to predict the possibility that a randomly selected, hypothetical minimally competent candidate will be able to answer each multiple choice question in the test correctly. These item performance estimates are averaged across p...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Other Authors: | |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[S.l.] :
Distributed by ERIC Clearinghouse,
1998.
|
| Subjects: |
| Summary: | In the traditional Angoff Standard Setting Method, experts are instructed to predict the possibility that a randomly selected, hypothetical minimally competent candidate will be able to answer each multiple choice question in the test correctly. These item performance estimates are averaged across panelists and aggregated to determine the minimum passing score for the test. Some applications have used a modification of this method where panelists are instructed to provide their item performance estimates in deciles, with each decile representing a 10-point probability range. The purpose of the study was to investigate the validity of this approach, in terms of comparability of results to that which would occur from the traditional, open-ended administration procedures. Differences were found between the minimum passing scores across the two methods. A variation that gathered restricted item performance estimates for the initial round and reverted to the full probability scale for round 2 was shown to reduce these differences. Discussion focuses on situations where this variation to the modified Angoff method may be particularly attractive. (Contains one table and four references.) (Author/SLD) |
|---|---|
| Item Description: | ERIC Document Number: ED422354. ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association (San Diego, CA, April 13-17, 1998). |
| Physical Description: | 13 p. |