The Use of Subsets of Test Questions in an Angoff Standard Setting Method [electronic resource] / Abdullah Ferdous and Barbara Plake.
In the Angoff standard setting procedure, subject matter experts (SMEs) estimate the probability that a hypothetical randomly selected minimally competent candidate will answer correctly each item comprising the test. In many cases, these item performance estimates are made twice, with information s...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Other Authors: | |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
2003.
|
| Subjects: |
| Summary: | In the Angoff standard setting procedure, subject matter experts (SMEs) estimate the probability that a hypothetical randomly selected minimally competent candidate will answer correctly each item comprising the test. In many cases, these item performance estimates are made twice, with information shared with SMEs between estimates. This estimation process can be time-consuming and fatiguing, especially for the SMEs. This study addressed the possibilities of saving time and resources in an Angoff standard setting study. The study used three sets of databases, two from a medical health certification program, with 10 judges for each data et, and one from a financial analyst certification study, with 33 judges. The study shows that using subsets of items, as opposed to the full length test, could be an important consideration that could reduce the time and resources necessary to conduct a standard setting study. The results of this study suggest that 50% of test items may be sufficient to estimate an equivalent minimum passing score in an Angoff setting study. This could result in a substantial saving of time and resources not only for the agency that has been carrying out this activity, but also to the practitioners (panelists) who participate in the standard setting study. (Author/SLD) |
|---|---|
| Item Description: | ERIC Document Number: ED475369. ERIC Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Chicago, IL, April 22-24, 2003). |
| Physical Description: | 21 pages. |