Interjudge Consensus and Intrajudge Consistency [microform] : Is It Possible To Have Both in Standard Setting? / Charles B. Friedman and Kevin T. Ho.
Eleven judges representing 11 different geographic regions in the United States participated in a standard-setting session designed to determine the possibility of obtaining interjudge consensus and intrajudge consistency simultaneously. Each judge had experience in the field for which standards wer...
Saved in:
| Online Access: |
Request ERIC Document |
|---|---|
| Main Author: | |
| Other Authors: | |
| Format: | Microfilm Book |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
1990.
|
| Subjects: |
MARC
| LEADER | 00000nam a22000002u 4500 | ||
|---|---|---|---|
| 001 | b6173936 | ||
| 003 | CoU | ||
| 007 | he u||024|||| | ||
| 008 | 900401s1990 xx |||| bt ||| | eng d | ||
| 005 | 20241104190237.9 | ||
| 035 | |a (ERIC)ed322164 | ||
| 040 | |a ericd |c ericd |d MvI | ||
| 099 | |f ERIC DOC # |a ED322164 | ||
| 100 | 1 | |a Friedman, Charles B. | |
| 245 | 1 | 0 | |a Interjudge Consensus and Intrajudge Consistency |h [microform] : |b Is It Possible To Have Both in Standard Setting? / |c Charles B. Friedman and Kevin T. Ho. |
| 260 | |a [Place of publication not identified] : |b Distributed by ERIC Clearinghouse, |c 1990. | ||
| 300 | |a 19 pages | ||
| 336 | |a text |b txt |2 rdacontent. | ||
| 337 | |a microform |b h |2 rdamedia. | ||
| 338 | |a microfiche |b he |2 rdacarrier. | ||
| 583 | 1 | |a committed to retain |c 20240101 |d 20490101 |5 CoU |f Alliance Shared Trust |u https://www.coalliance.org/shared-print-archiving-policies | |
| 500 | |a ERIC Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Boston, MA, April 17-19, 1990). |5 ericd. | ||
| 500 | |a ERIC Document Number: ED322164. | ||
| 520 | |a Eleven judges representing 11 different geographic regions in the United States participated in a standard-setting session designed to determine the possibility of obtaining interjudge consensus and intrajudge consistency simultaneously. Each judge had experience in the field for which standards were being set. The judges rated 65 multiple-choice test items that are part of a national health certification examination. All items had been field tested. The judges participated in a rater-training session that included a discussion of the Angoff method and the conceptualization of skills needed for minimum competence. After all items were rated, handouts containing a list of all ratings for all judges were reviewed and discussed by the judges. All judges changed their ratings on at least 4 of the items, and 2 judges changed their ratings on 20 or more items. Results indicate that the procedures used to improve interjudge consensus (that is, provision of feedback via the handouts) did not have an adverse affect on intrajudge consistency. In fact, results show that techniques designed to improve consensus also improved consistency. Two data tables and two bar graphs are included. (TJH) | ||
| 533 | |a Microfiche. |b [Washington D.C.]: |c ERIC Clearinghouse |e microfiches : positive. | ||
| 650 | 1 | 7 | |a Evaluators. |2 ericd |
| 650 | 0 | 7 | |a Feedback. |2 ericd |
| 650 | 1 | 7 | |a Interrater Reliability. |2 ericd |
| 650 | 1 | 7 | |a Licensing Examinations (Professions) |2 ericd |
| 650 | 0 | 7 | |a Medicine. |2 ericd |
| 650 | 0 | 7 | |a Minimum Competency Testing. |2 ericd |
| 650 | 0 | 7 | |a Multiple Choice Tests. |2 ericd |
| 650 | 1 | 7 | |a Standard Setting (Scoring) |2 ericd |
| 650 | 1 | 7 | |a Standardized Tests. |2 ericd |
| 650 | 0 | 7 | |a Test Construction. |2 ericd |
| 700 | 1 | |a Ho, Kevin T. | |
| 856 | 4 | 2 | |z Request ERIC Document |u https://colorado.idm.oclc.org/login?url=https://colorado.illiad.oclc.org/illiad/COD/illiad.dll?Action=10&Form=23 |
| 907 | |a .b61739364 |b 01-18-22 |c 10-10-10 | ||
| 944 | |a MARS - RDA ENRICHED | ||
| 998 | |a pas |b 10-10-10 |c f |d m |e - |f eng |g xx |h 0 |i 1 | ||
| 956 | |a ERIC | ||
| 999 | f | f | |i 605677c8-6baf-5833-a159-1cddeaf8d607 |s 515d36fd-89c0-5bfc-a2ff-355a3f891f06 |
| 952 | f | f | |p Can circulate |a University of Colorado Boulder |b Boulder Campus |c Offsite |d PASCAL Offsite |e ED322164 |h Other scheme |i microfiche |n 1 |