Component vs. Composite Grading [microform] : Outcome Quality and Passing Rate as Functions of Number of Tests, Test Correlation, and Reliability / Eric Werner.
Credentialing agencies that use multi-test examinations (MTEs) should be concerned with the quality of pass/fail outcomes as well as with the proportion of candidates passing. This study addressed three questions: (1) the effects on passing rate of MTE reliability, number of tests comprising a MTE,...
Saved in:
| Online Access: |
Request ERIC Document |
|---|---|
| Main Author: | |
| Format: | Microfilm Book |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
1991.
|
| Subjects: |
MARC
| LEADER | 00000nam a22000002u 4500 | ||
|---|---|---|---|
| 001 | b6147185 | ||
| 003 | CoU | ||
| 007 | he u||024|||| | ||
| 008 | 910401s1991 xx |||| bt ||| | eng d | ||
| 005 | 20240722191327.6 | ||
| 035 | |a (ERIC)ed335374 | ||
| 040 | |a ericd |c ericd |d MvI | ||
| 099 | |f ERIC DOC # |a ED335374 | ||
| 100 | 1 | |a Werner, Eric. |0 http://id.loc.gov/authorities/names/n2015020907 |1 http://isni.org/isni/0000000447519109. | |
| 245 | 1 | 0 | |a Component vs. Composite Grading |h [microform] : |b Outcome Quality and Passing Rate as Functions of Number of Tests, Test Correlation, and Reliability / |c Eric Werner. |
| 260 | |a [Place of publication not identified] : |b Distributed by ERIC Clearinghouse, |c 1991. | ||
| 300 | |a 23 pages. | ||
| 336 | |a text |b txt |2 rdacontent. | ||
| 337 | |a microform |b h |2 rdamedia. | ||
| 338 | |a microfiche |b he |2 rdacarrier. | ||
| 500 | |a ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association and the National Council on Measurement in Education (Chicago, IL, April 3-7, 1991). |5 ericd. | ||
| 500 | |a ERIC Document Number: ED335374. | ||
| 520 | |a Credentialing agencies that use multi-test examinations (MTEs) should be concerned with the quality of pass/fail outcomes as well as with the proportion of candidates passing. This study addressed three questions: (1) the effects on passing rate of MTE reliability, number of tests comprising a MTE, and correlations between pairs of component tests; (2) the effects on outcome quality of test reliability and correlations between pairs of component tests; and (3) how component (multiple-cutoff) and composite (compensatory) grading differ in terms of outcome quality when evaluated against the same standard. Using three independent variables (the number of tests comprising a MTE, the tests' reliabilities, and their true-score correlations) that define 18 conditions, large-sample data sets (1,000 scores) were computer-generated and analyzed under classical true-error conditions. Results show that: chances of candidate success on component-graded MTEs varied dramatically with the technical characteristics of the MTE; for component-graded and composite-graded MTEs, the quality of pass/fail outcomes varied significantly according to test characteristics; and the two grading strategies produced different distributions of candidates across outcome-quality categories. Implications for licensing MTE construction are discussed. Four tables present study data. An attachment illustrates the formula for controlling correlations among the distributions. (SLD) | ||
| 533 | |a Microfiche. |b [Washington D.C.]: |c ERIC Clearinghouse |e microfiches : positive. | ||
| 583 | 1 | |a committed to retain |c 20240101 |d 20490101 |5 CoU |f Alliance Shared Trust |u https://www.coalliance.org/shared-print-archiving-policies | |
| 650 | 0 | 7 | |a Accrediting Agencies. |2 ericd. |
| 650 | 0 | 7 | |a Agency Role. |2 ericd. |
| 650 | 0 | 7 | |a Certification. |2 ericd. |
| 650 | 0 | 7 | |a Comparative Analysis. |2 ericd. |
| 650 | 0 | 7 | |a Computer Simulation. |2 ericd. |
| 650 | 1 | 7 | |a Correlation. |2 ericd. |
| 650 | 1 | 7 | |a Licensing Examinations (Professions) |2 ericd. |
| 650 | 1 | 7 | |a Pass Fail Grading. |2 ericd. |
| 650 | 0 | 7 | |a Quality Control. |2 ericd. |
| 650 | 1 | 7 | |a Scores. |2 ericd. |
| 650 | 0 | 7 | |a Scoring. |2 ericd. |
| 650 | 0 | 7 | |a Test Content. |2 ericd. |
| 650 | 1 | 7 | |a Test Reliability. |2 ericd. |
| 650 | 0 | 7 | |a Test Use. |2 ericd. |
| 856 | 4 | 2 | |z Request ERIC Document |u https://colorado.idm.oclc.org/login?url=https://colorado.illiad.oclc.org/illiad/COD/illiad.dll?Action=10&Form=23 |
| 907 | |a .b61471859 |b 01-18-22 |c 10-09-10 | ||
| 998 | |a pas |b 10-09-10 |c b |d m |e - |f eng |g xx |h 0 |i 1 | ||
| 907 | |a .b61471859 |b 08-31-20 |c 10-09-10 | ||
| 944 | |a MARS - RDA ENRICHED | ||
| 956 | |a ERIC | ||
| 948 | |a bslw20/21 : aug : ess | ||
| 999 | f | f | |i 1a3f09d5-06b8-50f0-9dbe-0e0d1516e8a5 |s 1970d042-7ba1-5c6a-99ac-8785451a9a87 |
| 952 | f | f | |p Can circulate |a University of Colorado Boulder |b Boulder Campus |c Offsite |d PASCAL Offsite |e ED335374 |h Other scheme |i microfiche |n 1 |