Some Applications of Generalizability Theory to the Dependability of Domain-Referenced Tests. ACT Technical Bulletin No. 32 [electronic resource] / Robert L. Brennan.
Using the basic principles of generalizability theory, a psychometric model for domain-referenced interpretations is proposed, discussed, and illustrated. This approach, assuming an analysis of variance or linear model, is applicable to numerous data collection designs, including the traditional per...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Corporate Author: | |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[S.l.] :
Distributed by ERIC Clearinghouse,
1979.
|
| Subjects: |
MARC
| LEADER | 00000cam a22000002u 4500 | ||
|---|---|---|---|
| 001 | b6383117 | ||
| 003 | CoU | ||
| 005 | 20080221101652.2 | ||
| 006 | m d f | ||
| 007 | cr un | ||
| 008 | 790401s1979 xx |||| o ||| s eng d | ||
| 035 | |a (ERIC)ed167577 | ||
| 040 | |a ericd |c ericd |d MvI | ||
| 099 | |f ERIC DOC # |a ED167577 | ||
| 099 | |f ERIC DOC # |a ED167577 | ||
| 100 | 1 | |a Brennan, Robert L. | |
| 245 | 1 | 0 | |a Some Applications of Generalizability Theory to the Dependability of Domain-Referenced Tests. ACT Technical Bulletin No. 32 |h [electronic resource] / |c Robert L. Brennan. |
| 260 | |a [S.l.] : |b Distributed by ERIC Clearinghouse, |c 1979. | ||
| 300 | |a 79 p. | ||
| 500 | |a ERIC Document Number: ED167577. | ||
| 500 | |a ERIC Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (San Francisco, California, April, 1979) ; Not available in hard copy due to marginal legibility. |5 ericd. | ||
| 520 | |a Using the basic principles of generalizability theory, a psychometric model for domain-referenced interpretations is proposed, discussed, and illustrated. This approach, assuming an analysis of variance or linear model, is applicable to numerous data collection designs, including the traditional persons-crossed-with-items design, which is treated extensively here. It is shown that the appropriate error variance for domain-referenced interpretations is at least equal to and usually greater than the error variance for norm-referenced interpretations. Also, it is shown that two indices, error variance and signal/noise ratio, can be developed to reflect the dependability of a domain-referenced testing procedure. These indices are interpretable in several complementary ways, and they are easily compared with generalizability coefficients. In this paper, consideration is given not only to theoretical results but also to estimation procedures, illustrative examples, extensions to multiple facet designs, and recommendations for researchers and practitioners. Problems concerning loss functions and the setting of cutting scores are discussed. It is argued that differences between norm-referenced and domain-referenced tests are differences in score interpretation, whereas test development procedures define different domains. Venn diagrams are used to explain concepts. (Author/CTM) | ||
| 650 | 0 | 7 | |a Analysis of Variance. |2 ericd. |
| 650 | 0 | 7 | |a Cost Effectiveness. |2 ericd. |
| 650 | 1 | 7 | |a Criterion Referenced Tests. |2 ericd. |
| 650 | 0 | 7 | |a Cutting Scores. |2 ericd. |
| 650 | 1 | 7 | |a Error of Measurement. |2 ericd. |
| 650 | 1 | 7 | |a Mastery Tests. |2 ericd. |
| 650 | 0 | 7 | |a Mathematical Models. |2 ericd. |
| 650 | 0 | 7 | |a Norm Referenced Tests. |2 ericd. |
| 650 | 0 | 7 | |a Scores. |2 ericd. |
| 650 | 0 | 7 | |a Statistical Analysis. |2 ericd. |
| 650 | 0 | 7 | |a Test Construction. |2 ericd. |
| 650 | 1 | 7 | |a Test Interpretation. |2 ericd. |
| 650 | 1 | 7 | |a Test Reliability. |2 ericd. |
| 710 | 2 | |a American College Testing Program. |b Research and Development Division. | |
| 856 | 4 | 0 | |z Full Text (via ERIC) |u http://files.eric.ed.gov/fulltext/ED167577.pdf |
| 907 | |a .b6383117x |b 07-06-22 |c 10-15-10 | ||
| 998 | |a web |b 10-23-12 |c f |d m |e - |f eng |g xx |h 0 |i 1 | ||
| 956 | |a ERIC | ||
| 999 | f | f | |i fd28c7f7-b123-5c12-834a-06801f40f5f1 |s ef2290b7-118d-5ee1-bf5f-2a0eaa0b2670 |
| 952 | f | f | |p Can circulate |a University of Colorado Boulder |b Online |c Online |d Online |e ED167577 |h Other scheme |i web |n 1 |