The Effects of Content Mix and Equating Method on the Accuracy of Test Equating Using Anchor-Item Design [electronic resource] / Wen-Ling Yang.
Using an anchor-item design of test equating, the effects of three equating methods (Tucker linear and two three-parameter item-response-theory-based (3PL-IRT) methods), and the content representativeness of anchor items on the accuracy of equating were examined; and an innovative way of evaluating...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[S.l.] :
Distributed by ERIC Clearinghouse,
1997.
|
| Subjects: |
| Summary: | Using an anchor-item design of test equating, the effects of three equating methods (Tucker linear and two three-parameter item-response-theory-based (3PL-IRT) methods), and the content representativeness of anchor items on the accuracy of equating were examined; and an innovative way of evaluating equating accuracy appropriate for the particular item-sampling design of the study was introduced. Data analyzed were test results from 2 forms of a professional competency examination with 197 and 203 items respectively. There were 145 anchor items embedded in both forms, and the 2 examinee groups were not randomly formed. From the two test forms, four pairs of shortened test forms were created to differ in the content representativeness of their anchor items. The total raw score on the original anchor items was regarded as a "pseudo true score," which was used as a criterion for evaluating equating accuracy. Overall, the three equating methods appeared to yield moderately accurate equating results on every test, but the outcomes of the IRT-based methods seemed to be more accurate than the outcomes of the Tucker method. The accuracy of equating depended on the content representativeness of the anchor items, no matter which method was used to equate test forms. The 3PL-IRT model seemed appropriate for equating the test form with negative skewed score distribution. One appendix presents the item sampling schemes and the other contains tables of correlation analyses on anchor and nonanchor items. (Contains 6 tables, 2 figures, and 58 references.) (SLD) |
|---|---|
| Item Description: | ERIC Document Number: ED409334. ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, IL, March 24-28, 1997). |
| Physical Description: | 44 p. |