Modeling Conditional Probabilities in Complex Educational Assessments. CSE Technical Report [electronic resource] / Robert J. Mislevy, Russell Almond and Lou Dibello.
An active area in psychometric research is coordinated task design and statistical analysis built around cognitive models. Compared with classical test theory and item response theory, there is often less information from observed data about the measurement-model parameters. On the other hand, there...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Corporate Authors: | , |
| Other Authors: | , , , , , |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
2002.
|
| Subjects: |
| Summary: | An active area in psychometric research is coordinated task design and statistical analysis built around cognitive models. Compared with classical test theory and item response theory, there is often less information from observed data about the measurement-model parameters. On the other hand, there is more information from the grounding psychological theory, and the task designer's insights into which patterns of skills lead to which patterns of performance. The paper describes a Bayesian approach to modeling these situations, which uses experts' judgments to produce prior distributions for the conditional probabilities in a multivariate latent-variable model, and Monte Carlo Markov Chain estimation to refine the estimated. Task-design schemes and expert judgments are used in the first phase to structure the conditional probability tablethat is, conjunctive, compensatory, or disjunctive models, or combinations thereof. Machinery form graded-response item response theory is used to translate experts' judgments about task requirements into prior distributions for model parameters, which in turn imply values for all the conditional probabilities. Bayesian estimation methods are then used to update the distributions for the model parameters in response to observed data. The approach is illustrated with examples from the Biomass biology assessment prototype. (Contains 9 figures, 12 tables, and 25 references.) (Author/SLD) |
|---|---|
| Item Description: | ERIC Document Number: ED482930. Sponsoring Agency: Office of Educational Research and Improvement (edition), Washington, DC. Contract Number: R305B960002. |
| Physical Description: | 45 pages. |