Measuring Agreement When Two Observers Classify People Into Categories Not Defined in Advance [electronic resource] / Robert L. Brennan and Richard J. Light.
Basic to many psychological investigations is the question of agreement between observers who independently categorize people. Several recent studies have proposed measures of agreement when a set of nominal scale categories have been pre-defined and imposed on both observers. This study, in contras...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Other Authors: | |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[S.l.] :
Distributed by ERIC Clearinghouse,
1973.
|
| Subjects: |
| Summary: | Basic to many psychological investigations is the question of agreement between observers who independently categorize people. Several recent studies have proposed measures of agreement when a set of nominal scale categories have been pre-defined and imposed on both observers. This study, in contrast, developes a measure of agreement for settings where observers independently define their own categories. Thus, it is possible for observers to delineate different numbers of categories, with different names. Computational formulae for the mean and variance of the proposed agreement measure are given; further, a statistic with a large-sample normal distribution is suggested for testing the null hypothesis of random agreement. A computer based comparison of the large sample approximation with the exact distribution of the test statistic shows a generally good fit, even for moderate sample sizes. Finally, a worked example involving two psychologists' classifications of children illustrates the computations. (Author) |
|---|---|
| Item Description: | ERIC Document Number: ED093975. ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, Illinois, April, 1974). |
| Physical Description: | 24 p. |