Interrater Reliability and Internal Consistency of Student and Staff Ratings of Medical Instruction [electronic resource] / T. E. Dielman and Paula K. Horvatich.
The purposes of this study were to establish the interrater reliability, dimensionality, and internal consistency of an instruction evaluation instrument used at The University of Michigan Medical School. Using the nine-item rating scale, 1,758 student ratings and 88 staff ratings were gathered on 6...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Author: | |
| Other Authors: | |
| Format: | Electronic eBook |
| Language: | English |
| Published: |
[S.l.] :
Distributed by ERIC Clearinghouse,
1985.
|
| Subjects: |
MARC
| LEADER | 00000cam a22000002u 4500 | ||
|---|---|---|---|
| 001 | b6319869 | ||
| 003 | CoU | ||
| 005 | 20080221101618.6 | ||
| 006 | m d f | ||
| 007 | cr un | ||
| 008 | 850301s1985 xx |||| o ||| s eng d | ||
| 035 | |a (ERIC)ed254554 | ||
| 040 | |a ericd |c ericd |d MvI | ||
| 099 | |f ERIC DOC # |a ED254554 | ||
| 099 | |f ERIC DOC # |a ED254554 | ||
| 100 | 1 | |a Dielman, T. E. | |
| 245 | 1 | 0 | |a Interrater Reliability and Internal Consistency of Student and Staff Ratings of Medical Instruction |h [electronic resource] / |c T. E. Dielman and Paula K. Horvatich. |
| 260 | |a [S.l.] : |b Distributed by ERIC Clearinghouse, |c 1985. | ||
| 300 | |a 12 p. | ||
| 500 | |a ERIC Document Number: ED254554. | ||
| 500 | |a ERIC Note: Paper presented at the Annual Meeting of the American Educational Research Association (69th, Chicago, IL, March 31-April 4, 1985). |5 ericd. | ||
| 500 | |a Educational level discussed: Higher Education. | ||
| 520 | |a The purposes of this study were to establish the interrater reliability, dimensionality, and internal consistency of an instruction evaluation instrument used at The University of Michigan Medical School. Using the nine-item rating scale, 1,758 student ratings and 88 staff ratings were gathered on 61 faculty. Interrater agreement ranged from .28 to .53 among students, from .11 to .70 among staff, and from .28 to .70 between students and staff. Separate factor analyses of student and staff data showed all items except one exhibited high loadings on a single factor. The eight items forming this factor were summed with unit weighting to form a total "Teaching Quality" index score for each instructor. Internal consistency (Cronbach's alpha) coefficients for this index were .92 for student raters and .93 for staff raters. Although this evidence for reliability is compelling, the question of validity remains. Validation methods depend on how the instructional ratings are used. The instructor evaluation form is appended. (Author/BS) | ||
| 521 | 8 | |a Researchers. |b ericd. | |
| 650 | 0 | 7 | |a Evaluation Methods. |2 ericd. |
| 650 | 0 | 7 | |a Graduate Medical Education. |2 ericd. |
| 650 | 0 | 7 | |a Higher Education. |2 ericd. |
| 650 | 1 | 7 | |a Interrater Reliability. |2 ericd. |
| 650 | 1 | 7 | |a Medical School Faculty. |2 ericd. |
| 650 | 0 | 7 | |a Peer Evaluation. |2 ericd. |
| 650 | 1 | 7 | |a Rating Scales. |2 ericd. |
| 650 | 0 | 7 | |a Student Evaluation of Teacher Performance. |2 ericd. |
| 650 | 1 | 7 | |a Teacher Evaluation. |2 ericd. |
| 650 | 1 | 7 | |a Test Reliability. |2 ericd. |
| 700 | 1 | |a Horvatich, Paula K. | |
| 856 | 4 | 0 | |u http://files.eric.ed.gov/fulltext/ED254554.pdf |z Full Text (via ERIC) |
| 907 | |a .b63198691 |b 07-06-22 |c 10-13-10 | ||
| 998 | |a web |b 10-23-12 |c f |d m |e - |f eng |g xx |h 0 |i 1 | ||
| 956 | |a ERIC | ||
| 999 | f | f | |i f8d81a98-421f-54a5-840c-9f99c58a9af3 |s 6d0e18d4-56dc-587e-93f1-bd968440cc7d |
| 952 | f | f | |p Can circulate |a University of Colorado Boulder |b Online |c Online |d Online |e ED254554 |h Other scheme |i web |n 1 |