An Open Vocabulary Approach for Estimating Teacher Use of Authentic Questions in Classroom Discourse / Connor Cook, Andrew M. Olney and Sean Kelly.
Automatic assessment of the quality of classroom discourse can have a transformative effect on research and practice on improving teaching effectiveness. We improve on a previous automated method to measure teacher authentic questions -- open-ended questions without pre-scripted responses that predi...
Saved in:
| Online Access: |
Full Text (via ERIC) |
|---|---|
| Main Authors: | , , , |
| Format: | eBook |
| Language: | English |
| Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
2018.
|
| Subjects: |
| Summary: | Automatic assessment of the quality of classroom discourse can have a transformative effect on research and practice on improving teaching effectiveness. We improve on a previous automated method to measure teacher authentic questions -- open-ended questions without pre-scripted responses that predict student achievement growth -- using classroom audio and expert question codes from two sources: (1) a large archival database of text transcripts of 428 class-sessions from 116 classrooms, and (2) a newly collected sample of 132 high-quality audio recordings with automatic speech recognition transcripts from 27 classrooms. Whereas previous work utilized a "closed vocabulary" approach, consisting of 732 pre-defined word, sentence, and discourse level features, the present "open vocabulary" approach exclusively utilized word and phrase counts from the transcripts themselves. The two approaches yielded substantial, but statistically equivalent, correlations with gold-standard human codes of authenticity (Pearson r's of 0.396 vs. 0.424 and 0.602 vs. 0.613 for datasets 1 and 2, respectively). Importantly, averaging estimates from the two approaches resulted in statistically significant improvements over either approach (r's of 0.492 and 0.686 for datasets 1 and 2, respectively). We discuss implications of our findings for automated analysis of classroom discourse. [For the full proceedings, see ED593090.] |
|---|---|
| Item Description: | Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org. Sponsoring Agency: National Science Foundation (NSF). Sponsoring Agency: Institute of Education Sciences (ED). Contract Number: NSFIIS1735785. Contract Number: R305A130030. Abstractor: As Provided. Educational level discussed: Grade 7. Educational level discussed: Junior High Schools. Educational level discussed: Middle Schools. Educational level discussed: Elementary Education. Educational level discussed: Secondary Education. Educational level discussed: Grade 8. |
| Physical Description: | 1 online resource (11 pages) |
| Type of Computer File or Data Note: | Text (Speeches/Meeting Papers) Text (Reports, Research) |
| Preferred Citation of Described Materials Note: | International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (11th, Raleigh, NC, Jul 16-20, 2018). |