Controlling for Background Beliefs When Developing Multiple-Choice Critical Thinking Tests. Technical Report No. 429 / Stephen P. Norris.
The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct a...
Saved in:
Online Access: |
Full Text (via ERIC) |
---|---|
Main Author: | |
Corporate Authors: | , , , |
Format: | eBook |
Language: | English |
Published: |
[Place of publication not identified] :
Distributed by ERIC Clearinghouse,
1988.
|
Subjects: |
MARC
LEADER | 00000cam a22000002u 4500 | ||
---|---|---|---|
001 | b6339502 | ||
003 | CoU | ||
006 | m o d f | ||
007 | cr ||||||||||| | ||
008 | 880701s1988 xx |||| ot ||| | eng d | ||
005 | 20230817230016.2 | ||
035 | |a (ERIC)ed297280 | ||
035 | |a (MvI) 6J000000290147 | ||
040 | |a ericd |b eng |c MvI |d MvI | ||
099 | |a ED297280 | ||
100 | 1 | |a Norris, Stephen P. | |
245 | 1 | 0 | |a Controlling for Background Beliefs When Developing Multiple-Choice Critical Thinking Tests. Technical Report No. 429 / |c Stephen P. Norris. |
264 | 1 | |a [Place of publication not identified] : |b Distributed by ERIC Clearinghouse, |c 1988. | |
300 | |a 15 pages. | ||
336 | |a text |b txt |2 rdacontent. | ||
337 | |a microform |b h |2 rdamedia. | ||
338 | |a microfiche |b he |2 rdacarrier. | ||
500 | |a Sponsoring Agency: Social Sciences and Humanities Research Council of Canada, Ottawa (Ontario). |5 ericd. | ||
520 | |a The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct answer. Multiple-choice testing can lead to unfair treatment of students, but disqualifying these tests can result in less powerful assessments of critical thinking. Differences in background beliefs can lead to invalid and unfair assessments of critical thinking ability using these tests. A methodology to lessen these problems was developed using high school students taking trial versions of exams and thinking aloud as they took the test. The examinees' verbal reports were analyzed for critical thinking skills and assigned a numerical score. A high correlation between critical thinking scores and performance scores represents a high correspondence between thinking critically and choosing the correct answer. Items with a low correlation were revised. Although only a brief sketch of this methodology could be presented in this paper, the relevance of verbal reports of thinking to test construction has been suggested by several testing specialists. Using verbal reports may be time consuming, but the ideal of critical thinking is worth the effort. Otherwise, only the worn-out and educationally indefensible emphasis on memorization of factual information, rote recall, and pat answers is left. (Twenty-eight references are appended.) (RS) | ||
650 | 0 | 7 | |a Critical Thinking. |2 ericd. |
650 | 0 | 7 | |a High School Students. |2 ericd. |
650 | 0 | 7 | |a High Schools. |2 ericd. |
650 | 0 | 7 | |a Multiple Choice Tests. |2 ericd. |
650 | 0 | 7 | |a Protocol Analysis. |2 ericd. |
650 | 0 | 7 | |a Test Construction. |2 ericd. |
650 | 0 | 7 | |a Test Theory. |2 ericd. |
650 | 0 | 7 | |a Test Validity. |2 ericd. |
650 | 0 | 7 | |a Testing Problems. |2 ericd. |
710 | 2 | |a Illinois Univ., Urbana. Center for the Study of Reading. | |
710 | 2 | |a Bolt, Beranek and Newman, Inc., Cambridge, MA. | |
710 | 2 | |a University of Illinois at Urbana-Champaign. |b Center for the Study of Reading. | |
710 | 2 | |a Bolt, Beranek, and Newman. | |
856 | 4 | 0 | |u http://files.eric.ed.gov/fulltext/ED297280.pdf |z Full Text (via ERIC) |
907 | |a .b63395022 |b 11-24-21 |c 10-14-10 | ||
998 | |a web |b 10-24-12 |c f |d m |e - |f eng |g xx |h 0 |i 1 | ||
956 | |a ERIC | ||
999 | f | f | |i f5ab6173-2d87-59ef-8d08-b390261ecf61 |s 1437c925-8830-5576-a69c-4fd7d6777512 |
952 | f | f | |p Can circulate |a University of Colorado Boulder |b Online |c Online |d Online |e ED297280 |h Other scheme |i web |n 1 |