Controlling for Background Beliefs When Developing Multiple-Choice Critical Thinking Tests. Technical Report No. 429 / Stephen P. Norris.

The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct a...

Full description

Saved in:
Bibliographic Details
Online Access: Full Text (via ERIC)
Main Author: Norris, Stephen P.
Corporate Authors: Illinois Univ., Urbana. Center for the Study of Reading, Bolt, Beranek and Newman, Inc., Cambridge, MA, University of Illinois at Urbana-Champaign. Center for the Study of Reading, Bolt, Beranek, and Newman
Format: eBook
Language:English
Published: [Place of publication not identified] : Distributed by ERIC Clearinghouse, 1988.
Subjects:

MARC

LEADER 00000cam a22000002u 4500
001 b6339502
003 CoU
006 m o d f
007 cr |||||||||||
008 880701s1988 xx |||| ot ||| | eng d
005 20230817230016.2
035 |a (ERIC)ed297280 
035 |a (MvI) 6J000000290147 
040 |a ericd  |b eng  |c MvI  |d MvI 
099 |a ED297280 
100 1 |a Norris, Stephen P. 
245 1 0 |a Controlling for Background Beliefs When Developing Multiple-Choice Critical Thinking Tests. Technical Report No. 429 /  |c Stephen P. Norris. 
264 1 |a [Place of publication not identified] :  |b Distributed by ERIC Clearinghouse,  |c 1988. 
300 |a 15 pages. 
336 |a text  |b txt  |2 rdacontent. 
337 |a microform  |b h  |2 rdamedia. 
338 |a microfiche  |b he  |2 rdacarrier. 
500 |a Sponsoring Agency: Social Sciences and Humanities Research Council of Canada, Ottawa (Ontario).  |5 ericd. 
520 |a The problems of validity and fairness involved in multiple-choice critical thinking tests can be lessened by using verbal reports of examinees' thinking during the process of developing such tests in order to retain only those items which rely on critical thinking skills to obtain the correct answer. Multiple-choice testing can lead to unfair treatment of students, but disqualifying these tests can result in less powerful assessments of critical thinking. Differences in background beliefs can lead to invalid and unfair assessments of critical thinking ability using these tests. A methodology to lessen these problems was developed using high school students taking trial versions of exams and thinking aloud as they took the test. The examinees' verbal reports were analyzed for critical thinking skills and assigned a numerical score. A high correlation between critical thinking scores and performance scores represents a high correspondence between thinking critically and choosing the correct answer. Items with a low correlation were revised. Although only a brief sketch of this methodology could be presented in this paper, the relevance of verbal reports of thinking to test construction has been suggested by several testing specialists. Using verbal reports may be time consuming, but the ideal of critical thinking is worth the effort. Otherwise, only the worn-out and educationally indefensible emphasis on memorization of factual information, rote recall, and pat answers is left. (Twenty-eight references are appended.) (RS) 
650 0 7 |a Critical Thinking.  |2 ericd. 
650 0 7 |a High School Students.  |2 ericd. 
650 0 7 |a High Schools.  |2 ericd. 
650 0 7 |a Multiple Choice Tests.  |2 ericd. 
650 0 7 |a Protocol Analysis.  |2 ericd. 
650 0 7 |a Test Construction.  |2 ericd. 
650 0 7 |a Test Theory.  |2 ericd. 
650 0 7 |a Test Validity.  |2 ericd. 
650 0 7 |a Testing Problems.  |2 ericd. 
710 2 |a Illinois Univ., Urbana. Center for the Study of Reading. 
710 2 |a Bolt, Beranek and Newman, Inc., Cambridge, MA. 
710 2 |a University of Illinois at Urbana-Champaign.  |b Center for the Study of Reading. 
710 2 |a Bolt, Beranek, and Newman. 
856 4 0 |u http://files.eric.ed.gov/fulltext/ED297280.pdf  |z Full Text (via ERIC) 
907 |a .b63395022  |b 11-24-21  |c 10-14-10 
998 |a web  |b 10-24-12  |c f  |d m   |e -  |f eng  |g xx   |h 0  |i 1 
956 |a ERIC 
999 f f |i f5ab6173-2d87-59ef-8d08-b390261ecf61  |s 1437c925-8830-5576-a69c-4fd7d6777512 
952 f f |p Can circulate  |a University of Colorado Boulder  |b Online  |c Online  |d Online  |e ED297280  |h Other scheme  |i web  |n 1