TITLE

Using the Rasch model to quantify the causal effect of test instructions

AUTHOR(S)
Delgado, Ana R.
PUB. DATE
August 2007
SOURCE
Behavior Research Methods;Aug2007, Vol. 39 Issue 3, p570
SOURCE TYPE
Academic Journal
DOC. TYPE
Article
ABSTRACT
This experimental study was designed to quantify, by means of the Rasch model (RM), the effects of three instruction/ scoring conditions on student measures and on the reliability of an achievement multiple-choice test in a field context. Examinees performed the test in one of three conditions which differed only in the instructions provided. Predictions regarding performance indicators were fulfilled, and the expected differences in reliability favoring omission-inducing instructions did appear. This difference in reliability was found for both Rasch and raw data and thus it can be concluded that the fact that results from previous studies failed to corroborate this prediction must have been due to the lack of important consequences of test scores for the students. The RM has served to neatly quantify the differences between instructions promoting guessing and instructions promoting omission under uncertainty, showing that the recommendation to omit is not only educationally but also psychometrically sound.
ACCESSION #
27263026

 

Related Articles

  • ANALYSIS AND EVALUATION OF LIBERAL (FREE-CHOICE) MULTIPLE-CHOICE TESTS. Warwick, Jon; Bush, Martin; Jennings, Sylvia // ITALICS: Innovations in Teaching & Learning in Information & Com;Nov2010, Vol. 9 Issue 2, p51 

    We present a new model of liberal (also known as free-choice) multiple-choice tests in which a candidate's test score is represented as a function of two other variables: their inclination to eliminate perceived distracters; and the accuracy with which they are able to do this. We propose a...

  • A confidence and safety approach to multiple-choice question scoring. Tweed, M. J.; Thompson-Fawcett, M.; Schwartz, P.; Wilkinson, T. J. // Focus on Health Professional Education;2012, Vol. 13 Issue 3, p84 

    Aims: This study explored the effect of a scoring system that incorporates a rating of the candidates' confidence in their responses and the safety of the chosen responses in practice. BackgrountL Multiple-choice question (MCQ) tests with number-correct scoring are widely used in high-stakes...

  • Notes on a Simple and Economical Testing and Scoring System. Ralya, Lynn L. // Education;Sep1944, Vol. 65 Issue 1, p43 

    This article describes a system of testing which has been experimented with and utilized for several years and which is thought to incorporate such technique of scoring. The types of test items which can be used to best advantage with the scoring technique described are those which lend...

  • ROBUSTNESS OF NUMBER RIGHT ELIMINATION TESTING (NRET) SCORING METHOD FOR MULTIPLE-CHOICE ITEMS IN COMPUTER-ADAPTIVE ASSESSMENT SYSTEM (CAAS). SIE-HOE LAU; KIAN-SAM HONG; PAUL NGEE-KIONG LAU; USOP, HASBEE // Research & Practice in Technology Enhanced Learning;Jul2014, Vol. 9 Issue 2, p283 

    This paper compares the robustness of the Number Right Elimination Testing (NRET) scoring method for multiple-choice items in Computer-Adaptive Assessment System (CAAS) with two existing scoring methods: Number Right (NR) and Elimination Testing (ET). The NRET scoring method is more reflective...

  • The Prepared Practitioner. Colburn, Alan // Science Teacher;Mar2009, Vol. 76 Issue 3, p10 

    The article discusses the use of multiple choice questions on tests in science courses. The author notes the limitations of multiple choice questions in evaluating students' problem-solving skills, social abilities and scientific inquiry skills but comments that they are easy to score. He notes...

  • The effect of MCQ vetting on students' examination performance. Wadi, Majed; Rahim, Ahmad Fuad Abdul; Yusoff, Muhamad Saiful Bahri; Baharuddin, Kamarul Aryffin // Education in Medicine Journal;2014, Vol. 6 Issue 2, pe16 

    Context: Question vetting is important to ensure validity, reliability, and other quality indicators of assessment tools, including the MCQ. Faculty members invest a substantial amount of time and effort into the MCQ vetting process. However, there is shortage of scientific evidence showing its...

  • The art of cheating. Levenson, Ellie // New Statesman;6/7/2004, Vol. 133 Issue 4691, p16 

    Offers a look at ways in which people cheat on examinations in Great Britain. Case of stolen examination papers in April 2004; Ways in which teachers help students to cheat on exams.

  • The Monopoly of Objective Tests. Freeman, Frank N. // Education Digest;Nov1946, Vol. 12 Issue 3, p43 

    The article presents a reprint of the article "The Monopoly of Objective Tests," by Frank N. Freeman, which appeared in the May 1946 issue of "Educational Forum." It discusses the extensive use of objective tests as direct means of exploring the student's mind. The three most commonly used forms...

  • Mixture Rasch model for guessing group identification. Siow, Hoo Leong; Mahdi, Rasidah; Siew, Eng Ling // AIP Conference Proceedings;Apr2013, Vol. 1522 Issue 1, p1248 

    Several alternative dichotomous Item Response Theory (IRT) models have been introduced to account for guessing effect in multiple-choice assessment. The guessing effect in these models has been considered to be itemrelated. In the most classic case, pseudo-guessing in the three-parameter...

Share

Read the Article

Courtesy of THE LIBRARY OF VIRGINIA

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics