A meta-validation model for assessing the score-validity of student teaching evaluations

Onwuegbuzie, Anthony J.; Daniel, Larry G.; Collins, Kathleen M. T.
April 2009
Quality & Quantity;Apr2009, Vol. 43 Issue 2, p197
Academic Journal
Virtually every institution of higher education in the US uses some type of student teaching evaluation (STE) instrument as a means of assessing instructors’ instructional performance in courses. Unfortunately, many administrators and faculty misinterpret STE ratings. Therefore, the present article provides a comprehensive critique of STE instruments. In particular, we build on Messick’s (Educational Measurement, MacMillan, pp. 13–103, and Messick (Am. Psychol., 50, 741–749, 1995, 1989) conceptualization of validity to yield what we refer to as a meta-validity model that subdivides content-, criterion-, and construct-related validity into several areas of evidence. We use our meta-validity model to conduct a meta-validity analysis of STEs. Specifically, we assessed the score-validity of STEs based on findings from the extant literature. We conclude that strong evidence has been provided with respect to areas of criterion-related validity; however, for the most part, weak or inadequate evidence has been provided with regard to areas of both content-related and construct-related validity. This seriously calls into question both the score-validity and utility of STEs.


Related Articles

  • Validity and Reliability of the Attitude Toward Educational Measurement Inventory. Alkharusi, Hussain // Asia-Pacific Education Researcher (De La Salle University Manila;Nov2011, Vol. 20 Issue 3, p612 

    This study examined validity and reliability of the Attitude Toward Educational Measurement Inventory (ATEMI). Undergraduate teacher education students (N = 294) enrolled in an educational measurement course at Sultan Qaboos University in Oman completed the ATEMI. Confirmatory factor analyses...

  • Grads Assess Schools.  // Education Digest;Mar1976, Vol. 41 Issue 7, p66 

    This article reports that five serious deficiencies in high school education were pinpointed by 30-year-olds, in a quality-of-life survey recently. The survey, sponsored by the National Institute of Education, interviewed 1,000 young adults who had been previously interviewed in 1960 as a part...

  • Developments in Undergraduate Education. Boucher, C. S. // Journal of Higher Education;Dec1930, Vol. 1 Issue 9, p491 

    The article presents a discussion related to the developments in the undergraduate education in the U.S. The Senate of the University of Chicago recently approved an administrative reorganization of the work in arts, literature, and science which is significant, not because it changes...

  • Modeling the Research Process. Felzien, Lisa; Cooper, Janer // Journal of College Science Teaching;May/Jun2005, Vol. 34 Issue 6, p42 

    Presents a study which focused on the effectiveness of modifying an Introduction to Research course taught to students who were not engaged in research projects. Objectives and activities used to meet the goal of the course; Assessment of the knowledge students gained from reading "The...

  • The Evaluation of Doctoral Level "Development and Learning" and "Instructional Planning and Evaluation" Courses. Bümen, Nilay T. // Educational Sciences: Theory & Practice;Jan2006, Vol. 6 Issue 1, p44 

    The present study aimed to evaluate two doctoral level courses that are offered in Ege University. The study employed both quantitative and qualitative methods. Achievement tests and attitude scales were administered to the students in a one group pretest-posttest design. In terms of gender, 61%...

  • Formação de professores e educação inclusiva: análise das matrizes curriculares dos cursos de licenciatura. Araujo Pedroso, Cristina Cinto; Paula Perez Campos, Juliane Aparecida de; Duarte, Márcia // Educação Unisinos;jan-abr2013, Vol. 17 Issue 1, p40 

    National Curriculum Guidelines for Teacher Training Basic Education, CNE/CP no. 1/02, state that higher education institutions should provide in their curriculum teacher training to meet the diversity contemplating knowledge about the specificities of pupils with special educational needs....

  • Using Pupil Scores To Access Teachers Criticized as Unfair. Rothman, Robert // Education Week;6/3/1987, Vol. 6 Issue 36, p1 

    The article reports that the St. Louis Board of Education's policy to use the student test scores to evaluate teachers is unfair, because the standardized tests used are poorly matched with the district's curriculum, according to analysis. According to a research firm, a test that is expressly...

  • Selecting software tools for IS/IT curricula. Parker, Kevin // Education & Information Technologies;Dec2010, Vol. 15 Issue 4, p255 

    The evaluation and selection of software tools for use in an IS or IT curriculum is difficult not only because actual industry software tools are often used but also because there is no formal approach to guide the process. How does one choose between SQL Server and MySQL, or Dreamweaver and...

  • Conflicting Views.  // Connection (0895-6405);Winter2003, Vol. 17 Issue 4, p28 

    Presents the results of a survey on the attitudes of businesses, government and academic leaders concerning pressing higher education issues in the U.S. Views on ways to improve higher education; Opinions on issues from college curriculum to governance; Perceptions on the system of tenure for...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics