Has Rasch Scaling Made Better Tests?

"Has it helped us understand better what kids know?" I believe the answer to these questions is not "no" but a resounding "yes." Unfortunately, many test developers using IRT do not take advantage of the powerful interpretation features that become accessible when person abilities and item difficulties have been calibrated on a common Rasch scale. This is probably one reason that some observers have not appreciated some benefits of Rasch measurement.

Allow me to take a recent chapter I have written, and elaborate on its contents for those who may be interested:

Woodcock, R. W. (1999). What can Rasch-based scores convey about a person's test performance? In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement: What every psychologist and educator should know. Hillsdale, NJ: Lawrence Erlbaum Assoc.

The title of the chapter explains its purpose and why it is relevant to this topic. The chapter begins by describing four levels of information that are potentially available from any test and how the use of Rasch measurement helps exploit this available information. The chapter describes several procedures that facilitate interpretation of test performance including:

1) Rasch-scaled item maps.

2) The "Relative Proficiency Index" which states a prediction of the subject's level of success on tasks performed with 90% success by average age- or grade-mates. This index is similar to the Snellen Index used in vision examinations. An example is "67/90" which states that the subject is predicted to perform with 67% success those tasks that others perform with 90% success.

3) The "Developmental Zone" used in cognitive tests and the "Achievement Zone" used in achievement tests. These zones identify a range along an age or grade scale from the level at which the subject will find tasks "easy" (RPI = 96/90) to the level at which the subject will find tasks "difficult" (RPI = 75/90).

4) After some other examples, the chapter concludes with an example test report based on an assessment of Spanish and English language proficiency in a bilingual student. The scores and text highlighted by bold type in a figure in the chapter identify the information derived from Rasch-based scales that could not have been provided by traditional CTT procedures. Half of the information in the report, and probably the most important information for teachers and others concerned with the question of what this child knows and can do, appears in bold.

The Embretson & Hershberger book has a lot of good information and I recommend it to you.

Richard W. Woodcock

Has Rasch scaling made better tests? Woodcock R.W. … Rasch Measurement Transactions, 2000, 14:1 p.738

Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free	An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse	Rasch Measurement Theory Analysis in R, Wind, Hua	Applying the Rasch Model in Social Sciences Using R, Lamprianou	El modelo métrico de Rasch: Fundamentación, implementación e interpretación de la medida en ciencias sociales (Spanish Edition), Manuel González-Montesinos M.
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar	Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch	Rasch Models for Measurement, David Andrich	Constructing Measures, Mark Wilson	Best Test Design - free, Wright & Stone Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias	Diseño de Mejores Pruebas - free, Spanish Best Test Design	A Course in Rasch Measurement Theory, Andrich, Marais	Rasch Models in Health, Christensen, Kreiner, Mesba	Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
Rasch Books and Publications: Winsteps and Facets
Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene	Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver	Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone	Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale	Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes	Rasch Models for Solving Measurement Problems (Facets), George Engelhard, Jr. & Jue Wang	Statistical Analyses for Language Testers (Facets), Rita Green	Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind	Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind	Rasch Measurement: Applications, Khine	Winsteps Tutorials - free Facets Tutorials - free	Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre	Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan

Forum

Rasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

The URL of this page is www.rasch.org/rmt/rmt141j.htm

Website: www.rasch.org/rmt/contents.htm