Georg Rasch and Item Fit

Georg Rasch didn't expect all kinds of items to fit a Rasch model in all kinds of frames of reference, so he was always extremely careful about testing the items to see whether there was something wrong with the way they had been constructed or with the theory underlying the items. He was in fact an absolute fundamentalist when it came to model checking not only for the Rasch model, but for all kinds of statistical models.

Rasch 1960 Figure 14

Figure 14. Subtest F of BPP. lri plotted against lr. for each group of items. From Rasch (1960) "Probabilistic Models for Some Intelligence and Attainment Tests".

Graphical techniques were very important to Rasch. He had a principle saying (in Danish) that you should "tegne" before you "regne" (meaning "plots" before "calculations") and he had a lot of students (including Peter Allerup) doing the plots for him. He would never draw the ICC curves as we do today. Rasch plotted the logistic values of the probabilities against estimates of person parameters (or similar but more complicated functions of the item parameters against the total scores) because it is much easier to assess systematic departures from straight lines than departures from logistic curves (See Figure from Rasch, 1960).

In addition to these plots he would, of course, also use numerical tests and he would always insist that these calculations should be made relative to the conditional distribution of item responses given the total score to make sure that he had separated his inference on items from the persons.

You can find some of this in his 1960 book, but far from all. We know that he at some point worked on a sequel to the book that he never finished. When we celebrated his centenary in 2001 we published a collection of his unpublished papers and notes. (You can find this collection at www.rasch.org/rasch.htm). Among these papers we included a chapter on "Estimation of Parameters and Control of the Model for Two response Categories" where he describes five different methods including a test for the hypothesis that the item discrimination is the same for all items and including much of the theory of conditional inference that Erling B. Andersen worked on and published during the 70'es. It is quite interesting reading so take a look at it. You can find it at www.rasch.org/memo196y.pdf.

Rasch's view on item fit analyses were that evidence against the item means that it should be either revised (if at all possible) or removed. That goes both for items where item discrimination is too weak and items where discrimination is too strong (Infits and/or Outfits that are smaller than 1). That is also my point of view, but the interpretation of the lack of fit of the item is very different for items that do not discriminate and items with too strong discrimination. In the first case I would suspect inept item writing or multidimensionality. In the second case I would always look for evidence of local response dependence (LD) because I know that positive local dependence has the effect that the item discrimination of the items look stronger than expected by the Rasch model. It is my experience this is the case in many of the analyses where I find evidence of too strong discrimination. You can find one such example in
Kreiner S (2011) A Note on Item-Restscore Association in Rasch models. Applied Psychological Measurement, 35, 557-561
where the local dependence is a consequence of inept item writing in the sense that items are phrased in such a way that local dependence is unavoidable.

Svend Kreiner
University of Copenhagen
Denmark



Georg Rasch and Item Fit, S. Kreiner, Rasch Measurement Transactions, 2012, 26:1, 1354




Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse Rasch Measurement Theory Analysis in R, Wind, Hua Applying the Rasch Model in Social Sciences Using R, Lamprianou El modelo métrico de Rasch: Fundamentación, implementación e interpretación de la medida en ciencias sociales (Spanish Edition), Manuel González-Montesinos M.
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Rasch Models for Measurement, David Andrich Constructing Measures, Mark Wilson Best Test Design - free, Wright & Stone
Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias Diseño de Mejores Pruebas - free, Spanish Best Test Design A Course in Rasch Measurement Theory, Andrich, Marais Rasch Models in Health, Christensen, Kreiner, Mesba Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
Rasch Books and Publications: Winsteps and Facets
Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes Rasch Models for Solving Measurement Problems (Facets), George Engelhard, Jr. & Jue Wang Statistical Analyses for Language Testers (Facets), Rita Green Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind Rasch Measurement: Applications, Khine Winsteps Tutorials - free
Facets Tutorials - free
Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

 

The URL of this page is www.rasch.org/rmt/rmt261b.htm

Website: www.rasch.org/rmt/contents.htm