Thresholds, Steps and Rating Scale Conceptualization

How many steps does a rock take to get to its weight? Our measurement principles should be the same for properties of rocks as it is for the properties of people. What we say has to be consistent with physical measurement. We do not model how a rock got to its weight, even though we could model our process of locating the weight. If the thresholds on our ruler come out back to front, then our process of locating the person, or the rock has gone wrong.

The word "step" has no place in measurement. You can take steps over thresholds, but you can have steps without thresholds, and thresholds without steps, and measurement is not about modelling people taking steps, but modelling the responses to check where they are. The word "step" has a connotation of a local distance in the sense that the next step starts where the previous one finished and on movement. It is never used when we are trying to explain physical measurement.

The point at which the probability is 50% of a response being in one or other category, given that it is in one of them, is a threshold. No one goes anywhere in measurement - the person location is fixed. The Rasch model is a measurement model that models probabilistically where we reckon the person is, between thresholds, as in a ruler. It does not model how a person got there.

The threshold estimates are independent of the person distribution - so we can tell if there is something wrong with our instrument independently of the distribution. All those other statistics to check if the categories are "going up" are not distribution free and they do not answer the question unequivocally and they add to the confusion.

What I said over 20 years ago was simple and correct:

(i) The rating scale transition points are thresholds - they are points where there is 50% chance of being in either category, given that you are in one of them. Everyone understands that as a threshold;

(ii) If in the data, the thresholds are reversed as evidenced by the estimates, there is something wrong in the data. Nothing else. And the evidence on the thresholds is distribution free - very much consistent with Rasch philosophy.

When I say that there is "something wrong in the data", I, of course, mean in the sense of measurement. It is the same kind of wrong as when we have different item discriminations in the dichotomous case. In any particular set of data, it might be perfectly explainable why it is that some item really discriminates too much or too little, and that is a property of the data that we must acknowledge. Likewise when the thresholds in a multicategory item are reversed, they may be reversed for some good reason, and we should acknowledge it. However, the data demonstrate that the ordering is not working as intended.

If the discriminations at these Rasch thresholds are equal, then we have the integer scoring function - just as an integer score arises when the items are independent. Everything is the same as in the simple dichotomous case, except that the dichotomies are not independent. Being dependent does not turn them from dichotomies to steps. The dichotomous case with one dichotomy specializes from the general case. In the special case we have a threshold, not a step. No one goes from wrong to right, they are either wrong or right, and that is a big difference.

This is central - the category probability curves are about the implied distribution of responses of a single person to the item on replications. It is important to think of this as sample- and item-distribution free, that it is about the implied distribution of a single person with a single fixed location responding to a single item on repeated occasions with nothing but random error causing the variation - that is all there is in the model - together with the item parameters, which are thresholds. Those category characteristic curves pertain to only one person responding to the item, not the distribution of persons. Most important.

The Rasch model is not a model of how long any one spends in a category. If that is an issue in the data, then this is not the right model. So we should not try to force the model to do things it cannot do. This is model of where people are. The idea of time, of motion, is not relevant to this model, and it leads to misunderstanding. A rating scale is just like dichotomous items, except that there is a constraint on the dichotomies within the items - the constraint is that response must follow a Guttman pattern.

My suggestions are simple, and consistent: the transition points should be called "thresholds", and in the context of Thurstone or other thresholds, they should be called Rasch thresholds.

David Andrich, Murdoch University
Andrich@murdoch.edu.au

Andrich D. 1978. A rating formulation for ordered response categories. Psychometrika, 43 561-573

Andrich D. 1979. A model for contingency tables having an ordered response classification. Biometrics, 35, 403-415.

Thresholds, Steps and Rating Scale Conceptualization.Andrich D.A. … Rasch Measurement Transactions, 1998, 12:3 p. 648-9.


Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Oct. 25-27, 2017, Wed.-Fri. In-person workshop: Applying the Rasch Model hands-on introductory workshop, Melbourne, Australia (T. Bond, B&FSteps), Announcement
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
April 13-17, 2018, Fri.-Tues. AERA, New York, NY, www.aera.net
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt1239.htm

Website: www.rasch.org/rmt/contents.htm