# The Rasch Model derived from E.L. Thorndike's (1904) Criteria

Edward Lee Thorndike (1904) criticizes a pioneering 1895 spelling test of Dr. Joseph M. Rice, because its words are of unequal difficulty (p. 8, see below). "In arranging a scale of measurement one must as far as possible, (1) keep free of individual opinion, ... (2) call equal only those things which can be interchanged without making any difference to the issue involved." (p. 14-15, italics Thorndike's). This suggests that, at the time, Thorndike considered that the measurement of ability could only be performed by ascertaining the level of success on a set of equally difficult items. Though Thorndike's later writings relax this requirement, let us derive a measurement model from his 1904 criteria.

Imagine that Dr. Rice compiles a set {i} of spelling-word items all of equal difficulty di, and Prof. Thorndike another set {j} all of equal difficulty dj. Both sets are administered to examinee n of ability bn and to examinee m of ability bm.

We observe that examinee n has Fni successes and Fin failures on item set {i}. So the empirical odds of success for examinee n on item set {i} are Fni/Fin. From this, we infer that examinees of ability bn, such as examinee n, have Pni/Pin odds of success on items of difficulty di, such as item set {i}, where

f(bn,di) = Pni/Pin ≈ Fni/Fin

and f is the relationship between bn and di yielding these odds.

Similarly, when examinee m encounters item set {i}:

f(bm,di) = Pmi/Pim ≈ Fmi/Fim

The ability difference between m and n is indicated by their relative odds of success on item set {i}:

g(bn,bm,di) = (Pni/Pin)/(Pmi/Pim)

and g is the relationship between bn, bm and di yielding these odds.

The same holds true when examinees n and m encounter item set {j}:

f(bn,dj) = Pnj/Pjn ≈ Fnj/Fjn

f(bm,dj) = Pmj/Pjm ≈ Fmj/Fjm

and their relative odds of success are

g(bn,bm,dj) = (Pnj/Pjn)/(Pmj/Pjm)

Thorndike's first criterion is that measures must be free of individual opinion, i.e., of who chooses the spelling-word test items. Accordingly, for invariance in measuring ability differences, the ability difference between bn and bm must be independent of the item set. Therefore it must be the same for items sets {i} and {j}. Consequently,

g(bn,bm) = g(bn,bm,di) = g(bn,bm,dj)

= (Pni/Pin)/(Pmi/Pim) = (Pnj/Pjn)/(Pmj/Pjm)

Rearranging,

(Pni/Pin) = (Pmi/Pim) * (Pnj/Pjn)/(Pmj/Pjm)

We can choose item set {j} to have any difficulty, in particular that of item "0" at the local origin of the scale, i.e., of difficulty dj=d0. Also the ability of examinee n must be independent of the particularly ability of examine m, so we can also choose m to be examinee "0" whose ability is at the local origin of the scale, bj=b0. The local origins of the ability and difficulty scales can be constructed to coincide, so that the probability of success of examinee "0" on item "0" becomes 0.5.

(Pni/Pin) = (P0i/Pi0) * (Pn0/P0n)/(P00/P00)

so that

(Pni/Pin) = (Pn0/P0n) / (Pi0/P0i)

Pn0/P0n is the odds of success of an examinee of ability of bn on a standard item at the local origin of the scale. Let this be the definition of bn. Similarly, (Pi0/P0i) is the odds of failure on an item of difficulty di by a standard examinee at the local origin of the scale. Let this be the definition of di. Then

f(bn,di) = (Pni/Pin) = (Pn0/P0n) / (Pi0/P0i) = bn / di

yielding the ratio form of the Rasch model:

Pni/Pin = bn / di

and

g(bn,bm) = g(bn,bm,di) = (Pni/Pin)/(Pmi/Pim)

= (bn/di)/(bm/di) = bn/bm

In a ratio metric, the odds of success of examinee n on item i is the ability of examinee n divided by the difficulty of item i. Expressing f(bn,di) in a more convenient additive metric, and reparameterizing, we obtain the familiar form of the dichotomous Rasch model:

loge(Pni/Pin) = loge(bn / di) = loge(bn)-loge(di) = Bn - Di

where Bn and Di are ability and difficulty expressed in an additive metric. Thus, E. L. Thorndike's 1904 criteria lead to the Rasch model.

And the difference in ability between m and n is Bm - Bn ≈ log(Fmi/Fim) - log(Fni/Fin) ≈ log(Fmj/Fjm) - log(Fnj/Fjn)

John Michael Linacre

Thorndike, E.L. (1904). An introduction to the theory of mental and social measurements. New York: Teacher's College.

Excerpts from Thorndike, E. (1904). Introduction to the theory of mental measurement. New York: Science Press (pp. 5-6):

The Special Problems of Mental Measurements

In the mental sciences, as in the physical, we have to measure things, differences, changes and relations. The psychologist thus measures the acuity of vision, the changes in it due to age, and the relation between acuity of vision and ability to learn to spell. The economist thus measures the wealth of a community, the changes due to certain inventions and perhaps the dependence or the wealth of communities upon their tariff laws or labor laws or poor laws. Such measurements, which involve human capacities and acts, are subject to certain special difficulties, due chiefly to the absence or imperfection of units in which to measure, the lack of constancy in the facts measured, and the extreme complexity of the measurements to be made.

lf, for instance, one attempts to measure even so simple a fact as the spelling ability of ten-year-old boys, one is hampered at the start by the fact that there exist no units in which to measure. One may, of course, arbitrarily make up a list of 10 or 50 or 100 words and measure ability by the number spelled correctly. But if one examines such a list, for instance the one used by Dr. J. M. Rice in his measurements of the spelling ability of 18,000 children, one is or should be at once struck by the inequality of the units. Is 'to spell certainly correctly' equal to 'to spell because correctly'? In point of fact, I find that of a group of about 120 children, 30 missed the former and only one the latter. All of Dr. Rice's results which are based on the equality of any one of his 50 words with any other of the 50 are necessarily inaccurate, ....

The problem for a quantitative study of the mental sciences is thus to devise means of measuring things, differences, changes and relationships for which standard units of amount are often not at hand, which are variable, and so unexpressible in any case by a single figure, and which are so complex that to represent any one of them a long statement in terms of different sorts of quantities is commonly needed. This last difficulty of mental measurements is not, however, one which demands any form of statistical procedure essentially different from that used in science in general.

The Rasch Model derived from E. L. Thorndike's 1904 Criteria. Thorndike, E.L.; Linacre, J.M. … Rasch Measurement Transactions, 2000, 14:3 p.763

1. The Rasch Model derived from E. L. Thorndike's 1904 Criteria, Thorndike, E.L.; Linacre, J.M. … 2000, 14:3 p.763
2. Rasch model derived from consistent stochastic Guttman ordering, Roskam EE, Jansen PGW. … 6:3 p.232
3. Rasch model derived from Counts of Right and Wrong Answers, Wright BD. … 6:2 p.219
4. Rasch model derived from counting right answers: raw Scores as sufficient statistics, Wright BD. … 1989, 3:2 p.62
5. Rasch model derived from Thurstone's scaling requirements, Wright B.D. … 1988, 2:1 p. 13-4.
6. Rasch model derived from Campbell concatenation: additivity, interval scaling, Wright B.D. … 1988, 2:1 p. 16.
7. Dichotomous Rasch model derived from specific objectivity, Wright BD, Linacre JM. … 1987, 1:1 p.5-6

Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse Rasch Measurement Theory Analysis in R, Wind, Hua Applying the Rasch Model in Social Sciences Using R, Lamprianou El modelo métrico de Rasch: Fundamentación, implementación e interpretación de la medida en ciencias sociales (Spanish Edition), Manuel González-Montesinos M.
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Rasch Models for Measurement, David Andrich Constructing Measures, Mark Wilson Best Test Design - free, Wright & Stone
Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias Diseño de Mejores Pruebas - free, Spanish Best Test Design A Course in Rasch Measurement Theory, Andrich, Marais Rasch Models in Health, Christensen, Kreiner, Mesba Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
Rasch Books and Publications: Winsteps and Facets
Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes Rasch Models for Solving Measurement Problems (Facets), George Engelhard, Jr. & Jue Wang Statistical Analyses for Language Testers (Facets), Rita Green Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind Rasch Measurement: Applications, Khine Winsteps Tutorials - free
Facets Tutorials - free
Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan

 Forum Rasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
May 17 - June 21, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 12 - 14, 2024, Wed.-Fri. 1st Scandinavian Applied Measurement Conference, Kristianstad University, Kristianstad, Sweden http://www.hkr.se/samc2024
June 21 - July 19, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 5 - Aug. 6, 2024, Fri.-Fri. 2024 Inaugural Conference of the Society for the Study of Measurement (Berkeley, CA), Call for Proposals
Aug. 9 - Sept. 6, 2024, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com