Many physical laws are expressed as universal conditionals among variable triplets. Newton's second law, for example, formalizes the relationship between mass and acceleration when holding force constant (i.e., conditioning on) as F = MA. Similarly, the combined gas law specifies the relationship between volume and temperature conditioning on pressure. After transformation (e.g., log_{e} pressure + log_{e} volume - log_{e} temperature = constant, given a frame of reference specified by the number of molecules), each of these laws can be abstracted to a common form (a + b - c = constant). Note that these laws permit causal claims expressible as counterfactual conditionals. If we have 20 Liters of a gas at 2000°K under 20 atmospheres of pressure and we cool the gas to 1000°K, we will observe a decrease in the pressure to 10 atmospheres.
The value of such laws may lie more in the explicit causal organization of key constructs than in accuracy of prediction in the real world. Cartwright (1983) made a useful distinction between "the tidy and simple mathematical equations of abstract theory, and the intricate and messy descriptions, in either words or formulae, which express our knowledge of what happens in real systems made of real materials" (p. 128). This distinction led Cartwright to the view that "fundamental equations do not govern objects in reality; they govern only objects in models [i.e., idealizations]" (p. 129).
The human sciences, for the most part, lack laws such as those stated above and consequently lack causal stories that are universal in application: "Lacking a 'complete (causal) theory' of what influences what, and how much, we simply cannot compute expected numerical changes in stochastic dependencies when moving from one population or setting to another" (Meehl, 1978, p. 814, emphasis in original). In this note we build on the abstracted formalism derived above and imagine the form of a Rasch Reading Law.
Table 1 Comprehension Rates for Readers of Different Ability with Texts of the Same Readability or How Reader Ability and Comprehension Rate Relate Under Constant Text Readability | ||
ReaderAbility | Sports Illustrated Readability | Comprehension Rate |
500L 750L 1000L 1250L 1500L | 1000L 1000L 1000L 1000L 1000L | 25% 50% 75% 90% 96% |
Contemporary reading theory recognizes three related constructs: reader ability (a stable attribute of persons), text readability (a stable attribute of text), and comprehension (the rate at which a particular reader makes meaning from a particular text). As a result of 25 years of ongoing research, we know that comprehension is a function of the difference between reader ability and text readability (Stenner & Burdick, 1997). Table 1 illustrates the relationship between reader ability and comprehension rate with text readability held constant. With increasing reader ability, the model forecasts increasing comprehension rate conditioning on text readability. This description of the relationship between reader, text, and comprehension echoes the description of the combined gas law (Table 2).
Table 2 How Temperature and Pressure Relate Under Constant Volume | ||
Temperature Volume Pressure | ||
2000°K 1000°K 500°K 250°K 125°K | 20 Liters 20 Liters 20 Liters 20 Liters 20 Liters | 20.0 atm 10.0 atm 5.0 atm 2.5 atm 1.25 atm |
In fact, logit transformed comprehension rate + text measure - reader measure = the constant 1.1 (given a frame of reference that specifies 75% comprehension whenever text measure = reader measure). Therefore, a + b - c = constant holds as the common abstracted form of both the combined gas law and the Rasch Reading Law as well as many other physical laws. Below are several causal corollaries of the Rasch Reading Law.
(1) For any reader (and thus for all readers), an increase in text measure causes a decrease in comprehension.
(2) For any reader (and thus for all readers), a decrease in text measure causes an increase in comprehension.
(3) For any text (and thus for all texts), an increase in reader ability causes an increase in comprehension.
(4) For any text (and thus for all texts), a decrease in reader ability causes a decrease in comprehension.
Corollaries such as those above are consequences of the highly abstracted a + b - c = constant, holding in a domain of enquiry. Tables 1 and 2 concretize this abstraction for the gas law and reading law. The Rasch model, in concert with a substantive theory, is a powerful tool for discovering and testing the adequacy of such formulations. Note, however, that the fact that data fit a Rasch model says nothing about causality. Rasch models are associational rather than causal. Substantive theory provides the causal story for the variation detected by a measurement procedure. Specification equations formalize these causal stories and allow precise predictions.
These causal explanations have truth built into them. When I infer from an effect to a cause, I am asking what made the effect occur, what brought it about. No explanation of that sort explains at all unless it does present a cause, and in accepting such an explanation, I am accepting not only that it explains in the sense of organizing and making plain, but also that it presents me with a cause. (Cartwright, 1983, p. 91)
If one of our children cannot summarize what he just read in his fifth grade science text, we explain this by pointing out that he is a 580L
reader and the text book is at 830L
. The equation that models comprehension rate as a function of the difference between reader measure and text measure produces an expected comprehension rate below 50%. We hypothesize that the child's failure to produce a good summary has a cause: low comprehension. Suppose that we go to the Web and find a 600L
article on the same science topic, and the child reads the article and produces a coherent summary of the text. We conclude that, indeed, low comprehension was the cause of poor summarization. Manipulating the reader-text match caused an increase in comprehension, which in turn caused a change in summary performance. Clearly I am inferring from effect to probable cause. Note that this explanation is unintelligible "without the direct implication that there are [readers, texts and comprehension rates]" (Cartwright, 1983, p. 92).
We wonder how many other variable triplets in the human sciences can be abstracted to the form a + b - c = constant. The implications of this kind of law-making for construct validity should be evident (see Borsboom, 2005).
Donald S. Burdick
Mark H. Stone
A. Jackson Stenner
References
Borsboom, D. (2005). Measuring the mind. Cambridge: Cambridge University Press.
Cartwright, N. (1983). How the laws of physics lie. New York: Oxford Press.
Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
Stenner, A. J., & Burdick, D. S. (1997). The objective measurement of reading comprehension: In response to technical questions raised by the California Department of Education technical study group. Unpublished manuscript.
The Combined Gas Law and a Rasch Reading Law, Burdick, D.S., Stone, M.H., Stenner, A.J. … Rasch Measurement Transactions, 2006, 20:2 p. 1059-60
Rasch Publications | ||||
---|---|---|---|---|
Rasch Measurement Transactions (free, online) | Rasch Measurement research papers (free, online) | Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch | Applying the Rasch Model 3rd. Ed., Bond & Fox | Best Test Design, Wright & Stone |
Rating Scale Analysis, Wright & Masters | Introduction to Rasch Measurement, E. Smith & R. Smith | Introduction to Many-Facet Rasch Measurement, Thomas Eckes | Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. | Statistical Analyses for Language Testers, Rita Green |
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar | Journal of Applied Measurement | Rasch models for measurement, David Andrich | Constructing Measures, Mark Wilson | Rasch Analysis in the Human Sciences, Boone, Stave, Yale |
in Spanish: | Análisis de Rasch para todos, Agustín Tristán | Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez |
Forum | Rasch Measurement Forum to discuss any Rasch-related topic |
Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement
Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.
Coming Rasch-related Events | |
---|---|
March 21, 2019, Thur. | 13th annual meeting of the UK Rasch user group, Cambridge, UK, http://www.cambridgeassessment.org.uk/events/uk-rasch-user-group-2019 |
April 4 - 8, 2019, Thur.-Mon. | NCME annual meeting, Toronto, Canada,https://ncme.connectedcommunity.org/meetings/annual |
April 5 - 9, 2019, Fri.-Tue. | AERA annual meeting, Toronto, Canada,www.aera.net/Events-Meetings/Annual-Meeting |
April 12, 2019, Fri. | On-line course: Understanding Rasch Measurement Theory - Master's Level (G. Masters), https://www.acer.org/au/professional-learning/postgraduate/rasch |
May 24 - June 21, 2019, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
May 22 - 30, 2019, Wed.-Thu. | Measuring and scale construction (with the Rasch Model), University of Manchester, England, https://www.cmist.manchester.ac.uk/study/short/intermediate/measurement-with-the-rasch-model/ |
June 4 - 7, 2019, Tue.-Fri. | In-Person Italian Rasch Analysis Workshop based on RUMM (entirely in Italian). For enquiries and registration email to workshop.rasch@gmail.com. |
June 17-19, 2019, Mon.-Wed. | In-person workshop, Melbourne, Australia: Applying the Rasch Model in the Human Sciences: Introduction to Rasch measurement (Trevor Bond, Winsteps), Announcement |
June 20-21, 2019, Thurs.-Fri. | In-person workshop, Melbourne, Australia: Applying the Rasch Model in the Human Sciences: Advanced Rasch measurement with Facets (Trevor Bond, Facets), Announcement |
June 28 - July 26, 2019, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
July 2-5, 2019, Tue.-Fri. | 2019 International Measurement Confederation (IMEKO) Joint Symposium, St. Petersburg, Russia,https://imeko19-spb.org |
July 11-12 & 15-19, 2019, Thu.-Fri. | A Course in Rasch Measurement Theory (D.Andrich), University of Western Australia, Perth, Australia, flyer - http://www.education.uwa.edu.au/ppl/courses |
Aug 5 - 10, 2019, Mon.-Sat. | 6th International Summer School "Applied Psychometrics in Psychology and Education", Institute of Education at HSE University Moscow, Russia.https://ioe.hse.ru/en/announcements/248134963.html |
Aug. 9 - Sept. 6, 2019, Fri.-Fri. | On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com |
August 25-30, 2019, Sun.-Fri. | Pacific Rim Objective Measurement Society (PROMS) 2019, Surabaya, Indonesia https://proms.promsociety.org/2019/ |
Oct. 11 - Nov. 8, 2019, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
Nov. 3 - Nov. 4, 2019, Sun.-Mon. | International Outcome Measurement Conference, Chicago, IL,http://jampress.org/iomc2019.htm |
Jan. 24 - Feb. 21, 2020, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
May 22 - June 19, 2020, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
June 26 - July 24, 2020, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
Aug. 7 - Sept. 4, 2020, Fri.-Fri. | On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com |
Oct. 9 - Nov. 6, 2020, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
June 25 - July 23, 2021, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
The URL of this page is www.rasch.org/rmt/rmt202c.htm
Website: www.rasch.org/rmt/contents.htm