There are four obstacles to inference which science must overcome.
have => want
now => later
statistic => parameter
De Moivre 1733
de Finetti 1931
1. Uncertainty is the motivation for inference. We have only the past with which to foresee the future. The past may seem certain. But, on reflection, it is realized to have been not only unique and unrepeatable - awash in special circumstances and inexplicable outcomes - but also a mere interpretation. In order to generalize the problematic past, we invent probability distributions that describe how idiosyncratic data can result from regular processes. It is probability that enables us to make the past useful for predicting the future.
2. Distortion occurs during the transition from observation to conceptualization. Data have no meaning of their own, they must always be interpreted. This interpretation is expedited when we transform our data in ways that facilitate thinking. Our ability to figure things out is rooted in our ability to visualize. Our ability to visualize devolved from the survival value of bodily navigation. Thus, the best solution to distortion is to represent observations in a linear, i.e., additive, form that makes our observations look like the space in front of us. To "see" what our data "mean", we "picture" them.
3. Confusion is caused by the inevitability of inter-action and interdependency. Raw data are too complicated to understand. Each data point indicates many things, intended and unintended. As we look for tomorrow's probabilities in yesterday's lessons, confounding confuses us. Our solution is to force the endless complexity we experience into only a few invented "dimensions", few enough that we can think clearly with them. The authority of these fictions is their logic and utility. Their "truth" is intangible. What matters is whether they work - a consequence discoverable in future experience.
The logic necessary to control confounding is enforced singularity. Define and measure one dimension at a time. The mathematics necessary is parameter separability. Only models which introduce hypothesized "causes" as separately estimable parameters survive confounding. The models which do this are the founding laws of quantitative research. They define measurement. They determine what is measurable. They decide which data are useful.
4. Ambiguity, a different form of confusion, is also present, because we never know precisely what to count or at what level of detail. To measure traffic, do we count cars or passengers? Do we rate performance holistically or itemize? Robust inference requires that incidental changes in data collection cause no change in inference. Ambiguity is controlled by measurement models that possess divisibility and thus are stable with respect to arbitrary composition. Divisibility, the solution to ambiguity, is algebraically equivalent to separability, the solution to confusion.
The Table summarizes the obstacles to inference, their current solutions and the originators of these solutions.
Benjamin D. Wright 1994 RMT 8:1 p. 346
Foundations of inference. Wright BD. Rasch Measurement Transactions, 1994, 8:1 p.346
|Rasch Measurement Transactions (free, online)||Rasch Measurement research papers (free, online)||Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch||Applying the Rasch Model 3rd. Ed., Bond & Fox||Best Test Design, Wright & Stone|
|Rating Scale Analysis, Wright & Masters||Introduction to Rasch Measurement, E. Smith & R. Smith||Introduction to Many-Facet Rasch Measurement, Thomas Eckes||Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr.||Statistical Analyses for Language Testers, Rita Green|
|Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar||Journal of Applied Measurement||Rasch models for measurement, David Andrich||Constructing Measures, Mark Wilson||Rasch Analysis in the Human Sciences, Boone, Stave, Yale|
|in Spanish:||Análisis de Rasch para todos, Agustín Tristán||Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez|
|Forum||Rasch Measurement Forum to discuss any Rasch-related topic|
Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement
Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.
|Coming Rasch-related Events|
|June 23 - July 21, 2023, Fri.-Fri.||On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com|
|Aug. 11 - Sept. 8, 2023, Fri.-Fri.||On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com|
The URL of this page is www.rasch.org/rmt/rmt81n.htm