Statistics text books explain the "standard error of the mean", but are generally silent about the "standard error of a measure". How do they relate?
The standard error is the modeled standard deviation of the observed estimate around the unobservable "true" value. In practice, the observed estimate substitutes for the "true" value and we think of the standard error being centered on observed estimate.
Both the observed estimate and its standard error are computed from the data. Each data point gives us an estimate of the mean or the measure, and the accumulation of the estimates provides the final best estimate along with its precision, its standard error. Thus:
Accumulation of estimates (one per observation) => mean parameter estimate ± S.E. of estimate
For a typical "text book" normal distribution, the parameter of interest is the mean, which is the sum of all perfectly-precise observations divided by their count. And its standard error is the sample standard deviation of the observations divided by the square-root of the count.
A Rasch measure has parallels to a sample mean. Conceptually, each qualitative observation ("Right", "Wrong", etc.) provides an estimate of the relevant measure, so
Accumulation of estimates (one per observation) => measure estimate ± S.E. of estimate
Implementing this directly is awkward, It is more convenient to rearrange the computation:
Estimate of (accumulation of observations) => measure estimate ± S.E. of estimate
Here, the standard error is computed by summing the statistical model variance across the observations, and then the standard error is the square-root of the inverse of the summed variance. For example, consider 1000 reasonably targeted observations of a dichotomous item. Experience shows that a reasonable p-value for such an item is .8. So the average binomial variance = p-value*(1 - p-value) = .8*.2 = .16. So the variance of 1000 observations = 1000 * .16 = 160. Standard error of the logit estimate = 1 / square root (variance) = 1 / square-root (160) = .08 logits. The ease of this type of computation is one reason the Rasch model is formulated in logits, rather than in log_{10}, probits, etc.
Local Origins and Standard Errors
The standard error of the mean is usually computed in an absolute frame of reference in which the zero point is defined external to the data. Rasch measures are defined relative to a local zero point. How does this impact standard error computations?
In the same way as the zero point on a temperature scale is an arbitrary point, chosen according to some definition, e.g., "the freezing point of water", the zero point (local origin) of a Rasch measurement scale is an arbitrary point on the latent variable, defined in some manner. Typical choices are "the average difficulty measure of all items", "the difficulty of a specific item" or "the average ability measure of all respondents".
In general, the Rasch local origin is considered to be the absolute location on the latent variable with which the empirically-derived location happens to coincide. Thus the measures and standard errors are considered to be in an absolute frame of reference.
Standard error of an Average Imagine we measure the lengths of three pieces of wood: 1 m with precision 2 mm, and 3 m. with precision 3 mm, and 5 m with precision 3 m. If we sum the lengths (putting the pieces of wood end-to-end) then: total = 1+3+5 = 9 m with precision = sqrt( 2*2 + 3*3 + 3*3) = sqrt (22) mm Now we want the "average length" = 9/3 = 3 m with precision = sqrt(22/3) mm. So if we put the three "average lengths" end-to-end we construct the total length and its precision. So, for measures, M_{i} with precision SE_{i} where i=1,L: |
However, when comparing measures across parallel analyses, shifts in the locations of local origins might be crucial. Accordingly the standard error of the empirical zero could be included. This suggests that the most stable possible choice of local origin be made to minimize the need for this computation. In general, if the mean of the item difficulties is chosen, and the same set of items is administered a second time, then the standard error of the mean-item "origin" is the average standard error (root-mean-square-error, RMSE) of the items. Typically, this would be much smaller than the standard error of a person measure.
So the joint standard error of the difference between two measures across test forms comprising the same items would approximate:
SE(measure_{1} - measure_{2}) = square-root( SE(measure_{1})^{2} + SE(origin_{1})^{2} + SE(measure_{2})^{2} + SE(origin_{2})^{2} )
Anchor Values and Standard Errors
An anchored (fixed) measure is treated as though it is an estimate of the "true" value of the parameter, so it is reported along with the standard error around the "true" value. If the corresponding local empirical value is also computed, this can be compared with the anchor value along with its standard error in order to test the hypothesis that the data were generated by the true (anchor) value.
John Michael Linacre
Standard Errors: Means, Measures, Origins and Anchor Values. Linacre J.M. … Rasch Measurement Transactions, 2005, 19:3 p. 1030
Rasch Publications | ||||
---|---|---|---|---|
Rasch Measurement Transactions (free, online) | Rasch Measurement research papers (free, online) | Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch | Applying the Rasch Model 3rd. Ed., Bond & Fox | Best Test Design, Wright & Stone |
Rating Scale Analysis, Wright & Masters | Introduction to Rasch Measurement, E. Smith & R. Smith | Introduction to Many-Facet Rasch Measurement, Thomas Eckes | Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. | Statistical Analyses for Language Testers, Rita Green |
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar | Journal of Applied Measurement | Rasch models for measurement, David Andrich | Constructing Measures, Mark Wilson | Rasch Analysis in the Human Sciences, Boone, Stave, Yale |
in Spanish: | Análisis de Rasch para todos, Agustín Tristán | Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez |
Forum | Rasch Measurement Forum to discuss any Rasch-related topic |
Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement
Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.
Coming Rasch-related Events | |
---|---|
June 29 - July 27, 2018, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
July 25 - July 27, 2018, Wed.-Fri. | Pacific-Rim Objective Measurement Symposium (PROMS), (Preconference workshops July 23-24, 2018) Fudan University, Shanghai, China "Applying Rasch Measurement in Language Assessment and across the Human Sciences", www.promsociety.org |
July 29 - August 4, 2018 | Vth International Summer School `Applied Psychometrics in Psychology and Education`, Institute of Education at the Higher School of Economics, St. Petersburg, Russia, https://ioe.hse.ru/en/announcements/215681182.html |
July 30 - Nov., 2018 | Online Introduction to Classical and Rasch Measurement Theories (D.Andrich), University of Western Australia, Perth, Australia, http://www.education.uwa.edu.au/ppl/courses |
Aug. 10 - Sept. 7, 2018, Fri.-Fri. | On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com |
August 25 - 28, 2018, Sat.-Tue. | Análisis de Rasch introductorio (en español). (Agustín Tristán), Instituto de Evaluación e Ingeniería Avanzada. San Luis Potosí, México. www.ieia.com.mx |
Sept. 3 - 6, 2018, Mon.-Thurs. | IMEKO World Congress, Belfast, Northern Ireland, www.imeko2018.org |
Oct. 12 - Nov. 9, 2018, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
The URL of this page is www.rasch.org/rmt/rmt193e.htm
Website: www.rasch.org/rmt/contents.htm