Rasch Analysis of Repeated Measures

Repeated measures are common in rehabilitation studies where patients are scored on assessments at both admission and discharge. There are often intermediate or follow-up data collection periods in addition. The amount of change in patient functional status is an important indicator of rehabilitation quality. In order to determine that it is indeed the patients who have changed and not the item difficulty, constant "anchor" values are needed to fix item difficulties at admission and discharge (or any other time point) within a common frame of reference. Yet creating an anchor file is problematic.

One approach is to create a file of item anchor values by "stacking" the admission and discharge data so that each item corresponds to one column, and each time-point for each person is a row the combined dataset. However this approach may violate the Rasch assumption of local independence in the observations because some characteristics of the patients span time-points . Yet creating item anchor values from either the admission data only, or the discharge data only, and then applying those values to the whole data set may not be reasonable either. Generally, patients are quite disabled at admission to rehabilitation so performance on difficult items of assessment tools are rarely observed or are scored in their lower rating-scale categories. At discharge, patients have often made considerable improvement and most will be scored in the top categories of easier items. At either admission or discharge, some items will be "off-target" compared to patient ability and, for some items (the hardest ones at admission, and the easiest ones at discharge), only one or two categories of the rating scale may be observed.

This suggests a different approach:

1) Create a random sample of patients across the time-points so that each patient is only in the data set once but all time-points are equally represented.

2) Analyze this "random" data set and estimate the item difficulties and Rasch-Andrich thresholds. Save these values in anchor files. They become the definitive set of item difficulties, defining the measurement framework of the latent variable.

3) Apply the anchor files to the estimation of the person abilities at all time points. This can be done either with each time-point in a separate dataset or with all time-points stacked in one dataset. There will be no interaction between the observations of each person at the different person because they are isolated from each other by the item anchor values.

4) With all the data stacked, and a time-point code in each patient record, do an item-by-time-point DIF analysis to verify that nothing unexpected has happened to the items.

The suggested approach was applied to a dataset of 459 older adults measured on a 13-item self-report survey at 5 time points. Time 1 is before treatment; Time 2 is after treatment. Not all adults were observed at all time-points. All 13 items fit the Rasch model. In accordance with (1), a random sample was selected across all 5 time points so that each person was only in the "random" dataset once but all 5 time points were equally represented. Then (2), this random sample was used to create the anchor files. Finally (3), the anchor files were used in the estimation of 327 adults with both Time 1 and Time 2 records. For comparison, an unanchored "stacked" analysis of all 1527 available records for all adults at all time-points was performed. In this last analysis, the estimates for Time 1 and Time 2 would be influenced by local dependency across time-points, if there is any.

The Figures show the relationship between the "stacked" and "anchored" measures of the first 10 persons with both Time 1 and Time 2 records. We can see that in this dataset the influence of local dependency is small, much less than the S.E.s of the measures which are 0.3 logits or more.

In this dataset, dependencies in the data have little effect on person measures. However, using anchor values from a random sample (selected to be without intra-person dependencies) should satisfy manuscript reviewers that a possible source of time-series dependency has been eliminated.

Trudy Mallinson,

University of Southern California


Figure 1. Time 1 - stacked and anchored


Figure 2. Time 2 - stacked and anchored

    See also:
  1. Repeated Measure Designs (Time Series) and Rasch
  2. Rack and Stack: Time 1 vs. Time 2: Repeated Measures



Rasch Analysis of Repeated Measures, Trudy Mallinson ... Rasch Measurement Transactions, 2011, 251:1, 1317




Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse Rasch Measurement Theory Analysis in R, Wind, Hua Applying the Rasch Model in Social Sciences Using R, Lamprianou El modelo métrico de Rasch: Fundamentación, implementación e interpretación de la medida en ciencias sociales (Spanish Edition), Manuel González-Montesinos M.
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Rasch Models for Measurement, David Andrich Constructing Measures, Mark Wilson Best Test Design - free, Wright & Stone
Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias Diseño de Mejores Pruebas - free, Spanish Best Test Design A Course in Rasch Measurement Theory, Andrich, Marais Rasch Models in Health, Christensen, Kreiner, Mesba Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
Rasch Books and Publications: Winsteps and Facets
Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes Rasch Models for Solving Measurement Problems (Facets), George Engelhard, Jr. & Jue Wang Statistical Analyses for Language Testers (Facets), Rita Green Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind Rasch Measurement: Applications, Khine Winsteps Tutorials - free
Facets Tutorials - free
Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

 

The URL of this page is www.rasch.org/rmt/rmt251b.htm

Website: www.rasch.org/rmt/contents.htm