Local Dependency, Correlations and Principal Components

   COG.       PRINCIPAL COMPONENTS (LOGIT RESIDUAL) FACTOR PLOT
F     +-------------------------------------------------------------------+
A  .7 +                   Expression                                      |
C  .6 +            Com  Mem ProbSolve                                     |
T  .5 +           Social     |                                            |
O  .4 +                      |                                            |
R  .3 +                      |                                            |
   .2 +                      |                                            |
2  .1 +             BowBladder                                            |
   .0 +-------------------------------------------------------------------+
L -.1 +      Eating          |                                            |
O -.2 +            Groom     |                                            |
A -.3 +                      |   Walk                                     |
D -.4 +                      |  Toileting    Tub         Stairs           |
I -.5 +                  UppBedBexLower                                   |
N -.6 +                      | ToiletTransfer                             |
G     +----------------------+--------------------------------------------+
 MOTOR-1                     0                     1                     2
       EASY                  ITEM CALIBRATION                         HARD

Successful implementation of Rasch measurement requires items that approximate local independence. Statistical independence in data occurs when the value of one datum has no influence on the value of another. Thus, the outcome of a "head" for a coin toss does not increase the probability that the next toss produces a "tail". Local independence specifies that the value of one datum has no influence on another once the underlying variable has been accounted for (conditioned out). Local independence includes, but goes beyond, unidimensionality. Including the same math item twice in a math test would not effect its dimensionality. Yet an examinee would be expected to either succeed or fail on both items, so responses to the two identical items would not be locally independent.

Most commonly encountered Rasch quality-control fit statistics are designed to flag statistically unexpected responses or response patterns by considering the performance of one respondent or one test item at a time. These statistics are very powerful for detecting guessing, carelessness, response sets, social conformity, miskeyed items, data entry errors and the like. They also often hint at problems with local independence, but leave the analyst guessing at exactly where to look.

Smith & Miao (1994) demonstrate that factor analysis is a useful method for identifying multidimensionality in data that has been constructed to be unidimensional. They analyze the matrix of raw responses. But this has drawbacks:

(i) the raw responses are non-linear, so that the first factor only approximates the Rasch dimension.

(ii) the second factor, which might identify the nature of any general lack of local independence, is based on the non-linear residuals left after the extraction of the first factor from non-linear data. These residuals are doubly non-linear.

This suggests an improved method of factor analysis: I. Perform a conventional Rasch analysis. The resulting Rasch dimension is analogous to the first principal component, but now in a linear framework.

II. For each observation, X, compute its expected value according to the measurement model, E, and the model variance of the observed about expected Q. (For dichotomous data, Q is Jacob Bernoulli's binomial variance). The part of the observation not directly explained by the measurement model, the residual, is X-E. This is still in the raw score metric.

III. Linearize the residuals. Each residual indicates how much locally easier or harder that item was than expected (or how much more or less locally competent the examinee). A linear estimate of this local discrepancy is obtained by converting the residual into a logit value. An approximation to linearity is obtained by using the local slope of the logistic ogive (ICC) to convert from the raw score to the logit metric. This slope is the model variance, so that Linear (logit) residual = (X-E)/Q

IV. For each pair of items, compute the Pearson correlation between the linear residuals across all examinees who responded to both items. Potentially locally dependent pairs of items will have high positive correlations (e.g., items which cue each other) or high negative correlations (e.g., items which probe alternative therapeutic techniques).

Largest Logit Residual Correlations
used to identify dependent items
Corr. Item Item
.73
.64
.62
.56
.55
Bladder
Comprehension
Bed transfer
Problem solving
Upper body dressing
Bowel
Expression
Toilet transfer
Memory
Lower body dressing
-.33 Upper body dressing Expression

The most extreme logit residual correlations for Functional Independence Measure (FIM-SM) data gathered for a sample of right-body (left-brain) stroke victims are shown in the Table. It is reassuring that, in retrospect, these local dependencies are so obvious. Only the negative correlation between upper-body dressing and expression causes us a second thought. Perhaps this is diagnostic of the manner in which left-brain stroke affects functioning. For right-brain stroke, the biggest negative correlation is:

Corr. Item Item
-.40 Toileting Expression

V. Perform a principal components factor analysis of the item correlation matrix. The first factor reported here is really the second factor, because the Rasch dimension is the first factor overall. This second factor identifies the strongest pattern in local dependency among the items as reflected in their correlations. For left-brain stroke, the second factor is:

Factor Loading Item
2
2
2
2
2
.67
.62
.60
.59
.49
Expression
Comprehension
Problem solving
Memory
Social Interaction
2
2
2
2
-.56
-.64
-.53
-.49
Toilet transfer
Lower body dressing
Bed transfer
Upper body dressing

This clearly indicates that there is a pattern among the five cognitive items on the FIM that is in opposition to that among the motor-oriented transfer and dressing items. In the case of the FIM, this second factor is so strong that, for many purposes, it is more clinically useful to obtain two measures from the FIM (a motor and a cognitive one) than a single composite measure.

Factor Loading Item
3
3
.89
.89
Bladder
Bowel

Subsequent principal components may be useful diagnostically, but reflect weaker patterns in the data. For left-brain stroke, the third factor is indicative of the strong residual correlation between bladder and bowel already reported in the table of correlations.

VI. Tables of numbers are informative, but difficult to synthesize mentally. A picture is worth a thousand words, and a million numbers. A plot of the second factor (first residual factor) against the Rasch dimension depicts clearly the relationship among the FIM items (see Figure). The Rasch dimension (X-axis) is from easy to perform to difficult. The Residual factor (Y-axis) is from motor to cognitive.

Benjamin D. Wright

Smith RM, Miao CY (1994) Assessing unidimensionality for Rasch measurement. Chapter 18 in M. Wilson (Ed.) Objective Measurement: Theory into Practice. Vol. 2. Norwood NJ: Ablex.


Local dependency, correlations and principal components. Wright B.D. … Rasch Measurement Transactions, 1996, 10:3 p. 509-511.

Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Oct. 25-27, 2017, Wed.-Fri. In-person workshop: Applying the Rasch Model hands-on introductory workshop, Melbourne, Australia (T. Bond, B&FSteps), Announcement
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
April 13-17, 2018, Fri.-Tues. AERA, New York, NY, www.aera.net
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt103b.htm

Website: www.rasch.org/rmt/contents.htm