Using the KeyFIM...

Instantaneous Measurement and Diagnosis

Presented at Outcome Measurements in Rehabilitation

by John Michael Linacre
MESA Psychometric Laboratory

Instantaneous measurement and diagnosis by means of observations on rating scales can be explained and demonstrated by means of a practical example: The KeyFIM - Self-Measuring Score Form.

The Functional Independence Measure (FIMSM) is an observation instrument used to track the improvement of patients during rehabilitation. In its most widely distributed version, the instrument is merely a data collection form on which the ratings of the 18 FIM items are recorded. The data are then entered into a computer system and analyzed elsewhere and later. The clinical staff may never be informed of the results. With a redesigned form, however, data collection can immediately encompass measurement and fit diagnosis.

Comprehensive Rasch analysis of FIM data has been undertaken (see References). This has enabled the construction of a self-measuring version of the FIM, the KeyFIM. An abbreviated version, containing only the 5 cognitive items of the FIM is presented here.

The KeyFIM form is used for data collection, then measurement construction, and finally diagnostic analysis. First, the form is turned on its side for data collection. The rating given to each item is recorded, and the corresponding value circled on the pre-calibrated expected-score scale (obtained from a calibration run using normative data, and reported in BIGSTEPS Table 2.2). When extreme ratings are observed (1 and 7 in the KeyFIM), the circle extends from the printed extreme rating value to the edge of the active area.


In clinical settings, different staff members rate different items. In this example, Item Q, "Problem Solving" has not yet been rated (and may never be).

Second, the form is used for measurement construction. Once some data has been recorded, the KeyFIM is rotated back to the vertical. A line is drawn across it, by eye, through the middle of the bulk of the ratings (ignoring outliers) to represent this patient's usual level of functioning. Looking across to the "FIM Raw Score" column, this patient's general level of performance corresponds to a FIM score of "21". We can also fill in a useful predicted rating value for unobserved item Q at "3". (Note that this would give a FIM sum-of-ratings score of 18. It is lower than the expected score of 21 because we ignored the outlying rating of "2" on item O, "Expression".)


To the right can be seen a linear measure for this patient on a convenient logit rescaling from 0 to 100. 0 corresponds to the lowest meaningful logit measure on this instrument, 100 to the highest. The patient's measure is 50±6 measurement units (FIMITs). This S.E. is estimated by eye to be about 6 FIMITs, rather than the indicated "4", due to one unobserved rating and one misfitting rating. The measurement imprecision inherent in a complete set of ratings can be seen by locating the FIM raw score values in the columns marked "FIM at +1 S.E." and "FIM at -1 S.E." and "FIM Raw Score". These three locations indicate the FIM measure and ±1 S.E. relative to it.

Third, the KeyFIM is used to identify and diagnose unexpected response patterns. In this example, the patient's deficit in "Expression", Item O, is glaring, and would immediately attract clinicians' attention for substantive reasons. The imprecision of a single rating is about 15 FIMITs overall (and less than 10 FIMITs in the center of the scale). This rating is over 20 FIMITs less than the patient's typical level of performance and so it is also somewhat surprising on statistical grounds. The KeyFIM has now given as much guidance to the clinical staff, in seconds, as an elaborate computer analysis gives in months!

Self-measuring forms are simple to construct. Most of the effort goes into making them as helpful and convenient as possible for the users.

References:

Fisher A.G., Bryze K.A., Granger C.V., Haley S.M., Hamilton B.B., Heinemann A.W., Puderbaugh J.K., Linacre J.M., Ludlow L.H., McCabe M.A., Wright B.D. (1994) Applications of conjoint measurement to the development of functional assessments. International Journal of Educational Research 21(6) p.579-594

Granger C.V., Hamilton B.B., Linacre J.M. Heinemann A.W., Wright B.D. (1993) Performance profiles of the Functional Independence Measure. American Journal of Physical Medicine and Rehabilitation 72:2 April 84-89.

Heinemann A.W., Hamilton B., Linacre J.M., Wright B.D., Granger C.V. (1995) Functional status and therapeutic intensity during inpatient rehabilitation. American Journal of Physical Medicine and Rehabilitation. 74(4) p. 315-326.

Heinemann A.W., Linacre J.M., Wright B.D., Hamilton B., Granger C.V. (1994) Measurement characteristics of the Functional Independence Measure. Topics in Stroke Rehabilitation 1(3) p.1-15. Fall.

Linacre J.M., Heinemann A.W., Wright B.D., Granger C.V., Hamilton B.D. (1994) The structure and stability of the Functional Independence Measure. Archives of Physical Medicine and Rehabilitation 75(2), 127-132, Feb.

Linacre J.M., Wright B.D. (1991) BIGSTEPS Rasch Analysis Computer Program. Chicago IL: MESA Press.

Linacre J.M., Wright B.D., Heinemann A., Hamilton B. (1991) Criterion-sensitive measurement. Paper presented at AERA Annual Meeting. April. Chicago. (ERIC ED 333 048)

Wright B.D., Linacre J.M., Heinemann A.W. (1993) Measuring functional status in rehabilitation. Physical Medicine and Rehabilitation Clinics of North America 4(3) 475-491. August.

This appeared in
Physical Medicine and Rehabilitation
11 (2) pp. 315-324, June 1997



Go to Top of Page
Go to Institute for Objective Measurement Page



Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse Rasch Measurement Theory Analysis in R, Wind, Hua Applying the Rasch Model in Social Sciences Using R, Lamprianou Journal of Applied Measurement
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Rasch Models for Measurement, David Andrich Constructing Measures, Mark Wilson Best Test Design - free, Wright & Stone
Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias Diseño de Mejores Pruebas - free, Spanish Best Test Design A Course in Rasch Measurement Theory, Andrich, Marais Rasch Models in Health, Christensen, Kreiner, Mesba Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
Rasch Books and Publications: Winsteps and Facets
Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes Rasch Models for Solving Measurement Problems (Facets), George Engelhard, Jr. & Jue Wang Statistical Analyses for Language Testers (Facets), Rita Green Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind Rasch Measurement: Applications, Khine Winsteps Tutorials - free
Facets Tutorials - free
Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:
Please email inquiries about Rasch books to books \at/ rasch.org

Your email address (if you want us to reply):

 

FORUMRasch Measurement Forum to discuss any Rasch-related topic

Coming Rasch-related Events
Oct. 6 - Nov. 3, 2023, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Facets), www.statistics.com
Oct. 12, 2023, Thursday 5 to 7 pm Colombian timeOn-line workshop: Deconstruyendo el concepto de validez y Discusiones sobre estimaciones de confiabilidad SICAPSI (J. Escobar, C.Pardo) www.colpsic.org.co
June 12 - 14, 2024, Wed.-Fri. 1st Scandinavian Applied Measurement Conference, Kristianstad University, Kristianstad, Sweden http://www.hkr.se/samc2024
Aug. 9 - Sept. 6, 2024, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com

 

Our current URL is www.rasch.org

The URL of this page is www.rasch.org/memo60.htm