Presented at Outcome Measurements in Rehabilitation
by John Michael Linacre
MESA Psychometric Laboratory
Instantaneous measurement and diagnosis by means of observations on rating scales can be explained and demonstrated by means of a practical example: The KeyFIM - Self-Measuring Score Form.
The Functional Independence Measure (FIMSM) is an observation instrument used to track the improvement of patients during rehabilitation. In its most widely distributed version, the instrument is merely a data collection form on which the ratings of the 18 FIM items are recorded. The data are then entered into a computer system and analyzed elsewhere and later. The clinical staff may never be informed of the results. With a redesigned form, however, data collection can immediately encompass measurement and fit diagnosis.
Comprehensive Rasch analysis of FIM data has been undertaken (see References). This has enabled the construction of a self-measuring version of the FIM, the KeyFIM. An abbreviated version, containing only the 5 cognitive items of the FIM is presented here.
The KeyFIM form is used for data collection, then measurement construction, and finally diagnostic analysis. First, the form is turned on its side for data collection. The rating given to each item is recorded, and the corresponding value circled on the pre-calibrated expected-score scale (obtained from a calibration run using normative data, and reported in BIGSTEPS Table 2.2). When extreme ratings are observed (1 and 7 in the KeyFIM), the circle extends from the printed extreme rating value to the edge of the active area.
In clinical settings, different staff members rate different items. In this example, Item Q, "Problem Solving" has not yet been rated (and may never be).
Second, the form is used for measurement construction. Once some data has been recorded, the KeyFIM is rotated back to the vertical. A line is drawn across it, by eye, through the middle of the bulk of the ratings (ignoring outliers) to represent this patient's usual level of functioning. Looking across to the "FIM Raw Score" column, this patient's general level of performance corresponds to a FIM score of "21". We can also fill in a useful predicted rating value for unobserved item Q at "3". (Note that this would give a FIM sum-of-ratings score of 18. It is lower than the expected score of 21 because we ignored the outlying rating of "2" on item O, "Expression".)
To the right can be seen a linear measure for this patient on a convenient logit rescaling from 0 to 100. 0 corresponds to the lowest meaningful logit measure on this instrument, 100 to the highest. The patient's measure is 50±6 measurement units (FIMITs). This S.E. is estimated by eye to be about 6 FIMITs, rather than the indicated "4", due to one unobserved rating and one misfitting rating. The measurement imprecision inherent in a complete set of ratings can be seen by locating the FIM raw score values in the columns marked "FIM at +1 S.E." and "FIM at -1 S.E." and "FIM Raw Score". These three locations indicate the FIM measure and ±1 S.E. relative to it.
Third, the KeyFIM is used to identify and diagnose unexpected response patterns. In this example, the patient's deficit in "Expression", Item O, is glaring, and would immediately attract clinicians' attention for substantive reasons. The imprecision of a single rating is about 15 FIMITs overall (and less than 10 FIMITs in the center of the scale). This rating is over 20 FIMITs less than the patient's typical level of performance and so it is also somewhat surprising on statistical grounds. The KeyFIM has now given as much guidance to the clinical staff, in seconds, as an elaborate computer analysis gives in months!
Self-measuring forms are simple to construct. Most of the effort goes into making them as helpful and convenient as possible for the users.
Fisher A.G., Bryze K.A., Granger C.V., Haley S.M., Hamilton B.B., Heinemann A.W., Puderbaugh J.K., Linacre J.M., Ludlow L.H., McCabe M.A., Wright B.D. (1994) Applications of conjoint measurement to the development of functional assessments. International Journal of Educational Research 21(6) p.579-594
Granger C.V., Hamilton B.B., Linacre J.M. Heinemann A.W., Wright B.D. (1993) Performance profiles of the Functional Independence Measure. American Journal of Physical Medicine and Rehabilitation 72:2 April 84-89.
Heinemann A.W., Hamilton B., Linacre J.M., Wright B.D., Granger C.V. (1995) Functional status and therapeutic intensity during inpatient rehabilitation. American Journal of Physical Medicine and Rehabilitation. 74(4) p. 315-326.
Heinemann A.W., Linacre J.M., Wright B.D., Hamilton B., Granger C.V. (1994) Measurement characteristics of the Functional Independence Measure. Topics in Stroke Rehabilitation 1(3) p.1-15. Fall.
Linacre J.M., Heinemann A.W., Wright B.D., Granger C.V., Hamilton B.D. (1994) The structure and stability of the Functional Independence Measure. Archives of Physical Medicine and Rehabilitation 75(2), 127-132, Feb.
Linacre J.M., Wright B.D. (1991) BIGSTEPS Rasch Analysis Computer Program. Chicago IL: MESA Press.
Linacre J.M., Wright B.D., Heinemann A., Hamilton B. (1991) Criterion-sensitive measurement. Paper presented at AERA Annual Meeting. April. Chicago. (ERIC ED 333 048)
Wright B.D., Linacre J.M., Heinemann A.W. (1993) Measuring functional status in rehabilitation. Physical Medicine and Rehabilitation Clinics of North America 4(3) 475-491. August.
This appeared in
Physical Medicine and Rehabilitation
11 (2) pp. 315-324, June 1997
Go to Top of Page
Go to Institute for Objective Measurement Page
|Coming Rasch-related Events|
|June 26 - July 24, 2020, Fri.-Fri.||On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com|
|June 29 - July 1, 2020, Mon.-Wed.||Measurement at the Crossroads 2020, Milan, Italy , https://convegni.unicatt.it/mac-home|
|July - November, 2020||On-line course: An Introduction to Rasch Measurement Theory and RUMM2030Plus (Andrich & Marais), http://www.education.uwa.edu.au/ppl/courses|
|July 1 - July 3, 2020, Wed.-Fri.||International Measurement Confederation (IMEKO) Joint Symposium, Warsaw, Poland, http://www.imeko-warsaw-2020.org/|
|Aug. 7 - Sept. 4, 2020, Fri.-Fri.||On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com|
|Oct. 9 - Nov. 6, 2020, Fri.-Fri.||On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com|
|June 25 - July 23, 2021, Fri.-Fri.||On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com|
Our current URL is www.rasch.org
The URL of this page is www.rasch.org/memo60.htm