Using the KeyFIM...

Instantaneous Measurement and Diagnosis

Presented at Outcome Measurements in Rehabilitation

by John Michael Linacre
MESA Psychometric Laboratory

Instantaneous measurement and diagnosis by means of observations on rating scales can be explained and demonstrated by means of a practical example: The KeyFIM - Self-Measuring Score Form.

The Functional Independence Measure (FIMSM) is an observation instrument used to track the improvement of patients during rehabilitation. In its most widely distributed version, the instrument is merely a data collection form on which the ratings of the 18 FIM items are recorded. The data are then entered into a computer system and analyzed elsewhere and later. The clinical staff may never be informed of the results. With a redesigned form, however, data collection can immediately encompass measurement and fit diagnosis.

Comprehensive Rasch analysis of FIM data has been undertaken (see References). This has enabled the construction of a self-measuring version of the FIM, the KeyFIM. An abbreviated version, containing only the 5 cognitive items of the FIM is presented here.

The KeyFIM form is used for data collection, then measurement construction, and finally diagnostic analysis. First, the form is turned on its side for data collection. The rating given to each item is recorded, and the corresponding value circled on the pre-calibrated expected-score scale (obtained from a calibration run using normative data, and reported in BIGSTEPS Table 2.2). When extreme ratings are observed (1 and 7 in the KeyFIM), the circle extends from the printed extreme rating value to the edge of the active area.


In clinical settings, different staff members rate different items. In this example, Item Q, "Problem Solving" has not yet been rated (and may never be).

Second, the form is used for measurement construction. Once some data has been recorded, the KeyFIM is rotated back to the vertical. A line is drawn across it, by eye, through the middle of the bulk of the ratings (ignoring outliers) to represent this patient's usual level of functioning. Looking across to the "FIM Raw Score" column, this patient's general level of performance corresponds to a FIM score of "21". We can also fill in a useful predicted rating value for unobserved item Q at "3". (Note that this would give a FIM sum-of-ratings score of 18. It is lower than the expected score of 21 because we ignored the outlying rating of "2" on item O, "Expression".)


To the right can be seen a linear measure for this patient on a convenient logit rescaling from 0 to 100. 0 corresponds to the lowest meaningful logit measure on this instrument, 100 to the highest. The patient's measure is 50±6 measurement units (FIMITs). This S.E. is estimated by eye to be about 6 FIMITs, rather than the indicated "4", due to one unobserved rating and one misfitting rating. The measurement imprecision inherent in a complete set of ratings can be seen by locating the FIM raw score values in the columns marked "FIM at +1 S.E." and "FIM at -1 S.E." and "FIM Raw Score". These three locations indicate the FIM measure and ±1 S.E. relative to it.

Third, the KeyFIM is used to identify and diagnose unexpected response patterns. In this example, the patient's deficit in "Expression", Item O, is glaring, and would immediately attract clinicians' attention for substantive reasons. The imprecision of a single rating is about 15 FIMITs overall (and less than 10 FIMITs in the center of the scale). This rating is over 20 FIMITs less than the patient's typical level of performance and so it is also somewhat surprising on statistical grounds. The KeyFIM has now given as much guidance to the clinical staff, in seconds, as an elaborate computer analysis gives in months!

Self-measuring forms are simple to construct. Most of the effort goes into making them as helpful and convenient as possible for the users.

References:

Fisher A.G., Bryze K.A., Granger C.V., Haley S.M., Hamilton B.B., Heinemann A.W., Puderbaugh J.K., Linacre J.M., Ludlow L.H., McCabe M.A., Wright B.D. (1994) Applications of conjoint measurement to the development of functional assessments. International Journal of Educational Research 21(6) p.579-594

Granger C.V., Hamilton B.B., Linacre J.M. Heinemann A.W., Wright B.D. (1993) Performance profiles of the Functional Independence Measure. American Journal of Physical Medicine and Rehabilitation 72:2 April 84-89.

Heinemann A.W., Hamilton B., Linacre J.M., Wright B.D., Granger C.V. (1995) Functional status and therapeutic intensity during inpatient rehabilitation. American Journal of Physical Medicine and Rehabilitation. 74(4) p. 315-326.

Heinemann A.W., Linacre J.M., Wright B.D., Hamilton B., Granger C.V. (1994) Measurement characteristics of the Functional Independence Measure. Topics in Stroke Rehabilitation 1(3) p.1-15. Fall.

Linacre J.M., Heinemann A.W., Wright B.D., Granger C.V., Hamilton B.D. (1994) The structure and stability of the Functional Independence Measure. Archives of Physical Medicine and Rehabilitation 75(2), 127-132, Feb.

Linacre J.M., Wright B.D. (1991) BIGSTEPS Rasch Analysis Computer Program. Chicago IL: MESA Press.

Linacre J.M., Wright B.D., Heinemann A., Hamilton B. (1991) Criterion-sensitive measurement. Paper presented at AERA Annual Meeting. April. Chicago. (ERIC ED 333 048)

Wright B.D., Linacre J.M., Heinemann A.W. (1993) Measuring functional status in rehabilitation. Physical Medicine and Rehabilitation Clinics of North America 4(3) 475-491. August.

This appeared in
Physical Medicine and Rehabilitation
11 (2) pp. 315-324, June 1997



Go to Top of Page
Go to Institute for Objective Measurement Page

Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:
Please email inquiries about Rasch books to books \at/ rasch.org

Your email address (if you want us to reply):

 

FORUMRasch Measurement Forum to discuss any Rasch-related topic

Coming Rasch-related Events
Jan. 25-26, 2017, Wed.-Thurs. In-person workshop: Measurement with the Rasch Model (M. Pampaka, J. Williams, Winsteps), Manchester, UK, website
Feb. 27 - June 24, 2017, Mon.-Sat. On-line: Advanced course in Rasch Measurement Theory (EDUC5606), Website
March 31, 2017, Fri. Conference: 11th UK Rasch Day, Warwick, UK, www.rasch.org.uk
April 2-3, 2017, Sun.-Mon. Conference: Validity Evidence for Measurement in Mathematics Education (V-M2Ed), San Antonio, TX, Information
April 26-30, 2017, Wed.-Sun. NCME, San Antonio, TX, www.ncme.org
April 27 - May 1, 2017, Thur.-Mon. AERA, San Antonio, TX, www.aera.net
May 26 - June 23, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 30 - July 29, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

Our current URL is www.rasch.org

The URL of this page is www.rasch.org/memo60.htm