Therapeutic Measurement

Patients and Rasch practitioners will benefit from the April 1993, American Journal of Occupational Therapy. This issue focusses on "alternative strategies for functional assessment", and includes 3 papers on Rasch measurement.

Guest editors, Margaret Short-DeGraff and Anne G. Fisher (Nationally Speaking - A Proposal for Diverse Research Methods and a Common Research Language, p.295-297), remedy the confusion surrounding such terms as qualitative, quantitative, assessment, evaluation, score, and measure by proposing definitions and encouraging authors to use the terms consistently. They note that "what one researcher might view as qualitative could well be considered quantitative by another", and decry the value judgements implied by labeling qualitative methods, "moral" and "feminine", but quantitative methods, "reductionistic" and "male". For measure, they recommend a definition related to Michell (1990): to determine quantitative differences in amounts based on the use of numeric "units of like kind", i.e., equal-interval units.

Lunz and Stahl (L&S, The Effect of Rater Severity on Person Ability Measure: A Rasch Model Analysis, p.311-317) launch an enthusiastic and skilled attack on the problem of differences in severity across raters, a topic of interest in OT because supervisors rate student's fieldwork performance, and therapists rate clients' task performance. In a judge-rated examination, L&S discover that the range of rater severity measures is about half that of candidate performance measures. This yields the disturbing possibility that raw scores of the best and worst candidate could coincide if they happen to be rated by the most severe and most lenient rater respectively! The Scores by Measures Plot shows that the actual situation was almost that bad. Candidates with the same raw score as the best candidate failed!

L&S demonstrate that a many-facet Rasch model constructs measures adjusted for rater severity differences. They find that "raters vary markedly in their level of severity but tend to be consistent in that level of severity across candidates and protocols." With a Rasch model, "more control of the evaluation process can be exercised with regard to constructing items or protocols, training and providing feedback to raters, and providing reliable pass/fail decisions that are independent of the raters and items encountered."

Anne Fisher (The Assessment of IADL Motor Skills: An Application of Many- Faceted Rasch Analysis, p.319-329) writes a primer on many-facet Rasch measurement as she explains how she applied the methodology to develop the motor scale of the Assessment of Motor and Process skills. It is amazing that she can describe the theory behind her model, and then build a model for her observations, and finally calibrate a variable and measure the patients, all without inundating the reader with tables of numbers and algebraic formulae. Indeed, her only table of numbers appears at the end of her paper, clearly intended solely for those who plan to employ the methodology.

She utilizes her concept of linear "rulers", marked with calibrated items and tasks, to demonstrate how the different elements of four facets interact to generate observations. In her Task and Skill Plot, "Sweeping" is the easiest task and "vacuuming" the hardest. "Lifts" is the easiest item and "calibrates" the hardest. "Transports" on the "sweeping" task is about as easy as "lifts" on the "tossed salad". "Bends" on "vacuuming" is about as hard as "calibrates" on the "tossed salad". Even the most qualitatively-oriented therapist can grasp the message of such pictures.

William P. Fisher Jr. (Measurement-Related Problems in Functional Assessment, p.331-337) addresses the conceptual issue of "just what is good data?" He sees that stochastic conjoint order is essential to measurement and meaning. He attacks Stevens' sloppy scale definitions, pointing out that summing a hodge-podge of disparate ratings into a raw score does not produce a measure, indeed such a number can lack any meaning. He further proposes that meaning implies generality, so that meaningful measures must maintain their meaning when moved beyond the local context. He illustrates such generality by comparing in his PECS©-FIM® plot the calibrations for two sets of items in two different instruments that purport to measure the same thing. "The capacity to overcome the constraints of existing methods of assessment is not a matter of simply abandoning the old in favor of the new, but of turning implicit assumptions about numbers into explicit requirements for measurement."

John Michael Linacre

Michell J. 1990. Introduction to the logic of psychological measurement. Hillsdale NJ: Erlbaum

Therapeutic measurement. Fisher AG, Short-DeGraff M, Lunz ME, Stahl JA, Fisher WP Jr. Rasch Measurement Transactions 1993 7:3 p.301


Therapeutic measurement. Fisher AG, Short-DeGraff M, Lunz ME, Stahl JA, Fisher WP Jr. … Rasch Measurement Transactions, 1993, 7:3 p.301

Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Oct. 25-27, 2017, Wed.-Fri. In-person workshop: Applying the Rasch Model hands-on introductory workshop, Melbourne, Australia (T. Bond, B&FSteps), Announcement
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
April 13-17, 2018, Fri.-Tues. AERA, New York, NY, www.aera.net
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt73a.htm

Website: www.rasch.org/rmt/contents.htm