# Multidimensional Scaling vs. Rasch PCA Residual Analysis

"Multidimensional-scaling (MDS) models are based on the idea that a set of ordinal data can be converted into a smaller amount of cardinal information" (Nijkamp & Voogd, 1984, p. 201). Rasch measurement is based on the same idea. But do these methods find the same information?

30 schools districts in the Chicago suburbs have been ranked on their performance on each of 13 state-mandated tests. These data have been analyzed with MDS and also with a principal components analysis (PCA) of Rasch residuals (RRP).

Analysis of "Items"
Figure 1 shows an MDS plot, produced using the default options of SYSTAT, with the 13 tests treated as "variables". W is Writing, R is Reading, M is Math, S is Science, C is Social Studies. The number is the grade level, e.g., W3 is Writing - 3rd Grade. On the plot, W3, W6 and W8 are all outliers, but in different directions. There is little natural clustering by either subject area or grade level.

The identical data were subjected to Rasch analysis. Since the schools are rank ordered, all 13 tests (treated as items) have the same raw score and the same measure. The Rasch analysis confirmed the MDS finding that W3, W6 and W8 are the most misfitting tests. Figure 2 plots the first two principal components in the Rasch residuals. Clusters and patterns are now evident both by subject area and grade level. The Rasch Figure is easier to interpret and suggestive. The fact that W3, W6 and W8 form a cluster on this plot suggests that their commonalities are greater than their differences. This example suggests that Rasch analysis is a powerful investigative tool even when measurement construction is not the primary objective.

Analysis of "persons"
The MDS and Rasch analyses were continued focusing on the schools as "cases" or "persons". Figure 3 shows an MDS plot of the 30 schools, identified by District number. It has the appearance of a ring. This plot suggests that there are two processes at work, but gives little guidance to what they are.

The RRP plot for the schools is Figure 4. Since the schools were rank ordered on the 13 Tests, the schools have different sums of ranks, and so different measures. Since measures are available, they are plotted along the x-axis. School 181 is the highest ranked overall, school 33 the lowest. Now the y-axis in the MDS plot, Figure 3, is seen to be a faint shadow of overall school performance. This is depicted by the main diagonal in Figure 5, but sub-diagonals compound the difficulty of interpreting the first MDS dimension.

The y-axis in Figure 4, the RRP plot, is the first principal component in the Rasch residuals. By inspection of the raw data, it is seen that the schools at the positive pole of this component are strong in Writing and 3rd Grade performance relative to schools at the negative pole. On this plot, clusters of similarly performing schools are apparent. This axis corresponds to the x-axis in Figure 3, the MDS plot, as shown in Figure 6.

These plots are remarkable. According to Figure 6, the misfit from the Rasch model has been captured by the MDS analysis. But, according to Figure 5, the level of overall school performance, a typical focus of studies such as this, has been almost lost in the MDS results. MDS has not been as successful as Rasch in extracting cardinal information from ordinal data.
John Michael Linacre

Nijkamp P., Voogd H. (1984) Multidimensional and homogenous scaling in spatial analysis. Chapter 12 in Bahrenburg G., Fischer M.M., Nijkamp P. (Eds.) Recent Developments in Spatial Data Analysis: Methodology, Measurement, Models. Brookfield, Vermont: Gower Publishing Co.

Rasch PCA residual analysis Linacre, J.M. Multidimensional scaling vs. … Rasch Measurement Transactions, 1999, 13:1 p. 684

Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

 Forum Rasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
March 21, 2019, Thur. 13th annual meeting of the UK Rasch user group, Cambridge, UK, http://www.cambridgeassessment.org.uk/events/uk-rasch-user-group-2019
April 4 - 8, 2019, Thur.-Mon. NCME annual meeting, Toronto, Canada,https://ncme.connectedcommunity.org/meetings/annual
April 5 - 9, 2019, Fri.-Tue. AERA annual meeting, Toronto, Canada,www.aera.net/Events-Meetings/Annual-Meeting
April 12, 2019, Fri. On-line course: Understanding Rasch Measurement Theory - Master's Level (G. Masters), https://www.acer.org/au/professional-learning/postgraduate/rasch
May 24 - June 21, 2019, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 22 - 30, 2019, Wed.-Thu. Measuring and scale construction (with the Rasch Model), University of Manchester, England, https://www.cmist.manchester.ac.uk/study/short/intermediate/measurement-with-the-rasch-model/
June 17-19, 2019, Mon.-Wed. In-person workshop, Melbourne, Australia: Applying the Rasch Model in the Human Sciences: Introduction to Rasch measurement (Trevor Bond, Winsteps), Announcement
June 20-21, 2019, Thurs.-Fri. In-person workshop, Melbourne, Australia: Applying the Rasch Model in the Human Sciences: Advanced Rasch measurement with Facets (Trevor Bond, Facets), Announcement
June 28 - July 26, 2019, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 2-5, 2019, Tue.-Fri. 2019 International Measurement Confederation (IMEKO) Joint Symposium, St. Petersburg, Russia,https://imeko19-spb.org
July 11-12 & 15-19, 2019, Thu.-Fri. A Course in Rasch Measurement Theory (D.Andrich), University of Western Australia, Perth, Australia, flyer - http://www.education.uwa.edu.au/ppl/courses
Aug 5 - 10, 2019, Mon.-Sat. 6th International Summer School "Applied Psychometrics in Psychology and Education", Institute of Education at HSE University Moscow, Russia.https://ioe.hse.ru/en/announcements/248134963.html
Aug. 9 - Sept. 6, 2019, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
August 25-30, 2019, Sun.-Fri. Pacific Rim Objective Measurement Society (PROMS) 2019, Surabaya, Indonesia https://proms.promsociety.org/2019/
Oct. 11 - Nov. 8, 2019, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Nov. 3 - Nov. 4, 2019, Sun.-Mon. International Outcome Measurement Conference, Chicago, IL,http://jampress.org/iomc2019.htm
Jan. 24 - Feb. 21, 2020, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 22 - June 19, 2020, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 26 - July 24, 2020, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 7 - Sept. 4, 2020, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 9 - Nov. 6, 2020, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 25 - July 23, 2021, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com