# Proper Measurement is "Universally Reproducible"

The late John A. Simpson was a physicist and metrologist associated with the University of Chicago, the Enrico Fermi Institute, and the US National Institute for Standards and Technology.

In the following definition of measurement, taken from the Metrology subject heading in the Encyclopedia of Physics, note that Simpson makes repeated explicit references to the concept of quantity without specifically invoking any tests of additivity or divisibility, though these, along with other similar tests, are indeed implicit in the concept of a "continuous scale of magnitude."

Simpson places far more emphasis on common units, and common methods of obtaining them and determining ordinal relations, than he does on knowing how and when additive relations have been established. He goes so far as to hold that "a proper measurement" is one that is "universally reproducible" "wherever and whenever the measurement process is repeated."

Psychometricians might then do well to shift some of their resources toward deployment of common units and methods for each major measurable variable, and away from the generation of ever more different units and methods. In what follows, the emphasis is mine.

William Fisher

Simpson, J. A. (1991). Metrology. In R. G. Lerner & G. L. Trigg (Eds.), Encyclopedia of physics, 2d Ed. (pp. 723-5). New York, New York: VCH Publishers, Inc.

p. 723-4: "A measurement is a series of manipulations of physical objects or systems according to defined protocols that result in a number. The objects or systems involved are test objects, measuring devices, and computational operations. The objects and devices exist in and are influenced by some environment. The value obtained is purported to represent uniquely the magnitude, or intensity, of some quantity embodied in the test object. This number is acquired to form the basis of a decision affecting some human goal or satisfying some human need that depends on the properties of the test object.

In order to attain this goal of useful decision making, metrology has focused on the task of assuring that the value obtained for a given quantity of a given object is functionally identical wherever and whenever the measurement process is repeated. Only then can all parties to the decision work from a concordant data base. Such a universally reproducible measurement is called a proper measurement.

An analysis of the logical conditions that must be satisfied to achieve a proper measurement shows that three independent arbitrary axioms must be universally agreed upon:

1. All parties must agree upon and have access to a common unit in which the results will be expressed.

2. There must be an agreed-upon physically realizable method of obtaining a continuous scale of magnitude based on the unit.

3. There must be an agreed-upon physically realizable method of determining when the quantity of interest, as embodied in a physical object or system, is equal to, less than, or greater than, some fixed point on this realized scale.

The principal activity of metrologists consists of generating, propagating, testing, and applying to an object or system of interest sets of these measurement axioms for all quantities and all useful magnitudes of those quantities...

Fundamental to the success of such a system is the development, at each transfer [points through which the unit is traceable to the reference standard from secondary standards and the point of use], of realistic estimates of uncertainty."

p. 725: "By far the greatest activity in metrology is that performed in the service of quality control. Manufacturing establishments of any size maintain standards laboratories and/or metrology laboratories. The laboratories maintain the company master standards, gauges, and measuring instruments, which are periodically calibrated against the national standards. The working measuring equipment on the shop floor is calibrated by the metrology laboratory on a scheduled basis. ... In this manner the measurements made for quality control are considered `traceable' to national standards."

William P. Fisher, Jr.

"Measurement lies at the heart of genuine quality improvement, the kind that healthcare organizations undertake on behalf of their patients and communities, not simply to ensure accreditation. When delivery systems get ready to transition from talking about continuous quality improvement to really practicing it, learning to measure and manage care processes and outcomes becomes the first priority. If quality is Job One, measurement is Job Zero."
Carl Stevens, M.D. (UCLA Medical Center) in the Foreword to Statistical Process Control for Healthcare, Marilyn K. Hart & Robert F. Hart, Brooks Cole, 2001

And it is now agreed that measurement is not merely, as S.S. Stevens mistakenly leads people to believe, the arbitrary assignment of numbers to observations.

William P. Fisher, Jr.

Proper Measurement is Universally Reproducible, Fisher W.P. Jr., … Rasch Measurement Transactions, 2004, 18:1 p.967

Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse Rasch Measurement Theory Analysis in R, Wind, Hua Applying the Rasch Model in Social Sciences Using R, Lamprianou El modelo métrico de Rasch: Fundamentación, implementación e interpretación de la medida en ciencias sociales (Spanish Edition), Manuel González-Montesinos M.
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Rasch Models for Measurement, David Andrich Constructing Measures, Mark Wilson Best Test Design - free, Wright & Stone
Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias Diseño de Mejores Pruebas - free, Spanish Best Test Design A Course in Rasch Measurement Theory, Andrich, Marais Rasch Models in Health, Christensen, Kreiner, Mesba Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
Rasch Books and Publications: Winsteps and Facets
Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes Rasch Models for Solving Measurement Problems (Facets), George Engelhard, Jr. & Jue Wang Statistical Analyses for Language Testers (Facets), Rita Green Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind Rasch Measurement: Applications, Khine Winsteps Tutorials - free
Facets Tutorials - free
Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan

 To be emailed about new material on www.rasch.orgplease enter your email address here: I want to Subscribe: & click below I want to Unsubscribe: & click below Please set your SPAM filter to accept emails from Rasch.org

 Forum Rasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

The URL of this page is www.rasch.org/rmt/rmt181e.htm

Website: www.rasch.org/rmt/contents.htm