Theory Construction from Empirical Observations

Science depends on theory, imagination and memory in a continuous dialogue with experience. This dialog flows from the initiating idea, with which each scientific adventure begins, through a focusing of the idea into a variable of one varying magnitude. The variable requires an articulation bench-marking the variable's emerging line of inquiry into an itemization of operations by which manifestations of the variable may be observed, counted, stochastically ordered, and so used to construct measures.

Scientific understanding of a phenomenon requires the construction of a theory. This theory is the basis for predicting, manipulating, controlling and counteracting the phenomenon, and also for relating the phenomenon to other phenomena. The construction of theory requires the careful selection of data. In astronomy, Tycho Brahe's careful planetary observations enabled first the geometric theories of Johanes Kepler and then the dynamic theory of Isaac Newton. In the social sciences, we still linger at the early stage of seeking ways to select useful data.

But theory construction from observations can already be realized. Much useful data has been carefully recorded. Analysis of these data, however, has been merely descriptive. Theory-construction has tended to degenerate into speculation on accidental features of the data and reinforcement of preconceptions.

A strong theory implies structure in data despite the inevitable vagaries inherent in all observations. Rasch measurement detects and quantifies the details of data structure whenever structure exists. The metric realization of the structure provides a foundation for theory construction. Every piece of data confirms or challenges the theory. Further, the presence of structure invites the researcher to extrapolate, to predict extensions which can be confirmed or refuted by further data collection.

This kind of theory construction is illustrated by an analysis of the "Signs of Ten Common Problems" (Adams, 1973) in the Table. Adams notes that certain behavioral "Signs" are often exhibited by individuals with certain psychological "Problems". He reports his data as a counselling aid, but not as a basis for theory.

Mental Problems and Behavioral Signs


For theory development, however, the initiating idea is mental health. Mental health is focused into a variable: degree of mental illness. This variable is articulated by 10 mental problems. Finally these ten problems are itemized into 30 behavioral signs by which the mental problems might be identified and thence mental illness measured. The crucial question at this point of theory development is: Do these ten problems and these 30 signs relate to one another in a pattern sufficiently singular to enable the construction of a single variable of mental illness?

Delightfully, Rasch analysis of Adams' data uncovers a conjoint ordering of Signs and Problems. Signs are ordered from those observed most frequently with many Problems to those observed least frequently with few Problems. Problems are ordered from those with the most Signs observed most frequently to those with the fewest signs observed least frequently. Since these two orderings are found to be compatible, the data exhibits structure, and each of the Signs and Problems can be placed in a single linear measurement system, enabling the mathematical expression of their relationships. The degree to which each Sign and each Problem coordinate in the structure can be evaluated by statistical quality control.

Construct Map of Problems and Signs


The measures for Signs are reported in the adjacent Table. Three Signs, "Communication Breakdown", "Sleeplessness", and "Anxiety" are present for all problems. "Hallucinations" is present with only one Problem. These measures locate the Signs on an underlying linear variable of mental illness, with each location having a precision given by its standard error.

The degree to which each Sign coordinates in defining the structure is given by its quality-control mean-square fit statistic (Fit MnSq in Table). Each mean-square has an expectation of 1. Mean-squares substantially larger than 1 indicate Problem patterns for a Sign that are not in accord with the general structure.

The most noticeable misfit of 2.16 is associated with "Slackening of Interests." An individual exhibiting "Sexual Deviation" may have a slackening of normal interests, but is far from apathetic. This implies how the structure could be clarified and strengthened, and the utility of the Table increased, by redefining "Slackening of interests" into two Signs, "Lack of activity" and "Misdirected activity."

A similar analysis of Problems (see Table) discloses "Guilt" as the problem that exhibits the most signs, while "Blame Shifting" and "Sexual Deviation" exhibit the least. The large misfit for "Depression" indicates that it may be a nebulous problem, reflecting a general frame of mind, rather than a specific diagnosis.

In using Rasch results to construct theory, a visual representation of the measurement system is decisive (see Figure opposite). Adams' Problems mark out a spectrum ranging from internalized stress at the top of the Figure down through externally-expressed emotional stress to externally-expressed physical stress, with the externalized behavior exhibiting more symptoms at the bottom. His Signs show a trend from the more frequently observed, polite neuroses at the bottom of the Figure, up through self-destructive symptoms, to anti-social symptoms, climaxing with the autistic extreme of "Hallucinations."

Rasch analysis of Adams' data suggests the theory that as psychological problems become more anti-social and dynamic, there are more socially-overt symptoms, but as the problems increase to psychosis, the symptoms of more introvert problems are still observed.

These conclusions may be thought self-evident by practitioners. Nevertheless, it is the precise expression of such knowledge that enables scientific advance. With this theory, for instance, one can predict where uncategorized Signs, such as drunkenness and drug abuse should appear. A likely location is between "Violence" and "Over- eating." Unlisted Problems such as "Greed" or "Avarice" should appear between "Self-Pity" and "Anger."

The Rasch technique develops a quantitative framework for the data. Inspection of the placement of the Problems and Signs facilitates the development of an explanatory and predictive theory for data structure. This phase of theory construction, however, still falls short of predicting measures for further Problems or Signs. Though that phase was long ago reached in the physical sciences, it is only now being approached in just a few social science areas, such as in predicting the reading difficulty of a text passage (Stenner et al. 1987).

Adams J.E. 1973. The Christian Counselor's Manual. Grand Rapids, MI: Zondervan

Stenner AJ, Smith M, Horabin I, Smith DR. 1987. Lexile Test of Reading Comprehension. Durham NC: Metametrics.

Raw    Measure  S.E.  Fit  Behavioral Sign
Score                MnSq
                             Associated with few Problems
 2       1.93   .63  1.26  Hallucinations
 5       1.13   .45  1.20  Failure to do daily chores
 6        .94   .43   .71  Dry mouth, clammy hands, heart palpitates
 6        .94   .43  1.17  Frequently asks why? dwells on past
 6        .94   .43   .85  Shyness
 8        .60   .40   .90  Loneliness
 8        .60   .40  2.16  Slackening of interests
11        .13   .39  1.42  Bitterness
11        .13   .39   .55  Disorder of person, in home, on job
12       -.03   .40   .73  Bizarre behavior
12       -.03   .40  1.49  Excuses, lies
12       -.03   .40   .49  Immobility
12       -.03   .40  1.25  Sexual impotency
12       -.03   .40  1.08  Suspicion
12       -.03   .40   .79  Ulcer
12       -.03   .40   .68  Withdrawal, avoidance
13       -.19   .40   .65  Blue, sad, tears
13       -.19   .40   .83  Violence (verbal or physical)
14       -.35   .42  1.19  Colitis
14       -.35   .42   .99  Excessive eating (weight gain)
14       -.35   .42   .21  Tiredness
15       -.54   .44  1.41  Muscular tension
15       -.54   .44   .60  Suicidal tendencies
16       -.74   .47  1.31  Headaches
18      -1.31   .63  1.21  Loss of appetite (weight loss)
18      -1.31   .63  1.52  Sensitive, touchy, irritable
18      -1.31   .63  1.52  Trouble with people
20      -2.40  1.27   -    Anxiety
20      -2.40  1.27   -    Communication breakdown
20      -2.40  1.27   -    Sleeplessness
                             Associated with many Problems
Raw   Measure  S.E.  Fit   Mental Problem
Score                MnSq
                             with more Signs
44       1.18   .32   .90  Guilt
42        .99   .29   .87  Fear
42        .99   .29  1.45  Organic Problem
40        .83   .28   .84  Self-Pity
31        .22   .25  1.92  Depression
27       -.02   .24   .66  Anger
25       -.14   .24   .69  Envy, Jealousy
22       -.31   .25   .80  Rebellion
21       -.38   .25   .76  Blame Shifting
21       -.38   .25  1.24  Sexual Deviation
                             with less Signs

Theory construction from empirical observations. Wright BD. … Rasch Measurement Transactions, 1994, 8:2 p.362

Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
May 26 - June 23, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 30 - July 29, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
April 13-17, 2018, Fri.-Tues. AERA, New York, NY, www.aera.net
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt82h.htm

Website: www.rasch.org/rmt/contents.htm