| Rating Scale Instrument Quality Criteria | |||||
|---|---|---|---|---|---|
| Criterion | Poor | Fair | Good | Very Good | Excellent |
| Targeting * | > 2 errors | 1-2 errors | < 1 error | < .5 error | < .25 error |
| Item Model Fit Mean-Square Range Extremes | < .33 - >3.0 | .34 - 2.9 | .5 - 2.0 | .71 - 1.4 | .77 - 1.3 |
| Person and Item Measurement Reliability | <.67 | .67-.80 | .81-.90 | .91-.94 | >.94 |
| Person and Item Strata Separated | 2 or less | 2-3 | 3-4 | 4-5 | >5 |
| Ceiling effect: % maximum extreme scores | >5% | 2-5% | 1-2% | .5-1% | <.5% |
| Floor effect: % minimum extreme scores | >5% | 2-5% | 1-2% | .5-1% | <.5% |
| Variance in data explained by measures | <50% | 50-60% | 60-70% | 70-80% | >80% |
| Unexplained variance in contrasts 1-5 of PCA of residuals | >15% | 10-15% | 5-10% | 3-5% | <3% |
| This Table has been developed by William P. Fisher, Jr. based on the Rasch literature and his many years of experience conducting Rasch analyses in different settings. | |||||
* How far the average or modal measure is from the center of the item calibrations. Just as a rough indication, if the average measure is less than one error of measurement from the center of the item hierarchy, then the instrument is on target. The average individual error of measurement made more sense to me to use than the SE of the mean, as this latter can be quite small. Of course, an instrument might not have items that go as far up or down the scale as the measures go, so some indication of how well the measure and calibration distributions match would also be in order.
Rating Scale Instrument Quality Criteria. Fisher, W.P. Jr. … Rasch Measurement Transactions, 2007, 21:1 p. 1095
| Rasch Publications | ||
|---|---|---|
| Rasch Measurement Transactions (free, online) | Rasch Measurement research papers (free, online) | Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch |
| Applying the Rasch Model 2nd. Ed., Bond & Fox | Best Test Design, Wright & Stone | Rating Scale Analysis, Wright & Masters |
| Introduction to Rasch Measurement, E. Smith & R. Smith | Introduction to Many-Facet Rasch Measurement, Thomas Eckes | Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. |
| Statistical Analyses for Language Testers, Rita Green | Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar | Journal of Applied Measurement |
|
|
|
| Forum | Rasch Measurement Forum to discuss any Rasch-related topic |
Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement
Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.
| Coming Rasch-related Events | |
|---|---|
| May 15-17, 2013, Wed.-Fri. | In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| May 20-22, 2013, Mon.-Wed. | In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| May 31 - June 28, 2013, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
| June 7, 2013, Fri. | SPHERE workshop: Response-Shift and subjective measures in health science, Nantes, France, www.sphere-nantes.fr/ |
| June 19-21, 2013, Wed.-Fri. | SIS 2013 Conference on Advances in Latent Variables: Methods, Models and Applications, Brescia, Italy, meetings.sis-statistica.org/index.php/sis2013/ALV |
| July 1 - Nov. 30, 2013, Mon.-Sun. | Online Course: Introduction to Rasch Measurement Theory (D. Andrich, RUMM), uwa.edu.au |
| July 5 - Aug. 2, 2013, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
| Aug.1-5, 2013, Thur.-Mon. | TERA-PROMS Annual Meeting, Kaohsiung, Taiwan, tera.education.nsysu.edu.tw |
| Aug. 9 - Sept. 6, 2013, Fri.-Fri. | On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com |
| Aug. 22, 2013, Thursday. | Symposium in honor of Svend Kreiner, Copenhagen, Denmark, biostat.ku.dk/kreinersymposium |
| Sept. 4-6, 2013, Wed.-Fri. | IMEKO TC1-TC7-TC13 Symposium: Measurement Across Physical and Behavioural Sciences, Genoa, Italy, www.imeko-genoa-2013.it |
| Sept. 13 - Oct. 11, 2013, Fri.-Fri. | On-line workshop: Rasch Applications in Clinical Assessment, Survey Research, and Educational Measurement (W.P. Fisher), www.statistics.com |
| Sept. 18-20, 2013, Wed.-Fri. | In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| Sept. 23-25, 2013, Mon.-Wed. | In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| Sept. 26-27, 2013, Thurs.-Fri. | In-person workshop: Advanced Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| Oct. 18 - Nov. 15, 2013, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com |
| Oct. 20 - Oct. 25, 2013, Sun.-Fri. | International Association for Educational Assessment (IAEA) 39th Annual Conference, Tel Aviv, Israel, www.iaea-2013.com |
| Dec. 11-13, 2013, Wed.-Fri. | In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| March 12-14, 2014, Wed.-Fri. | In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| May 14-16, 2014, Wed.-Fri. | In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| May 19-21, 2013, Mon.-Wed. | In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| July 4 - Aug. 1, 2014, Fri.-Fri. | On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com |
| Aug. 8 - Sept. 5, 2014, Fri.-Fri. | On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com |
| Sept. 10-12, 2014, Wed.-Fri. | In-person workshop: Introductory Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| Sept. 12 - Oct. 10, 2014, Fri.-Fri. | On-line workshop: Rasch Applications in Clinical Assessment, Survey Research, and Educational Measurement (W.P. Fisher), www.statistics.com |
| Sept. 15-17, 2014, Mon.-Wed. | In-person workshop: Intermediate Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| Sept. 18-19, 2014, Thurs.-Fri. | In-person workshop: Advanced Rasch (A. Tennant, RUMM), Leeds, UK, www.leeds.ac.uk/medicine/rehabmed/psychometric |
| The javascript to add "Coming Rasch-related Events" to your webpage is: <script type="text/javascript" src="http://www.rasch.org/events.txt"></script> | |
The URL of this page is www.rasch.org/rmt/rmt211m.htm
Website: www.rasch.org/rmt/contents.htm