Rasch Item-bank Open Source Project

Purpose

The purpose of the Rasch Item-bank Project is to create an objective and highly reliable numeracy assessment tool, which is free and available to children all over the world.

There is an abundance of commercial education software on the web and there are many free games or game-like education applications, but there are few serious measurement tools. The idea of this project is to create a self-assessment tool enabling children in sub-Saharan Africa or the mountains of Peru to be measured on the same scale as children from central London or Manhattan.

Theory

The project is inspired by the chapters in Probabilistic Models (Rasch 1960), which deal with reading rates (Chapters 3 and 9). The software applies the arguments in those chapters to use the scoring rates directly to estimate item difficulty and student ability.

Scoring rates are defined as the reciprocal of the time taken (in fractions of a minute) to complete each item. Timing item responses invisibly on each item averts the theoretical and practical concerns expressed in the literature (Ebel, 1979, Meijer, 1993, Halkitis, Jones & Pradhan, 1996) over tightly timed pencil and paper tests.

Research by the project owner (Hippisley & Douglas, 1998) indicates that scoring rates on number skill tests make a highly reliable metric. Scoring rates on individual items correlate well with each other, with the mean rates on whole sessions, and with mean rates on other sessions by the same student.

Method

The method of the software is:

· To serve up test items from a bank of items stored on a file server;

· To record a dichotomous item score on each item;

· To record the scoring rate (reciprocal of the time taken) on each item;

· To adjust the difficulty of items served in response to the ability implied by the results on items previously served;

· To record a unique session parameter for each student test session;

· To return the items scores, scoring rates and session parameters to the server.

By default, for the purpose of Rasch analysis the session replaces the student. This enables anonymous data to be collected and analyzed, without contravening the data

protection and privacy laws, which apply in many countries. In cases where permission has been granted to record data against students, actual students can be used in the analysis.

Roles of the project owner

· To create source code for a demonstration web based application (done);

· To make the demonstration application available on a public server (done);

· To analyze data from the application and refine item grouping.

· To raise awareness of the project and the application.

Possible roles of future participants

· Programmers may create source code for the generation of additional test items;

· Researchers may use the published application to carry out addition research, perhaps further researching the reliability of the application, or correlating results with other instruments;

· Teachers may simply use the application for their own diagnostic purposes.

Resources

· Project URL: http://java.net/projects/rasch-itembank/

· Demonstration application URL: http://softway.org/PP120101/AMJApp.php.

Project owner
Jonathan Hippisley, PhD
Email: jhipp\at/softway.org

References

Ebel, R.L. (1979) Essentials of Educational Measurement Prentice Hall, New Jersey.

Halkitis, P.N., Jones, P.J., Pradhan, J. (1996) Estimating Testing Time: The Effects of Item Characteristics on Response Latency ED397119

Hippisley, J., Douglas, G. (1998) The reliability and validity of an interactive arithmetic test British Journal of Education Technology, 29(4), 303-320

Meijer, J. (1993) Learning potential, personality characteristics and test performance Learning Potential Assessment: Theoretical methodological and practical issues (Hamers JHM, Sijtsma K, Ruijssenaars JM Eds) Swets and Zeitlinger, Amsterdam, NL 341-362

Rasch, G. (1960) Probabilistic models for some intelligence and attainment tests University of Chicago Press, Chicago


Rasch Item-bank Open Source Project. Jonathan Hippisley … Rasch Measurement Transactions, 2012, 26:2 p. 1370




Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
May 17 - June 21, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 12 - 14, 2024, Wed.-Fri. 1st Scandinavian Applied Measurement Conference, Kristianstad University, Kristianstad, Sweden http://www.hkr.se/samc2024
June 21 - July 19, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 5 - Aug. 6, 2024, Fri.-Fri. 2024 Inaugural Conference of the Society for the Study of Measurement (Berkeley, CA), Call for Proposals
Aug. 9 - Sept. 6, 2024, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

 

The URL of this page is www.rasch.org/rmt/rmt262g.htm,

Website: www.rasch.org/rmt/contents.htm,