Course: Analysis of Measurement Instruments (Glas and Fox)

Analysis of Measurement Instruments: Introduction to classical test theory, item response models and multilevel item response models

Target: The course provides an introduction on classical and modern test theory and its major applications, such as the construction of measurement instruments, linking and equating measurements, evaluation differential item functioning, optimal test construction, computerized adaptive testing and the evaluation of large-scale dicational surveys such as PISA and TIMSS. The introduction is broad and on a conceptual level, but references will be provided to the more technical aspacts such as estimation and testing of the models.

The second part of the course will focus on Bayesian item response modeling. An introduction will be given to the important features of the Bayesian modeling approach, which will be illustrated with real data examples using software packages WinBUGS and R. The practicals will focus on standard software, but interested students will also be given the opportunity to get acquinted with Baysian modeling software.

Tutors:

Prof. Dr. Cees Glas (http://www.utwente.nl/gw/omd/afdeling/Glas/)

Dr. Jean-Paul Fox, (www.Jean-PaulFox.com)

Ir. Marianna Avetisyan.

Maximum number of participants: 25

Registration for this course is closed.

Date and Venue: November 15th – 18th 2010, University of Twente, Enschede, Netherlands.

Prior Requirements:

Knowledge of statistics and methodology in the field of the behavioral and social sciences

Literature:

J. Scheerens, S. Thomas, & C.A.W. Glas. Educational evaluation and monitoring: A systemic approach. Swets and Zeitlinger Publishers.

Fox, J.-P. (2010). Bayesian Item Response Modeling: Theory and Applications. Springer, New York.

Work method

The course takes 4 full days. Every session consists of a lecture of approximately 2.5 hours and a computer workshop of approximately 3 hours.

For your registration, please use the registration form below. Participants will be accepted by order of application date, the number of participants is limited to 25 persons.

Participants are required to bring their own laptop with Windows (XP or higher) as operating system (also Mac with Windows via Boot Camp). The programs R and WinBugs have to be installed. Instructions for the installation of both packages will be send. Programs from the tutors will be given during the course.

Accommodation: There are various hotels in Enschede, some are located near the University of Twente (we will send information after registration). Seminar fee and payment: The participation fee is 150,00 € for non-IOPS students. Reductions or refunds are not possible. Travel costs, accommodation and meals are not included. Please make your own arrangements.

Contents

In general, the course provides an overview of classical and modern test theory discusses the coherence of the various theories and deals with the application of test theory for developing and evaluating measurement instruments for the social sciences.

Preliminary Schedule

Overview

A preliminary schedule is given below. The course consists of four days. The lectures will be given in the morning and the practicals in the afternoon. On Monday 15 nov and Tuesday 16 nov, Professor Cees Glas will discuss classical and modern test theory techniques. Wednesday (17) and Thursday (18), Dr Jean-Paul Fox will discuss the topics Bayesian (response) modeling and Bayesian item response modeling where attention will be paid to clustered response data.

Participants and fee

Around 25 participants have registered for the course. The participation fee for the non-IOPS students is 150,- €. An invoice will be send to the address given at registration. Contact Birgit Olthof (Birgit.Olthof@utwente.nl) if this is not correct. Please inform Birgit Olthof when you will not be able to follow the course (although you have registered). There are students on a wait list who would like to follow the course.

Location

The course will take place in room 1.03 in the Chalet at the University of Twente, Enschede, The Netherlands. Each participant will receive an account to connect wireless to the internet. (A wired connection is not possible). This account will be a guest account for one week.