RCEC Workshop on IRT and Educational Measurement
University of Twente, October 12 – October 14, 2016
Keynote: Ph.D. Alina A. von Davier, ACTNext, USA
The 7th RCEC Workshop on Item Response Theory and Educational Measurement will be held at the University of Twente in Enschede from Wednesday, October 12th, through Friday, October 14th , 2016. The workshop will start with a 1-day seminar by Alina von Davier.
Attendants are invited to present their work during the second and third day of the workshop.
The keynote speaker, Alina von Davier is Vice President of the division Research and Innovation at ACTNext. She also is an Adjunct Professor at Fordham University. At ETS, von Davier was responsible for developing a team of experts and a psychometric research agenda in support of next generation of assessments. Computational psychometrics, which include machine learning and data mining techniques, Bayesian inference methods, stochastic processes and psychometric models are the main set of tools employed in her current work. She also works with psychometric models applied to educational testing: test score equating methods, item response theory models, adaptive testing. She published several books, authored or edited; she also published numerous papers in peer reviewed journals.
Seminar by Alina A. von Davier.
In this workshop I will introduce the basic concepts of computational psychometrics (CP; , ), focusing on data mining, machine learning, and data visualization with applications in assessment. CP merges the data driven approaches with the theoretical (cognitive and psychometrics) models to provide a rigorous framework for the measurement of skills in the presence of Big Data. I will discuss five types of big data in educational assessment: a) ancillary information about the test takers; b) process data from simulations and games; c) data from collaborative interactions; d) data from multimodal sensors; and e) large data sets from tests with continuous administrations over time.
Learning technology offers rich data for developing novel educational assessments. It is also increasingly recognized that technology designed for learning and assessment can be enhanced by reliable measurement of target constructs. However, the data obtained from learning and assessment technologies are typically “complex,” in the sense that they involve sources of statistical dependence that violate the assumptions of conventional psychometric models. These data are also referred to process data. Complex assessment data have also been hypothesized to involve a variety of “non-cognitive” factors such as motivation and social skills, thereby increasing the dimensionality of the measurement problem and the potential for measurement bias. The question is how can one measure, predict, and classify test takers’ skills in a simulation or game-based assessment? DM and ML tools merged with the theoretical (cognitive) models may help answer this question. For data that consist of test scores and background questionnaire data over many administrations from a test with an almost continuous administration mode one research question may be about patterns in the data, another question may be whether tests scores for specific subpopuations can be predicted as part of the quality control efforts .
I will discuss similarities and differences between machine learning and statistical inference and will present several free software available for machine learning and visualization, such as WEKA, MIRAGE, and routines in R. I will also present examples of research projects and applications in assessment.
Participants are invited to present papers themselves. The topic of these papers have to be
related to the broad area of Item Response Theory and Educational Measurement. Please fill inthe (preliminary) title of your presentation in the registration form.
Participation fees are € 350,-. for course and the workshop. Lunches and a workshop dinner are included in the fee. It is also possible to attend only the course (€ 150) or the workshop (€ 250).
You will receive an invoice upon registration.
Accommodation can be reserved at conference hotels, Drienerburght at the Campus of the University. We will take care of the reservation of your room. Note: You have to pay the room yourself upon arrival.
For questions and further information, please do not hesitate to contact Birgit olthof (secretariat RCEC)
Theo Eggen and Bernard Veldkamp