On this page you can find more information about the analysis and evaluation of your test results. As a lecturer you want to know how reliable and valid your test really was. By doing an analysis of the results you can see how students performed and if any adjustments (for the next time) are needed. Based on the analysis you can also formulate improvement points for the next exam.
- Contest: Automated Multiple Choice exams, reports and analysis: The University of Twente offers a service for automated processing and grading of multiple choice exams. Students fill out their answers on scannable forms, and lecturers receive automatically calculated grades and reports. This document contains a brief overview of the available reports.
- Using SPSS for item analysis :This document describes how you can use SPSS for analyzing your test results.
- Excel Spreadsheets for Classical Test Analysis: this site designed and maintained by Prof. Glenn Fulcher. The Excel spreadsheets on this website calculate the basic statistics developed in classical test analysis for closed response items such as multiple choice. These include distractor analysis, item facility, a discrimination index, reliability, and descriptive statistics (mean, standard deviation, and standard error of measurement).
- Template for a combination of mc and essay questions: This excel template helps you in analyzing your combined exam.
Some more software:
- TAP (free): TAP is a program written in Delphi Pascal that performs test analyses and item analyses based on classical test theory. TAP is a classical test and item analysis program. It provides reports for examinee total scores, item statistics (e.g., item difficulty, item discrimination, point-biserial), options analyses, and other useful information
- Matlock‐Hetzel, S. (1997). Basic concepts in item and test analysis: An explanation about the basic concepts in item and test analysis.
Learning analytics is the collection, analyses and interpretation of data about students in education, with the purpose to improve the quality of education (SURF - learning analytics). As a teacher it can give you insights into the activities of students, but also as a student it can be helpful to get insight in your own learning activities and performance.
Application learning analytics with assessment
The collection of data received by learning analytics can consist of tests grades, learning activities, learning goals etc. Therefore, data received from assessment activities can be combined with other data. For example, tests results with learning materials. Hereby, you can analyse the relation between the students' results and the used materials, which subsequently can give you insight into your choice of these learning materials.
Literature & websites
- In search for the most informative data for feedback generation: Learning Analytics in a data-rich context - Tempelaar, Rienties, Giesbers, 2014.
Interpreting test results: understanding how to interpret the useful statistics concerning your students' multiple-choice test scores will help you construct well-designed tests and improve instruction.