CTIT University of Twente
Research Business & Innovation About CTIT Research Calls Looking for a job? Intranet

Better Testing with Game Theory

Project Number: 612.001.303

Project Manager: dr. Mariëlle Stoelinga

Faculty of Electrical Engineering, Mathematics and Computer Science

Tel.: +31-53-4893773

Email: m.i.a.stoelinga@utwente.nl

Project website: BEAT

Summary

Motivation. Testing is an important means to assess and improve the quality of ICT systems. At the same time, testing is costly and time consuming, often consuming 50% of the development budget. The goal of the BEAT project is to improve test effectiveness and efficiency by using mathematical game theory, yielding higher system quality at lower costs.

Approach. Testing is naturally phrased as a game, where the tester tries to find faults, playing against the system-under-test (SUT). Also, testing is by nature an optimization problem, asking for a test suite with maximal impact within a given budget.

Aim of the BEAT project is to develop a model-based testing framework that allows one to automatically derive an optimal test suite for a wide range of optimality criteria, including cost, impact, coverage, and risk.

Scientific challenges are (1) to phrase the model-based test theory in terms of mathematical games, so that test cases coincide with game strategies. (2) to develop game-theoretic strategy synthesis algorithms for test optimization (3) to implement these algorithms in our test tool JTorX and perform quantitative assessment of our framework on realistic case studies.  

Project duration: 1 June 2014 – 5 August 2018

Project budget: 216.6 k-€ funding

Number of person/months: 48 person months

Involved groups: Formal Methods & Tools group