Machine Learning For Medical Applications

This course is open
to external participants
as well as UT students
Enrol now!

About this course

Past decade has seen a quantum shift in how computers perform pattern recognition tasks.  A new paradigm, popularly described as machine learning, has been invented to “teach” computers how to solve problems such as classification, segmentation, and pattern recognition. The old paradigm for solving these problems in classical computer vision consisted of explicitly programming into the software, task specific features. For example, in order teach a program how to recognize human faces in an image, one would explicitly code into the software features that define a human face.

By contrast, the new paradigm of machine learning programs a computer by providing it with example data. The computer adapts its behavior by learning from these examples, much like a child learns from its surroundings. Machine learning concerns the recognition of complex patterns in observed data in order to automatically make decisions about patterns hidden in that data.

We are surrounded by examples of this new paradigm. The success of face or other object recognition programs, ability to use images instead of keywords in a search query, and the fidelity with which modern translation programs are able to transform prose from one language to another, are just a few examples of machine learning algorithms. A confluence of three trends —namely, massive computation power, easy availability of “big” data (e.g., through social media), and advent of a new computational architecture called deep neural networks— has made such rapid and widespread adoption of machine learning feasible.

Just as this paradigm has fundamentally altered the discourse on the social media and the internet, machine learning will fundamental alter nearly all aspects of medical practice of future. Medical systems, e.g., CT and MRI scanners, ECG machines, EEG and other physiologic monitors, produce huge amounts of data that often contain abundant information. Only a fraction of this information is important for the diagnosis. The new paradigm of machine learning raises several deep and incisive questions.

Can machine learning automate and help to extract relevant information from vast amounts of medical data?

  • What are the various paradigms for organizing and extracting relevant information?
  • Is it possible to teach a computer to make automated decisions after a session of example-driven learning?
  • More fundamentally, can we make a medical diagnostician obsolete, relegating the diagnostic exercise to a computer?

These are the central questions that we will be addressing in this course.


This course will help a student acquire knowledge, skills and insight in machine learning in the domain of medical imaging and sensor data. The course will begin with an introduction to the classical techniques in classification, supervised and unsupervised learning, and regression. This will be followed by the newly developed field of machine learning. While the concepts are general, the focus will be on medical applications of these concepts.

Examples of polyp, ischemic stroke, retrained surgical hardware (sponge) after surgery, and subarachnoid haemorrhage. Can a computer learn to automatically detect them after looking at thousands of such examples?


The course addresses the machine learning and deep learning paradigm for classification and pattern recognition in vast amounts of data. Examples: how can we program a system in such a way that anomalous frames in an endoscopic video stream are detected automatically? how can we delineate an anatomical structure? In the machine learning paradigm, the solution is found by providing the system with a large number of examples from which, in a training stage, the system tries to generalize. Once trained, the system is then ready to be used on any individual image in the operational stage.

This course is an introduction to machine learning and deep learning. The topics are structured as follows:

  1. Architectures for classification and regression
  2. Overfitting, underfitting, and the generalization gap
  3. Strategies for learning
  4. Convolutional neural networks for image segmentation
  5. Hardware and software platforms
  6. The medical context and significance of machine learning

The course is organized in a daily pattern consisting of:

  • Clinical context and clinical relevance of the topic of that day
  • Introduction to the theory
  • Matlab hands-on exercise
  • Re-cap, closing remarks, and closure of the day

The students will be expected to program extensively by themselves. This will enable them to quickly apply their newfound knowledge and learn the material from a practical stand point.


This course is intended for PhD students and young scientists with a background in Biomedical Technology, Technical Medicine, and related fields. It is primarily intended for students who have a need for more insight in machine learning with application to medical image data.

The course assumes a background in programming. In addition to the medical relevance of the topics being covered, the exposition to the theoretical concepts will be made more concrete by a set of well selected programming exercises.

Some familiarity and experience with Matlab and with vector-matrix calculus is a prerequisite for this course.


The course is organized by:

  • Prof Rajiv (Raj) Gupta, MD, PhD – Massachusetts General Hospital and Harvard Med School
  • Dr Ferdinand (Ferdi) van der Heijden, PhD – University of Twente
  • Dr Beril Sirmaçek, PhD – University of Twente

under the auspices of the Technical Medicine department of the University of Twente in collaboration with the Medical Imaging group of the MIRA Institute for Biomedical Technology and Technical Medicine.


  • The course is part of the regular UT curriculum and welcomes attendance from external participants
  • The course will run from 28 May – 1 June 2018

For UT Master students

  • Attending the course is free of charge for UT master students
  • The course will represent 1.5 EC
  • This ML course is part of the optional course “3D Computer Vision for Medical Applications” (5 EC). If you enrol yourself for that course, then you are automatically also enrolled for this ML course
  • Enrol yourself in OSIRIS for either the 5 EC or the 1.5 EC course

For other participants

In case you want to be contacted in order to answer any further questions, please fill out this information request form. We will contact you as soon as possible.