Human-centered design of vibrotactile wearables for persons with a visual impairment
Due to the COVID-19 crisis measures the PhD defence of Hendrik Buimer will take place online.
The PhD defence can be followed by a live stream.
Hendrik Buimer is a PhD student in the research group Biomedical Signals and Systems (BSS). His supervisor is prof.dr. R.J.A. van Wezel from the Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS).
The aim of the research presented in this dissertation was to explore the opportunities that novel technologies, such as wearable consumer electronics, offer to support persons with a visual impairment (PVIs) in their daily lives by following the principles of human-centered design. We identified problems of daily life for PVIs and explored wishes and needs for the development and innovation agenda of wearable technologies. It was decided to focus on recognition of nonverbal communication and navigation in unknown environments.
We developed and evaluated a wearable system consisting of a head mounted camera, a tablet running emotion recognition software, and a haptic belt with small vibration motors to convey information to its users. Haptic feedback was chosen over other means of feedback to keep the eyes and ears of users free, as PVIs are highly dependent on their hearing – and in some cases remaining vision – to perceive their surroundings.
Initially we found that, under ideal conditions, vibrotactile cues can be used to convey facial expressions of emotions to PVIs in real-time. After making adjustments based on feedback, the research continued under more realistic conditions. Additionally, we explored whether a wearable GPS based navigation system using the same vibrotactile belt could support PVIs to find their way in unfamiliar outdoor environments. Despite positive comments from the participants, we concluded the system required improvements in performance and wearability before it is ready to use in interactions and wayfinding.
Our studies showed that participants can learn, interpret, and use the vibrotactile signals conveyed by the system easily and that they are enthusiastic about the concept. Although various technical and usability challenges were identified which need to be addressed in future development, the research has led to valuable insights in the possibilities that tactile feedback offers to support PVIs in their daily lives.