The user is able to discover the content by simply moving their finger across the screen. The various highlighted elements all have a different vibration. The audio starts automatically. The possibilities in terms of content are limitless: buildings, paintings, applied art, historical objects and maps; as long as there is a digital image available, content can be created.
The hardware consists of a tactile overlay made up of small dots, which allows the user to feel the surface of a screen. In this case a Samsung tablet. The software is calibrated in a way that individual dots, or a groups of dots vibrate, when touched. The vibrations can be programmed into many different settings. In addition, there is a possibility to add pre recorded audio to whatever part of the screen is highlighted.
In this test case, we incorporated an image of the Groninger Museum building and a painting from the collection. With the software, we were able to highlight any element of the digital images and enrich them with both sensory and auditory feedback. The sensory feedback was given through different vibrations, the auditory feedback was given through audio descriptive storytelling.
Highlighted elements of the painting