Share

ABILITY, a digital accessibility revolution for the visually impaired

La tablette telle que présentée à Embedded World en 2024, deux mains parcourent une carte sur la tablette.
The user explores a map with their fingers to find points of interest.© CEA
In a digital world dominated by sight and sound, visual disabilities pose accessibility challenges, especially for graphical content. To make digital content accessible, we’ve developed the world’s first multisensory tablet as part of the European ABILITY project, leveraging CEA-List’s innovative haptic technologies.

We took a conventional tablet and integrated localized, multi-point, vibrotactile feedback capability as well as AI algorithms for image analysis/simplification, text extraction, and predictive input.

This vibrotactile feedback is output by a matrix of piezoelectric actuators in the form of a patch, glued directly under the screen using cleanroom-compatible processes developed by CEA-Leti. The first 10.5-inch OLED tablet prototype is now ready for testing by target users. The localized, multi-point tactile feedback, made possible by CEA-List efforts, has a wide range of practical use cases—from already-common confirmation vibrations, to button feedback that matches input force, to even more complex and rich experiences, such as textures.

For example, a visually impaired person who wants to familiarize themselves with a travel route can pull up a map on their tablet and explore it with both hands (in particular to use a second finger as a reference point). They can feel the different elements of the map—the road, buildings, open spaces, etc.—thanks to different textures assigned to each one and triggered on contact, with an added effect of attraction toward the destination.

Left: Prototype 10.5-inch screen. Right: Illustration of colored zones and their associated haptic effects. ©CEA

This multisensory tablet aims to use other visual and auditory feedback to adapt to users’ varying needs and forms of visual impairment.

Chiffres clés

1 patent

+ 1 patent before the project

3 publications

and 2 publications before the project

Contributed to this article:

  • Sabrina Panëels engineer-researcher coordinator of the ABILITY project at CEA-List
  • Charles Hudin engineer-researcher at CEA-List