Skip to content

Output actuators and action feedback

Action feedback is a crucial aspect of accessibility for blind people who use devices. It allows them to know what is happening on the screen and interact with the device effectively. Without action feedback, blind people may have difficulty using devices and may be excluded from certain activities or experiences (Craig, 2021).

One of the key benefits of action feedback is that it provides blind people with information about what is happening on the screen. For example, when a blind person uses a smartphone, they may not be able to see the app icons or buttons on the screen. With action feedback, they can hear an audible notification or feel a physical sensation when they touch a button, allowing them to interact with the device more easily.

Action feedback can also help blind people navigate and use devices more efficiently. For example, when using a navigation app, action feedback can provide spoken turn-by-turn directions, allowing the user to know when to turn left or right without having to constantly look at the screen. When using a social media app, action feedback can provide notifications when a new message is received, allowing the user to stay up-to-date without constantly checking the app. It can also enhance the overall user experience for blind people. For example, when using a music app, action feedback can provide haptic feedback when a song is paused or skipped, allowing the user to feel the music and enjoy the app more (Craig, 2021).

Overall, action feedback is an essential component of accessibility for blind people who use devices. It provides important information, improves navigation, and enhances the user experience. By including action feedback in the design of devices and apps, developers can help ensure that blind people are not excluded from using these technologies.

Types of feedback

There are a few different ways that a physical remote can provide action feedback to blind users. Some of the most effective strategies include: - Using haptic feedback to indicate when a button has been pressed. This could involve the remote vibrating or providing a distinct sensation that the user can feel (Ahmad, 2021). - Using audio feedback to indicate when a button has been pressed. This could involve the remote playing a brief sound or tone to let the user know that their action has been registered. - Using both haptic and audio feedback together, to provide a more complete and intuitive experience for the user. - Providing clear, concise instructions for navigating and using the remote, using plain language that is easy for blind users to understand.

Overall, the key is to make the remote as intuitive and user-friendly as possible for blind users, while providing clear, consistent feedback that helps them understand what is happening and how to use the device effectively.

To elaborate on the previous list of ways that a physical remote can provide action feedback to blind users, it is important to consider the specific needs and challenges that blind users face when using a remote control. By providing haptic and audio feedback, the remote can help blind users understand what is happening and how to navigate and use the device effectively.

Haptic feedback, such as vibrating or providing a distinct sensation when a button is pressed, can help blind users understand that their action has been registered and that the remote is responding to their input. This can be particularly helpful for blind users who may not be able to hear the audio feedback, or who may have difficulty distinguishing between different tones and sounds (Yirka, 2022).

Audio feedback, such as playing a brief sound or tone when a button is pressed, can also be useful for blind users. This can help them understand what is happening and provide confirmation that their action has been registered. It can also be used to provide more detailed information, such as the current channel or volume level, which can be difficult for blind users to discern using visual cues alone.

By using both haptic and audio feedback together, the remote can provide a more complete and intuitive experience for blind users. For example, the haptic feedback could indicate that a button has been pressed, while the audio feedback could provide more detailed information about the current state of the device or the action that has been performed.

In addition to providing feedback, it is also important to provide clear, concise instructions for navigating and using the remote. This should be done in plain language that is easy for blind users to understand, and should include information about the button layout and the functions of each button.

Considering bad hearing

In order to be inclusive of both blind and deaf users, it is important to provide multiple forms of feedback that can be accessed using different senses. In the case of a physical remote, this could include a combination of haptic feedback and audio feedback.

  • Haptic feedback, such as vibrating or providing a distinct sensation when a button is pressed, can be accessed by blind users and users who are deaf (Yirka, 2022). This can help them understand that their action has been registered and that the remote is responding to their input.

  • Audio feedback, such as playing a brief sound or tone when a button is pressed, can be accessed by blind users who are not deaf (Comparison of Feedback Modes for the Visually Impaired: Vibration Vs. Audio, n.d.). This can help them understand what is happening and provide confirmation that their action has been registered in a more effective way since this method allows for more specific information.

Haptic feedback

There are a few different types of haptic feedback that can be suitable for blind people. Some examples include:

Vibration

This type of haptic feedback involves the remote vibrating or shaking when a button is pressed. This can provide a distinct sensation that can be felt by the user, allowing them to understand that their action has been registered.

Single-pulse vibration involves the remote vibrating or shaking briefly when a button is pressed. This can provide a distinct sensation that can be felt by the user, allowing them to understand that their action has been registered. Single-pulse vibration can be useful for providing simple, straightforward feedback, such as indicating that a button has been pressed (v.padasinavik@teslasuit.io, 2022).

Multi-pulse vibration involves the remote vibrating or shaking multiple times when a button is pressed. This can provide a more complex sensation that can be felt by the user, allowing them to understand more detailed information about the action that has been performed. For example, the remote could vibrate twice to indicate that a button has been pressed twice in quick succession, or could vibrate with different intensities to indicate different actions or functions (Ahmad, 2021).

Continuous vibration lets the remote vibrate or shake continuously while a button is held down. This can provide a sustained sensation that can be felt by the user, allowing them to understand that the action is ongoing and that the remote is responding to their input (Yirka, 2022). Continuous vibration can be useful for providing feedback about actions that require sustained input, such as holding down a button to increase the volume or navigate through a menu.

Variable vibration involves the remote vibrating or shaking with different intensities or patterns depending on the action that has been performed. This can provide a more detailed and nuanced form of feedback that can be felt by the user, allowing them to understand more complex actions or functions. For example, the remote could vibrate more strongly when a button is pressed firmly, or could vibrate in a specific pattern to indicate a specific action or function.

Taptic engine image Apple

Apple’s taptic engine responsible for device vibration

Comparatively, the vibrotactile feedback system is simple, cheap, easily powered and controlled. It has been in use in many devices, for example, mobiles phones, steering wheels, game controllers, and smartwatches. It requires hardly any tracking parameters and has a small power consumption.

But the downside is that vibrating motors cannot stipulate the depth and diversity of sensations. It may be irritating as compared with other stimulators. Further vibration motors are difficult to miniaturize efficiently and could negatively affect ligaments and joints.

Pressure or force-feedback

This type of haptic feedback makes the remote apply pressure or resistance when a button is pressed. This can provide a distinct sensation that can be felt by the user, allowing them to understand that their action has been registered. It is the kind of haptic technology that appeared first (starts in the late 1960s). Therefore, it is the most studied and well-implemented in different applications so far.

Force feedback stimulates the ligaments and muscles through our skin into the musculoskeletal system, whereas any other types of haptics affect top layers of skin receptors (technology called transcutaneous electrical nerve stimulation —TENS). The cutaneous devices (involving the outer layer of the skin) are quite compact and apply the acupressure on small areas of the body.

Electro tactile feedback

Electro tactile feedback uses electrical current to stimulate the skin nerves via electrodes placed on the skin’s surface. It affects not only the receptors but also the nerve ending with electrical impulses. Electrical impulses can activate any sensation by sending a small pulse to the electrode with varying amplitude, frequency, and amperage. While this technology is promising, it is not widely used in consumer electronics yet (Pamungkas, n.d.).

Temperature

This type of haptic feedback makes the remote change temperature when a button is pressed. For example, the remote could become warmer or cooler when a button is pressed (User Feedback on Usefulness and Accessibility Features of. . . : Indian Journal of Ophthalmology, n.d.). This can provide a distinct sensation that can be felt by the user, allowing them to understand that their action has been registered.

Texture

This type of haptic feedback makes the remote change texture when a button is pressed. For example, the button could become rough or smooth when pressed. This can provide a distinct sensation that can be felt by the user, allowing them to understand that their action has been registered.

The key is to provide haptic feedback that is distinct, intuitive, and easy for blind users to understand and use. By doing this, the remote can be made more user-friendly and accessible for blind users, and can help them use the device more effectively and efficiently.

Audio feedback

Verbal feedback

This type of audio feedback uses speech or synthesized speech to provide information to the user. For example, the remote could speak the current channel or volume level, or it could announce the status of the battery or other settings. Verbal feedback can be particularly helpful for blind users who may not be able to see the screen or other visual indicators on the remote (Comparison of Feedback Modes for the Visually Impaired: Vibration Vs. Audio, n.d.).

Auditory cues

These are sounds that are used to indicate the status of the remote or provide directional information. For example, a short beep could indicate that a button has been successfully pressed, while a longer beep could indicate an error or warning. Auditory cues can be helpful for providing feedback without interrupting the user’s audio experience, such as when watching a movie or listening to music.

Sonification

This involves using sound to represent data or information in a way that can be understood by the user. For example, the remote could use different pitches or tones to indicate different channels or settings (Comparison of Feedback Modes for the Visually Impaired: Vibration Vs. Audio, n.d.). Sonification can be useful for providing information that is not easily conveyed using speech or other audio feedback, such as data or complex information.

Selection for the Steap-hear remote solution

Since not all step-hear users are deaf, it would be a combination for both Haptic feedback and Audio feedback. Other types of feedback require a greater amount of research & development and may not be more effective for this scenario.

Specific feedback solutions will have to be determined on the actual remote design. Variables like size of the remote, weight, functionality and power requirements are vital to make a decision.

The chosen options are: - Vibration (haptic feedback) - Audio tones

Sources

Pamungkas, D. S. (n.d.). Overview Electrotactile Feedback for Enhancing Human Computer Interface. IOPscience. https://iopscience.iop.org/article/10.1088/1742-6596/1007/1/012001

v.padasinavik@teslasuit.io. (2022, September 26). What is Haptic Feedback? Types, devices and use | Teslasuit Blog. Teslasuit. https://teslasuit.io/blog/haptic_feedback/

Craig, A. (2021, December 10). Designing and Developing your Android Apps for Blind Users (Part 1). Medium. https://medium.com/@AlastairCraig86/designing-and-developing-your-android-apps-for-blind-users-part-1-cc07f7ffb5df

Yirka, B. (2022, January 24). Haptic feedback sleeve and goggles allow blind people to “see” with their arm. https://techxplore.com/news/2022-01-haptic-feedback-sleeve-goggles-people.html

Comparison of Feedback Modes for the Visually Impaired: Vibration vs. Audio. (n.d.). https://www.yorku.ca/mack/hcii2018a.html

User feedback on usefulness and accessibility features of. . . : Indian Journal of Ophthalmology. (n.d.). LWW. https://journals.lww.com/ijo/Fulltext/2021/03000/User_feedback_on_usefulness_and_accessibility.16.aspx

Ahmad, N. (2021, October 13). Haptic Feedback: How it Brings in Inclusivity and Accessibility. Algoworks. https://www.algoworks.com/blog/haptic-feedback-in-ui-ux-design/?s=


Last update: April 20, 2023