Platform Capabilities

From Mobile Accessibility Task Force

Platform Capabilities

This is a discussion of the state of platform capabilities on mobile devices – touch, keyboard etc. This is a preliminary step to including information on platform capabilities in Note: WCAG 2.0 and Mobile.

Discussion

Importance of platform capabilities

Keyboard control, touch targets, screen gestures, device manipulation gestures (shaking, tilting). A lot stems from the devices capabilities. Especially as we talk about keyboard access and the different sections that relate to that. Capabilities overall – where the different ways we can interact with it.

Split up capabilities into different sections and then assign to whoever wants to test and then compile and discuss:

Platforms

  • iOS
  • Android
  • Windows Phone
  • Windows Tablet@@Alan added@@
  • Blackberry OS

Topics

Physical Keyboard

Android: Bluetooth keyboards are supported for text entry and navigation. Some Android devices also support USB keyboards via USB OTG.

  • @@Alan: With the varied and diverse manufacturing sources for Android devices some offer Bluetooth and/or USB connectivity for keyboards. I have seen that the lower end devices often require repairing the Bluetooth keyboard when the device is turned off and then back on. With tablets typically coming with micro or mini USB connections a cable adapter sometimes called On the Go are required if the keyboard comes with the larger USB connecter. (Note: The challenge with On the Go adapters is that they are hard to find and can be confused with some USB to mini USB adapters that only allow power connectivity and not data and power. Added 12/18/14 by Alan) Some manufacturers offer keyboard cases with their tablets with the proper mini/micro USB cable built into the tablet/case. External keyboards typically require separate charging. RCA recently introduced a keyboard case with internal connections between the tablet and keyboard. It does not use either Bluetooth or USB and charging is only required to the tablet which will charge the keyboard as well.

iOS: Bluetooth keyboards can be connected and used to type text, but the user must use VoiceOver in order to use the keyboard to navigate the user interface.

  • @@Alan: These keyboards come either integrated into a tablet case or as individual keyboards. Once paired, the keyboard typically requires one keyboard key to be depressed to restart the communication when the device is turned off and then back on. iOS does not support USB connections although through some cabling for other devices it can be connected. Keyboards typically require separate charging.
  • @@Others: IOS has keyboard support when running voiceover, but it's limited when voiceover is notrunning.

List of keyboard commands that are available when voiceover is not running? If you use the tab key it only goes among form fields Is option tab available @@jda: from what I can tell option-tab doesn't work in iOS and you can only tab to input fields@@ – allows you to tab through links and form fields and Safari – does that work? Android seems to always require the keyboard to be repaired every time you turn the system on and off again. I think that's a device thing not an Android thing. In iOS 7 some of the keyboard shortcuts have been lost in iOS 8.

BlackBerry OS: Some BlackBerry devices have aq built-in physical keyboard. Bluetooth keyboards are supported for text entry, but not user interface navigation.

Windows Phone: Bluetooth keyboards are not currently supported.

Windows Tablets: Windows tablets support mini/micro or Bluetooth keyboards.

  • @@Alan: I have successfully used keyboards designed specifically for iOS devices on my Dell 8 inch Windows 8.1 tablet with no issues. While these keyboards to not have Fxx function keys, all the other labeled hot keys work great such as Search, volume controls, etc. Pairing is a one time setup and the iOS Command key even works as the "Windows" key typically found on Windows keyboards. The keyboard signals are instantaneous and do not required a one key touch to start the communications as I have found on iOS Bluetooth keyboards.

@@Alan General Comments: Smaller keyboard sizes often have moved several keys due to space limitations and this could be problematic for visually impaired users. Tablet keyboards are often much smaller than traditional desktop keyboards and as such place the keys much closer together to fit them within a smaller foot print. Manufacturers also change some of the keys used by the right baby finger. Being smaller hand and finger fatigue is common. Keys are often mistyped. Furthermore, with the reordering of keys used by the right hand baby finger the question mark, forward slash and even the shift keys are in the "wrong" place and even more mistyping is common. Zagg makes a 6 inch and 9 inch keyboard case for the Apple iPad mini. I found that the 9 inch had the best keyboard size and layout and did not relocate keys. I personally use this for my Dell 8 inch Windows 8.1 with no issues. I have seen several keyboard cases for the iPad that while they had the space to do the layout correctly opted to relocate the question mark and forward slash and using it I made countless keyboard errors.@@Alan@@

On-Screen Keyboard

iOS

  • (iOS 8) allows for custom on-screen keyboards.
  • Has UIAccessibilityTraitKeyboardKey to provide role for keyboard keys.

Android

  • Allows for custom on-screen keyboards (input methods).

Blackberry OS

  • Only built-in on-scrren keyboard.

Windows Phone

  • Only built-in on-scrren keyboard.

Text Resizing

iOS

  • (iOS 8) "Larger type" setting (requires developer to monitor setting)

Android

  • "Font size" setting (requires developer to monitor setting)

Windows Phone

  • "Text size" setting (requires developer to monitor setting)

Blackberry OS

  • "Font size" setting (requires developer to monitor setting)

System-Level Magnification

Note: Magnification doesn't replace the need for font size increase because it does not re-flow.

iOS

  • "Zoom" includes numerous settings including full screen and magnified pane modes. An onscreen zoom controller is available to simplifies the previously complex control gestures (3-finger taps and drags).

Android

  • "Magnification Gestures" setting. Gestures were simple (triple-tap to turn on/off, pinch zoom) and reliable.

Windows Phone

  • "Screen Magnifier" setting. Zoom in/out. Control gestures are somewhat complicated (2-finger taps and drags).

Blackberry OS

  • "Magnify Mode" setting. Gesture is simple (pinch zoom) and reliable.

Speech Control

iOS

  • Speech key on keyboard allows you to switch to speech input.
    • Speech input includes words, punctuation and spacing commands such as "New line" and "New Paragraph".
    • The spacing commands are all "in line" commands, meaning they are recognized within a string of words, e.g. "butter new line eggs" puts butter and eggs on separate lines.
    • Speech keyboard control does not include correction or navigation.
    • @@ seems like dictation can learn over time, for example, if you dictation "john" but then fix it with the keyboard to "jon" it will recognize this and adapt.
  • Intelligent Agent (Siri) functionality allows you to use speech to make requests of an intelligent agent.
    • Requests include tasks such as searches, calls, text messages, emails and launching apps.
    • Some requests begin a dialogue with the intelligent agent that allows the user to use speech through several steps of a task, including starting an email to a given person, dictating a message, then sending the mail.
    • In hands-free mode, which requires the device to be plugged into a power supply, the user can wake up the device using speech.
  • Native iOS speech does not include command and control, e.g. navigating an app beyond launching it; carrying out a task beyond an initial command, then replying to the intelligent agent (Siri); or controlling the keyboard beyond dictating text.
  • In general, speech requires a Wi-Fi connection.
  • Some apps, including the Google app, and Dragon Go contain their own speech functionality.

Android

  • Speech key on keyboard allows you to switch to speech input
    • (see iOS explanation above for detail)
  • Intelligent Agent functionality allows you to use speech to make requests of an intelligent agent.
    • Requests include tasks such as searches, calls and launching apps.
  • Native speech does not include command and control, e.g. navigating an app beyond launching it; carrying out a task beyond an initial command, then replying to the intelligent agent; or controlling the keyboard beyond dictating text.
  • Some apps, including the Samsung camera app, contain their own speech functionality ("smile" to take picture).

Blackberry OS

  • "BlackBerry Assistant" app can be used to make calls, send emails, text messages, BBM messages, search the Internet, schedule appointments, etc.

Windows Phone

  • Speech can be used to make calls, text messages, search the Internet, open an app, etc.

Windows Tablet@@Alan@@

  • Windows has built in Windows Speech Recognition app that is designed to work with most apps.
    • I found it took a lot of setup to train the tool for my voice and even after all that training it still did not do a good job of recognizing what I say.
    • It made a lot of mistakes in what I said to what it thought I said.
    • I would classify this as unreliable.

Built-in Screen Reader

iOS

  • VoiceOver is a MATURE built-in screen reader capable of accessing any app that has been developed following iOS accessibility programming guidance.
  • Provides explore-by-touch feature as well as sequential navigation through on-screen elements.
  • Most of the built-in apps shipped with iOS devices are VO accessible including the Safari browser.

Android

  • TalkBack is a RELATIVELY MATURE built-in screen reader capable of accessing any app that has been developed following Android accessibility programming guidance.
  • Provides explore-by-touch feature as well as sequential navigation through on-screen elements.
  • Only some of the built-in apps shipped with Android devices are properly TalkBack-accessible. The most accessible browser is probably Firefox for Android.
  • Differences between Android "flavors" are also an issue for TalkBack.

Windows Phone

  • Narrator is a BETA built-in screen reader capable of accessing any app that has been developed following Windows Phone accessibility programming guidance.
  • Provides explore-by-touch feature as well as sequential navigation through on-screen elements.
  • Only some of the built-in apps shipped with Windows Phone devices are properly Narrator-accessible. The IE browser works with Narrator to only some extent.

Blackberry OS

  • There is a BETA built-in screen reader capable of accessing any app that has been developed following BlackBerry OS accessibility programming guidance.
  • Provides explore-by-touch feature as well as sequential navigation through on-screen elements.
  • Only some of the built-in apps shipped with BlackBerr yOS devices are properly Screen Reader-accessible. The browser was not accessible with the Screen Reader (when last tested).

Braille Display Support

iOS

Android

Windows Phone, Blackberry OS

  • N/A

Ability Switch Support

iOS

  • "Switch control" available in 7.0+
  • supports external switch controls and camera for head movement
  • groups items for easier scanning
  • Has point scanning option like mousegrid to narrow select for apps that doesn't support scan access
  • @@Jan: Not very efficient when used to access the web via Safari

Android

  • "Switch Access" available natively in Lollipop 5.0+ (in Android 2+ the Tecla Access app could be used)
  • not very user friendly (need to cycle through each item - active and text items)
  • No point scanning access

Blackberry OS, Windows Phone

  • No switch support

Touchscreen Gesture and Device Manipulation Gesture Emulation

iOS

  • "Assistive Touch" allow single touch access to many gestures including ones that include multiple touch points such as pinch zoom
  • Can add favorite/custom gestures
  • Allows access to home and other standard features/buttons as well as device shake, tilt, etc.

Android

  • "Assistant Menu" on Samsung devices provides emulation of some some buttons/gestures

Windows Phone, Blackberry OS

  • N/A

Alternative display modes

Mouse control

Android

  • Support for Bluetooth mouse. Mouse click is equivalent to finger tap.

Blackberry OS

  • Support for Bluetooth mouse. Mouse click is equivalent to finger tap.

iOS, Windows Phone

  • N/A

Color filters/correction

Filters

  • Android - Colorblind filters (Android 5 and Samsung prior to 5)
  • iOS (Grayscale)

Color inversion

  • iOS
  • Android (invert colours, in Lollipop lightness is inverted preserving the hue)
  • BlackBerry OS (Reverse contrast mode)
  • Windows Phone (High Contrast Mode - needs to be supported by app developers)

Captions

Control of captions

  • iOS
  • Android
  • BlackBerry OS
Retrieved from "https://www.w3.org/WAI/GL/mobile-a11y-tf/wiki/index.php?title=Platform_Capabilities&oldid=2555"