| Medium |
Device |
Mode |
Function |
| recording |
dialog |
transcription |
verification |
| acoustic |
microphone |
speech |
audiofile (e.g. voicemail) |
spoken command / query / response (verbal = true) |
dictation |
speaker recognition |
| singing a note (verbal = false) |
| tactile |
keypad |
dtmf |
audiofile / character stream |
typed command / query / response (verbal = true) |
text entry (T9-tegic, word completion, or word
grammar) |
password / pin entry |
| command key "Press 9 for sales" (verbal = false) |
| keyboard |
keys |
character / key-code stream |
typed command / query / response (verbal = true) |
typing |
password / pin entry |
| command key "Press S for sales" (verbal = false) |
| pen |
ink |
trace, sketch |
handwritten command / query / response (verbal = true) |
handwritten text entry |
signature, handwriter recognition |
| gesture (e.g. circling building) (verbal = false) |
| gui |
N/A |
tapping on named button (verbal = true) |
soft keyboard |
password / pin entry |
| drag and drop, tapping on map (verbal = false) |
| mouse |
ink |
trace, sketch |
handwritten command / query / response (verbal = true) |
handwritten text entry |
N/A |
| gesture (e.g. circling building) (verbal = false) |
| gui |
N/A |
clicking named button (verbal = true) |
soft keyboard |
password / pin entry |
| drag and drop, clicking on map (verbal = false) |
| joystick |
ink |
trace,sketch |
gesture (e.g. circling building) (verbal = false) |
N/A |
N/A |
| gui |
N/A |
pointing, clicking button / menu (verbal = false) |
soft keyboard |
password / pin entry |
| visual |
page scanner |
photograph |
image |
handwritten command / query / response (verbal = true) |
optical character recognition, object/scene recognition
(markup, e.g. SVG) |
N/A |
| drawings and images (verbal = false) |
| still camera |
photograph |
image |
objects (verbal = false) |
visual object/scene recognition |
face id, retinal scan |
| video camera |
video |
movie |
sign language (verbal = true) |
audio/visual recognition |
face id, gait id, retinal scan |
| face / hand / arm / body gesture (e.g. pointing, facing) (verbal =
false) |