SC1-2-2-video-element

From Automated WCAG Monitoring Community Group
Jump to: navigation, search

Status

Version 0: Draft

Description

This test checks captions in video elements with a track element. So, this one test the quality of the given captions. Note that instead of a pass or fail, we could also return a graded rating scheme. This can be the case if for example emotions are captured, and only one emotion is forgotten. We could return a 90% pass?

"BITV-Test, a German web-based accessibility evaluation tool which in its latest revision is a WCAG 2.0 test in all but name, takes a different approach. Its checkpoints that have graded rating scheme that offers five grades: from a clear "pass" (100%) via intermediate steps to a clear "fail" (0%). " http://www.bitvtest.de/infothek/artikel/lesen/talking-head-captions.html

Background

Assumptions

  • Test device renders html5 video (phantomJS doesn't render)

Test properties

Property Possible values
Success Criterion
  • 1.2.2
Test mode
  • SemiAuto
Test environment
  • DOM and CSS + media API
Test subject
  • DOM document fragment
User expertise and skills

For manual tests only:

  • no prior knowledge
User profile For manual tests only:
any additional requirements, such as language skills, use of AT etc.

Test procedure

Selector

Property Possible values
Mode
  • automatic

<VIDEO> containing a TRACK attribute

Step 1

Property Possible values
Mode
  • automatic

Track element contains 'kind'-attribute with value 'captions'

If the step returns true, go to step 3 with the value of 'src'

Step 2

Property Possible values
Mode
  • automatic

Track element contains 'kind'- attribute with value 'subtitles'

NOTE: success criterion doesn't take into account language changes. So it is valid to have spoken text in language 1, subtitles in language 2 and page content in language 3. We prefer captions as they include non-spoken text as well

Step 3

Property Possible values
Mode
  • automatic

src contains file

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage no caption file provided with the video
Pointer position
Info



Step 4

Property Possible values
Mode
  • automatic

File content contains time codes and text

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage empty caption file provided with the video
Pointer position
Info


Step 5

Property Possible values
Mode
  • automatic

file contains valid time and text combinations

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage no valid caption data provided with the video
Pointer position
Info



Step 6

Property Possible values
Mode
  • semi-automatic

For each spoken audio fragment a timecode and text exists

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage Not all dialogs are covered in the captions
Pointer position
Info


Step 7

Property Possible values
Mode
  • manual

For each spoken audio fragment the content of the spoken text has the same meaning as the caption text

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage The text of the captions doesn't correspond to the spoken text
Pointer position
Info



Step 8

Property Possible values
Mode
  • semi-automatic

Check to see is a speaker is presented in a fixed frame with unchanging background ('talking head' video). For each frame check if the image is similar to the other frames.

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome passed
Pointer position
Info


NOTE: not sure if we should add this step, but if this step can be done fully automatic with frame scanning, we can skip additional manual steps.

Step 9

Property Possible values
Mode
  • manual

Check for each sound if it is important and has a timecode and descriptive text

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage Important sound not explained in the caption
Pointer video-id and timecode
Info


Step 10

Property Possible values
Mode
  • manual

Check for each background fragment if it is important and has a captioned text

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage Location not explained in the caption
Pointer videoid and timecode
Info


Step 11

Property Possible values
Mode
  • manual

Check for each speaker fragment if it has a captioned identification

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage Speaker not identified in the captions
Pointer position
Info


Step 12

Property Possible values
Mode
  • manual

Check for each emotion if it is important and has a captioned text

Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome failed
ErrorMessage Emotion not explained in the caption
Pointer position
Info


Property Value
TestCase SC 1.2.2 video
Identifier {{{id}}}
Outcome passed
Pointer position
Info