Accessibility Conformance Testing Teleconference

Versioning of rules

Status of va11ys use of the ACT test case format

<Wilco> https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Testing_Resources

Charu: We worked on how to incorporate the va11ys examples and Deque. Moe Kraft and I found that examples all pass. How would we put in the JSON fail pass format?

<Wilco> https://github.com/IBMa/Va11yS

<Charu> https://github.com/IBMa/Va11yS/blob/master/HTML5/button.html

<Wilco> https://rawgit.com/IBMa/Va11yS/master/HTML5/button.html

Button example doesn't have any pass fail defined. Possibility to reformat to have it consumable by JSON.

<Wilco> "a11y-testcases": [{

<Wilco> "url": "https://rawgit.com/IBMa/Va11yS/master/HTML5/button.html",

<Wilco> "successCriteria": ["wcag20:4.1.2"]

<Wilco> }]

Wilco: Might want to point to URL, then indicate SC you are referring to. WCAG ID should be used.

<Wilco> ensure-compat-rsv

4.1.2's WCAG ID is ensure-compat-rsv

<Wilco> "main > h1 + *"

Charu: We will work to include success criteria in the formatting.

<Wilco> https://github.com/w3c/wcag-act/pull/92

Wilco: We will look into pull requests due to limited number of people on call.

First pull request: Outcomes undetermined

MaryJo: Using terms to define term is not good practice. Possibly reword the definition.

Wilco: What was reason behind change of definition?

Charu: We will reword. Will include "because" human [...] is needed
... We will append the pull request.

<Wilco> https://github.com/w3c/wcag-act/pull/90

<Wilco> This includes test rules that are verified through automated, semi-automated and manual tests.

Wilco: Reviewing.Update act-rules-format.bs, looking at Moe's comments on manual, semi-automated and automated tests.

<Wilco> This includes test rules that are fully-automatic, semi-automatic, and manually.

Charu: Change manually to manual. Wilco agrees

Wilco, general comment from me: Think we would need a minor edit on rule format: on 6.2 Outcome: Sentence reads "Cannot tell: It is unclear whether or not the Test Target passes of rails the test". I think this should read as "fails the test"

Found on https://w3c.github.io/wcag-act/act-rules-format.html

Wilco: We will continue on the agenda next week.

Charu: Will take a look at the format hopefully this week.