Shadi: Summary of what we discussed: Rules have to be testable, Rule aggregation is complicated, needs the breakdown of rules and where it fails
... We should look at the granularity of the rules and how it relates and supports silver
Wilco: Silver conformance is breaking down requirements and trying to attach rules to each, almost like SCs statements that would add up to the total method
DM: does that mean the scoring mechanism may change
Wilco: it will turn out to be # of passes, fails and inapplicable with a percentage
... they have not figured out the scoring mechanism yet
... Probably come up with a flavor like excellent, good...bad
... Once Silver figures the scoring mechanism we can apply that to our rules
... Can the ACT rules work without a testable requirements
Shadi: no, than what would you fail?
MJ: rules require some manual tests in addition to automated tests before you can score
... than see for example # of images and than try to calculate once you have the results
Wilco: Yes that is the problem, coming to a threshold of failures
... but that does not fit into the rules format
... currently we go with pass, fail, further tests needed
... the solution works for now and can be extended
... another piece is guided task based testing approach
... As i understand it is putting your self in the shoe of the user and try to accomplish the task
MJ: user scenarios, not sure if that fits in with what we have
... We have elements based testing
cpandhi; you still need to fail something
Wilco: can you express into applicability and expectations
Trevor: I am not quite sure how they would fit in
... rules are unit test oriented
DT: A user for example would use a key stroke to get to the image, explore the image kind of scenario
Wilco: do not know enough about these kind of test, so we should try to get some examples and see if can learn more and than give some recommendations
MJ: a user goes through a use case
Wilco: can the rules catch if they get stuck
MJ: how can we tell if the user has a frustrating experience to complete
... have to keep an eye on what SIlver comes with
Wilco: We would need examples of the scenarios, need testable statements for rules and figure how to determine pass, fail criterio
... anyone attend silver and want to take this on?
MJ: can have a discussion on it
Wilco: will take an action item on it
Wilco: This was Shadi's idea
Shadi: we have some rules being published, 5 to be precise by W3C
... So if we want to do a public announcement or introduction or invite folks to talk about how they are using in their tools, methodology development
... so we have people not just from the group talking
... Time frame would be sometime in May or June before or after GAAD
Trevor: trying to get a feel of how many rules we will have
Shadi: We can do something again, this is for rules and methodology developers who are watching like Webaim, Level access and try to get them in the group and active again
Wilco: i like the idea, it is a good time
... this will be a kickoff for publishing the rules and why
Shadi: The integration process will take a while than it will be later in June or July
... so we wait untill we have more complete or do it now and do one again
MJ: There are lot that are close and get them in too and have WCAG to integrate
SHadi: so what time line are we thinling
Wilco: may be in a couple months, we will have enough to be there
... so i would say July
MJ: agree
... have to be careful about vacation
Shadi: Either way... have think about getting more people involved
... Dont feel strongly... maybe can wait a couple months
Wilco: we can comeback to this in a month or so
Wilco: this is minor... typo... we should be using US English, so need to fix it
Shadi: if we do an errata, what is the process?
<shadi> https://www.w3.org/WAI/GL/task-forces/conformance-testing/errata
Shadi: That can be done
<shadi> +1
Wilco: OK than lets do that
+1
Wilco: MJ can u take that on?
MJ: can't do it this week
Shadi: i can volunteer
Wilco: are there any new comments?
... We have addressed most
... what was the conclusion about odd angles
... There is some minor work remaining so can't publish yet
... have a new issue with all the comments
cpandhi, ok i can do that
Wilco: that went quick...
MJ: reminder about a new survey for 3 rules
Wilco: resolve the 3 done..
<shadi> Acknowledgments fix: https://github.com/w3c/wcag-act/pull/443
Wilco: there are 2 or 3 more that will be coming for survey
Shadi: i made a PR