13:58:48 RRSAgent has joined #auto-wcag 13:58:48 logging to http://www.w3.org/2016/04/21-auto-wcag-irc 13:59:05 zakim, start meeting 13:59:05 I don't understand 'start meeting', Judy 13:59:14 rrsagent, start meeting 13:59:14 I'm logging. I don't understand 'start meeting', Judy. Try /msg RRSAgent help 13:59:29 trackbot has joined #auto-wcag 13:59:40 trackbot, start meeting 13:59:40 Sorry, but no Tracker is associated with this channel. 13:59:53 trackbot, sorry, ignore that 13:59:53 Sorry, Judy, I don't understand 'trackbot, sorry, ignore that'. Please refer to for help. 14:02:12 shadi has joined #auto-wcag 14:04:26 cpandhi_ has joined #auto-wcag 14:04:51 agenda? 14:04:54 agenda+ Upcoming Auto-WCAG workshop 14:04:54 agenda+ Rewritten goals 14:04:54 agenda+ DL1 ACT-Rule Definition 14:04:54 agenda+ DL2 ACT Rule Benchmark 14:04:54 agenda+ DL3 W3C ACT-Rule Collection 14:04:55 agenda+ Open questions 14:04:57 agenda+ Final thoughts 14:06:11 Charu Pandhi 14:07:40 present+ Judy 14:07:40 hi 14:07:45 almost there 14:07:50 maryjom has joined #auto-wcag 14:07:54 present+ shadi 14:08:01 struggles with the captcha again ... 14:08:19 present+ Frank_Berker 14:08:23 present+ Mary Jo 14:09:45 scribe: maryjom 14:10:34 Wilco: Auto-wcag workshop will be in July in Frankfort, Germany 14:10:48 Wilco: Focus will be on test cases and some of the in-progress documents. 14:11:33 https://www.w3.org/community/auto-wcag/wiki/Accessibility_Conformance_Testing_for_W3C#Goals 14:12:13 present+ Charu 14:12:35 Wilco: Trying to clearly set the goals. 14:14:44 s/in Frankfort, Germany/in Dortmund, Germany/ 14:15:53 q+ 14:16:04 Wilco: Regarding Goal #4 on the development of rules: We want to make sure the rules remain up-to-date and useful 14:17:18 SA: Agrees with the goals set here. Are there any things we want to specifically exclude from our goals? e.g. Interpretations of WCAG and what that means. 14:18:01 same here 14:22:24 CP: Rules will be technology agnostic without testing to the differences in browser handling? How will we take that into consideration? 14:23:10 CP: Different browsers render the content differently, and have varying support for HTML5, etc. 14:23:42 q+ 14:24:13 Wilco: This work is not limited to simple rules, want rules to be applicable to any technology. 14:25:26 SA: The way WCAG uses the term technology-agnostic is because their requirements apply to any technology. Every test rule will apply to a specific technology. 14:26:58 Wilco: The framework should be technology agnostic. But there will have to be rules for specific technologies, but not necessarily limited to specific browsers. 14:27:53 [framework - technology agnostic; rules - technology specific; accessibility support?] 14:27:58 q+ 14:28:14 Wilco: The question is how would the rules work where there is different browser support. 14:28:35 https://www.w3.org/community/auto-wcag/wiki/Accessibility_Support 14:28:35 Annika: Katie provided a wiki page on this topic, so it's worth looking at. 14:28:52 emma_bbc-a11y has joined #auto-WCAG 14:29:00 q- 14:29:06 Judy has joined #auto-wcag 14:29:06 ack me 14:29:20 https://www.w3.org/community/auto-wcag/wiki/Accessibility_Support 14:29:48 Wilco: That came down to we wanted to be agnostic of implementation, but not sure about that any more. There is something to omitting rules for implementation that isn't well supported. 14:29:50 Detlev has joined #auto-wcag 14:30:17 Hi - sorry for being late - I don't have the password tzo enter the Webex meeting 14:30:43 Wilco: For exammple iOS has little support for table markup, so rules should probably point that out for that platform and let the developer know that there are additional accessibility considerations here. 14:32:12 s/exammple/example/ 14:32:15 Sorry I'm late - had another meeting. New to this and have no password. 14:32:30 same problem for me 14:32:41 Thanks shadi 14:34:12 Wilco: Proposes we provide a way to deal with AT accessibility support for newer HTML, ARIA and other standards. 14:35:39 MJ: There is danger in being too closely coupled with AT support, as that can change very quickly with bug fixes, new releases, etc that we have no access to until they come out. 14:37:18 Wilco: 3 components of the project: We want to have a framework for the rules so that various tools can utilize them. We need to vet the rules so that they meet the quality we need. We also need a database to keep the rules. 14:39:17 SA: The rule benchmark sets a good framework. The rules definition would be more spec-like. The existing test rules that we've started can be used in the first phase to test this framework out. 14:39:33 # Tooling and development process - the points in the "Benchmark" and "Collection" deliverables makes me immediately think of the tools and process(es) that we envision. Maybe these should be open questions for now? We want to encourage a community-driven process, which you outline in some of the wording already, but it needs to be emphasized, I think. 14:40:33 SA: How will we develop and test the rules? Use GitHub or something else? 14:42:29 Wilco: Not sure yet how to go about it yet. We will have to have a representative set of pages that you test the rules on, use the test tool and see how well the rules work and if there are any false positives. 14:44:55 Wilco: If you write unit tests for code, you know what you expect the rule to do. And those rules will be tested against our assumptions. It still doesn't catch things we didn't think about - different implementations we didn't think about. 14:45:13 Wilco: We need to test against real web pages to make sure our assumptions are correct. 14:45:29 q+ 14:47:15 SA: Why not both types of validations of the rules to coexist? 14:47:28 ack me 14:47:37 Wilco: Yes, there is value in both. 14:48:21 SA: Testing with real web pages - how do we know we've tested enough web pages to make sure our assumptions are correct? 14:48:25 WIlco has joined #auto-wcag 14:48:53 Out in the "wild" folk do odd stuff!! 14:50:07 Annika: The differences from deliverable 1 and 3 are not exactly clear. 14:51:40 q+ 14:51:42 Wilco: auto-wcag we hope is where the rules get developed and the validation of the rules is done to make sure the quality is sufficient. 14:52:13 q+ 14:53:29 Detlev: This is about finding rules and aggregating them to create a more sophisticated automated test. There will still be human checking needed, so to what extent will that be handled in this work? 14:54:23 Wilco: We do want to include both. Part of our rules will be automation and part is providing prompting for the manual checks to complete the manual testing. 14:56:00 Makoto has joined #auto-wcag 14:56:14 JB: Need to figure out where this work, potentially a task force, will land. Best option looks like it will best be a task force of the WCAG working group. Some work would continue in this community group as well. 14:57:21 General agreement from the group that a task force under WCAG is reasonable. 14:57:42 +1 to a task force under WCAG 14:58:54 SA: The signing off of the rules should be in the task force. Auto-wcag community group should be kept as doing the spec work so it is more open to participation. 14:59:58 Anna: Introduction - accessibility specialist from the BBC. This is Anna's first meeting. 15:01:21 Detlev: Introduction - Been part of the Evaluation Methodology task force and EM working group. May not be able to commit time to active working in the group, but wants to be familiar with the work of this group. 15:02:44 JB: Happy work is continuing to move along. There are others that want to join - someone from the U.S. Trusted Tester program, and someone from Zhejiang University as they are also working on test rules in China.