14:14:30 RRSAgent has joined #auto-wcag 14:14:30 logging to http://www.w3.org/2016/04/07-auto-wcag-irc 14:14:52 scribe: Birkir 14:15:10 Zakim has joined #auto-wcag 14:15:39 Judy, I was just going to ask you if we can use the W3C tools in IRC, such as zakim, and all that. 14:16:50 High level EPUB accessibility document https://docs.google.com/document/d/1U0ZyVwPCw0IOb0YM0HiPY-j3NH-SgzuGYO-yVnFwTl8/pub 14:17:06 RD: I am Roman Deltour, based out of Rance (insert scribe note, aka tour de France), work for DAISY consortium. We are working on automated or semi automated testing for WCAG conformance, then implement tests specific to epub. 14:17:30 https://www.w3.org/community/auto-wcag/wiki/Action_items 14:18:28 Wilco: Item 1, workshop dates. 14:18:58 AN: WE'll take a look at the Doodle pole. 14:19:39 WF: Birkir's is the only test case worked on in the last month (insert scribe note, today actually), we all need to find some spare time and step up a bit. 14:20:35 present+ Judy 14:20:37 WF: Judy suggests bi-weekly meetings on development of W3C proposal. Propose shorter meetings on proposals specifically inbetween our monthly meeting. 14:21:23 John: Trouble with audio .. 14:22:14 Wilco, suggest April 22nd for a W3C meeting, May 3rd for our next regular meeting, same time. 14:22:44 q+ 14:22:55 WF: Note May 3rd is a Tuesday. 14:23:57 JB: Encourage geting the proposal done sooner rather than later. Bi-weekly pace helpful. 14:24:41 BG: Do we all need to be on all meetings (W3C proposal different). 14:25:05 WF: All people do not necessarily need to be present at all meetings. 14:25:22 https://www.w3.org/community/auto-wcag/wiki/Accessibility_Conformance_Testing_for_W3C 14:25:25 AN: Me and Frank both work at FTB, we may split up the meeting participation. 14:26:07 WF: Sent out a first draft of W3C proposal. 14:26:26 WF: ACT (Accessibility Conformance Testing). 14:27:31 WF: Start with introduction, why this is important, leads to problem description. 14:28:23 Talk about assumptions e.g. alt="image" is an assumption, tehre are scenarios where it might be appropriate). 14:28:51 Assumption about a.t./user agent support (differences in ARIA in particular). 14:29:52 WF: Goal 1 (see draft for exact wording). 14:30:41 John: What is a property. 14:30:52 WF: Look at our templates, they have a lot of properties already defined. 14:31:31 Chirp chirp. 14:31:33 q+ 14:31:49 JB: People may need more context to discuss. 14:32:08 ack J 14:32:11 ack A 14:32:41 AN: Concerned about conformance rules wording. 14:33:17 AN: WE can't cover everything, we need human input. Conformance rules might be too strong a term. 14:34:14 WF: Avoid to strong a term, such as compliance. 14:34:40 q- 14:34:52 WF: Fur work focuses on informing users when they are not conformant. Passing all these rules does not necessarily imply conformance. 14:35:17 JB: Lots of requests for formal conformance procedures. 14:35:54 JB: We need a more authoritative appraoch to determining when a ctent conforms. 14:36:24 AN: Discuss better in W3C proposal meeting. 14:37:43 John: What about "WCAG performance" as opposed "conformance". 14:38:31 John: Compliance is the low end of where we want to be, inaccessible pop ups are e.g. WCAG 2.0 AA compliant (see webaim discussion). 14:40:42 JB: EArlier we had concerns about tests that go beyond WCAG. Our draft needs to word that clearly. 14:41:09 JB: May want to include planning e.g. for WCAG 2.1 14:41:57 WF: Need to avoid false impression that if people pass all tests that they are conformant, maybe we should go for inconformance test? 14:42:38 ... concerns about confusion associatdted with the new term. 14:43:41 John, are we talking recommendation document or a work document? 14:44:04 WF: Open discussion. 14:45:02 Birkir: Floating the idea of a concept such as automated tool compliance test. 14:45:56 JB: Important to be clear taht automated testing does not give you the whole picture. Helpful to define a framework that would go beyond automated to semi-automted or expert testing. 14:47:13 Birkir: We might want to consider levels of compliance .. "automated test compliante" "user test compliant" "expert test compliant" .. 14:47:23 On-going discussion item. 14:48:06 WF: WE need to make sure our tests are reliable, accurate, and predictable. 14:48:32 WF: We need community feedback on the rules, which helps us to assess the quality of those rules. 14:49:12 WF: 4. We need a process to describe how rules can be implemented, how we register rules, publish rules etc. 14:49:55 WF: auto-WCAG has some of this, but may need revision based on the standards we define. 14:50:43 AN: Difference between accessibility rules in item 3 and conformance rules in item 1? 14:50:58 WF: The are the same, need change of wording. 14:52:48 After discussion we may consider changing the wording to 'ACT" rules, needs further investigation. 14:53:15 WF: Are we missing anything? 14:53:45 John: Too many rule sets, try to figure where they overlap and where they don't. 14:55:00 WF: We need to try and combine the experiences of the differnt rule sets and design our template so that it might allow for them. 14:56:27 Birkir: We need to start out with the common denominator, WCAG, but set up the process that may allow for flexibility. We need something out there that is useful soon. We need to start by understanding what is a good rule. 14:58:12 JB: Shadi is going to provide more feedback on the format, come up with an accepted common denominator for rule sets. 14:59:27 JB: Need more feedback on existing rule sets (also Shadi has input). Need a careful inspection of what is available with regards to content and format. 15:00:15 s/come up with/with hopes that the group can come up with/ 15:00:35 s/has input/may have input on the format/ 15:01:09 John: Flashback to discussions we had 10 years ago. We used Eclipse expert system that worked with 5 different rule sets. I can go check on the format we used and see how digestable it is to humans. 15:01:12 s/and format/and format -- with consideration to what would be most useful as a common reference set/ 15:01:37 John: Every html code became a rule statement. 15:02:20 JB: Pull in other folks e.g. from W3C Interaction, experience from browser testing. 15:03:35 WF: Now I see why Judy recommended bi-weekly meetings. (scribe note: Note the time stamp, we are over an hour in). 15:04:11 WF: Getting to the rest of the agenda. 15:05:54 WF: auto WCAG members need to focus on rule developemnt. need a standard way of defining rules with regards to properties, quality, interaction with other rules. End up with implementation mechanism and predictable output. 15:07:39 AN: WE can't be more stable than the browser that processes our code. We can think of our work as similar to WCAG techniques. 15:08:48 WF: Need to discuss reliability e.g. aXe's mantra of "no false positives". 15:09:02 WF: WE need 95% accuracy. 15:11:36 JB: WE need to sort out what rules can be normative. We need to look at the scale of things that can be tested, can get overwhelming quickly. We need something taht is authoritative and realistic. 15:13:10 WF: We could look at a small scale test based on what we have implented. 15:13:43 s/authoritative and/authoritative on some level, but also/ 15:14:36 AN: This may involve "some" manual work. (scribe note, put the word "some" in sarcastic quotes").. 15:15:57 AN: Think of 2 steps, firstly that the theoretical rule is effective, secondly that te tool implementation of that rule is accurate. 15:16:27 WF: Integration tests may be an additional property of our rules. 15:18:01 WF: I am going to take the feedback from meeting and look at it. Also encourage al of y'all to share the page and comment on it (note from scribe, we need a bit of southern slang in here). 15:19:18 WF: We hope to turn this document into something normative. 15:20:39 JB: We need to find out which W3C member organizations are willing to be involved in the work. We need concrete commitment for rule set contribution. 15:21:35 JB: It may require some opensourcifaction of rule sets to be donated. 15:22:17 s/opensourcifaction/opensourcification/ 15:22:57 RD: Daisy is a W3C member, will very likely contribute to a working group. 15:23:30 https://github.com/auto-wcag/auto-wcag/ 15:23:52 WF: Proposes an off-line catch up with RD. 15:24:28 WF: Review Github stuff, decide what we want to do with outdated stuff. 15:24:44 http://auto-wcag.github.io/auto-wcag/dist/rules.html 15:25:34 WF: Should include all test cases we have designed so far. 15:26:05 WF: This week, try starting working with Github over wiki. 15:26:36 WF: For upcoming work, stop being wicket, start being a Git. (add your work through Github pull requests). 15:27:23 http://doodle.com/poll/etgpz5a55xeycp3f 15:27:45 WF: Last agenda item .. Doodle Pole. 15:28:24 AN: 4 participants, available on all dates. 15:29:21 WF: Maybe host this around W3C workshop in Madrid? I don't think it will work, too much time needed on workshop. 15:30:17 JB: W3C meeting in Lisbon in 2016. 15:32:01 WF: I am going to pick a date this week. 15:32:56 s/W3C meeting/W3C TPAC meeting/ 15:33:30 John: Final thought, Github a good idea, from text towards technical implementation. 15:35:07 rrsagent, make log public 15:35:53 regrets+ Katie 15:35:59 regrets+ George 15:37:11 present+ Avneesh_Singh 15:37:19 present+ Wilco Fiers 15:37:22 present+ Judy 15:37:23 present+ frank berker 15:37:36 present+ frank_berker 15:37:37 present+ annnika 15:37:40 present+ Wilco_fiers 15:37:55 regrets+ Jon 15:38:01 regrets+ Dylan 15:38:13 present+ Romain_Deltour 15:38:26 rrsagent make minutes 15:38:48 rrsagent, make minutes 15:38:48 I have made the request to generate http://www.w3.org/2016/04/07-auto-wcag-minutes.html Birkir 15:39:42 bye 15:41:55 John has joined #auto-wcag 15:42:22 anyone still here? 15:42:35 sorry guys, will use next time 15:44:03 Judy_alt has joined #auto-wcag 17:54:01 Judy_alt has joined #auto-wcag 18:00:42 Zakim has left #auto-wcag