14:06:56 <RRSAgent> RRSAgent has joined #wcag-act
14:06:56 <RRSAgent> logging to http://www.w3.org/2017/04/24-wcag-act-irc
14:06:58 <trackbot> RRSAgent, make logs public
14:06:58 <Zakim> Zakim has joined #wcag-act
14:07:00 <trackbot> Zakim, this will be
14:07:00 <Zakim> I don't understand 'this will be', trackbot
14:07:01 <trackbot> Meeting: Accessibility Conformance Testing Teleconference
14:07:01 <trackbot> Date: 24 April 2017
14:07:14 <Kathy> present+ Kathy
14:07:15 <Kathy> scribe: Kathy
14:07:41 <Kathy> agenda+ TPAC 2017 Face-to-face https://www.w3.org/2002/09/wbs/93339/ACT_TPAC2017/results
14:07:52 <Kathy> agenda+ Test case repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Test_case_repository
14:08:03 <Kathy> Agenda+ Rules repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Rules_repository
14:08:17 <Kathy> agenda+ ACT benchmark https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Benchmark_requirements
14:08:29 <Kathy> zakim, take up next
14:08:29 <Zakim> agendum 1. "TPAC 2017 Face-to-face https://www.w3.org/2002/09/wbs/93339/ACT_TPAC2017/results" taken up [from Kathy]
14:09:08 <Kathy> Mary Jo - questionnaire open until today
14:09:55 <Kathy> ... looks like from the results that is highly probably that we will have a meeting
14:11:55 <Kathy> ...if anyone has any time that does not work please add to the survey
14:12:00 <Kathy> zakim, take up next
14:12:00 <Zakim> agendum 2. "Test case repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Test_case_repository" taken up [from Kathy]
14:13:08 <Kathy> Mary Jo - looks like there is a list of repositories
14:13:24 <Kathy> .. and some metadata defined
14:14:14 <Kathy> ... there is a repository of test cases https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Testing_Resources
14:14:36 <Kathy> ... does anyone have any feedback on this
14:15:15 <Kathy> Alistair - Wilco put in a format and you need to run that against test suite
14:15:20 <Kathy> ... model is ok
14:15:42 <Kathy> ... we are supposed to collect the repositories
14:16:10 <Kathy> ... bentoweb does not have a pass / fail so someone will manually need to go through
14:16:29 <Kathy> ... AXE model is different
14:16:43 <Kathy> ... I think Wilco wanted someone to own this
14:17:14 <Kathy> Shadi - issue is that bentoweb is not participating
14:17:27 <Kathy> ... so can we extract what we need
14:17:40 <Kathy> ... we will need someone to write a conversion tool
14:18:02 <Kathy> Alistair - I took a look but didn't see where the pass/fail was
14:18:18 <Kathy> Shadi - pretty sure that the data is there, we may need to ask them
14:18:40 <Kathy> ... metadata is in XML
14:19:05 <shadi> http://www.bentoweb.org/refs/TCDL2.0.html
14:20:05 <shadi> https://www.w3.org/WAI/ER/tests/usingTCDL
14:20:31 <Kathy> ... w3c took a subset of these
14:20:55 <ChrisLoiselle> looks like this may be where it goes into pass fail <locations expectedResult="fail">
14:21:07 <ChrisLoiselle> 8.1.3. Linking Locations and Techniques
14:24:27 <Kathy> ... if a tool runs the file, it is expected to produce
14:25:01 <Kathy> ... so expectResult is the results - pass, fail, cannotTell and notApplicable
14:25:39 <Kathy> Mary Jo - maybe we can ask them questions
14:26:33 <Kathy> Alistair - we have tried emailing and not sure how to push out note out to people
14:27:17 <Kathy> Kathy - may want to post to the interest group
14:28:01 <Kathy> Shadi - Jon Gunderson may have a test suite and they may have a person to join
14:28:25 <Kathy> zakim, take up next
14:28:25 <Zakim> agendum 3. "Rules repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Rules_repository" taken up [from Kathy]
14:28:59 <Kathy> Mary Jo - proposal for review
14:30:30 <Kathy> Kathy - wouldn't we want the publication to be on the same schedule as WCAG 2.0
14:31:11 <Kathy> Mary Jo - we should sync with the WCAG 2.0 schedule
14:32:23 <Kathy> ... it would be good to talk to the chairs of AG to find out schedule
14:34:04 <Kathy> ... any other comments?
14:34:19 <Kathy> zakim, take up next
14:34:19 <Zakim> agendum 4. "ACT benchmark https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Benchmark_requirements" taken up [from Kathy]
14:34:35 <shadi> scribe: shadi
14:37:04 <shadi> AG: isn't benchmark same as running against test suite?
14:37:13 <shadi> ...coverage and accuracy
14:38:04 <shadi> MJM: thought it was you run your tools against
14:38:34 <shadi> https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/ACT_Overview_-_What_is_ACT
14:40:51 <shadi> AG: different ways to do things
14:41:04 <shadi> ...use Jasmine and Cucumber
14:41:25 <shadi> ...may not be good to write another tool
14:43:25 <shadi> SAZ: maybe reuse these tools rather than rewrite
14:44:00 <shadi> AG: don't have access to all tools
14:44:17 <shadi> ...vendors need to carry out the testing themselves
14:47:38 <MoeKraft> I need to drop for a daily scrum call.
14:48:49 <shadi> SAZ: think idea was to provide a runner
14:50:15 <shadi> AG: we're not set out to develop software here
14:50:21 <shadi> ...many years of work
14:50:27 <shadi> ...we all do it differently
14:51:04 <shadi> ...best way is to just ask people to use the test suites and send in the results
14:51:20 <shadi> ...optionally, of course
14:51:34 <shadi> MJM: sounds reasonable
14:54:14 <shadi> NEXT MEETING: MAY 8th
14:54:44 <shadi> trackbot, end meeting
14:54:44 <trackbot> Zakim, list attendees
14:54:44 <Zakim> As of this point the attendees have been Kathy
14:54:52 <trackbot> RRSAgent, please draft minutes
14:54:52 <RRSAgent> I have made the request to generate http://www.w3.org/2017/04/24-wcag-act-minutes.html trackbot
14:54:53 <trackbot> RRSAgent, bye
14:54:53 <RRSAgent> I see no action items