IRC log of wcag-act on 2017-04-24

Timestamps are in UTC.

14:06:56 [RRSAgent]
RRSAgent has joined #wcag-act
14:06:56 [RRSAgent]
logging to http://www.w3.org/2017/04/24-wcag-act-irc
14:06:58 [trackbot]
RRSAgent, make logs public
14:06:58 [Zakim]
Zakim has joined #wcag-act
14:07:00 [trackbot]
Zakim, this will be
14:07:00 [Zakim]
I don't understand 'this will be', trackbot
14:07:01 [trackbot]
Meeting: Accessibility Conformance Testing Teleconference
14:07:01 [trackbot]
Date: 24 April 2017
14:07:14 [Kathy]
present+ Kathy
14:07:15 [Kathy]
scribe: Kathy
14:07:41 [Kathy]
agenda+ TPAC 2017 Face-to-face https://www.w3.org/2002/09/wbs/93339/ACT_TPAC2017/results
14:07:52 [Kathy]
agenda+ Test case repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Test_case_repository
14:08:03 [Kathy]
Agenda+ Rules repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Rules_repository
14:08:17 [Kathy]
agenda+ ACT benchmark https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Benchmark_requirements
14:08:29 [Kathy]
zakim, take up next
14:08:29 [Zakim]
agendum 1. "TPAC 2017 Face-to-face https://www.w3.org/2002/09/wbs/93339/ACT_TPAC2017/results" taken up [from Kathy]
14:09:08 [Kathy]
Mary Jo - questionnaire open until today
14:09:55 [Kathy]
... looks like from the results that is highly probably that we will have a meeting
14:11:55 [Kathy]
...if anyone has any time that does not work please add to the survey
14:12:00 [Kathy]
zakim, take up next
14:12:00 [Zakim]
agendum 2. "Test case repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Test_case_repository" taken up [from Kathy]
14:13:08 [Kathy]
Mary Jo - looks like there is a list of repositories
14:13:24 [Kathy]
.. and some metadata defined
14:14:14 [Kathy]
... there is a repository of test cases https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Testing_Resources
14:14:36 [Kathy]
... does anyone have any feedback on this
14:15:15 [Kathy]
Alistair - Wilco put in a format and you need to run that against test suite
14:15:20 [Kathy]
... model is ok
14:15:42 [Kathy]
... we are supposed to collect the repositories
14:16:10 [Kathy]
... bentoweb does not have a pass / fail so someone will manually need to go through
14:16:29 [Kathy]
... AXE model is different
14:16:43 [Kathy]
... I think Wilco wanted someone to own this
14:17:14 [Kathy]
Shadi - issue is that bentoweb is not participating
14:17:27 [Kathy]
... so can we extract what we need
14:17:40 [Kathy]
... we will need someone to write a conversion tool
14:18:02 [Kathy]
Alistair - I took a look but didn't see where the pass/fail was
14:18:18 [Kathy]
Shadi - pretty sure that the data is there, we may need to ask them
14:18:40 [Kathy]
... metadata is in XML
14:19:05 [shadi]
http://www.bentoweb.org/refs/TCDL2.0.html
14:20:05 [shadi]
https://www.w3.org/WAI/ER/tests/usingTCDL
14:20:31 [Kathy]
... w3c took a subset of these
14:20:55 [ChrisLoiselle]
looks like this may be where it goes into pass fail <locations expectedResult="fail">
14:21:07 [ChrisLoiselle]
8.1.3. Linking Locations and Techniques
14:24:27 [Kathy]
... if a tool runs the file, it is expected to produce
14:25:01 [Kathy]
... so expectResult is the results - pass, fail, cannotTell and notApplicable
14:25:39 [Kathy]
Mary Jo - maybe we can ask them questions
14:26:33 [Kathy]
Alistair - we have tried emailing and not sure how to push out note out to people
14:27:17 [Kathy]
Kathy - may want to post to the interest group
14:28:01 [Kathy]
Shadi - Jon Gunderson may have a test suite and they may have a person to join
14:28:25 [Kathy]
zakim, take up next
14:28:25 [Zakim]
agendum 3. "Rules repository https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Rules_repository" taken up [from Kathy]
14:28:59 [Kathy]
Mary Jo - proposal for review
14:30:30 [Kathy]
Kathy - wouldn't we want the publication to be on the same schedule as WCAG 2.0
14:31:11 [Kathy]
Mary Jo - we should sync with the WCAG 2.0 schedule
14:32:23 [Kathy]
... it would be good to talk to the chairs of AG to find out schedule
14:34:04 [Kathy]
... any other comments?
14:34:19 [Kathy]
zakim, take up next
14:34:19 [Zakim]
agendum 4. "ACT benchmark https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/Benchmark_requirements" taken up [from Kathy]
14:34:35 [shadi]
scribe: shadi
14:37:04 [shadi]
AG: isn't benchmark same as running against test suite?
14:37:13 [shadi]
...coverage and accuracy
14:38:04 [shadi]
MJM: thought it was you run your tools against
14:38:34 [shadi]
https://www.w3.org/WAI/GL/task-forces/conformance-testing/wiki/ACT_Overview_-_What_is_ACT
14:40:51 [shadi]
AG: different ways to do things
14:41:04 [shadi]
...use Jasmine and Cucumber
14:41:25 [shadi]
...may not be good to write another tool
14:43:25 [shadi]
SAZ: maybe reuse these tools rather than rewrite
14:44:00 [shadi]
AG: don't have access to all tools
14:44:17 [shadi]
...vendors need to carry out the testing themselves
14:47:38 [MoeKraft]
I need to drop for a daily scrum call.
14:48:49 [shadi]
SAZ: think idea was to provide a runner
14:50:15 [shadi]
AG: we're not set out to develop software here
14:50:21 [shadi]
...many years of work
14:50:27 [shadi]
...we all do it differently
14:51:04 [shadi]
...best way is to just ask people to use the test suites and send in the results
14:51:20 [shadi]
...optionally, of course
14:51:34 [shadi]
MJM: sounds reasonable
14:54:14 [shadi]
NEXT MEETING: MAY 8th
14:54:44 [shadi]
trackbot, end meeting
14:54:44 [trackbot]
Zakim, list attendees
14:54:44 [Zakim]
As of this point the attendees have been Kathy
14:54:52 [trackbot]
RRSAgent, please draft minutes
14:54:52 [RRSAgent]
I have made the request to generate http://www.w3.org/2017/04/24-wcag-act-minutes.html trackbot
14:54:53 [trackbot]
RRSAgent, bye
14:54:53 [RRSAgent]
I see no action items