18:58:54 RRSAgent has joined #aria-at 18:58:54 logging to https://www.w3.org/2022/08/18-aria-at-irc 18:59:06 Zakim has joined #aria-at 18:59:14 rrsagent, make log public 18:59:36 MEETING: ARIA and Assistive Technologies Community Group 18:59:42 CHAIR: Matt King 18:59:45 present+ 18:59:50 rrsagent, make minutes 18:59:50 I have made the request to generate https://www.w3.org/2022/08/18-aria-at-minutes.html Matt_King 19:03:35 Alyssa_G has joined #aria-at 19:04:41 michael_fairchild has joined #aria-at 19:07:36 Sam_PAC has joined #aria-at 19:13:49 present+ 19:18:46 TOPIC: Meeting schedule through September 22 19:19:06 present+ 19:19:20 TOPIC: Meeting schedule through September 22 19:19:53 Helen has joined #aria-at 19:20:18 SKovanic has joined #aria-at 19:20:41 Next Week Matt has a multi day event happening internally, and won't be able to attend this meeting. The TPAC conference is during the Week of September 12th 19:21:00 For Next Weeks meeting on August 25th, do we need to have a meeting? 19:21:43 James wants to discuss one topic sooner than later, but will need Matts input. 19:22:43 Decision - Cancel next weeks meeting on August 25th 19:24:58 Week of September 15th, there will be no meetings 19:25:30 TOPIC: Report on design workshop held August 17 19:26:52 Yesterday, Issac, Rich, Seth and Matt met to discuss fundamentals of the way that the status of the reports and data and test plans are reflected in the the UI of ARIA-AT App, and how the way things need to be in the future 19:28:00 Seth plans to post a summary of this conversation in GitHub 19:28:43 They arrived at a small list of changes to how to think about the working mode. The goal was to help separate out a few things a that are all currently mixed together 19:29:46 When talking about collecting results we are collecting SR output, and the Results which are the humans analysis of the output in answering a set of assertions 19:30:05 The working mode will need more terminology to define these points 19:31:13 In the future automation may run part of the plans, and humans will analyze the results 19:31:53 There will be one new page in the app, that will focus on the test plans and being able to dig back through the history the test plan, and compare to current status 19:32:26 You will also be able to see information about supported technologies as the relate to test plans 19:32:52 TOPIC: Check in on status of flight 2 of 16 patterns 19:36:41 These 16 test plans are going through our internal QA process 19:38:00 Our goal is to have these ready for Apple and Vispero to review by the end of the yera 19:38:08 There are 4 that are currently ready 19:39:38 Joe plans to have run the 4 tests by next meeting. 19:40:14 PAC and Louis from Bocoup have both been running the tests 19:42:12 James wanted to discuss an issue 19:43:24 There is a bit of confusion between incorrect output or no output 19:44:20 if youre expecting it to say button and it says something else, PAC interprets that as incorrect output. If the SR doesn't say anything PAC believes that is no output 19:45:23 the group agreed 19:46:50 James will create an issue to create some documentation around training related to the difference between no output and incorrect output 19:47:28 Michael Fairchild noted that documentation is good, but often unread. It may be better to make this explanation in the UI 19:48:21 Matt noted that eventually we will need a training program for humans to run tests 19:49:00 It wont be reasonable to assume everyone will come onboard and pick everything up based on osmosis, as is the case today 19:49:47 Michael suggested using a example test plan for training 19:50:25 Joe suggested that new users, or users who haven't tested in a while, be prompted to go through a training/refresher course on running tests 19:51:34 Seth suggested potentially creating a sandbox that users could see tests that have been run successfully. Matt noted that the APG is supposed to show people how these functions should work 19:51:48 Seth suggested potentially creating a sandbox that users could see tests that have been run successfully. Matt noted that the APG is supposed to show people how these functions should be coded 19:52:12 James made a note to make an issue to create a sample test plan for people to work through 19:52:45 They could go through the example and see the correct answers, or they could submit and have another person review their test runs 19:52:56 TOPIC: Next step on mode change testing 19:53:27 This is about when certain SR when you tab to an element, the SR changes their mode automatically 19:54:44 If you tab to any composite widget, the browser needs the key commands, so the SR switches mode to send those keystrokes. 19:54:58 We want to be able to capture issues around this mode change 19:55:30 this is currently difficult, because SR often use a sound to notate a mode switch which we can't capture 19:55:52 all SR's do have a setting that allows for instead of sound to use speech out put for mode changes 19:56:34 We decided that in order to due this kind of testing, we have to make an expectation and instruct testers to change the default mode of the SR 19:57:01 For JAWS, there is no longer an easy way to go back to the default settings 19:57:19 WE will need to figure out how to change instructions in test plans to instruct testers to make this change in settings 19:57:35 James - There is a list of 4 outcomes that are actionable 19:57:46 provide instruction to testers to change SR to announce mode changes 19:57:58 update 16 plans to include mode changing assertions 19:58:44 Amount the 16 test plans, we are going to prioritize getting the test plans ready that don't need these changes 19:59:49 Think through the new undesirable behavior with the App, like "unexpected mode switch occurred" Do we need one for each mode, or just a checkbox? 20:01:18 Bocoup noted that there are some changes in the works related to these features. 20:01:40 James will work on the new instructions for SR to make the changes to announce the mode change 20:02:33 rrsagent, make minutes 20:02:33 I have made the request to generate https://www.w3.org/2022/08/18-aria-at-minutes.html Matt_King 23:30:36 Travis has joined #aria-at 23:31:14 jcraig has joined #aria-at