20:06:11 <RRSAgent> RRSAgent has joined #aria-at
20:06:11 <RRSAgent> logging to https://www.w3.org/2022/02/24-aria-at-irc
20:06:36 <Matt_King> rrsagent, make log public
20:06:56 <Matt_King> MEETING: ARIA and Assistive Technologies Community Group
20:07:01 <Matt_King> present+
20:07:09 <Matt_King> rrsagent, make minutes
20:07:09 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/24-aria-at-minutes.html Matt_King
20:07:11 <JoeHumbert> present+
20:07:17 <Sam_PAC_> present+
20:10:52 <Matt_King> TOPIC: Merging in changes without throwing out data
20:10:57 <Alyssa_G> Alyssa_G has joined #aria-at
20:11:10 <Alyssa_G> present+
20:11:28 <Matt_King> Jes: have working prototype for a feature related to merging in new test plans
20:12:04 <Matt_King> You can pull new version of test plan
20:12:17 <Matt_King> and decide what to do with report.
20:15:07 <Matt_King> Link to sandbox of new experience:
20:15:12 <boaz> boaz has joined #aria-at
20:15:16 <jesdaigle> jesdaigle has joined #aria-at
20:15:19 <boaz> present+
20:15:21 <jesdaigle> https://aria-at-app-sandbox.bocoup.com/test-queue
20:31:27 <Matt_King> Galk through experience of how new test plan versions are merged into existing report; it is in sandbox and in a prototype state
20:33:20 <Matt_King> Jes: next step for Lewis and Isaac to review and test
20:33:27 <Matt_King> then make adjustments.
20:37:20 <Matt_King> Jes: The way the plans are structured, with a plan with tests inside of it, would it make sense to separate the test plans from the test plan run?
20:54:48 <jongunderson> https://github.com/w3c/aria-at/wiki/Running-a-Test-Plan
21:03:47 <Matt_King> rrsagent, make minutes
21:03:47 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/24-aria-at-minutes.html Matt_King
21:04:53 <Matt_King> regrets+ Seth
21:05:05 <Matt_King> present+ Jes_Daigle
21:05:26 <Matt_King> CHAIR: Matt King
21:05:36 <Matt_King> rrsagent, make minutes
21:05:36 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/24-aria-at-minutes.html Matt_King
21:07:43 <Matt_King> mk: Jes can you raise an issue where we document the logic used to determine which tests data is copied to the new run?
21:07:47 <Matt_King> Jes: yes
21:09:28 <Matt_King> mk: So, the way the works is the test que shows a run of a test plan for specific AT/Browser. We can update teh version of the plan for that run, which essentially makes a new test run for that browser/AT and copies data from old run to new run. Optionally, the test admin can delete the old run.
21:09:40 <Matt_King> Jes: yes
21:10:52 <Matt_King> mk: It is the logic for copying data from old run to new run that we need to dive into. We want to do it in a way where test admin can make decisions to override the default rules that might prevent copying results from test X in old run to text X in new run.
21:11:30 <Matt_King> The default rules might say that text X haschanged in a breaking way, but the test admin may know that it is not a breaking change.
21:12:10 <Matt_King> We need to consider whether that new run should be flagged with a different status if the admin overrode logic to make sure the decision is verified?
21:12:38 <Matt_King> We don't want test admins to inadvertantly introduce errors into the results.
21:13:11 <Matt_King> Jes: we also need to discuss whether or not we will truly delete or only soft delete
21:13:19 <Matt_King> mk: very good question
21:13:46 <Matt_King> Boaz: will discuss with Seth and bring some considerations to table
21:14:00 <Matt_King> TOPIC: Current test runs
21:14:46 <Matt_King> mk: looking at select-only combo for FF/NVDA. Alyssa and Louis results have 9 conflicts.
21:15:16 <Matt_King> Walked through how to either correct results or raise issue to ask a different person to correct results.
21:15:40 <Matt_King> Alyssa can start working on those conflicts after Mar 7
21:15:56 <Matt_King> Jon: started working on test guide
21:16:09 <Matt_King> https://
21:17:02 <Matt_King> https://github.com/w3c/aria-at/wiki/Running-a-Test-Plan
21:17:19 <Matt_King> Discussed when to mark the unexpected output box.
21:17:32 <Matt_King> Jon: we don't have criteria for when to check box
21:17:40 <Matt_King> for unexpected output.
21:18:22 <Matt_King> Joe marked it for when NVDA said clickable on combobox.
21:18:53 <Matt_King> Joe: we previously discussed and agreed that is actually an expected, default behavior for NVDA in certain circumstances.
21:19:07 <Matt_King> I'll change my results where they conflict for taht reason.
21:19:26 <Matt_King> What about where NVDA says list instead of listbox?
21:19:36 <Matt_King> mk: Let's cover in next meeting.
21:19:43 <Matt_King> rrsagent, make minutes
21:19:43 <RRSAgent> I have made the request to generate https://www.w3.org/2022/02/24-aria-at-minutes.html Matt_King