18:57:54 <RRSAgent> RRSAgent has joined #aria-at
18:57:58 <RRSAgent> logging to https://www.w3.org/2023/10/19-aria-at-irc
18:57:58 <Zakim> RRSAgent, make logs Public
18:57:59 <Zakim> please title this meeting ("meeting: ..."), Matt_King
18:58:16 <Matt_King> MEETING: ARIA and Assistive Technologies Community Group
18:58:28 <Matt_King> CHAIR: Matt King
18:58:33 <Matt_King> present+
18:58:39 <Matt_King> rrsagent, make minutes
18:58:40 <RRSAgent> I have made the request to generate https://www.w3.org/2023/10/19-aria-at-minutes.html Matt_King
19:00:04 <jugglinmike> jugglinmike has joined #aria-at
19:02:34 <jugglinmike> present+ jugglinmike
19:02:37 <jugglinmike> scribe+ jugglinmike
19:03:34 <Sam_Shaw> Sam_Shaw has joined #aria-at
19:05:01 <jugglinmike> Matt_King: Our next meeting will be on Wednesday, October 25
19:05:29 <jugglinmike> Topic: Review new report format
19:06:01 <Matt_King> Sample report:
19:06:04 <Matt_King> https://aria-at.w3.org/report/2407/targets/201
19:07:18 <jugglinmike> Matt_King: I want to talk about the headings and the tables on this page
19:07:31 <Michael_Fairchild> Michael_Fairchild has joined #aria-at
19:07:42 <Michael_Fairchild> Present+
19:08:01 <jugglinmike> Matt_King: Previously, the table had a column for command, a column for overall success (pass or fail), and a third column with lists inside it (a list for passing assertions and list for failing assertions, and more)
19:08:12 <jugglinmike> Matt_King: In this new report, we have a separate table for each command
19:08:25 <jugglinmike> Matt_King: Above each table is a block quote which contains the output for that command
19:08:48 <jugglinmike> Matt_King: The table itself has three columns: priority, assertion, and result (pass or fail)
19:09:03 <jugglinmike> Matt_King: That's the new report format. I hope everyone agrees that it's a lot easier to read
19:09:15 <jugglinmike> Matt_King: I've raised an issue about this which is related to the heading structure, though
19:10:35 <jugglinmike> [the group members individually review the new report page and the heading structure in particular]
19:11:43 <alflennik> alflennik has joined #aria-at
19:11:46 <jugglinmike> Matt_King: does anyone have any issues with the way it's currently structured?
19:12:39 <jugglinmike> [no response from the group]
19:12:57 <jugglinmike> Matt_King: Well, I have one. I filed issue #999 to report my suggestion https://github.com/w3c/aria-at/issues/999
19:15:06 <jugglinmike> Matt_King: It's obvious to me that the letter "B" is a command in this context
19:15:40 <jugglinmike> Matt_King: But because it's just a letter, I think it might sound weird to others
19:15:50 <jugglinmike> Matt_King: e.g. "B Results: 2 passed, 0 failed"
19:16:31 <jugglinmike> present+ Alyssa_Gourley
19:17:04 <jugglinmike> Alyssa_Gourley: Maybe if we prefixed those with a word like "Command". As in "Command B Results: 2 passed, 0 failed"
19:17:17 <jugglinmike> present+ James_Scholes
19:17:31 <jugglinmike> James_Scholes: I think it would be best if we could avoid having the headings all begin with the same word, whether its an unadorned key name or the word "Command"
19:18:01 <jugglinmike> James_Scholes: We have level-3 headings for all the commands in a test, and then you have another level-3 heading immediately following that for "run history"
19:18:36 <jugglinmike> James_Scholes: I'm not a big fan of both those things being the same level because they mean different things and because it's not obvious how you should jump past all the commands in a test to get to the run history
19:19:27 <jugglinmike> James_Scholes: One solution would be to add a level-3 heading for something like "Command Results" and then to change all the current level-3 command-related headings to instead use a level-4 heading
19:20:04 <jugglinmike> present+ Justin_Yarbrough
19:20:12 <jugglinmike> Justin_Yarbrough: That makes a lot more sense to me, too
19:21:23 <jugglinmike> Matt_King: In issue 999, I suggested what Alyssa_Gourey suggested about prefixing with "Command", and separately, I also suggested the alternative that James_Scholes just described
19:22:51 <jugglinmike> Matt_King: Keep in mind that in this future, these command descriptions are expected to grow to include information about the virtual cursor
19:23:00 <jugglinmike> present+ Michael_Fairchild
19:23:13 <jugglinmike> Michael_Fairchild: I like the second proposal, too
19:24:44 <jugglinmike> Matt_King: Alright, hearing widespread support for that change, I'll add a comment along these lines in issue #744 https://github.com/w3c/aria-at-app/issues/744
19:25:56 <jugglinmike> Topic: Schedule for re-running tests for refactored test plans
19:26:26 <jugglinmike> Matt_King: We will have the ability to preview the tests in the new format as early as next week (on the staging server, anyway)
19:27:38 <jugglinmike> Matt_King: As soon as we have the "preview" capability merged to production in ARIA-AT, we'll have the ability to land the refactors in ARIA-AT
19:27:54 <jugglinmike> Matt_King: It looks like we should be able to start running tests in the new format sometime in the first half of November
19:28:07 <jugglinmike> Matt_King: Once this happens, we're going to want to run these new tests as quickly as possible
19:28:39 <jugglinmike> Matt_King: For the Testers here, I want to find out whether you will actually have availability starting in the week before Thanksgiving
19:29:07 <jugglinmike> Matt_King: Because we may want to schedule testing outside of a Community Group meeting, via e-mail
19:29:51 <jugglinmike> Justin_Yarbrough: I'll be traveling out of the country that week, but I should be available to test after Thanksgiving
19:30:35 <jugglinmike> present+ Hadi
19:31:00 <jugglinmike> Hadi: I will be out of the country in December and most of January, but I'll be present and at your service in November
19:32:31 <jugglinmike> James_Scholes: PAC will be closed starting Friday the 15th of December. That will be the final day of the year for us
19:32:59 <jugglinmike> Matt_King: Ideally, we'll get at least five of these through
19:33:29 <jugglinmike> Matt_King: ...before the end of the year, getting some recommended reports at that time. Along with 5 which are actively in "candidate"
19:34:08 <jugglinmike> Matt_King: That (along with another 3 in draft) would be a nice, ideal ending by the end of the year
19:35:56 <jugglinmike> Matt_King: We'll have some more updates soon about the app and the refactor. But if there's nothing new before next week, we may cancel this meeting. I'll try to let you folks know about this by Tuesday of next week
19:36:43 <jugglinmike> Zakim, end the meeting
19:36:43 <Zakim> As of this point the attendees have been Matt_King, jugglinmike, Michael_Fairchild, Alyssa_Gourley, James_Scholes, Justin_Yarbrough, Hadi
19:36:45 <Zakim> RRSAgent, please draft minutes
19:36:46 <RRSAgent> I have made the request to generate https://www.w3.org/2023/10/19-aria-at-minutes.html Zakim
19:36:52 <Zakim> I am happy to have been of service, jugglinmike; please remember to excuse RRSAgent.  Goodbye
19:36:53 <Zakim> Zakim has left #aria-at
19:41:15 <jugglinmike> jugglinmike has left #aria-at