Meeting minutes
Matt_King: Our next meeting will be on Wednesday, October 25
Review new report format
<Matt_King> Sample report:
<Matt_King> https://
Matt_King: I want to talk about the headings and the tables on this page
Matt_King: Previously, the table had a column for command, a column for overall success (pass or fail), and a third column with lists inside it (a list for passing assertions and list for failing assertions, and more)
Matt_King: In this new report, we have a separate table for each command
Matt_King: Above each table is a block quote which contains the output for that command
Matt_King: The table itself has three columns: priority, assertion, and result (pass or fail)
Matt_King: That's the new report format. I hope everyone agrees that it's a lot easier to read
Matt_King: I've raised an issue about this which is related to the heading structure, though
[the group members individually review the new report page and the heading structure in particular]
Matt_King: does anyone have any issues with the way it's currently structured?
[no response from the group]
Matt_King: Well, I have one. I filed issue #999 to report my suggestion w3c/
Matt_King: It's obvious to me that the letter "B" is a command in this context
Matt_King: But because it's just a letter, I think it might sound weird to others
Matt_King: e.g. "B Results: 2 passed, 0 failed"
Alyssa_Gourley: Maybe if we prefixed those with a word like "Command". As in "Command B Results: 2 passed, 0 failed"
James_Scholes: I think it would be best if we could avoid having the headings all begin with the same word, whether its an unadorned key name or the word "Command"
James_Scholes: We have level-3 headings for all the commands in a test, and then you have another level-3 heading immediately following that for "run history"
James_Scholes: I'm not a big fan of both those things being the same level because they mean different things and because it's not obvious how you should jump past all the commands in a test to get to the run history
James_Scholes: One solution would be to add a level-3 heading for something like "Command Results" and then to change all the current level-3 command-related headings to instead use a level-4 heading
Justin_Yarbrough: That makes a lot more sense to me, too
Matt_King: In issue 999, I suggested what Alyssa_Gourey suggested about prefixing with "Command", and separately, I also suggested the alternative that James_Scholes just described
Matt_King: Keep in mind that in this future, these command descriptions are expected to grow to include information about the virtual cursor
Michael_Fairchild: I like the second proposal, too
Matt_King: Alright, hearing widespread support for that change, I'll add a comment along these lines in issue #744 w3c/
Schedule for re-running tests for refactored test plans
Matt_King: We will have the ability to preview the tests in the new format as early as next week (on the staging server, anyway)
Matt_King: As soon as we have the "preview" capability merged to production in ARIA-AT, we'll have the ability to land the refactors in ARIA-AT
Matt_King: It looks like we should be able to start running tests in the new format sometime in the first half of November
Matt_King: Once this happens, we're going to want to run these new tests as quickly as possible
Matt_King: For the Testers here, I want to find out whether you will actually have availability starting in the week before Thanksgiving
Matt_King: Because we may want to schedule testing outside of a Community Group meeting, via e-mail
Justin_Yarbrough: I'll be traveling out of the country that week, but I should be available to test after Thanksgiving
Hadi: I will be out of the country in December and most of January, but I'll be present and at your service in November
James_Scholes: PAC will be closed starting Friday the 15th of December. That will be the final day of the year for us
Matt_King: Ideally, we'll get at least five of these through
Matt_King: ...before the end of the year, getting some recommended reports at that time. Along with 5 which are actively in "candidate"
Matt_King: That (along with another 3 in draft) would be a nice, ideal ending by the end of the year
Matt_King: We'll have some more updates soon about the app and the refactor. But if there's nothing new before next week, we may cancel this meeting. I'll try to let you folks know about this by Tuesday of next week