Meeting minutes
Review Agenda and Next Meeting Dates
<Matt_King> View agenda at https://
<Matt_King> Next CG Meeting: August 30
<Matt_King> • Next automation meeting: August 28
<murray_moss> +present
Check in on current testing work
Matt_King: It looks like we can get down to 1 test plan run
Matt_King: Lets talk about the current test plans
Matt_King: For VO Action Menu Button Example Using aria-activedescendant, two testers have completed their tests there are 5 conflicts
Isa: Joe and I got very different output
Matt_King: Is there a potential version conflict?
Joe: I updated everything to the latest OS and Safari version
Matt_King: Issue Related to Test 16
Joe: I'm on 13.5
Isa: I'm on one version older
Matt_King: We should improve the conflict layout so you can compare users version numbers
James: To be clear, the output for both users fails
Matt_King: If the menu script clicked the button
Matt_King: If the script did that then maybe it would work the same as the user doing it
James: I wonder how I can test that
Matt_King: Here are the paths forward. 1. remove the conflicts so we can publish report. Generate new version of test plan, which we are doing any way, wait to talk about this with Apple until we verify our new results
JoeHumbert: Is there a similar test for another screen reader?
James: Yes
JoeHumbert: Do the other SR have the same issue?
James: No
Matt_King: There could be something with how VO and Safari are interacting
Matt_King: I have a feeling its related to how VO process event chagnes
JoeHumbert: I'm fine with altering the test results with the correct output
Matt_King: I think we should report how the output is with 13.5. Lets keep Joes results and change Isa's
Matt_King: Is that discussion complete?
James: Yes
Matt_King: We may have a future change to how this test runs
Matt_King: The other test we have is Disclosure Navigation Menu Example
murray_moss: I performed my testing however I didn't click save and close
James: There is a next button that doesn't save your results
murray_moss: Yes thats what I did and I lost everything
James: This is a long standing issue
Matt_King: This is a pretty serious issue
Matt_King: I will add this issue
James: I will create an issue for Next and Previous button not saving data
Matt_King: Isa and Murray can you work together offline to resolve the conflicts?
Isa: Yes!
Matt_King: For Hadi's test is there any conflicts to resolve?
James: We just lost Hadi
Isa: I didn't see any conflicts
Matt_King: Test 41 has conflicts
Matt_King: Activate a link in reading mode
Matt_King: So Isa you didn't record excessive verbosity but Hadi did
Matt_King: If you mark your results Isa as excessive verbosity that will resolve it
Isa: Great I will publish this one today!
Check in on test plan prioritization
Findings related to collection of APG visits data.
Matt_King: We were looking for visit data from the APG. Lola was working on gathering this from the metrics system at W3C
Matt_King: I saw some conversation over email about this over the past week
Matt_King: I don't know that we have any updates on that
James: The oustanding question is there are several pages with the same title, but with different numbers of view. My hypothesis was that maybe it collects URLs with #, but the overall question is do we add up these views or disguard them
Matt_King: They are small enough numbers that they would be lost in any rounding we performed
Matt_King: When we prioritize patterns, should we consider all examples of a pattern vs another? Some plans have multiple examples, others don't
Matt_King: I think we should prioritize patterns first, then use examples as a secondary measure
michael_fairchild: Thats a fair approach
James: so you proposal is to focus on the pattern data over the example data?
Matt_King: Yes
James: If one plan has five examples and another has 1 that not a equal comparison
michael_fairchild: I think the pattern with the most overall views, including examples, that deserves priority
Matt_King: Sometimes people just view the examples, and those are the ones that get passed around
James: That is very true
Matt_King: I think if we use examples and patterns, that is reflective of the impact on the world
Matt_King: If we compare unique user data, it will help
James: I think that would over complicate things
James: I think we should take non unique visits to patterns
Matt_King: We will review this data as a group
Update on coming app changes
James: Just a note, when I approved a PR it didn't create a preview correctly
Matt_King: We are hoping to perform a deployment next week
Howard: We are targeting Mid week
Howard: Anything that was in the MVP board is included