16:46:25 RRSAgent has joined #silver-conf 16:46:25 logging to https://www.w3.org/2021/02/11-silver-conf-irc 16:46:37 rrsagent, make logs public 16:46:54 Meeting: Silver Conformance Options Subgroup 16:47:02 Date: 11 Feb 2021 16:47:06 Chair: sajka 16:47:12 agenda? 16:47:18 Agenda+ Agenda Review & Administrative Items 16:47:18 agenda+ Revisiting Principle #6 re Critical Failures 16:47:18 agenda+ Use Cases Discussion (Continued) 16:47:18 agenda+ Other Business 16:47:18 agenda+ Be Done 16:50:21 Regrets: Wilco, Azlan 16:50:25 present+ 16:51:39 regrets+ Bruce 16:52:10 rrsagent, make minutes 16:52:10 I have made the request to generate https://www.w3.org/2021/02/11-silver-conf-minutes.html sajkaj 17:01:34 Bryan has joined #silver-conf 17:01:49 JF has joined #silver-conf 17:01:58 Present+ 17:02:01 AGenda? 17:03:19 PeterKorn has joined #silver-conf 17:03:22 present+ 17:03:36 zakim, who is here? 17:03:36 Present: sajkaj, JF, PeterKorn 17:03:38 On IRC I see PeterKorn, JF, Bryan, RRSAgent, Zakim, sajkaj, MichaelC, Jemma, Rachael, trackbot 17:04:01 John_Northup has joined #silver-conf 17:04:10 present+ 17:04:42 present+ 17:04:47 scribe: John_Northup 17:05:33 KimD has joined #silver-conf 17:05:40 sarahhorton has joined #silver-conf 17:06:01 present+ 17:06:47 present+ 17:06:49 zakim, next item 17:06:49 agendum 1 -- Agenda Review & Administrative Items -- taken up [from sajkaj] 17:07:13 present+ 17:07:30 zakim, who is here? 17:07:31 Present: sajkaj, JF, PeterKorn, Bryan, John_Northup, sarahhorton, KimD, Jemma 17:07:33 On IRC I see sarahhorton, KimD, John_Northup, PeterKorn, JF, Bryan, RRSAgent, Zakim, sajkaj, MichaelC, Jemma, Rachael, trackbot 17:07:52 Present+ Jeanne Spellman 17:07:58 Janina: Some inconsistencies between google doc and working draft. 17:08:23 zakim, next item 17:08:23 agendum 2 -- Revisiting Principle #6 re Critical Failures -- taken up [from sajkaj] 17:09:00 Janina: Revisiting principle 6; what is a critical error. 17:09:12 q? 17:10:33 q+ to reconsider programatic solutions to flash, audio on load, etc 17:10:46 q+ 17:10:58 q+ 17:11:08 q? 17:11:38 Jeanne: Rachael and I do not disagree on critical errors; it's the final resolution of the critical error. Concern that critical error for flashing (zero) may be averaged out by higher scores in other areas and thus overlooked. 17:12:01 https://w3c.github.io/silver/guidelines/#conformance-levels-0 17:12:02 ack p 17:12:12 For content that conforms to the bronze level: The total score and score within each of the functional categories MUST be at least 3.5; and Views and processes MUST NOT have critical errors. 17:14:00 q? 17:14:25 Peter: Doesn't see how the calculation method could result in the outcome that Jeanne describes. 17:15:54 Jeanne & Peter: Discussion on calculations and possible outcomes. 17:16:43 ack ra 17:17:36 q? 17:17:38 Rachael: Low scoring items that are not critical do balance out, but the purpose of the critcial error is to be a hard stop. Would not agree with a model that passed critical errors. 17:18:09 Q+ 17:18:24 q+ 17:18:50 ack jf 17:19:14 q+ 17:19:25 John F: Ensure we are not focusing on flashing; other errors are critical. 17:19:39 Janina: ... but flashing is life-threatening... 17:19:57 John F: Other things can be life threatening too depending on content and context. 17:20:05 ack p 17:20:53 q+ 17:21:04 Peter: There has been a discussion about the difference between content itself being life-threatening, and the context being life-threatening. 17:21:11 q- 17:22:32 Peter: Marvel film trailer may trigger a seizure. Does it make a difference if the content is third-party? Do we treat this content differently if there is a warning? 17:25:12 Janina: Proposal to look at WCAG 2; possibility to programmatically correct problems; e.g., user agent detecting and stopping flashing. 17:25:27 ack sa 17:25:27 sajkaj, you wanted to reconsider programatic solutions to flash, audio on load, etc 17:25:30 ack br 17:25:36 q? 17:26:30 q+ 17:26:46 Brian: Challenging/impossible to catch every use case; need to keep it simple to drive adoption. 17:27:07 ack je 17:27:48 Jemma: If blocking a video is preferable to warning, how to score that? 17:27:51 Janina: Don't know yet. 17:28:06 q? 17:28:34 Peter: Focus on creating use cases; then will move toward solutions. 17:28:53 q? 17:29:04 Jeanne: Use cases valuable at this stage. 17:29:49 Peter: More to discuss about bugs? 17:30:04 q+ 17:30:06 Peter: Do we have an opinion on what should happen when a critical error is found? 17:30:46 John F: Do you mean time frame for remediation? A score is at a certain point in time... 17:30:58 q+ 17:31:26 John F: Discussion of lag time between scoring and remediation - if no followup evaluation, then old score is still the latest. 17:31:34 q+ 17:31:38 q- 17:31:44 ack ja 17:31:49 ack sa 17:31:49 Janina: Scheduling by priority... 17:32:49 q? 17:33:27 q+ 17:33:28 Jeanne: Met yesterday with DHS Trusted Tester, discussed measuring a11y errors compared to other bugs. They were cautiously enthusiastic. 17:34:59 Jeanne: Goal is a11y bugs treated same as other bugs. Just as critical as security or usability bugs. 17:35:32 Q+ to note that a11y, security and privacy bugs are *MORE* critical than other software bugs, due to legal obligations. 17:35:52 Jeanne: They are enthusiastic about the point system and critical errors because it helps with VPAT 17:36:00 q? 17:36:04 ack br 17:36:47 Bryan: Likes prioritizing by severity. 17:37:08 ack sa 17:37:28 Sarah: Are we talking about bugs as equivalent to critical errors, or bugs with different degrees of severity? 17:37:44 Janina: Trying to specify that a11y bugs are as important as other bugs; not de-prioritized. 17:37:50 q+ 17:38:05 q? 17:38:41 ack jf 17:38:42 JF, you wanted to note that a11y, security and privacy bugs are *MORE* critical than other software bugs, due to legal obligations. 17:38:59 Precious metals like gold and silver are measured using the “troy” system where there are 12 ounces in a pound. If you normalize everything to mass a pound of feathers is 454 grams and a pound of gold is 373 grams, therefore the feathers are technically heavier. 17:39:07 John F: Bugs related to security, privacy, a11y... not all bugs are created equal. 17:40:01 John F: Legal obligation puts a11y ahead of other bugs. 17:40:18 ack jo 17:40:30 q+ 17:41:02 John N: Likes the idea of commingling a11y and other types of bugs, so that a11y isn't diminished. 17:41:41 q? 17:41:45 ack p 17:42:38 Peter: So much content is programmatically-generated--a bug in the script that generates content over several pages, which may become critical. 17:42:51 q+ 17:43:27 Janina: The challenge is finding those instances. 17:43:46 q? 17:44:31 ack sa 17:45:08 Sarah: Perhaps not refer to "critical bugs" due to confusion with existing term "critical errors". 17:45:26 q? 17:46:05 q+ 17:46:13 q+ 17:46:18 Peter: Discussing equivalence across diff types of bugs (security vs a11y)... 17:46:20 Q+ 17:46:20 ack je 17:47:02 Jemma: Seeking clarity around critical errors 17:48:45 Sarah: Not quite far enough along with Errors work to definitively answer. 17:49:55 Bryan: Is the word "critical" a stumbling block, even though the general principle is appropriate... 17:49:55 q? 17:50:02 ack br 17:50:50 Sarah: Principle is sound. Use case introduces the issue of time... should that factor into the conformance model... 17:51:13 q+ 17:52:25 ack jf 17:54:17 John F: Just because something is critical, the fix may not take immediate effect. Score could change moment by moment as content changes... 17:54:22 ack p 17:55:24 Time issue *IS* real, but shold it have an impact on "Score"? 17:56:08 q+ 17:56:43 I think that Peter is touching the issue of impact scope of "critical error" 17:56:56 Peter: Acknowleging the time issue, while we also try to consider a11y in the context of other bugs... 17:56:59 q+ 17:57:00 ack s 17:58:00 Q+ to note that "culture" is a conce3rn in large orgs, maybe less so at "Joe's Pizzaria" 17:58:07 Sarah: Much about culture/practice/procedures that should weigh into conformance - beyond just products... 18:00:23 bye bye 18:01:53 rrsagent, make minutes 18:01:53 I have made the request to generate https://www.w3.org/2021/02/11-silver-conf-minutes.html sajkaj 18:01:58 zakim, bye 18:01:58 leaving. As of this point the attendees have been sajkaj, JF, PeterKorn, Bryan, John_Northup, sarahhorton, KimD, Jemma, Jeanne, Spellman 18:01:58 Zakim has left #silver-conf 18:01:59 rrsagent, make minutes 18:01:59 I have made the request to generate https://www.w3.org/2021/02/11-silver-conf-minutes.html sajkaj 18:03:57 rrsagent, bye 18:03:57 I see no action items