13:56:39 RRSAgent has joined #wcag3-protocols 13:56:39 logging to https://www.w3.org/2022/01/28-wcag3-protocols-irc 13:56:46 zakim, start this meeting 13:56:46 RRSAgent, make logs Public 13:56:47 please title this meeting ("meeting: ..."), JF 13:57:06 meeting: Protocols Sub Group - Jan 28, 2022 13:57:27 Agenda+ Continue brainstorming the protocols that we believe would be applicable 13:57:40 Agenda+ Preparing for larger presentation to #AG February 8th 13:57:51 Agenda+ Be Done 13:57:54 Present+ 13:58:50 Chuck has joined #wcag3-protocols 13:59:09 present+ 13:59:40 Rachael has joined #wcag3-protocols 13:59:44 https://www.w3.org/events/meetings/bfc72cd9-fdfc-4847-826a-01afb9e3f5e7/20211105T090000 13:59:57 present+ 14:00:46 ShawnT has joined #wcag3-protocols 14:00:52 present+ 14:02:41 Jaunita_george has joined #wcag3-protocols 14:02:49 Present+ 14:03:15 Regrets+ Jake 14:04:01 present+ 14:04:08 Scribe: Jaunita 14:04:31 agenda? 14:05:31 https://www.w3.org/WAI/GL/task-forces/silver/wiki/Protocols#Meeting_Minutes 14:06:13 JF: I have gone through the various meeting minutes. In the past two weeks, we have arrived at a few statements. Do we agree on these? 14:07:22 ...I want to verify if we have consensus on any of these statements 14:08:01 ...We want to explain the consensus we came to and what we still have to discuss 14:08:10 +1 on approach 14:08:14 +1 14:08:21 Jaunita: Can we paste the statements into IRC? 14:09:21 statements made in prior calls 14:09:22 "...the point of protocols is to achieve outcomes that we don't know how to measure." 14:09:30 "...protocols are about procedures you use to meet an outcome that is not easily measurable" 14:09:33 two statements: "...the point of protocols is to achieve outcomes that we don't know how to measure." "...protocols are about procedures you use to meet an outcome that is not easily measurable" 14:09:37 "...Methods are specific tests looking for specific outcomes. Protocols are about following a process or procedure." 14:09:43 "...Protocols evaluate process; Methods measure implementations..." 14:10:04 JF: Do we have a preference of doing one over the other 14:10:33 JF: MichaelC? 14:10:55 I like both, 1 as a clarification of 2 14:11:37 MichaelC: I lean towards the first 14:12:25 JF: Do we pick one over the other? Use both? 14:12:39 Shawn: I like both of them 14:12:43 jenniferS has joined #wcag3-protocols 14:12:47 present+ 14:13:32 Chuck: I like the first one, and like having the first as a sub-bullet of the second 14:13:56 s/and like having the first as a sub-bullet of the second/and I like having the second as a sub-bullet of the first/ 14:15:10 Jaunita: There were 2 proposals for adoption of a protocol that might need to be captured in this discussion. A checklist... 14:15:24 Jaunita: A public facing conformance statement. 14:16:09 JF: One of our larger struggles is how to integrate it into WCAG 3 14:17:42 JF: What I'm trying to drill into is whether or not any of these statements is stronger 14:17:43 I don't believe that all protocols will be "scorable" — rather it is about showing the effort to ensure the outcome is accessible, inclusive. 14:18:35 +1 to jenniferS 14:18:57 jenniferS: My impression is that not all protocols are scorable, but protocols offer a way to show effort 14:19:38 After reviewing the 2 statements on "repeat" (over and over), I now like second statement as primary and first statement as bullet. 14:19:42 ...everyone has done accessibility testing and sometimes it's a gut feeling 14:20:13 JF: I like the concept of "showing your homework" 14:21:39 ...The protocol was proof point, and we're giving some guidance to show effort 14:22:27 jenniferS: The protocols are about having empathy for the user to implement more of the subjective criteria 14:22:29 Capturing framework, empathy 14:23:10 Jaunita: If you don't have structure around it, it might get abused. 14:23:13 Questions to ask so that you can apply empathy 14:23:41 Jaunita: If you have a statement or saying "following such and such process", and many people can follow in different ways, there could be a method of following that could lead to a less accessible outcome. 14:24:10 Jaunita: And least level of effort. Folks that might not have the budget or are trying to do a lot with few resources might not follow the path that it was intended for. 14:25:32 jenniferS: I agree that we don't want to do this at the expense of outcomes 14:25:52 JF: The problem is that there is no definitive answer 14:26:25 q? 14:26:57 JF: With alt text for example, we can't measure the outcome, but we know it when we see it 14:27:52 ...plain language is another example 14:28:17 ...it has to be accessible to the intended audience 14:28:20 q? 14:28:20 q+ 14:28:52 Jaunita: The point I'm struggling with is how you prove that. Do you require a write out of a thesis of how it was achieved? 14:29:16 q+ 14:29:20 Jaunita: A conformance report can say "I did this", but how do you show that you "did it"? I want to caution about being able to say so w/o any accountability. 14:29:36 ack Jau 14:29:46 My vision was that it would be similar to a VPAT — a report, statement. 14:29:53 JF: There is a level of trust here 14:30:21 Q? 14:30:35 scribe: Chuck 14:30:56 Shawn: I want to say that we have the same issue with VPATs, echoing Jennifer's concern 14:31:00 Shawn: We have same issue with vpat. You trust the statements in a vpat. No different for protocols. 14:31:50 JF: I don't know how we get around it. The goal is not to get a bullseye, goal is to get on the dart board. 14:32:09 JF: Trust is going to have to be a part of it. To me the act of making a public statement that says "we have adopted..." there is a risk attached. 14:32:14 q? 14:32:16 ack tho 14:32:59 JF: One thing that informed me is ISO 9000 series. I drove by a business that had a banner making the claim of being ISO 9000 conformant. They went that far to make a declaration. 14:33:06 q+ 14:33:20 JF: I considered that if I went into the business I would see ways that they met ISO 9000. 14:33:52 JF: They published, so there is some level of truth. And if they mention the protocol, the protocol can be followed and the process used can be evaluated. 14:34:14 Jaunita: My question is, how would you get them to "prove" that? How would you hold them accountable? 14:34:38 Jaunita: Not sure how legal system works in Canada or EU, but I imagine that if there were an effort to hold them accountable, wouldn't necessarily get to court. 14:35:01 q+ 14:35:08 Jaunita: You wouldn't actually answer the question. I'm concerned that people might take the risk like they do with VPAT, and if anybody questions it, it is low to prove to the contrary. 14:35:16 JF: Any different from where we are today? 14:36:05 Jaunita: There's enough to go off of and determine if someone isn't conformance. If we are using this as part of a measuring system of sorts, and we intend it to replace WCAG 2.x, we have enough to hang our hat on and hold people accountable. At least providing a sufficient level of outcome that we would want. 14:36:06 q+ 14:36:11 ack Jaun 14:36:23 q+ to ask that this is an example 14:36:44 ack Tho 14:36:54 Shawn: Where would they state that they are following these protocols? 14:37:35 JF: A whole other conversation, I did have a proposal. Inside W3C, there is something EARL. It's being used in another protocol. W3C already has a mechanism of making conformance reports. 14:38:01 JF: I proposed we would generate a conformance report using this mechanism. 14:38:22 https://www.w3.org/WAI/standards-guidelines/earl/ 14:38:24 JF: Safe surf, early to mid 2000s, a mechanism for specifying parental guidance ratings on web content. 14:38:39 JF: You would make this declarative statement, and link to website. 14:39:01 Shawn: In Canada we are pushing for an accessibility statement on the website. 14:39:18 Shawn: Is that something that we could recommend? Say what protocol you are following. 14:39:24 JF: Broadly yes, that's the idea. 14:39:44 JF: Whether or not mandated by Canadian govt... 14:40:27 JF: Would be one way of doing it programmatically. I envisioned a meta data statement. We have to make sure it works for all types of content. 14:40:37 JF: May vary based on content. PDF, XR for examples. 14:41:02 JF: But you can link one thing to another. If we can live with "you will have a linked statement" that is probably close enough. 14:41:06 q? 14:41:11 ack Ch 14:41:11 Chuck, you wanted to ask that this is an example 14:42:06 Q? 14:42:19 Scribe: Jaunita 14:42:36 JF: We have a number of statements, and I'm not sure we agree 14:42:56 ...Let's get some agreement/disagreement 14:44:22 JF: I think we're struggling with semantics a buit 14:44:34 s/buit/bit 14:45:19 JF: Are we in agreement with this statement 14:45:21 "...methods evaluate outcomes, protocols evaluate objectives¨ seems to be a distinction..." 14:45:39 Straw Poll: "...methods evaluate outcomes, protocols evaluate objectives¨ 14:45:43 +1 if you agree 14:48:54 JF: Not all of the outcomes have been created to WCAG 3.0, protocols could get us closer 14:49:25 q+ to say it describes it for me 14:50:21 ...Protocols need to add to your total score. We're trying to evaluate the subjective criteria. It will be a robust discussion when we decide how to add this to WCAG 3.0 because we don't quite have a scoring model yet 14:52:34 thompsonS: I just can't +1 because we don't have a definition of objectives vs. outcomes 14:53:14 ...It's all the same it seems like. 14:53:55 JF: We haven't gotten to a definition for what a protocol is 14:55:01 Chuck has joined #wcag3-protocols 14:55:34 ...for experts it's instinctive 14:55:57 ...protocols offer guidance for non-experts 14:56:32 +1 to poll via email 14:56:37 +1 14:57:05 Jaunita: I agree with that approach. We could also... bring to larger group even with unanswered questions. 14:58:57 request from AG chairs a block of time for deeper discussion 14:59:35 rragent, make logs public 14:59:43 rrsagent, make logs public 14:59:50 zakim, end this meeting 14:59:50 As of this point the attendees have been JF, Chuck, Rachael, ShawnT, Jaunita_george, MichaelC, jenniferS 14:59:52 RRSAgent, please draft minutes 14:59:52 I have made the request to generate https://www.w3.org/2022/01/28-wcag3-protocols-minutes.html Zakim 14:59:55 I am happy to have been of service, JF; please remember to excuse RRSAgent. Goodbye 14:59:59 Zakim has left #wcag3-protocols 15:00:06 rrsagent, please part 15:00:06 I see no action items