13:57:10 RRSAgent has joined #silver-protocols 13:57:10 logging to https://www.w3.org/2022/01/07-silver-protocols-irc 13:57:28 zakim, start this meeting 13:57:28 RRSAgent, make logs Public 13:57:30 please title this meeting ("meeting: ..."), JF 13:57:48 meeting: Protocols Sub Team: Jan 7 2022 13:58:44 Agenda+ Continue brainstorming the protocols that we believe would be applicable 13:58:53 Agenda+ Other Business 13:59:03 Agenda+ Be Done 14:00:14 Previous minutes: https://www.w3.org/2021/12/17-silver-protocols-minutes.html 14:00:28 ShawnT has joined #silver-protocols 14:00:37 present+ 14:00:42 Chuck has joined #silver-protocols 14:00:54 present+ 14:00:59 Previous minutes: https://www.w3.org/2021/12/17-silver-protocols-minutes.html 14:03:31 Jaunita_George has joined #silver-protocols 14:04:18 Google document: Protocol Proposal: https://docs.google.com/document/d/1JK1UMfSDh0-dVEDuj5xswRU4XwlP50iuTSz8l1VFf-A/edit#heading=h.l62p8ibkxxfn 14:05:51 jeanne has joined #silver-protocols 14:08:30 scribe: Chuck 14:08:44 JF: Good morning, happy new year. 14:09:09 JF: Time to dive in and bring this to a point where we have a proposal to take to larger group. 14:09:13 https://www.w3.org/2021/12/17-silver-protocols-minutes.html 14:09:21 https://docs.google.com/document/d/1JK1UMfSDh0-dVEDuj5xswRU4XwlP50iuTSz8l1VFf-A/edit#heading=h.l62p8ibkxxfn 14:09:22 JF: URL's that are important... 14:09:44 JF: Minutes and google doc. To summarize... 14:10:12 JF: Our last call I got excited, inspired by Jaunita, mentioned decision tree. Characteristic of a protocol, provides step by step guidance. 14:10:31 JF: Useful model. One other thing to introduce was collection of AUR's out of WAI domain. 14:10:48 JF: We need to clearly define what we think a protocol looks like, our last conversation got us close. 14:11:00 JF: Any comments or recollections from past calls before we proceed? 14:11:24 Jaunita: We should also mention difference between protocol maintained by somebody else, and is there a portion we would maintain? 14:11:42 Jaunita: Defines whether or not the protocol was followed and sufficiently meets guideline? 14:12:06 JF: Important data point that we need to resolve. Protocols, do they live only at W3C? Do we accept 3rd party protocols? I'm on the fence. 14:12:37 JF: I thought allowing 3rd parties introducing would be useful addition to idea, but until we have a clear definition... "must contain these things". I don't know that 3rd party protocols would fit that model. 14:13:03 JF: I think we need to clearly define first, and reserve comment. Don't lose the idea, but have the discussion later after we define protocol. 14:13:12 Jaunita: Might make sense to have W3C approve. 14:13:48 JF: Yes, introduces another discussion. What is the vetting process? I think that to make extensible, we should allow for 3rd party, but they need to meet a structure. 14:13:59 JF: If 3rd party presents, W3C will need checklist. 14:14:48 JF: We are still at point of defining structure. We started talking about a guided tour. A walkthrough like decision tree. 14:15:26 JF: Does everybody agree that this is part of what a protocol would consist of? A decision tree process? Or too specific? 14:15:36 JF: Open conversation. 14:16:04 Jeanne: I think a decision tree process seems to exclude some protocols we wanted to include. I'm concerned about defining a protocol as a decision tree process. 14:16:20 Jeanne: It's fine to have it as a protocol, but limiting it to decision trees is too restrictive. 14:16:50 JF: Broadly speaking in my mind. Is the goal of a protocol to provide expert guidance to content creators on how to meet accessibility needs? Do we agree that is what a protocol will be? 14:17:12 Jaunita: Yes, along with some form or addendum you can measure against. If you do x, y, and z, you meet the requirement. 14:17:35 JF: I embrace the idea of some form of repeatability. Alt text decision tree has repeatability. 14:17:56 q+ to say that measurements can be done on inputs not necessarily outputs 14:18:05 JF: Jeanne, Jarred and Mike might look at an image, and all 3 provide good alt text, but all very different. 14:18:30 JF: By virtue of experience they go through in their head. At end of the day that this is the process they used. 14:18:44 JF: Measurability piece is ... is it obvious that they went through the process? 14:18:52 Jaunita: Measurement is, is it sufficient? 14:19:17 JF: But that is arbitrary. Measuring sufficient may be problematic. Very opinion. 14:19:38 JF: If they follow the process in the protocol, they will land in the circle of "sufficient". 14:19:51 Jaunita: I'm thinking that someone follows protocol, but doesn't lead to a sufficient result. 14:20:31 Jaunita: I'd like some repeatability in WCAG 3, leveraging latest research. If you don't, and if you are relying on an arbitrator, and there isn't a line we can draw, it would be difficult to adopt and scale. 14:21:38 Jeanne: I think this is why we can't put protocols at bronze level. We can't require them. If they are required, then they have to be "guidelines". We are already doing guidelines. I'm excited about the fact that it gave us the things that do not have measurable testable repeatable outcomes, look at best practices, that do have some measurement, but don't have to be repeatable. 14:22:07 Jeanne: We can have measurements on inputs. We could say for content usable, you need to hire editors, have a style guide, editorial process. We can do those measurements in advance. 14:22:42 Jeanne: We can put it at a higher level that is not regulatory. Bronze can be regulatory, and companies can have silver and gold levels. Let's stop trying to make it a traditional guideline. 14:23:10 Jaunita: Earlier discussions is that silver would be equiv to WCAG 2.0. Now we are saying bronze. If bronze only includes stuff that can be automated... 14:23:23 Jeanne: To be clear that this is not what I'm proposing. 14:24:03 JF: I've been talking about a different scoring mechanism. TF and WG has not yet selected a scoring mechanism. All options are on the table. My proposal is your total score lines up with the level, bronze, silver or gold. 14:24:19 JF: Not even W3C can claim conformance to WCAG 2.1 A and AA. 14:24:46 JF: In my thought process for scoring, you will be rewarded for public commitment. 14:24:53 q+ 14:24:53 q+ to say that Jaunita is pointing out the flaws in the Single Currency proposal 14:24:57 JF: Companies will be accountable. 14:25:17 ack Jeanne 14:25:17 jeanne, you wanted to say that measurements can be done on inputs not necessarily outputs and to say that Jaunita is pointing out the flaws in the Single Currency proposal 14:25:51 Jeanne: I think that Jaunita is pointing out the flaws in the single currency proposal. If we have a single currency, we will have to have measurability at every level. 14:26:03 Jeanne: We should collect the ideas and arguments and present to AG. 14:26:23 Jeanne: I think we need to review a multiple currency proposal. Jaunita has pointed out flaws of single proposal. 14:26:26 ack Mich 14:26:48 MC: The idea of bronze being equivalent, that's a rule of thumb not a rule, let's not get too concerned. Needs exploration. 14:26:53 q? 14:27:23 JF: Shawn, do you have some thoughts and comments? I want you to have opportunity. 14:27:43 q+ to note public commitment needs to be backed by accountability of procedures 14:27:57 Shawn: New to silver, trying to catch up. I think this is great. Trying to get something from Canada put into this list. Canada has been kind of behind the times. 14:28:05 q+ to reinforce input, not outcome 14:28:08 Shawn: I like the ideas. I'll stay on the wall. 14:28:18 ack Mic 14:28:18 MichaelC, you wanted to note public commitment needs to be backed by accountability of procedures and to reinforce input, not outcome 14:28:48 MC: Talking about public commitments, there needs to be a measurability to those commitments. Some information about the procedures to ensure that they are meeting the commitment. 14:28:57 MC: There's a balance to company internal decisions. 14:29:27 MC: When we talk about protocols, that we are all thinking the same way. We need to focus on inputs: What is it you do to achieve greater accessibility? That's where we should focus. 14:29:34 https://www.justice.gov/open/plain-writing-act/2020-report 14:29:57 JF: I agree with most of that. There is some way of having some accountability. I've pointed to another document that meets my concept is the plain writing req from us fed govt. 14:30:29 JF: Spoke with kirkwood, it's a 2020 report from justice dept. A review of their adoption of plain writing. I think that to that public accountability piece, here's an example. 14:30:43 q+ to discuss conformance vs accountability 14:30:47 JF: Don't know if that meets the model we need, but it is an example of something that fits my idea, as well as the accountability. 14:31:02 JF: Q on table, is that sufficient for our needs? 14:31:16 ack Mich 14:31:16 MichaelC, you wanted to discuss conformance vs accountability 14:31:18 Q+ 14:31:45 MC: We need to be careful about public accountability. Only a factor when making a public conformance claim. Most companies will try and meet without making a public statement. 14:31:54 MC: They may be required to make a conformance plain. 14:32:11 MC: Let's not mix up what's the point of conformance with what's the point of being a good citizen. 14:32:16 s/plain/claim/ 14:32:21 Q+ 14:32:23 ack Jau 14:32:37 q+ 14:32:48 q+ to very controversially refer to user need mapping 14:32:49 Jaunita: If we do this for each of the outcomes, may not be feasible. May put a target on companies. Whenever they make a claim you have drive by lawsuits. 14:33:07 q+ to say protocols != outcomes 14:33:07 Jaunita: Public declarations of how they meet will open up floodgates to critics. 14:33:49 Jaunita: If there is no way to say "we met because we've done x, y, z", and people can come back and say the result doesn't meet the standard, that could lead to problems for companies, especially if it becomes legally enforcable. 14:34:00 Jaunita: More of a rep issue at that point. Depends on how we are using this. 14:34:01 q? 14:34:05 ack JF 14:34:24 JF: I think you hit the nail on the head. I've been looking at a different angle, but close to agreement. 14:34:29 q+ to s/public/targeted/ 14:34:57 JF: difference between protocols is that we are not measuring outcomes, we are measuring inputs. We are measuring the process that the content creator used to arrive at the outcome. 14:35:09 JF: What is the decision tree used to determine that they followed the process? 14:35:32 JF: In terms of target on their back, that's what I'm shooting for. The idea that there is accountability, but not on outcome, instead on the process. 14:35:57 JF: If org adopted plain language, having it public is we are now asking the entity to point to the protocol or process that they used, so anybody can review. 14:36:23 JF: In case of drive by's, if it gets in front of judge, statements of here's the documents that was used. 14:36:24 q? 14:36:28 q+ to say this is all just for claims 14:36:30 q+ 14:36:34 ack me 14:36:34 MichaelC, you wanted to very controversially refer to user need mapping and to say protocols != outcomes and to s/public/targeted/ and to say this is all just for claims 14:36:57 MC: I don't see protocols as supporting outcomes. We have different kinds of outcomes. 14:37:22 https://docs.google.com/spreadsheets/d/1POhgI_xHZtSoNbHFp3r5HYIkl6ePaP8DC5d90SZ1tF4/edit#gid=470134919 14:37:42 +1 to another kind of statement, but I advocate that those other kinds of statements get rewarded for adoption 14:37:46 MC: Can sit along side the statements. This ties into the work that Jake has been leading with functional needs, identifying user needs and functions. We get a matrix and we see what are the outcomes needed to meet the outcomes. 14:37:57 MC: I'm wondering if protocols could follow same model. 14:38:16 MC: I'm not saying this is the proposal that should go forward, but for me it's a useful tool for thinking about this. 14:38:34 Q+ 14:38:44 MC: We keep getting tangled up on "publicness" of claim. We should stay focused on A) conformance claims are not required B) conformance claims need not be made public. 14:38:56 ack Jau 14:39:07 Jaunita: only 2% go to court, most are settled. 14:39:30 Jaunita: When a company makes a declaration, and there are a lot of lawsuits, most will be settled out of court. 14:39:51 Jaunita: You don't have to prove anything to bring a lawsuit, just have a plausible claim. 14:40:24 q+ to ask about lawsuit requirements vs claim 14:40:25 Jaunita: I would bring that point to say when we say we want companies to do this, we need to understand consequences, and see if it's reasonable to ask them to make a claim without thresholds to meet the claim. 14:40:28 q? 14:40:32 ack JF 14:41:00 JF: I want to challenge MC on conformance claims. Today they are not required and not needed to be public. I'm trying to change those 2 statements to be true. 14:41:26 JF: We introduce concept of progamatic conformance claims. Employ WIIFM 14:41:27 q+ to differentiate offering and requiring 14:41:43 q+ 14:41:45 JF: There must be a value in doing a public claim. We would need a framework in place. 14:42:30 JF: It is the introduction of public accountability, and company gets rewarded. That needs to be discussed, and needs to go back to AG. In my mind the way protocols contributes is that there is a value in adopting. 14:42:53 JF: Otherwise they are just best practices. And it doesn't matter how many AAA requirements we have, they don't get adopted because no value in adopting them. 14:42:54 ack me 14:42:54 MichaelC, you wanted to ask about lawsuit requirements vs claim and to differentiate offering and requiring 14:43:13 q+ to say that the advantage to organizations is a higher level which helps protect them from individual violations of required guidelines 14:43:20 MC: My thoughts are a combo of the others. 14:43:29 MC: I don't see how we can require a conformance claim. We can't force. 14:44:02 MC: If we require a public claim, I think some companies will decide the guidance is not for them. 14:44:15 MC: For legal, I don't know that law requires public claims. 14:44:39 MC: Depends on jurisdiction. I don't know if law requires. We should differentiate presumptive vs active conformance claims. 14:45:02 MC: I hear you that if we don't provide accountability, it will be analgous to AAA. I think we want to provide tools where we recommend. 14:45:03 Q+ 14:45:12 MC: I don't think we can force. 14:45:14 ack Jau 14:45:48 Q+ to point to the EU "Cookies" requirements 14:45:56 Jaunita: Let's say it was cyber security. And we required public claims. And company says "our system is unhackable", and one flaw is introduced by vendor, but wasn't there at time of claims... 14:46:04 q- 14:46:40 Jaunita: And someone exploits, anybody can bring a lawsuit. I agree with MC that we shouldn't make required. If it becomes replacement for what is legally binding, it would be difficult for that to become standard. 14:46:47 ack JF 14:46:47 JF, you wanted to point to the EU "Cookies" requirements 14:47:07 JF: I hear what you are saying all, but I'm going to reference in EU... that legal requirement around cookies. 14:47:33 JF: 3-4 years ago we started getting "accept cookie" popups. We have examples where the law says you need to have a privacy statement. 14:47:56 JF: It was a local thing that became world-wide. Having a public statement around cookies and retention is a good thing. The mechanism was there. 14:48:22 q+ 14:48:27 JF: They aren't saying you must accept this cookie policy, but you must have A policy and that must be available. We don't need to encorporate in our model. 14:48:31 q+ 14:48:34 JF: Already a thing today. 14:48:49 q+ to not object to accountability when policy requires conformance 14:48:59 Q+ 14:49:02 Jaunita: That requires that they have a retention process and guarantee rites for individuals. It requires mechanisms and not outcomes. Different if outcomes are required. 14:49:08 ack Jau 14:49:28 Jaunita: Problem is that no matter what a business does, they can't guarantee an outcome if there is no line in the sand. 14:49:47 JF: Are we measuring outcomes or inputs? You focus on outcomes, I focus on inputs. 14:49:49 ack JF 14:50:04 JF: If all structure and framework is in place, we have some confidence that outcome lands in the region. 14:50:10 ack me 14:50:10 MichaelC, you wanted to not object to accountability when policy requires conformance 14:50:23 MC: I'm hearing "how we measure best practices". We need to separate conditions. 14:51:00 MC: We are not requiring conformance, we can have accountability as best practices when conformance is not an option. We need separation of required vs optional. 14:51:01 q? 14:51:35 JF: I'm prepared to admit I'm wrong. We are agreeing on some points, disagreeing on others. 14:51:52 MC: I think we are agreeing on more than not. Close. 14:52:29 JF: I'd like to finish up with... maybe "can we get a bulleted list" on the things we agree on. If we can finish with that list, that would be significant progress. 14:52:36 MC: And we need list of what we don't agree on. 14:52:50 JF: Can MC articulate what we agree on? 14:53:12 MC: I think we all agree that protocols measures inputs and not outcomes. 14:53:13 +1 14:53:15 +1 14:53:15 +1 14:53:19 +1 14:53:30 Decision: Protocols measures inputs and not outcomes. 14:53:40 +1 14:53:42 MC: I think we agree that accountability mechanisms are necessary. 14:53:44 +1 14:53:48 +.5 14:53:52 +1 14:54:10 Decision: accountability mechanisms are necessary. 14:54:48 MC: For measurement, accountability mechanism of protocols corresponds to measurement mechanism of outcome statement 14:55:40 MC: for outcomes, there's a measurement for how you will get scored. There would be same thing for protocol, the actual measurement would be different, but the definition would be similar. 14:55:41 (measurement of protocols = adoption) 14:56:28 understood Jeanne. 14:56:39 +1 14:57:21 +.9 14:57:44 +.5 14:57:47 +.9 also 14:57:59 -1 14:58:00 Decision: For measurement, accountability mechanism of protocols corresponds to measurement mechanism of outcome statement. 14:58:30 MC: Accountability of protocols has same visibility as conformance statement, or is part of conformance claim. 14:58:39 Jaunita: Is claim public or private? 14:58:45 MC: I say we don't require either way. 14:58:46 +1 14:58:52 MC: We would probably recommend public. 14:58:57 -1 to us not requiring 14:59:16 +1 to chuck 14:59:19 Undecided: Accountability of protocols has same visibility as conformance statement, or is part of conformance claim. 15:00:01 zakim, make logs public 15:00:01 I don't understand 'make logs public', JF 15:00:24 zakim, end this meeting 15:00:24 As of this point the attendees have been ShawnT, Chuck, .5, .9 15:00:25 RRSAgent, please draft minutes 15:00:25 I have made the request to generate https://www.w3.org/2022/01/07-silver-protocols-minutes.html Zakim 15:00:29 I am happy to have been of service, JF; please remember to excuse RRSAgent. Goodbye 15:00:33 Zakim has left #silver-protocols 15:00:41 present+ 15:00:45 rrsagent, make minutes 15:00:45 I have made the request to generate https://www.w3.org/2022/01/07-silver-protocols-minutes.html MichaelC 15:01:14 rrsagent, please part 15:01:14 I see no action items