15:41:56 RRSAgent has joined #ag 15:41:56 logging to https://www.w3.org/2021/12/14-ag-irc 15:42:00 Zakim has joined #ag 15:42:03 zakim, start meeting 15:42:03 RRSAgent, make logs Public 15:42:04 Meeting: AGWG Teleconference 15:42:49 regrets: Sarah, Allistair G 15:43:58 agenda+Review how this session will be managed 15:44:10 agenda+ Review process changes made to date 15:45:44 agenda+Review previously raised challenges from the November session and discuss what is missing 15:46:00 agenda+ Review initial list of root causes and discuss what is missing or needs revision 15:48:13 agenda+ Next steps 15:48:46 Chuck has joined #ag 15:52:24 janina_ has joined #ag 15:52:29 present+ 15:52:36 SuzanneTaylor has joined #ag 15:53:30 SuzanneTaylor has joined #ag 15:53:54 bruce_bailey has joined #ag 15:55:19 mgarrish has joined #ag 15:55:54 bruce_bailey_ has joined #ag 15:56:19 agenda? 15:57:49 Breixo has joined #ag 15:57:57 chaals1 has joined #ag 15:58:03 Jen_G has joined #ag 15:58:20 Present+ 15:58:24 Present+ 15:58:39 JF has joined #ag 15:58:40 Jemma has joined #ag 15:58:49 Lauriat has joined #ag 15:58:51 Present+ 15:58:58 Present+ 15:59:01 present+ 15:59:03 Aimee_U has joined #ag 15:59:05 present+ 15:59:10 present + 15:59:13 present+ 15:59:32 present+ 15:59:34 present+ 16:00:10 LisaSeemanKest_ has joined #ag 16:00:33 present+ 16:00:37 present+ 16:00:46 present+ 16:00:54 Nicaise has joined #ag 16:00:58 present+ 16:01:06 AngelaAccessForAll has joined #ag 16:01:07 present+ Léonie (tink) 16:01:12 present+ 16:01:23 Azlan has joined #ag 16:01:44 MelanieP has joined #ag 16:01:45 Jennie has joined #ag 16:01:51 present+ 16:01:53 present+ 16:02:18 present+ 16:02:44 MarcJohlic has joined #ag 16:02:45 present+ 16:03:04 laura has joined #ag 16:03:13 shadi has joined #ag 16:03:51 agenda? 16:04:06 present+ 16:04:28 Raf has joined #ag 16:04:32 scribe: Rachael 16:04:45 JennC has joined #ag 16:04:47 Wilco has joined #ag 16:04:50 present+ 16:04:51 zakim, take up item 1 16:04:51 agendum 1 -- Review how this session will be managed -- taken up [from Rachael] 16:04:52 present+ 16:05:20 Chaals: We will follow the agenda and focus on listening. I will ask a few questions and then go back to listening. 16:05:26 present+ 16:05:37 present+ 16:05:46 present+ Laura_Carlson 16:06:05 ...As we work through issues, there are a few things I'd like to you to focus on. When answering the question, please focus on the question. You can also +1 items in IRC. 16:06:19 ...please do put your hand up and speak (use q+ to add yourself to queue). 16:06:38 mbgower has joined #ag 16:06:45 q? 16:06:45 Q+ to ask if we have defined "success" for this exercise 16:06:52 ...if you've +1 then you dont' need to repeat an idea. We have the whole meeting. I plan to give people enough time to speak but not an unlimited time to speak. Questions? 16:06:57 ack JF 16:06:57 JF, you wanted to ask if we have defined "success" for this exercise 16:06:58 present+ 16:07:19 JF: My question is do we have a working definition of what success is? I'm looking at the agenda. Can we get the big goal articulated? 16:07:40 chaals: Very good question. Does anyone have a sense of what they think before I answer the question from my sense? 16:07:50 present+ 16:08:10 present+ 16:08:46 TY 16:08:47 q+ 16:08:54 ...my sense of success is that we have a clear agreement across the group that we have a good working process and have addressed the issues and that previous problems will have been addressed. If people are still unhappy on how the group is making progress, we will not have acheived success. We will ask how much success we have acheived and how much more time we want to put into the exercise. thoughts? 16:08:57 +1 16:09:01 +1 16:09:03 ack Chuck 16:09:39 Chuck: I think its a big ask to assume everything will have been solved by the end fo the call but if we can identify data points that can be acted upon, even if we don't come to solutions, that would be a measure of success. 16:09:43 +1 to Chuck 16:09:47 +1 16:09:56 +1 16:10:39 Chaals: That is a reasonable level of compromise I can live with. I've been committed to be available to this meeting and the next meeting, if needed. If at the end of the next meeting we think there is a lot farther to go, we should be taking stock. 16:10:49 zakim, take up next item. 16:10:49 agendum 2 -- Review process changes made to date -- taken up [from Rachael] 16:10:57 Is next meeting next weeK? 21 December? 16:11:18 Chaals: The process has been recently tweaked. 16:11:20 scribe:alastairc 16:12:17 Rachael: To address some of the issues, we've made a couple of process changes. A lot of discussion around the WCAG 3 document, marking that up. We've also tried to rely more on surveys, and reviewing the surveys differently 16:12:29 ... those changes came out of the previous discussions, but we realise there is more to go. 16:12:48 chaals: From the retro or separately? 16:12:59 Rachael: Some from the retro, and ongoing conversations in this group. 16:13:24 chaals: I've read the minutes of the meeting where you looked at the proposal, looked at the proposal, it had a 2 month timeline to review. 16:13:29 minutes from previous meeting: https://www.w3.org/2021/11/05-silver-minutes.html#t02 16:13:31 ... is that what you expected? 16:13:40 Q+ 16:13:40 q+ 16:13:51 ack jf 16:13:58 Scribe: rachael 16:14:40 JF: Two things I noticed have been working well, is that we have agenda questions prior to the call, and ask people to respond in writing. That's managed to shake out the conversation more quickly. Also appreciating that the chairs are time-boxing things. 16:14:42 JF: Two things that have been working out well from my perspective. We send out a list of questions before the call and ask people to write back before the meeting. I'm liking that. I'm also appreciating that the chairs timebox items. That has also been quite helpful. 16:14:45 +1 to jf 16:14:50 ack al 16:15:19 +1 to JF's comment about the chairs doing a good job. 16:15:20 q+ 16:15:31 ack chu 16:15:39 alastair: In terms of publishing, its a bit early to say. We are going to mark up the document with maturity labels. We have a mockup of that but we need to get that into a proper PR to share with the group. After that it will hopefully be more obvious there is an new process and people can see the difference. 16:15:41 alastairc: It's a little early, as we haven't published the new labelling yet. 16:16:13 +1 to that Chuck 16:16:24 Chuck: from the perspective of running that process, it feels as though we're giving more voice and attention to people who hadn't provided their voice in the meetings. 16:16:31 +1 to JF regarding surveys giving structure 16:16:41 q+ 16:16:46 +1 to Chuck 16:16:47 Chuck: From the perspective of reviewing responses and running that process, it feels as though we are giving more voice and attention to individuals who have not in the past had the same opportunity to express their opinions. That is from the chairs perspective. Hope we can get feedback from those individuals. It seems to be working from our perspective. More diversity in voices/opinions. 16:16:48 scribe: Rachael 16:16:52 ack lis 16:17:39 LisaSeemanKest_: There was a concern from members of COGA who don't like filling out the surveys. There are a couple of problems with them. They've gotten a lot better in terms of people feeling confident. Its still not the preferred format for some people who'd like to participate. 16:18:16 chaals: this is the big question I had next. Its not perfect. Still people who are feeling like its difficult to be heard but its better? Is that a fair summary? 16:18:21 +1 to Lisa regarding survey barriers esp. COGA 16:19:04 LisaSeemanKest_: There are COGA members on the call who I invite to share their experience. If you don't have a channel that people feel comfortable speaking out on, then you won't know you are missing those voices. That tends to happen when we survey. Theres a group of people who you don't necessarily know you are not getting feedback from them. 16:19:34 q+ 16:19:38 chaals: I think we should mark this point down. 16:19:38 I'm making a list... 16:20:02 ack jan 16:20:24 Kim_patch has joined #ag 16:21:11 +1 - timelines are often quite short 16:21:30 +1 16:21:34 janina_: I am a bit concerned about using surveys to track conversations. The questions are put out on Thursday. A few responses come in on Sunday and Monday. Big stream in the last hour before the call come in. Its hard to track. On the call itself, we reiterate what is said in the surveys. I'm not sure its the best efficiency. Do others agree it needs some fine tuning? 16:21:36 +1 16:21:42 +1 16:21:57 WOuld an earlier deadline for survey responses partially address that? 16:22:27 chaals: If people are feeling this in the group, I imagine Coga are probably feeling that too. 16:22:46 +1 to chuck - sometimes coga group are the canary 16:22:52 q? 16:22:58 q+ 16:23:06 q+ 16:24:01 What are suggested alternatives to surveys? 16:24:09 LisaSeemanKest_: This is a concern brought up in the COGA taskforce a few times. They used to be a lot more complicated. Still multistep processes. Not sure. You have to open multiple tabs and the orientation process may be hindered by someone's disability. Even people who work in the field struggle. We have given that feedback. Use a google doc as well or call on people during call. If you structure conversation on survey results. To make it 16:24:09 inclusive, use survey plus another mechanism 16:24:32 bruce_bailey_: I heard John Kirkwood say its the latter one. 16:25:40 kirkwood: First I was queued to bring in that it becomes especially difficult when surveys are integrated with Github. Its hard to track. People feel uncomfortable saying anything because they aren't sure they have the information they need. 16:25:43 +1 to GitHub complicating surveys. 16:25:55 +1 it's difficult to know where to find discussions and information because it's split across multiple places (email, surveys, meetings, Github etc.). 16:26:10 chaals: I had asked if the problem COGA was having was that it was complicated. I think you answered that you think feedback is being dropped. 16:26:11 +1 to Tink 16:26:18 [good first question mbgower (there are many possible answers).] 16:26:19 q? 16:26:23 kirkwood: I am not comfortable with answering for all COGA. 16:26:27 ack br 16:26:28 ack kir 16:26:36 Q+ 16:26:39 q+ for a new topic 16:26:57 ack jf 16:27:53 JF: I think one of the problems is that the information is scattered over multiple places. I do not like using google docs. I find them next to impossible to find. File management in Google docs doesn't work for me. We have emails, surveys, github. Part of the problem is that no one solution works for everyone, so we use multiple solutions that doesn't work for anyone 16:28:46 q- 16:28:48 ack ti 16:28:48 tink, you wanted to discuss a new topic 16:28:50 q+ to say what the current workflow is supposed to be... 16:28:57 chaals: I think that in my experience lots of places cause problems but I recognize the irony of a group on inclusion saying you must use this even though its not working for you. Note what solutions can we live with vs what ar etoo hard? 16:29:45 +1 to tink on strongest vs loudest objections 16:30:02 AWK has joined #ag 16:30:09 +AWK 16:30:10 +1 to tink 16:30:22 [chair hat off: +1 to the distinction between "strong" and "loud" objections being important] 16:30:28 is there something that we can use that's interoperable, similar to RSS? 16:30:44 q/ 16:30:45 q? 16:30:50 +1 to tink 16:30:54 q? 16:30:54 ack alast 16:30:55 alastairc, you wanted to say what the current workflow is supposed to be... 16:30:57 tink: As someone who used to be in the group but came back after a break. In meetings, sometimes we mix up "strongest objections" with "loudest objections" I wonder what affect that has on new members who aren't used to the feistiness of W3C life. I wonder if it leads people to leave. I suspect its related to the bit in the decision making process. I expect it may relate for the process part that says striving for unanimity. That means that a 16:30:57 few louder voices can block things. I wonder if it got out of shape somewhere without anyone realizing it? 16:30:59 +1 to tink 16:31:04 +1 to agree that consensus is not necessarily unanimity 16:31:04 +1 to tink's comment of strongest objection vs loudest objection 16:31:13 +1 16:32:28 alastairc: We have various mechanisms for gathering issues but they are supposed to end up in github. we have two types of surveys. One is backlog surveys that center on github issues. That may have one issue or hundreds of comments. It may end up in a proposed change and/or a response. The survey is our mechanism to bring it into one place. What we have tried to do is to encourage as many people as possible to fill in the survey to have 16:32:28 people's thoughts in advance... 16:32:40 q+ 16:33:17 we can start to pick out topics. That helps us, the chairs, to structure the conversation a bit better. But that is our backlog type survey. We also use the same mechanism to discuss more open questions like when we are going to review a whole document. 16:33:37 KimD has joined #ag 16:33:53 ...its expected there will be bigger variety of opinions on these. Surveys are used for very different types. Sent out on Thursday. Respond by Tuesday. IS helpful for us. 16:33:58 scribe:alastairc 16:34:31 q- 16:34:55 Q+ 16:34:57 janina_: At the risk of trailing something I just complained about, what about an earlier cut-off for the survey? 16:35:03 ack jan 16:35:11 ... encourage people to get in earlier rather than last minute. 16:35:26 jon_avila has joined #ag 16:35:28 ... could think about email as another mechanism, but look to make them more efficient. 16:35:31 present+jon_avila 16:35:32 q+ 16:35:44 ack me 16:35:48 chaals: Please hold off on solutions for now, we're trying to understand the issues. 16:35:50 ack me 16:35:58 I think closing off the survey would prevent people from getting their input in. 16:36:22 JF: On Janina's comment, they go out thursday, not enough time to tuesday. 16:36:34 present+ 16:37:03 present+ 16:37:30 chaals: we've discussed the changes since Nov (Oct), but the question is what are the actual problems we're facing? 16:38:10 ... what are the problems you are facing still? 16:38:18 https://docs.google.com/document/d/1Kjovufu66f_k0cA06uBlPWXQWqwO-In4RW9NfCJQYW0/edit# 16:38:30 q+ 16:38:34 https:/www.w3.org/2021/11/05-silver-minutes.html 16:39:23 ack Ch 16:39:56 Issue: Fear of publication 16:39:56 Created ISSUE-56 - Fear of publication. Please complete additional details at . 16:40:45 chaals: Please speak from your own perspective. If you aren't comfortable saying that hear, please email / talk to me over the next week. 16:40:46 Are we having closed captions on the Zoom meeting? 16:41:30 Google doc Rachael shared has a great summary. 16:41:33 I got it to work- thanks. 16:42:04 janina_: We're looking at WCAG 2.2 which is end state, but also looking at very early stages of WCAG 3. We're so far from updating the working draft. 16:42:20 +1 (and then some) to Janina and struggling to put words even into Editors' Draft. 16:42:29 +1 16:42:38 chaals: I've seen expressed in various minutes both sides of that discussion. There are different issues at hand. 16:42:51 +1 16:43:07 +1 to janina's point, that it should be easier to publish 16:43:08 ... and it helps to +1 when someone (e.g. janina in this case) makes a point you agree with. 16:43:13 my issue the barriers (slowness) lack of stuctured embracing of collaboration in real time iditing (weither mcrosoft/google docs) 16:43:35 q+ desparately need that 16:43:50 +1 we should be able to publish (WCAG 3) often to get feedback. 16:44:01 ack kirk 16:44:25 Q+ to reiterate my disdain for Google Docs 16:44:34 q- JF 16:44:40 kirkwood: Not having a sandbox or a collaborative live environment, e.g. google docs or online word, so that we can each jump in and comment, or add editorial changes. We seem very behind the times on that. 16:44:51 LisaSeemanKest has joined #ag 16:45:00 ... we need to take advantage of that more. 16:45:06 q? 16:45:09 q+ 16:45:17 ack lis 16:45:19 q+ 16:45:24 q+ to ask a question about the sandbox idea 16:46:25 Lisa: Apologies if I missed something (internet issues). My concerns with moving forward with WCAG 3, is that we wanted to ask some questions on a draft. We made some alternative versions to ask about granularity of templates keep shifting. 16:46:56 ... we were advised to get these drafts as good as we could before even asking the question. But it brings up big risk of having to do the work 10 times. 16:47:32 ... running the risk of not being able to create materials of a high enough standard before we can ask questions. 16:47:46 ... seems a good way to ensure we burn out. 16:48:15 ... We've got to be working together to address the user-needs, which needs to be first, before we worry about later things (like testable). 16:48:17 Q+ 16:48:18 q+ to ask Kirkwood to state whether his point is that tools can be better, or that putting things where we can see them and play with them is important, or both 16:48:27 ... if we shut things down too quickly we can't do that. 16:48:45 +1 to Lisa about testability being more valued than addressing user needs 16:49:21 Lisa: If we had a sample, e.g. is this a good structure, we're being asked to make sure it's high standard, pre-empt questions on testability etc. 16:49:34 ... otherwise people shut it down straight away. We can't work like that. 16:50:03 ... can't experiment, can't get the right granuality sorted out. Also feels like we're not sympathetic group that is working together. 16:50:58 +1 to Wilco 16:51:11 +1 to Wilco 16:51:29 +1 to WIlco - a huge concern that will result in greater thrash down the road if a regular practice. 16:51:34 Wilco: Firstly, I have a feeling that people try to bypass AG, and bypass the discussions that normally happen in AG. E.g. peices of WCAG 3 that haven't been discussed in the group at all. There was a generic survey for agreeing publication. In doing that, wanting to go to the public before the group, it's the most important line of reviewers. 16:52:00 ack me 16:52:00 tink, you wanted to ask a question about the sandbox idea 16:52:06 +1 to risk of publishing too soon. I have been inundated by questions about this new contrast algorithm. 16:52:16 ... there's a risk to publishing things too soon. E.g. the colour contrast algorithm. There's currently a demand in the public for building this into various tools even thought it's not ready yet. 16:52:21 ack wil 16:52:21 ack wilco 16:52:24 ack jf 16:53:01 JF: I agree that user-need is an important consideration. That seems to be obfuscating developer needs. We have to balance those. 16:53:14 +q to say: Fear of publishing a draft that some think it is not ready or heading in the wrong direction. It is hard to get something out of a draft once it is in. 16:53:30 ... The implementers are the ones who have to act on things, and test them. 16:53:34 We people with disabilities have to USE the products that aren't accessible. 16:53:36 q- later 16:53:37 q+ 16:53:41 ... it can't be for users-alone. 16:53:41 -1 that we are specifically trying to address needs of large organizations 16:53:49 +1 to Wilco's concern, also appreciating the particular example that he provided, and the risks of early implementation without potentially insufficiently vetting 16:54:10 laura: there is a fear of publishing a draft that isn't ready because it is hard to get things out. 16:54:24 ... consensus can be frustrating, I've experienced that. 16:54:30 +1 to both the importance and frustration with consensus process :) 16:54:46 @jeanne that is not what I suggested - I am saying we need to solve problems for *both* groups, users AND implementers 16:55:01 +1 for a lot of representation of implementers 16:55:42 LisaSeemanKest: Implementers are very well represented here. The bigger ones have resources. Not worried about the implementer or testing-companies views will be under-represented. The difference between the user-needs in the supplement compared to WCAG was huge. 16:56:07 ... that shows how the user-needs aren't adequately represented, rather than the needs of implementors. 16:56:24 +1 to Jeanne for unbalanced voice, specifically stronger voice by testers and implementers. 16:56:24 s/implementors/implementers 16:56:54 +1 16:56:55 +1 16:56:58 +1 16:56:58 s/obfuscating developer needs/obfuscating implementers needs 16:57:00 chaals: Straw poll - Do we give enough priority to the needs of implementers. +1 for yes 16:57:01 +1 16:57:03 +1 16:57:06 +1 16:57:13 +0 16:57:13 +1 16:57:14 +1 16:57:15 +1 16:57:16 I am conflicted because of my different roles 16:57:17 0 16:57:21 +1 to lisaseems and user needs 16:57:29 can you clarify which stage of the process you're talking about? 16:57:31 +1 16:57:32 -.5 16:57:34 For WCAG 2.0/2.1 or in all documents? 16:57:39 +1 16:57:51 0 16:57:55 0 16:58:01 +1 by the end of the process, but agree we should start with user-needs. 16:58:06 q+ 16:58:09 -1 if by by implementors you mean content owners/authors, we are under represented in AG, better in Silver TF 16:58:09 Q--Actually produced = TR? or just WD 16:58:13 ack me 16:58:16 0 = adequately balanced 16:58:23 +1 by the end of the process, but agree we should start with user needs. 16:58:41 +1 by the end of the process, but agree we should start with user needs. 16:58:47 +1 by end of the 2.1 process 16:58:50 Agree with Kim. Content authors, except for the very large ones, are not well represented here 16:59:02 q+ 16:59:08 s/lisaseems/lisaseemankest/ 16:59:08 can we also ask if user needs are adiquatly represented ? 16:59:24 -1 16:59:25 -1 16:59:30 -1 16:59:30 -1 16:59:31 -1 16:59:31 -1 16:59:32 -1 16:59:34 Which user? 16:59:34 +1 16:59:36 -1 16:59:37 -1 16:59:41 +1 16:59:42 -1 16:59:45 +1 16:59:46 -1 in some ways 16:59:47 +1 16:59:50 0, some are, some are not 17:00:04 Different disabilities are represented more or less adequately 17:00:17 0, it starts there (generally), but in normative requirements can get filtered out by the end. 17:00:21 (-1 in AG, better in Silver) 17:00:21 +.75 17:00:22 aka I think representation varies by category 17:00:23 (or as JF would say it -5) 17:00:25 0 "users" is an awfully big pool 17:00:27 0, some are, some are not 17:00:32 0 17:00:40 retracting back to 0 - some are, some not 17:00:44 .5 17:00:52 0 17:01:03 q? 17:01:10 q- later 17:01:16 ack lau 17:01:16 laura, you wanted to say: Fear of publishing a draft that some think it is not ready or heading in the wrong direction. It is hard to get something out of a draft once it is in. 17:01:18 0 17:01:32 Jaunita_George has joined #ag 17:01:35 Present+ 17:02:19 [+1 to the concern abut whether this is forming up "camps" … that would be an unfortunate outcome] 17:02:19 q+ to say a more interesting poll to me would be the question 'do you think the 3.0 process to date is achieving..." 17:02:36 q- later 17:02:50 shadi: I'm a bit concerned about how this is framed, in terms of camps. People have expressed that not all users are the same or treated the same of equivalently. We need to think about implementability, even in the spirit of WCAG (2) some things are difficult to implement. 17:03:06 +1 to Shadi - implement-ability is closer to what my concern is, as opposed to 'implementers' 17:03:36 ... so the question is how we formulate things to make it feasible, rather than delineating camps. 17:03:45 ack me 17:03:51 ack Jennie 17:05:02 JennC: Similar to shadi, I think the term "implementer" is the reason I struggled with the question. It could included users, implementers. On COGA, I'm aiming to increase inclusion for people with cog issues. Also trying to teach 40k people to create content. So budget for implementer is really hard to define. 17:05:08 .... have to consider all of the audience. 17:05:10 +1 to Jennie 17:05:30 ... not sure all of the roles are being considered. We want something that is used. 17:05:38 q+ to ask the scope/definition of implement-ability 17:05:48 zakim, close queue 17:05:48 ok, Rachael, the speaker queue is closed 17:05:50 ack mbgo 17:05:50 mbgower, you wanted to say a more interesting poll to me would be the question 'do you think the 3.0 process to date is achieving..." 17:06:34 q- later 17:06:51 mbgower: On that last question, if you made it 'implementability' rather than implementers. you might get different responses from people involved in 2 vs 3. We're trying to find better ways to capture user inputs, and implement those in reasonable ways. 17:07:19 ... noting dissatisfaction with the amount of output with things going into 2.1. 17:07:43 ... there were about 70 candidate criteria and we ended up with about a dozen [ed - 18 I think] 17:08:03 ... solving that problem is a pain point. 17:08:15 ack je 17:08:15 Jemma, you wanted to ask the scope/definition of implement-ability 17:08:57 +1 to jemma 17:09:18 +1 to focus on automated testing and true false testing 17:09:20 Jemma: I think Michael Gower addressed it well. I really like implementability, it's important for the standards to be acceptable. But hearing it here, it tends to be about automated testing. 17:09:22 +1 17:09:24 +1 to jemma 17:09:35 chaals: Let's take a break for 3 minutes. 17:09:44 +1 to Jemma 17:10:12 +1 to John about the importance of efficient, collaborative tools 17:12:05 scribe: jeanne 17:13:00 [for the record, I mentioned several parameters beyond testability, including understandability and applicability in practice] 17:13:46 Q+ 17:13:56 Q+ 17:14:01 zakim, open the queue 17:14:01 ok, chaals, the speaker queue is open 17:14:06 Q+ 17:14:40 chaals: We are looking at problems that people have looked at 17:15:05 ... When participation lowers, it can reduce diversity of perspectives & voices, and the number of people aware of the details of the work 17:15:26 ...One person, unfamiliar with the details, can enter a group and shift direction unexpectedly 17:15:32 ... A few prominent voices can end up represented above other perspectives present 17:15:43 ... Work should not have gone to a second attempt-at-consensus 17:15:56 ... The inconsistent results of those attempts shows a lack of certainty in that consensus 17:16:10 ... Surveys prompt a closer look from the larger group who haven't looked at it before; shows potential gaps in keeping the group in the loop and our overall process of review may have missing steps 17:16:22 ack me 17:16:22 chaals, you wanted to ask Kirkwood to state whether his point is that tools can be better, or that putting things where we can see them and play with them is important, or both 17:16:23 ... The groups do not view themselves as a cohesive unit. AGWG’s role as the approving body causes friction with Silver, particularly when work does not move forward. Silver members see themselves as workers without a representative voice in the approval process. This results in frustration which leads to Silver members leaving. 17:16:35 I agree with Shadi's concept of implementablity principles. However, my observation in wcag and silver discussion has been heavily focused on whether it can tested "automatically" or even the SC is cost effective to be used for automated testing. 17:16:36 ack JF 17:17:18 s/can tested/can be tested/ 17:17:28 JF: Testability: I don't think that testability has to be machine testable. I look at Content Usable from COGA with a specific outcome without a metric. I think they are testable. 17:17:52 ... they are not a specific measure, you can know it when you see it and this is how you can recognize it. 17:18:14 ... when people have to implement and do them, they need a measure to know if they did it successfully 17:18:44 ... it has to be more than machine testable, but we have to know in some level of confidence that two people can agree it has met the needs 17:18:56 Very few things in WCAG are fully machine testable - agree that SC are not held to a standard of 'must be automatically testable' 17:19:16 +1 awk 17:19:28 +1 to awk 17:19:45 chaals: are there other problems that we need to address? 17:19:55 q+ 17:20:02 q+ 17:20:06 ack li 17:20:19 ... several people have said that some people have said that the difference between the completion level of 2.2 and 3.0 is a problem 17:21:04 +1 that it's hard for this one group to finalize 2.2 while organizing and promoting a nascent 3.0 17:21:12 LS: Content Usable does have a section of how things can be tested and some are by user testing. If you have tested these things, you have done a decent job of implementing it. 17:21:50 ... when we got rid of user testing in WCAG, that was a big change. User testing is a great way to know that something is implemented properly 17:22:16 chaals: I'm going to back to the issue of testing and testability. 17:22:35 +1 with that requirement 17:22:47 +1 to Charles 17:22:47 +1 17:22:58 +1 17:23:01 +1 17:23:13 +1 17:23:19 +1 17:23:29 +1 17:23:29 Q+ 17:23:34 ... is there any disagreement with the idea that when we produce a recommendation, it includes that it explains how to implment it and know whether you have implemented it or not? 17:23:35 -1 to minor diffs 17:23:43 JF: Implemented properly 17:23:46 Yes, minor differences matter 17:23:58 q+ to say I wouldn't use the word test 17:23:59 Chaals: I will wait on that interpretaion. 17:24:16 +1 because pretty sure there will be minor differences ! 17:24:19 ... let's also look at whether we can ignore whether there are minor differences in implementation 17:24:37 how minor? 17:24:39 ack jf 17:24:40 Minor differences *may* matter, *and* they already exist in WCAG 2.x 17:25:08 We need to eliminate subjectivity whenever possible. 17:25:34 JF: I agree there must be some level of testability, for example, a text alternative with a useless alternative 17:26:28 ... we received feedback that counting is too difficult and we received feedback from stakeholders that counting is onerous. I'm concerned about the adoption of that. 17:26:44 q+ to ask about the challenge of so much work in parallel, from one of the issues raised. 17:27:24 ack mb 17:27:24 mbgower, you wanted to say I wouldn't use the word test 17:27:24 MG: I agree that we want to have an area that is clearly about what is testable and repeatable. I don't think there has to be a "no go" are that are process related and maybe the final outcome may not be identical. 17:27:41 q+ 17:27:59 +1 to MG 17:28:21 ... within a team, you can agree that something meets the guideline, without having it is fully testable and reproducable 17:28:26 +1 to MG 17:29:08 +1 to MG and thanks for explanation associated with detailed workflow of measurement 17:29:12 LS: This fits in with what Mike Gower is saying that there are many ways of testing and we need to be open to that. 17:29:38 scribe: Chuck 17:29:58 chaals: If you are ok to have minor differences in results, then you should put that in IRC 17:30:00 Rachael: You had asked what other issues other than what is on the list. I float that we may be beyond communication and tools have a challenge with trust. 17:30:21 +1 17:30:22 Rachael: Not sure it's there or not, but want to raise with the group for consideration. Lots of work coming up, and a need for us to not all have to be present. 17:30:23 +1 to Rachael 17:30:30 Rachael: Is there a gap? 17:30:37 "minor differences" is too hypothetical - some are ok, some are not. 17:30:42 chaals: In any group is a critical question. 17:30:42 +1 to Rachel and needing to trust each other to make good decisions. 17:30:49 +1 to Rachael; esp. vis a vis what we expect from 2.2 as opposed to 3.0 17:30:49 As an example: "test your design with diverse users" a company can come up with their processes to achieve this, potentially publish that process, and confirm it is met with a release 17:31:06 In thinking about testability I keep coming back to this question: it useful for us to recognize that something is an issue for users even if we can't test it? 17:31:08 +1 to a gap in trust 17:31:12 q+ 17:31:16 chaals: I'm glad that was asked. It's unlike us... if people think there is a gap in trust, if its holding the group back, if you are comfortable providing your opinion, please do so. 17:31:18 +1 to Rachael 17:31:18 +1 - yes, gap in trust 17:31:22 +1, minor differences are ok, but it is probably best to separate into different levels. E.g. small differences guidelines around technical aspects (e.g. page language), but allowing for more at the process/protocol level. 17:31:23 q- 17:31:28 chaals: I understand that some may want to answer privately. 17:31:33 q+ 17:31:34 +1 there is a gap in trust 17:31:40 chaals: I will keep answers in confidence if provided through other channels. 17:31:46 +.5 yes, gap in trust 17:31:49 +1 to Alastairc 17:31:50 +1 there is a gap in trust 17:31:57 +1 yeah 17:31:59 +1 gap in trust 17:32:00 chaals: Appears consensus on this point. 17:32:03 q+ 17:32:07 chaals: I have no answer for in next 30 minutes. 17:32:14 ack me 17:32:14 alastairc, you wanted to ask about the challenge of so much work in parallel, from one of the issues raised. 17:32:16 chaals: Alastair had a different but important question. 17:32:19 result of Covid and lack of in person meetings? 17:32:45 Alastair: I'll continue Rachael's point. More raising the issue, in order to get WCAG 3 done, much has to be done in parallel. One thing that came up is that people work on something... 17:33:19 Alastair: gets to survey... The wider problem or example is that we have lots working in parallel, new guidelines, conformance, etc. We have to work in parallel. 17:33:46 Alastair: What mechanisms can we use to stay up to date on the parallel activities. What would work for the members w/o being overwelmed? 17:33:49 ack ls 17:33:54 ack lis 17:33:56 LisaSeemanKest_ has joined #ag 17:33:57 The feeling that no one is trying to game the system 17:34:41 chaals: Trying to call on Lisa... 17:34:49 chaals: will come back. Wilco. 17:34:57 sorry im back 17:35:08 start with using tools that allow people to collaborate more efficiently in the first place and follow what has happened 17:35:21 q_ lisa 17:35:27 q+ lisa 17:35:34 s/q_ lisa// 17:35:34 Wilco: Expressing my own sense of distrust. Reflecting on what Rachael said, there are a number of people in the group that I don't trust will represent the testability requirement very well. 17:35:50 +1 to Wilco I have a similar sense 17:35:56 Wilco: I need to see everything because at some point things may get put in that are difficult to take out if I don't see it. 17:36:09 Wilco: that's what is making me nervous, I don't know what to do about that. 17:36:15 +1 to Wilco 17:36:22 +1 to Wilco, I feel similarly 17:36:27 +1 to Wilco 17:36:29 chaals: Appreciate the way you explained it. 17:36:35 Kudos to Wilco for such honesty. 17:36:38 +1 I don't like having the feeling that someone is trying to game the system 17:36:46 Yes, if everyone feels a need to check everything, that makes work very slow... 17:36:56 It is hard to get something out of a draft once it is in. 17:36:59 chaals: Helps us to understand the problem. I can see that we can find ways through this and not take 50 years. 17:37:07 Wilco++ 17:37:14 q? 17:37:23 ack Wilco 17:37:29 ack janina_ 17:37:51 Janina: Thank you Wilco. When something is put in it can be hard to take out, so it's important to not mischaracterize when it is put it in. And that also fits in with fear of publishing. 17:37:58 q+ to say seeing diaparity in who is doing the work. 17:38:16 Janina: Maybe we need to work on putting in and pulling out. maybe we can frame it differently than "trust". I see us relitigating same questions. 17:38:46 Good on you in your want/desire to get it right Wilco 17:38:46 Janina: It's a lack of cohesion. I blame the fact that we are still trying to do 2.2 which has a different set of orientation than 3.0. That's my characterization of the trust question. 17:38:49 +1 to jaunita george 17:38:57 There is a fear of publishing a draft that some think is not ready or heading in the wrong direction. 17:39:53 Tink: I want to agree that there is a lack of trust, I have listened to many participants express their concerns. Agreeing with Wilco's side, I've seen decisions that I have had difficulty trusting. There are concerns creating guidelines that get entrenched in regulation and the user needs. 17:40:06 +1 to tink 17:40:21 q+ 17:40:24 +1 17:40:25 Tink: I struggle with that. There is a lot of focus on writing guidelines for legislatures and policy makers, but struggle with trusting that this is at the detriment to individuals with disabilities. 17:40:29 +1 tink 17:40:32 +1 thanks for sharing another level of trust issue. 17:40:37 ack tink 17:40:42 +1 17:40:58 +1 with Tink - a LOT of focus on making "legislatable" guidelines. 17:40:59 +1 to tink -- that too much focus on being adopted by regulators 17:41:03 ack lisa 17:41:15 Lisa: I have thought the same things Tink has. Part of our challenge is the success that legislative bodies refer to us. The issue with trust I see is, in other working groups, when they standardize something, everyone knows you are doing what is in interest for your company. 17:41:46 I think there are different level of trusts - technical, polictical, even individual to individual. 17:41:50 Lisa: Here there's that component. It's a member organization, where people standardize and it's useful to do so. Same as any other division of W3C. 17:42:00 Q+ to note that without legislators providing the driver, we may not get WCAG 3 adopted: a wonderful spec with laudable goals that no-one will adopt 17:42:16 Lisa: But people are torn between personal wish of what's best and representing their company's interest, and people have to do that. 17:42:27 q? 17:42:44 yes, company level of interest, not necessarily technical level. 17:42:53 Lisa: When supporting something that is testable, maybe through a more expensive or slower approach, that will impact their business model, they are going to be under instruction that this is hard for their company. 17:43:13 q+ 17:43:21 Lisa: It's not a criticism of anybody in particular, but this is a motivation for people. It has positive aspects, needs of companies are being included, but... 17:43:22 +1 to Lisa and companies motivated by vested interest. 17:43:37 q+ to say that testable is not driving good design; understandable guidelines are -- and company goals are not necessarily divergent with people with disabilities 17:43:54 Lisa: There is the thought that the expense weighs in on the decision, but they won't say outright. Or concerns with legislative pressures. 17:44:15 zakim, please close the queue 17:44:15 ok, chaals, the speaker queue is closed 17:44:19 Lisa: There are pressures that this wg is under, and we need to structure something around that. User testing should not be impacted by those pressures. 17:44:21 q- later 17:44:28 + lisa for reality check. 17:44:34 Lisa: Admitting that these pressures exist would be a good first step. 17:44:40 +1, well put Lisa 17:44:48 zakim, close queue 17:44:48 ok, Rachael, the speaker queue is closed 17:44:48 chaals: We are coming up near the end of the meeting. Queue closed. 17:44:55 q- 17:45:00 chaals: We still need to think about next steps. 17:45:05 ack jea 17:45:05 jeanne, you wanted to say seeing diaparity in who is doing the work. 17:45:29 Jeanne: I have problems with what feels like disparity between who is doing the work on wcag 3, and it feels silver subgroups are doing all the work and AG votes down in surveys. 17:45:50 Jeanne: It's hard on silver side to do all the work and not be able to see it move forward. It feels like one side is doing the work and the other side says "no". 17:45:56 Consensus is a lot of work but it produces a better product. 17:46:00 ack Kim 17:46:06 +1 to Jeanne 17:46:31 Kim: I want to go back to trust. I see a lack of trust who know at well because they use them. I explain over and over how things work. What happens is that I don't see a curiousity on why it is different. 17:47:02 Kim: You need to explain again. Ties to tools. Stuff goes by and difficult to follow multiple threads. If you use AT and it's difficult, people drop out. 17:47:06 +1 to Jeanne. I wonder if this is because there's a lack of clarity/understanding about the difference between 3.x and 2.x? 17:47:35 JF: Legislative is an important drive. I can point to use case in Canada. Before AODA, taking up wcag at scale, task wasn't really recognized. 17:47:35 +1 to JF 17:47:42 me\ thinks that that is why writing a supplement was a good solution 17:47:53 JF: Whatever we take up in wcag 3, there has to have enough for legislatures to adopt. 17:47:59 JF: Otherwise they will ignore. 17:48:11 +1 to jf 17:48:11 ack mb 17:48:11 mbgower, you wanted to say that testable is not driving good design; understandable guidelines are -- and company goals are not necessarily divergent with people with disabilities 17:48:16 q- 17:48:18 mg: Taking myself off. 17:48:19 there are people who want thier content to be useable 17:48:22 ack me 17:48:22 JF, you wanted to note that without legislators providing the driver, we may not get WCAG 3 adopted: a wonderful spec with laudable goals that no-one will adopt 17:48:43 chaals: Note that we have a number of things to think about and there are still a number of things to say. We have 12 minutes left. 17:48:53 chaals: We won't get all answers. I have some proposals. 17:49:07 chaals: Distrust is clearly an issue that we have to work on. It does appear to be holding us back. 17:49:57 chaals: Related feeling for a number of people that it's difficult to get work published. Relation being that there are people who don't trust that their work will be treated fairly, and that the work will be what they need in spec. 17:50:05 chaals: Getting work in draft seems to be an area. 17:50:24 chaals: Issues like people will use these in legislation. Contrast and color mechanisms adopted before they really are finalized. 17:50:41 q+ about the focus of the group. 17:50:45 chaals: It's also a case that the rest of the world is desperate for a partial solution, which is better than what they have now. 17:50:54 chaals: A partial solution may not be a bad thing to have. 17:51:03 chaals: And minds can be changed. 17:51:26 chaals: There are a couple of things that are important to keep looking at. One is tooling. What are the tools that people can work with. 17:52:05 chaals: Next step is can we gather what people would like to say in response to this meeting? Can we use the survey system? I'd like the chairs to continue to encourage getting more feedback on challenges. 17:52:11 chaals: What's feedback on next meeting? 17:52:27 s/feedback on/deadline for agenda of/ 17:52:34 Alastair: Meeting today, planning call tomorrow, we get agenda out shortly there after. Deadline is day after previous meeting. 17:53:21 chaals: Seems important to have another meeting on topic. Having planned by tomorrow may be too soon. But would be useful to have another call after we reflect and where we've looked at what is working well in addition to the challenges. Can we return in the new year? 17:53:25 +1 17:53:27 +1 17:53:29 +1 17:53:31 +1 17:53:31 +1 to next year 17:53:33 +1 17:53:33 +1 17:53:34 +1 17:53:35 +1 17:53:37 +1 17:53:42 +100 17:53:44 +1 and next week we would work to wrap up WCAG 2.2 issues. 17:53:45 +1, particularly if people can send around suggestions before then. 17:53:47 +1 17:53:57 +1 17:54:02 LisaSeemanKest has joined #ag 17:54:03 +1 17:54:11 +1 17:54:15 chaals: I want to support Alastair's point and get support from chairs. We need to process this. 17:54:16 +1 to continuing issues 17:54:20 rrsagent, make minutes 17:54:20 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html alastairc 17:54:37 @Chaals, you mentioned also accepting private comments. Perhaps you could share an email address? 17:54:43 chaals: I will try to write up the issues identified and make it available by next meeting, though may not be a topic in next call. From that point on.... 17:55:01 chaals: We should suggest additional changes that might help with the issues. My email address is 17:55:22 [my email address is charles.nevile@consensys.net] 17:55:35 chaals: Please put something clear in subject line. 17:55:41 shawn has joined #ag 17:56:03 chaals: Email is good, I have a phone number that you can get from chairs. 17:56:25 chaals: I will let chairs schedule instance of this call. 17:56:42 q+ 17:56:45 chaals: Asking anyone, if you have comment in less than 30 seconds that you would really like to say before we ajourn. 17:56:51 Wilco: Thanks for running this. 17:56:54 +1, thank you! 17:56:57 Thanks so much, @chaals 17:56:58 JF: Seconded. 17:56:59 Thanks chaals for solid chairing of a frank discussion 17:57:00 +1 17:57:00 +1 thank you 17:57:09 +1 on thanks to Charles! 17:57:10 Thanks for running. Having the discussion helps build that trust and process! 17:57:16 +1 17:57:20 chaals: Hopefully we get to a stage where we can finish this and are doing productive positive work on standards. 17:57:22 +1 Thanks Chaals 17:57:25 +1 thank you 17:57:39 chaals: Thank everyone for contributing and making the effort to be helpful, frank, kind and thoughtful. 17:57:48 chaals: I will take up more of your time, starting next year. 17:58:09 chaals: At chairs permission, chairs adjourn meeting? 17:58:21 Alastair: We will let everyone know when it comes up. 17:58:27 JF: Is this last call? 17:58:35 alastair: One more next week, on wcag 2.2 issues. 17:58:42 present+ 17:58:46 Thank you all very much 17:58:51 There will be a Silver call on Friday 18:01:14 rrsagent, generate minutes 18:01:14 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html Rachael 18:01:33 zakim, end meeting 18:01:33 As of this point the attendees have been janina_, Jen_G, JF, Lauriat, Chuck, alastairc, ShawnT, Aimee_U, bruce_bailey_, stevelee, SuzanneTaylor, LisaSeemanKest_, Nicaise, Léonie, 18:01:36 ... (tink), AngelaAccessForAll, Jennie, MelanieP, Azlan, Rachael, chaals, Wilco, mgarrish, shadi, Jemma, Laura_Carlson, mbgower, kirkwood, jeanne, AWK, jon_avila, Judy, KimD, .75, 18:01:36 ... Jaunita_George, Raf 18:01:36 RRSAgent, please draft minutes v1 18:01:38 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html Zakim 18:01:39 I am happy to have been of service, Rachael; please remember to excuse RRSAgent. Goodbye 18:01:42 Zakim has left #ag 18:06:09 chair: Chaals 18:06:14 rrsagent, draft minutes 18:06:14 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 18:07:15 s/Is next meeting next weeK? 21 December?// 18:09:13 s/dont'/don't/ 18:09:50 s/e will ask how much success we have acheived and how much more time/Although at some point before we have spent "too much time" wWe will ask how much success we have acheived and how much more time/ 18:10:08 s/by the end fo/by the end of/ 18:10:36 s/I've been committed to be/I've committed to be/ 18:11:13 Joshue108_ has joined #ag 18:12:28 s/... is that what you expected?/… is the outcome so far what you expected? Is it working?/ 18:15:27 s/JF: Two things I noticed have been working well, is that we have agenda questions prior to the call, and ask people to respond in writing. That's managed to shake out the conversation more quickly. Also appreciating that the chairs are time-boxing things.// 18:15:56 s/JF: Two things that have been working out well from my perspective. We send out a list of questions before the call and ask people to write back before the meeting. I'm liking that. I'm also appreciating that the chairs timebox items. That has also been quite helpful./JF: Two things that have been working out well from my perspective. We send out a list of questions before the call and ask people to write back before the meeting. I'm likin 18:15:57 g that, it is getting the conversation to shake out more quickly. I'm also appreciating that the chairs timebox items. That has also been quite helpful. 18:16:25 rrsagent, draft minutes 18:16:25 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 18:20:49 s/bruce_bailey_: I heard John Kirkwood say its the latter one.// 18:21:25 s/First I was queued to bring in that it becomes especially difficult when surveys are integrated/It becomes especially difficult when surveys are integrated/ 18:22:11 s/People feel uncomfortable saying anything because they aren't sure they have the information they need./People feel uncomfortable saying anything because they aren't sure they have the information they need. [added by chaals: John Kirkwood clarified that this meant input was being lost because it was too hard] 18:24:41 s/chaals: I had asked if the problem COGA was having was that it was complicated. I think you answered that you think feedback is being dropped.// 18:25:18 s/good first question mbgower (there/good question mbgower (there/ 18:27:12 s/Note what solutions can we live with vs what ar etoo hard/Note what solutions are workable even if not preferred, vs which are just too hard to work effectively/ 18:28:10 s/we can start to pick out topics. That helps us,/… we can start to pick out topics. That helps us,/ 18:29:24 s/Are we having closed captions on the Zoom meeting?// 18:29:36 s/I got it to work- thanks.// 18:30:48 s/tink, you wanted to ask a question about the sandbox idea// 18:33:27 s/can we also ask if user needs are adiquatly represented ?/can we also ask if user needs are adequately represented? [chair does so, clarifying the question as "by the time a Recommendation is published"] 18:34:57 i/+1 by the end of the process, but agree we should start with user-needs/chaals: Through the process - i.e. by the time a Rec is published. Note this isn't a perfectly scientific question, so we know interpretations of the question will vary… 18:35:08 rrsagent, draft minutes 18:35:08 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 18:38:14 s/chaals: We are looking at problems that people have looked at/chaals: We are looking at problems that people have looked at. The following were noted in followup of the retrospective: 18:38:32 s/chaals, you wanted to ask Kirkwood to state whether his point is that tools can be better, or that putting things where we can see them and play with them is important, or both// 18:40:17 JF has left #ag 18:44:56 s/inclusive, use survey plus another mechanism/… inclusive, use survey plus another mechanism/ 18:46:25 i/alastair: In terms of publishing, its a bit early to say./scribe: rachael/ 18:46:44 s/alastairc: It's a little early, as we haven't published the new labelling yet.// 18:46:58 s/Chuck: from the perspective of running that process, it feels as though we're giving more voice and attention to people who hadn't provided their voice in the meetings.// 18:47:47 s/few louder voices can block things. I wonder if it got out of shape somewhere without anyone realizing it?/…few louder voices can block things. I wonder if it got out of shape somewhere without anyone realizing it?/ 18:48:07 s/people's thoughts in advance…/… people's thoughts in advance... 18:48:41 rrsagent, draft minutes 18:48:41 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 18:50:16 ShawnT has joined #ag 18:50:29 s/Issue: Fear of publication/An issue is Fear of publication 18:51:05 s|Created ISSUE-56 - Fear of publication.  Please complete additional details at .|| 18:51:56 rrsagent, draft minutes 18:51:56 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 18:53:38 s/people's thoughts in advance…/… people's thoughts in advance…/ 18:53:46 rrsagent, draft minutes 18:53:46 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 19:02:25 s!s/people's thoughts in advance…/… people's thoughts in advance…/!! 19:02:30 rrsagent, draft minutes 19:02:30 I have made the request to generate https://www.w3.org/2021/12/14-ag-minutes.html chaals 19:03:50 [chaals can't work out the syntax and it's no longer documented under rrsagent help :( s end of attempts to correct minutes] 19:07:52 MarcJohlic has joined #ag 20:00:07 MarcJohlic has joined #ag 20:35:31 laura has joined #ag 21:03:54 ShawnT has joined #ag 21:14:03 ShawnT has joined #ag 21:20:02 LisaSeemanKest has joined #ag 21:25:35 ShawnT has joined #ag 22:56:32 MarcJohlic has joined #ag 23:12:36 ShawnT has joined #ag