IRC log of silver on 2021-11-12

Timestamps are in UTC.

14:50:37 [RRSAgent]
RRSAgent has joined #silver
14:50:37 [RRSAgent]
logging to
14:50:39 [Zakim]
RRSAgent, make logs Public
14:50:40 [Zakim]
Meeting: Silver Task Force & Community Group
14:50:53 [jeanne]
agenda+ Defining Conformance - addressing GH Issues
14:51:22 [jeanne]
Meeting: Silver Task Force & Community Group
14:51:22 [jeanne]
14:51:22 [jeanne]
chair: Shawn, jeanne
14:51:22 [jeanne]
14:51:23 [jeanne]
rrsagent, make minutes
14:51:23 [RRSAgent]
I have made the request to generate jeanne
14:51:23 [jeanne]
14:52:00 [jeanne]
regrets+ Shawn
14:52:04 [jeanne]
Chair: jeanne
14:56:12 [SuzanneTaylor]
SuzanneTaylor has joined #silver
14:59:15 [Chuck_]
Chuck_ has joined #silver
14:59:53 [shadi]
shadi has joined #silver
15:00:37 [Chuck_]
15:01:34 [JF]
JF has joined #silver
15:01:48 [JF]
15:01:59 [jenniferS]
jenniferS has joined #silver
15:01:59 [JF]
15:02:04 [jenniferS]
15:02:37 [shadi]
15:02:37 [Wilco]
Wilco has joined #silver
15:02:40 [Wilco]
15:02:49 [SuzanneTaylor]
15:03:12 [Chuck_]
15:03:40 [Makoto]
Makoto has joined #silver
15:03:53 [Makoto]
15:04:09 [sajkaj]
sajkaj has joined #silver
15:04:09 [Chuck_]
scribe: Chuck
15:04:13 [sajkaj]
15:04:32 [jeanne]
zakim, take up item 1
15:04:32 [Zakim]
agendum 1 -- Defining Conformance - addressing GH Issues -- taken up [from jeanne]
15:05:08 [GreggVan]
GreggVan has joined #silver
15:05:17 [GreggVan]
15:05:42 [Chuck_]
Jeanne: We want to work on today is to dig into some of the conformance topics that the silver task force and community group have been asked to work on, as part of WCAG 3 schedule.
15:06:16 [Chuck_]
Jeanne: The chairs suggested if we start looking at the issues that have been filed on conformance that do not have a group working on them.
15:06:38 [Chuck_]
Jeanne: I have a list of them in the sent agenda. That's a good place to start. Any Q on what we will be working on? Or comments?
15:06:54 [Chuck_]
Janina: Are we going through a github list? Can you announce issue numbers?
15:07:03 [Chuck_]
Jeanne: Yes. And I'll put a link to each one as we start.
15:07:10 [jenniferS]
* Jennifer says for menopausal women gold is preferable because it doesn't get hot, thereby cooling the body.
15:07:23 [Chuck_]
Jeanne: Shawn is on vacation, if anyone notices that there is a q, bring it up.
15:07:37 [Chuck_]
Chuck: I'll monitor queue.
15:07:44 [jeanne]
15:07:47 [Chuck_]
Jeanne: We have an interesting, old one. Issue 38.
15:08:08 [Chuck_]
Jeanne: About measurable test coverage. Should it be a silver requirement? Wilco, you made this comment 2 years ago.
15:08:11 [Chuck_]
Wilco: A while ago.
15:08:24 [Chuck_]
Wilco: I'll need a minute.
15:08:32 [Chuck_]
GV: Can you summarize the issue?
15:08:59 [Chuck_]
Jeanne: Challenge in WCAG 1 and 2, it's impossible to say anything about conformance, unless the page is fully tested. <reads issue>
15:09:19 [GreggVan]
15:09:34 [Chuck_]
Jeanne: More details on that, I can also read the whole thing. but it's an interesting place to start. We've talked about sampling as selecting specific pages.
15:09:52 [Chuck_]
Jeanne: I can see the need for large, dynamic orgs to be able to test portions of a page. Could we also allow that as well?
15:10:01 [Chuck_]
ack G
15:10:34 [Chuck_]
GV: This is an easy one to address. We are trying to create the ruler, not the rule. For example. If you are seeing if lumber in shipment meets weight, you create the legal weight the board needs to be.
15:10:53 [Chuck_]
GV: Process of how you test the entire truckload by random sampling is outside of the definition of a pound or foot or accessibility is.
15:11:29 [Wilco]
15:11:39 [Chuck_]
GV: We are trying to say what constitutes a page in accessible. As you say, it's a sample. There's no one that does 100% sampling of anything. That's not a q we need to deal with. It is something that is good for a testing sub-committee.
15:12:22 [Chuck_]
GV: Maybe they craft best practices. The guidelines are the measure. We don't have to worry about sampling. We'll get deep into statistics. I don't think it needs to be part of determining what constitutes an accessible page.
15:12:27 [Chuck_]
ack Wil
15:12:33 [sajkaj]
15:12:54 [Chuck_]
Wilco: We are doing that, Silver has pulled it into scope. How many errors are acceptable, taking into account the severity. There is also talk about sampling in the sub group.
15:12:58 [JF]
Q+ to ask about sampling at page level versus site level
15:13:07 [JF]
QQ+ Janina
15:13:27 [GreggVan]
15:13:31 [Chuck_]
wilco: If I remember correctly. One of the challenges is to get an understanding of how much it does and how much we have already done. Those are real questions that would be useful to have an answer to.
15:13:53 [Chuck_]
Wilco: If we don't, everybody does it a different way. One orgs conformance claim will be vastly different.
15:14:04 [Chuck_]
15:14:32 [JF]
ack ja
15:14:32 [Zakim]
Janina, you wanted to react to Wilco
15:14:43 [shadi]
15:14:56 [Chuck_]
Janina: What Wilco said and yes we put it in scope, part of challenge is to figure out process for defining conformance, you have reasonable expectation that if you run today and 6 months, you are in same range.
15:15:24 [Chuck_]
Janina: How do we say that process that you are applying the ruler, that we have consistent way of talking about view or page.
15:15:33 [Chuck_]
ack JF
15:15:33 [Zakim]
JF, you wanted to ask about sampling at page level versus site level
15:16:02 [Chuck_]
JF: To ask about sampling. The way Wilco explained, I imagined sampling images on page. I thought of sampling across the entire site, not sampling just the page.
15:16:06 [Wilco]
15:16:22 [Rachael]
15:16:28 [Chuck_]
JF: It seems to me that the page or collection of pages, that we cannot be in a position to determine that 90% of the images of alt text are sufficient, because the 10% are the most important.
15:16:41 [Chuck_]
JF: I think it's one of the existing gaps in WCAG 2.x today.
15:17:06 [Chuck_]
JF: A conformance report presumes to cover the entire site. I think we need to define at the site level not page level.
15:17:25 [JF]
Q+ to respond to gregg
15:17:32 [JF]
ack gr
15:17:44 [Chuck_]
GV: We didn't require anybody make a claim. You don't have to make a claim that you meet WCAG. You can meet w/o making a claim. There isn't a need to define in the same way to define the claim, you can write your claim any way that you like.
15:18:23 [Chuck_]
GV: Requirements could come from the buyer. I'm thinking about webapps and sampling site and web pages. I think your "critical" statement on images is key.
15:18:32 [JF]
+1 that would also be a great way to game a score
15:18:38 [sajkaj]
+1 to importance of critical errors
15:18:50 [Chuck_]
GV: In silver there's a nice critical error concept that helps handle that. If we get into sampling, I'd assume we'd use standard industry processes.
15:19:37 [Chuck_]
Shadi: Brief response to Greg, and q. Greg, issue is the policy or law requires you have accessible web site, and someone is checking that. That's what Wilco is pointing out, people come to different conclusions.
15:20:04 [Chuck_]
Shadi: Regardless of WCAG requiring conformance claims, someone can come along with a different result.
15:20:38 [Chuck_]
Shadi: Wilco, we did observe with WCAG 2. question to me is, would sampling improve that, or is it inherent, or is it that the requirements are written so broadly, such as 1.3.1, covers so many things...
15:21:00 [jeanne]
q+ to read comments on the Issue
15:21:13 [Chuck_]
Shadi: Makes the statistical issue that if you pick different pages you will come to different results. If we do imagine requirements to be specific and testable, maybe sampling will be reduced, maybe people will get similar issues.
15:21:24 [Chuck_]
Shadi: When people do their own evaluation.
15:21:51 [Chuck_]
Jeanne: The topic is focused on one issue, I do think we need to have conversation on side issues, like sampling.
15:21:55 [sajkaj]
15:21:57 [jeanne]
ack Shadi
15:22:06 [jeanne]
ack wil
15:22:32 [Chuck_]
Wilco: Responding to John's question. I do think that this will work. I don't think one page at a time and only one page works that well anymore, given dynamically loaded in, pageless sites. We don't have an answer on that.
15:23:00 [Chuck_]
Wilco: Greg, I do agree with you, I'm not the biggest fan of us not putting everything into a single doc. I think WCAG 3 can be split up, cleaner approach.
15:23:14 [Chuck_]
Wilco: I still think that there's a need for testing things that are bigger than single pages.
15:23:51 [Chuck_]
Rachael: I agree with JF, trying to define conformance and explain what we mean by it. We've identified a core question, where does conformance go as far as measurement.
15:24:07 [sajkaj]
15:24:16 [SuzanneTaylor]
q+ to suggest that there are 2 steps that should be part of any written recommendations about measuring testing coverage (the accessibility review of a sample which is often sent to an expert and then accessibility QA which is often built into a product team's process)
15:24:19 [Chuck_]
Rachael: ...a way of defining sampling and scope. At holistic level, we aren't just talking about websites. And at smaller, more granular level.
15:24:57 [Chuck_]
JF: Wilco, I don't disagree, we are in same place. My concern, your example is 90% sampling images. That could be used to game score. If I add 100 spacer.gifs, I can raise my alt text score.
15:25:24 [Chuck_]
JF: Too simple to game. I am concerned about scoping looking at that, whether we call it page or view. We've had that challenge for a while.
15:25:51 [Chuck_]
JF: We had long debate about "collection of pages". It comes down to scoping what has been evaluated. You have evaluated what you have scoped out. Defining a good scope is the challenge.
15:26:02 [Chuck_]
Jeanne: Reading some of existing comments.
15:26:22 [Chuck_]
Jeanne: Layne... <reads>
15:26:44 [Chuck_]
Jeanne: ...what happens if important stuff is on page that isn't covered...
15:26:54 [Chuck_]
Jeanne: Emma... <reads>
15:27:17 [Chuck_]
Jeanne: ...could a website make claim with full automation coverage...
15:27:23 [Chuck_]
Jeanne: Makoto <reads>
15:27:39 [JF]
s/Layne.../Leonie Watson...
15:27:45 [Chuck_]
Jeanne: ...Japan uses representative sampling of pages...
15:28:02 [Chuck_]
Jeanne: Makoto, want to add anything?
15:28:39 [Chuck_]
Makoto: In Japan we adopted 2.0 as national standard. We wanted to have mechanism to make a claim for websites, so we defined web page only, we had to do something extra.
15:29:08 [Chuck_]
Makoto: We discussed additional guidance on how to test website or web pages. We do have the option of using random sampling.
15:29:24 [Chuck_]
Makoto: I think it works well. It can help this discussion.
15:29:37 [Chuck_]
Makoto: If you have any questions, let me know.
15:29:39 [Chuck_]
15:29:57 [Chuck_]
Jeanne: I'm suggesting we figure out next steps on issue.
15:30:07 [Chuck_]
ack Rach
15:30:09 [Chuck_]
ack JF
15:30:09 [Zakim]
JF, you wanted to respond to gregg
15:30:13 [JF]
ack me
15:30:15 [Chuck_]
Ack jeanne
15:30:15 [Zakim]
jeanne, you wanted to read comments on the Issue
15:30:21 [Chuck_]
ack Suzan
15:30:21 [Zakim]
SuzanneTaylor, you wanted to suggest that there are 2 steps that should be part of any written recommendations about measuring testing coverage (the accessibility review of a
15:30:24 [Zakim]
... sample which is often sent to an expert and then accessibility QA which is often built into a product team's process)
15:30:56 [Chuck_]
Suzanne: If we define sampling, we should also define the QA process. What makes sampling work well, you identify QA process to identify as many pages as possible and that is what makes it work.
15:31:07 [JF]
+1 to defining the sample
15:31:13 [Chuck_]
Suzanne: If we just define the sample, that can become the standard, but the QA part is what makes it work.
15:31:19 [JF]
although I'd say "documenting" the sample
15:31:28 [Chuck_]
Jeanne: Good point. Do we have any suggestions for next steps?
15:31:30 [Chuck_]
15:31:44 [Chuck_]
Jeanne: Conformance options group is working on representative sampling.
15:31:50 [JF]
15:32:13 [Chuck_]
Janina: We are still talking use cases. That has worked for us now. All started by specifying use cases. There is a use cases doc, I'll put in IRC.
15:32:33 [Chuck_]
Jeanne: One next step is for people to look at existing use cases for what we have.
15:32:46 [jeanne]
scribe: jeanne
15:33:11 [sajkaj]
Conformance Options Sampling Use Cases:
15:33:12 [sajkaj]
15:33:14 [JF]
15:33:14 [kirkwood]
15:33:22 [Chuck_]
scribe: Chuck
15:33:25 [jeanne]
chuck: Makoto has put forward a model. The next step could be drilling down into the Japan model and understanding it.
15:33:29 [sajkaj]
15:33:32 [Chuck_]
ack Ch
15:33:35 [jeanne]
ack chuck
15:33:56 [Chuck_]
JF: I think Suzanne raised an important point. Defining, I'd say "documenting" the sample is a gap that we have today that I hope we can close in WCAG 3
15:34:01 [Chuck_]
ack JF
15:34:07 [Chuck_]
Jeanne: Any other ideas on next steps?
15:34:12 [Chuck_]
ack saj
15:34:37 [Chuck_]
Janina: Proposal about splitting into multiple documents, maybe that is something we should consider. We had a lot of conversations before I was involved, there's merit in that approach.
15:34:53 [Chuck_]
Janina: Not the first group to take a big problem and break it up.
15:35:01 [Chuck_]
15:35:42 [GreggVan]
15:35:42 [Chuck_]
Jeanne: I don't see we have an answer yet, trying to capture next steps. Summarize next steps in github issue and note that it was discussed in today's call.
15:36:19 [Chuck_]
Janina: If we were to say that we were willing to split, we'd need to talk AGWG through that. We can't decide here. It's a big shift, don't know how we'd go about that. Are Wilco and I are the only ones who think it has merit?
15:36:31 [Chuck_]
Janina: If you do decide to go that way, you'd want to know sooner rather than later.
15:37:07 [Chuck_]
Jeanne: This is going a long way away from this issue. I'd prefer to give that back to the chairs. For future AGWG meeting. Would rather discuss in that forum.
15:37:10 [Rachael]
q+ to address next steps on Janina
15:37:17 [Chuck_]
ack Gr
15:37:53 [Chuck_]
GV: Hopefully we can start to find some central reference document that captures the key issues. Pros or cons. Noting in minutes that it was discussed... which are short clips, you won't get richness.
15:38:18 [Chuck_]
GV: It would be helpful to see if we can't have people try to capture the "nubbins" of what was said, and then pass on the summary and synthesis.
15:38:37 [Chuck_]
GV: Otherwise we'll just keep discussing. Can we condense it down? Then moving up to AGWG.
15:38:41 [Chuck_]
Jeanne: Are you volunteering?
15:38:56 [Chuck_]
GV: Past chair, and new to the group. Might be challenging. Not in best position.
15:39:03 [Chuck_]
15:39:03 [JF]
15:39:16 [Chuck_]
GV: may not be wise to do myself.
15:39:50 [Chuck_]
Rachael: Addressing Janina's, I added multi document approach to our future topics for AGWG. Q on timing is the issue. Breaking up now may cause immediate issues.
15:39:57 [Chuck_]
ack Ra
15:39:57 [Zakim]
Rachael, you wanted to address next steps on Janina
15:39:58 [Chuck_]
ack JF
15:40:30 [Chuck_]
JF: Chuck suggested spending time on Makoto's doc. Makoto I think you captured in your doc an accurate reflection of our current conversation. +1 to spending time with Japanese model.
15:40:45 [Chuck_]
GV: Which is the document?
15:40:59 [Makoto]
I'm happy to share what we got in Japan.
15:40:59 [Rachael]
15:41:03 [JF]
Conformance model of JIS X 8341-3:2016 -
15:41:08 [Chuck_]
Jeanne: Makoto is referring to a writing that explains and translates Japan's model.
15:41:25 [Rachael]
15:41:51 [Chuck_]
Rachael: Next steps. My summary is that someone will add notes to the issue. Were there other next steps?
15:41:52 [Chuck_]
15:41:59 [Rachael]
ack Chuck_
15:42:08 [Chuck_]
ack Ch
15:42:26 [Rachael]
Next steps: Review japan model, adding notes to github issue
15:42:33 [Chuck_]
Chuck: Reviewing Japan model was one that has momentum.
15:43:12 [Chuck_]
Jeanne: At same time that Makoto wrote his overview we also did the silver conformance group a couple years back proposed how to adopt WCAG EM to WCAG 3. That could be next step doc to review.
15:43:38 [Chuck_]
Janina: You found that for me recently.
15:44:00 [Chuck_]
Jeanne: This is...
15:44:08 [Chuck_]
Jeanne: I'll send to list once I find.
15:44:29 [Chuck_]
Jeanne: I didn't see any other next steps.
15:45:01 [Chuck_]
Jeanne: We were going to ask people to submit use cases to the conformance options document. Janina, did you drop a link to that?
15:45:06 [Chuck_]
Janina: Yes I did.
15:45:40 [Chuck_]
Jeanne: My thought is that we can move on and review another issue. May be larger than we can address in one day.
15:45:57 [Chuck_]
Jeanne: I don't want to lightly discuss and not go into details. May not be good use of time today.
15:46:31 [jeanne]
Topic: GH issue 304
15:46:31 [Chuck_]
Jeanne: Issue 304, conformance claims need feedback mechanism.
15:46:34 [sajkaj]
15:46:35 [jeanne]
15:47:16 [Chuck_]
Janina: Q is feedback to who? W3C? Other than collecting interesting experiences, I don't think it would be useful. I don't think that W3C want's to go into this space. So to whom?
15:47:25 [Chuck_]
Jeanne: <reads github issue>
15:47:44 [Chuck_]
Jeanne: ...learning from users feedback and experiences is useful...
15:48:07 [Chuck_]
15:48:22 [Chuck_]
Jeanne: <continues reading>
15:48:34 [Chuck_]
q+ to ask if this is similar to peer review?
15:48:44 [sajkaj]
15:49:25 [Chuck_]
Jeanne: <continues reading>
15:49:43 [Chuck_]
ack saj
15:49:43 [JF]
15:49:55 [Chuck_]
Janina: I think we can close, this is covered in maturity model.
15:50:38 [Jemma]
Jemma has joined #silver
15:50:57 [Chuck_]
ack Ch
15:50:57 [Zakim]
Chuck_, you wanted to ask if this is similar to peer review?
15:51:01 [Jemma]
15:51:08 [shadi]
15:51:14 [Chuck_]
Jeanne: No, they are wanting every accessibility statement to provide feedback on each statement.
15:51:59 [Chuck_]
jf: I have been talking about using ERL and having linked conformance statements as part of protocol. I do believe that we have opportunity to have a standardized mechanism for making conformance claims.
15:52:06 [Chuck_]
jf: I hope that comes out in the end.
15:52:41 [Chuck_]
jf: That we have a mechanism for attaching declarative statements. ERL was created for this. I think we can have an entry with a feedback URL. Could contain feedback mechanism.
15:52:47 [shadi]
Developing an Accessibility Statement
15:52:48 [jeanne]
ack jf
15:52:52 [jeanne]
ack shad
15:53:10 [Chuck_]
Shadi: Side note, there is a WAI resource on creating accessibility statements, different from conformance claims.
15:53:18 [JF]
s/ERL/EARL (Evaluation And Reporting Language)
15:53:31 [Jemma]
15:53:41 [Jemma]
Developing an Accessibility Statement
15:53:47 [Chuck_]
Shadi: That does include considerations of EU requirements. Also suggests providing feedback options. Q is to what degree is this a technical requirement for WCAG?
15:53:58 [SuzanneTaylor]
+1 to having this live in the maturity model
15:54:01 [SuzanneTaylor]
15:54:02 [Chuck_]
Shadi: Sounds like maturity model, not really a measure of accessibility.
15:54:31 [Jemma]
rrsagent, make minutes
15:54:31 [RRSAgent]
I have made the request to generate Jemma
15:54:39 [Chuck_]
Suzanne: I agree that it's good to put in maturity model. In technical standards it will be rushed, and will be faded out. As part of maturity model, would be handled in the right way.
15:54:47 [Chuck_]
15:54:49 [Chuck_]
ack Suz
15:55:17 [Chuck_]
Jeanne: That's not to say that Chuck's idea is not a good idea. Peer review is an idea.
15:55:18 [Chuck_]
15:55:52 [Chuck_]
ack Ch
15:56:03 [SuzanneTaylor]
Chuck: it's fine to include that as idea, but it is not my idea, just an interpretation of someone else's
15:56:06 [Chuck_]
Chuck: Not really my idea, just my interpretation of the issue.
15:56:24 [Rachael]
q+ to suggest approach
15:56:30 [Chuck_]
Jeanne: I think we can close this issue as addressed in Maturity Model, but need to confirm.
15:56:39 [Chuck_]
Jeanne: Suzanne, do you know if it is included?
15:56:45 [Chuck_]
Suzanne: I do not.
15:56:57 [Chuck_]
Janina: I do recall such, not certain though.
15:57:20 [Chuck_]
Jeanne: Here's the maturity model doc. If someone can review and determine, we can start the next meeting with this item.
15:57:20 [jeanne]
Maturity_Model draft:
15:57:30 [Chuck_]
ack Rach
15:57:30 [Zakim]
Rachael, you wanted to suggest approach
15:57:32 [jeanne]
ack rach
15:57:44 [Chuck_]
Rachael: Let's write up a draft response and go through approval process.
15:57:53 [Chuck_]
Jeanne: Exactly! We can work on that next week.
15:58:09 [jeanne]
action: Suzanne will check if MM includes 304 and we will response next week
15:58:28 [Chuck_]
Jeanne: Thanks for participating. Will work on more next week.
15:58:33 [Jemma]
bye. sorry for joining late.
15:58:34 [Rachael]
15:58:36 [Jemma]
15:58:42 [Chuck_]
rrsagent, make minutes
15:58:42 [RRSAgent]
I have made the request to generate Chuck_
15:59:00 [jeanne]
rrsagent, make minutes
15:59:00 [RRSAgent]
I have made the request to generate jeanne
16:03:07 [jeanne]
s/ * Jennifer says for menopausal women gold is preferable because it doesn't get hot, thereby cooling the body.//
16:03:17 [jeanne]
rrsagent, make minutes
16:03:17 [RRSAgent]
I have made the request to generate jeanne
16:04:30 [jeanne]
s| * Jennifer says for menopausal women gold is preferable because it doesn't get hot, thereby cooling the body.| |
16:04:37 [jeanne]
rrsagent, make minutes
16:04:37 [RRSAgent]
I have made the request to generate jeanne
16:05:23 [jeanne]
s/says for menopausal women gold is preferable because it doesn't get hot, thereby cooling the body.//
16:05:31 [jeanne]
rrsagent, make minutes
16:05:31 [RRSAgent]
I have made the request to generate jeanne
16:23:50 [sajkaj]
sajkaj has left #silver
21:54:16 [kirkwood]
kirkwood has joined #silver
22:34:22 [kirkwood]
kirkwood has joined #silver
23:27:42 [kirkwood]
kirkwood has joined #silver