13:00:07 <RRSAgent> RRSAgent has joined #ag
13:00:12 <RRSAgent> logging to https://www.w3.org/2026/05/11-ag-irc
13:00:12 <Zakim> RRSAgent, make logs Public
13:00:13 <AWK> AC: everyone type "present+" please
13:00:13 <Zakim> Meeting: AGWG Teleconference
13:00:24 <stevef> stevef has joined #ag
13:00:32 <stevef> present+
13:00:39 <giacomo-petri> giacomo-petri has joined #ag
13:00:39 <AWK> Scribe: AWK
13:00:51 <kevin> present+
13:00:51 <Lisa> Lisa has joined #ag
13:01:01 <Jennie_Delisi> Jennie_Delisi has joined #ag
13:01:01 <shadi> shadi has joined #ag
13:01:04 <filippo-zorzi> filippo-zorzi has joined #ag
13:01:06 <Jennie_Delisi> present+
13:01:08 <kevin> Chair: Alastair, Rachael, Adam
13:01:10 <shadi> present+
13:01:30 <filippo-zorzi> present+
13:01:31 <kevin> agenda?
13:01:32 <alastairc> zakim, take up item 1
13:01:33 <Zakim> agendum 1 -- Conformance introduction -- taken up [from alastairc]
13:01:35 <Adam> present+
13:01:44 <Lisa> present+
13:01:55 <wendyreid> wendyreid has joined #ag
13:02:09 <jtoles> jtoles has joined #ag
13:02:11 <AWK> AC: Welcome
13:02:25 <stevekerr> stevekerr has joined #ag
13:02:54 <AWK> AC: focused on provisions more in 2025 and need to focus on conformance now
13:03:13 <sam-estoesta> sam-estoesta has joined #ag
13:03:17 <alastairc> https://docs.google.com/presentation/d/17t8pDzWZzRZS4B2hU3TLUXT6nBS5ILy1hLtMK4kk4sY/edit?slide=id.g3df2a96d1e0_0_0#slide=id.g3df2a96d1e0_0_0
13:03:21 <AWK> [showing slides]
13:03:29 <LenB> LenB has joined #ag
13:03:34 <wendyreid> present+
13:03:34 <LenB> present+
13:03:36 <sam-estoesta> present+
13:03:40 <AWK> ... want to get us all on the same page
13:03:51 <jtoles> present+
13:03:54 <Wilco> Wilco has joined #ag
13:03:55 <AWK> ... members of subgroup are here also
13:04:27 <nat_tarnoff> nat_tarnoff has joined #ag
13:04:40 <Rachael> present+
13:04:44 <Charles> Charles has joined #ag
13:04:45 <AWK> ... goal of conformance is that it can be used by orgs to talk about accessibility for their site and can be used by regulators
13:04:50 <AWK> ... key issues
13:04:53 <stevekerr> present+
13:04:54 <Charles> present+
13:04:56 <kevin> Slideset: https://docs.google.com/presentation/d/17t8pDzWZzRZS4B2hU3TLUXT6nBS5ILy1hLtMK4kk4sY/edit?slide=id.g3df2a96d1e0_0_0#slide=id.g3df2a96d1e0_0_0
13:05:02 <CClaire> CClaire has joined #ag
13:05:12 <AWK> ... people think conformance = Accessible
13:05:14 <BrianE> BrianE has joined #ag
13:05:14 <wendyreid> wendyreid has joined #ag
13:05:14 <GreggVan> GreggVan has joined #ag
13:05:14 <jedi> jedi has joined #ag
13:05:14 <hdv> hdv has joined #ag
13:05:14 <JeroenH> JeroenH has joined #ag
13:05:14 <Rachael> Rachael has joined #ag
13:05:14 <alastairc> alastairc has joined #ag
13:05:14 <alice> alice has joined #ag
13:05:14 <Adam> Adam has joined #ag
13:05:18 <kevin> [Slide 24]
13:05:27 <nat_tarnoff> Present+
13:05:34 <AWK> ... we say otherwise, but it is a source of confusion
13:05:39 <Makoto_U> Makoto_U has joined #ag
13:05:43 <CClaire> Present+
13:05:52 <BrianE> present+
13:06:01 <ShawnT> ShawnT has joined #ag
13:06:03 <AWK> ... products (and sites) rarely meet WCAG 2 conformance
13:06:05 <Makoto_U> Present+
13:06:16 <ShawnT> Present+
13:06:16 <AWK> ... makes it hard to use in procurement
13:06:35 <Charles> one of the biggest issues i recall from our original silver research was understanding the text of the guidelines
13:06:48 <julierawe> julierawe has joined #ag
13:06:52 <AWK> ... regulations apply WCAG's page-based conformance to complete sites and apps
13:06:54 <julierawe> present+
13:07:08 <AWK> ... often not realistic
13:07:34 <laura> laura has joined #ag
13:07:34 <BrianE> BrianE has joined #ag
13:07:34 <wendyreid> wendyreid has joined #ag
13:07:34 <GreggVan> GreggVan has joined #ag
13:07:34 <jedi> jedi has joined #ag
13:07:34 <hdv> hdv has joined #ag
13:07:34 <JeroenH> JeroenH has joined #ag
13:07:34 <Rachael> Rachael has joined #ag
13:07:34 <alastairc> alastairc has joined #ag
13:07:34 <alice> alice has joined #ag
13:07:34 <Adam> Adam has joined #ag
13:08:36 <Jennie_Delisi> q+
13:08:47 <kirkwood> kirkwood has joined #ag
13:08:47 <laura> laura has joined #ag
13:08:47 <BrianE> BrianE has joined #ag
13:08:47 <wendyreid> wendyreid has joined #ag
13:08:47 <GreggVan> GreggVan has joined #ag
13:08:47 <jedi> jedi has joined #ag
13:08:47 <hdv> hdv has joined #ag
13:08:47 <JeroenH> JeroenH has joined #ag
13:08:47 <Rachael> Rachael has joined #ag
13:08:47 <alastairc> alastairc has joined #ag
13:08:47 <alice> alice has joined #ag
13:08:47 <Adam> Adam has joined #ag
13:08:48 <Gez> Gez has joined #AG
13:08:52 <Detlev> Detlev has joined #ag
13:08:59 <AWK> ... confusion of conformance with compliance to a law
13:09:05 <Detlev> present+
13:09:12 <Gez> present+
13:09:30 <Jennie_Delisi> q?
13:09:42 <alastairc> ack Jennie_Delisi
13:09:44 <AWK> ... laws can add/remove items, include other mechanisms to meet
13:10:10 <ShawnT> I have to often remind people that conformance and compliance are different things
13:10:33 <Wilco> q+
13:10:47 <alastairc> ack Wilco
13:10:48 <Lisa> +1 to Jenny
13:10:48 <AWK> JD: points out that there is a disconnect between our conformance details and what regulators use
13:11:26 <Lisa> Q+
13:11:31 <kevin> q+ to say that responsibility is not within conformance but compliance
13:11:50 <AWK> Wilco: issues due to 3rd parties has many different possible causes and solutions. Question of who is responsible.
13:12:01 <alastairc> ack Lisa
13:12:01 <Charles> the biggest confusion i hear between conformance and compliance is not understanding that conformance is a snapshot moment in time. one can be in and out of conformance fluidly for any page with dynamic content.
13:12:32 <wendyreid> q+
13:12:48 <AWK> LS: Speaking to conformance = accessible. Conformance models don't directly speak to the user experience and needs as well as they should.
13:13:00 <Jon_Avila> Jon_Avila has joined #ag
13:13:01 <AWK> ... as a result, many users are overlooked.
13:13:02 <Jon_Avila> present+
13:13:32 <alastairc> q?
13:13:35 <alastairc> ack kevin
13:13:35 <Zakim> kevin, you wanted to say that responsibility is not within conformance but compliance
13:13:38 <wendyreid> q-
13:14:00 <GreggVan> q+
13:14:39 <Adam> +1 to kevin
13:14:39 <AWK> KW: Back to Wilco's comment. Don't believe that the conformance model should speak to who is responsible - it just addresses the level that a site meets the provisions.
13:14:49 <alastairc> ack GreggVan
13:15:32 <Lisa> some users should be many users and user groups
13:15:39 <Jon_Avila> WCAG understanding conformance requirements says Statement of Partial Conformance - Third Party Content
13:15:39 <Jon_Avila> Web pages that will later have additional content added can use a 'statement of partial conformance'. For example, an email program, a blog, an article that allows users to add comments, or applications supporting user-contributed content. Another example would be a page, such as a portal or news site, composed of content aggregated from multiple
13:15:39 <Jon_Avila> contributors, or sites that automatically insert content from other sources over time, such as when advertisements are inserted dynamically.
13:15:39 <Jon_Avila> In these cases, it is not possible to know at the time of original posting what the uncontrolled content of the pages will be. It is important to note that the uncontrolled content can affect the accessibility of the controlled content as well. Two options are available:
13:16:09 <AWK> GV: Rather than talk about responsibility, we can say that we assume that some users have AT. In the cognitive space the availability of AT has been an issue, but not all blind users have access to AT.
13:16:37 <alastairc> q?
13:16:42 <shadi> q+
13:16:47 <AWK> ... We have assumed that when we make content programmatically determinable that people can access it and that is an assumption
13:16:55 <alastairc> ack shadi
13:17:34 <Charles> q+
13:17:35 <AWK> SAZ: is this intended to be an exhaustive list? Do we need to add that these are examples at the bottom of the list?
13:17:57 <AWK> AC: We had a lot of things in the subgroup docs and I drew these from there.
13:18:03 <alastairc> ack Charles
13:18:15 <AWK> ... wanted to get agreement that these are major issues
13:18:16 <GreggVan> q+
13:19:00 <wendyreid> q+
13:19:10 <alastairc> ack GreggVan
13:19:10 <AWK> CH: Key issue from research was overall for WCAG about understandable language and this impacts everything including conformance
13:19:29 <Heather> Heather has joined #ag
13:19:34 <AWK> GV: Last one. Many people don't understand that AT are user agents.
13:19:54 <alastairc> ack wendyreid
13:20:17 <AWK> WR: Wondering how important this list is perfect
13:20:27 <shadi> +1 to wendyreid
13:20:40 <AWK> AC: primarily this is framing but hoping we can agree
13:20:45 <Detlev> +1  to Wendy!
13:21:17 <AWK> AC: WHERE to deal with issues is an important question
13:22:04 <AWK> ... in W3 we intend to have other docs, e.g., policy guidance, WCAG-EM-style document for testing, etc.
13:22:17 <GreggVan> +1  to alastair.  since it is unlikely that will agree on everything (wouildnt that be nice) -- the meetings main output must be that we find where we do agree and document it.
13:23:03 <AWK> AC: in the subgroup we had lawyers come in and they liked the idea of having additional guidance
13:23:05 <shoobe01> shoobe01 has joined #ag
13:23:34 <giacomo-petri> q+
13:24:20 <Jon_Avila> q+
13:24:21 <AWK> GP: Think that there is often a misconception. What is missing is documentation about processes, trainings, whatever. With assertions we were trying to address this.
13:24:29 <alastairc> ack giacomo-petri
13:24:33 <AWK> ... right now WCAG is a snapshot of the current state
13:25:07 <alastairc> ack Jon_Avila
13:25:08 <AWK> ... agree that policy docs should help
13:25:17 <wendyreid> +1 to giacomo's point
13:25:49 <GreggVan> q+  to say  not just policy - but  policy and enforcement
13:26:10 <AWK> JA: in ADA Title II rulemaking in first round. it was a challenge since there was no way of scoring. We should provide a framework that would help regulators choose.
13:26:51 <wendyreid> q+
13:26:51 <AWK> ... there is a risk that what we create won't be adopted unless we provide a way to facilitate adoption
13:27:18 <AWK> GV: Wherever we say poliy we should say 'policy and enforcement'
13:27:22 <alastairc> ack GreggVan
13:27:22 <Zakim> GreggVan, you wanted to say  not just policy - but  policy and enforcement
13:27:38 <alastairc> ack wend
13:27:40 <AWK> s/poliy/policy
13:27:43 <nat_tarnoff> +1 to GreggVan
13:28:26 <AWK> WR: Thinking about GP's point. May be helpful to understand who our primary audience is
13:28:58 <AWK> ... We have more than one audience, and we should understand what our priorities are
13:29:37 <AWK> ... how do we address the secondary audience needs? Perhaps it shouldn't be in the same document.
13:30:06 <AWK> AC: We have looked at that. This is part of why we are considering a separate policy document
13:30:06 <hdv> present+
13:30:43 <ShawnT> What about thinking about putting this into play Accessibility Roles and Responsibilities Mapping (ARRM): https://www.w3.org/WAI/planning/arrm/
13:31:09 <AWK> AC: Think that we may be able to agree on high-level solutions.
13:31:23 <AWK> ... proposals have included
13:31:37 <AWK> ... 1. prioritizing paths/tasks
13:31:46 <AWK> .... 2. automated testing
13:31:51 <AWK> ... 3. usability testing
13:32:04 <AWK> ... 4. authoring tool methods
13:32:18 <AWK> ... 5. some sort of progression score
13:32:33 <AWK> ... undoubtedly more possibilities
13:32:41 <AWK> q+
13:32:42 <nat_tarnoff> +1
13:32:47 <Wilco> q+
13:32:50 <kevin> [Slide 26]
13:32:54 <Adam> q?
13:32:56 <GreggVan> q+
13:33:01 <alastairc> ack AWK
13:33:05 <alastairc> scribe+
13:33:05 <kevin> scribe+
13:33:19 <kevin> AWK: Seem like a good thing. Good to get input from broader group
13:33:24 <kevin> scribe-
13:33:37 <AWK>    Wilco: Please explain the auth tool one?
13:34:26 <wendyreid> q+
13:34:35 <AWK> AC: One idea would be that if you are making a claim about an area that used generated or 3rd party content that you provide a good tool for users to add the alt
13:34:37 <alastairc> ack Wilco
13:34:52 <AWK> GV: These are high-level topics not solutions
13:35:01 <alastairc> ack GreggVan
13:35:22 <kirkwood> present+
13:35:55 <Charles> q+
13:36:01 <AWK> ... dealing with only part of a site is always easier and I wouldn't agree that is a solution.
13:36:09 <kirkwood> +1 to Gregg
13:36:18 <alastairc> q+ on 1st item
13:36:19 <nat_tarnoff> Not mention because it is a law, doesn't make it right.
13:36:31 <kevin> +1 to Gregg
13:36:44 <AWK> ... not sure about the automated testing one
13:37:26 <AWK> AC: Automated testing can give you wider coverage and more easily identify issues
13:38:04 <alastairc> ack wendyreid
13:38:54 <AWK> WR: wanted to call out that for the auth tools thing, people should know that there is an effort to reboot the authoring tools work
13:38:58 <giacomo-petri> q+
13:38:59 <GreggVan> great to hear.
13:39:07 <alastairc> ack Charles
13:39:11 <AWK> ... hopefully updated guidelines very soon
13:39:17 <hdv> +1 Wendy
13:39:29 <AWK> CH: different concern with first bullet. Paths and tasks are hard to define.
13:40:23 <AWK> ... does this mean prioritizing paths and tasks for more testing or to be different in some way? but not at the expense of other content?
13:40:26 <AWK> AC: yes
13:40:43 <alastairc> ack alastairc
13:40:43 <Zakim> alastairc, you wanted to comment on 1st item
13:41:06 <GreggVan> q+
13:41:22 <AWK> q+
13:41:22 <GreggVan> q-
13:41:27 <alastairc> ack giacomo-petri
13:41:30 <kevin> q+
13:41:54 <GreggVan> q+   to ask  "can we change  "solutions" to "strategies"
13:42:19 <mgifford2> mgifford2 has joined #ag
13:42:19 <AWK> GP: About first bullet - everyone working on accessibility knows that people use this approach when getting started
13:42:23 <kevin> [Slide 27]
13:42:36 <mgifford2> present+
13:42:43 <GreggVan> present+
13:42:44 <kevin> +1 to Giacomo
13:42:45 <AWK> ... concern that companies will use this as an excuse since they are "still working" on the main paths.
13:43:09 <Charles> an example challenge of defining a path/task: ecommerce checkout. guest versus account paths still are not static. each has dozens of sidequests.
13:43:19 <kevin> AWK: Debate now or later on survey?
13:43:28 <alastairc> ack kevin
13:43:32 <alastairc> ack AWK
13:43:37 <AWK> AC: More discussion on these in survey
13:43:48 <stevekerr> q+
13:44:00 <joryc> joryc has joined #ag
13:44:05 <AWK> KW: thinking about class of product as a conformance category.
13:44:25 <AWK> ... SVG has 4 classes for conformance  - generator, viewer, etc.
13:44:52 <AWK> ... share GV's concern about making a broad claim based on a small sample
13:45:25 <AWK> GV: Can we swap "strategies" and "solutions"?
13:45:54 <AWK> ... classes are a sorting mechanism and we would need to make sure that we are comprehensive
13:45:57 <mgifford2> mgifford2 has joined #ag
13:45:57 <kirkwood> kirkwood has joined #ag
13:45:57 <laura> laura has joined #ag
13:45:57 <BrianE> BrianE has joined #ag
13:45:57 <wendyreid> wendyreid has joined #ag
13:45:57 <GreggVan> GreggVan has joined #ag
13:45:57 <jedi> jedi has joined #ag
13:45:57 <hdv> hdv has joined #ag
13:45:57 <JeroenH> JeroenH has joined #ag
13:45:57 <Rachael> Rachael has joined #ag
13:45:57 <alastairc> alastairc has joined #ag
13:45:57 <alice> alice has joined #ag
13:45:57 <Adam> Adam has joined #ag
13:46:01 <Charles> q+
13:46:05 <Heather> present+
13:46:06 <alastairc> ack GreggVan
13:46:06 <Zakim> GreggVan, you wanted to ask  "can we change  "solutions" to "strategies"
13:46:18 <AWK> Zakim, who is scribe?
13:46:18 <Zakim> I don't understand your question, AWK.
13:46:30 <alastairc> q?
13:46:40 <LenB> LenB has joined #ag
13:46:41 <alastairc> ack stevef
13:46:47 <AWK> SK: two items
13:46:49 <alastairc> ack stevekerr
13:46:57 <kevin> rrsagent, make minutes
13:46:58 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
13:47:28 <AWK> ... 1. key challenges. User generated content is important due to the dynamic nature of products and new content is impossible to test
13:47:50 <kevin> s/[Slide 27]/[Slide 26]
13:47:53 <kevin> rrsagent, make minutes
13:47:55 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
13:48:02 <mgifford2> Back to an earlier point. I do have a concern about WCAG-EM vs the American style ACR approach (VPAT, GPAT, and most recently OpenACR). I do feel like we are confusing them too often on both sides of the Atlantic. WCAG-EM is important for pushing organizations to comply with their websites or web services. American ACRs are focused on procurement and are critical for pushing industry incentives. It is really a matter of where pressure is
13:48:02 <mgifford2> being applied. I do think that having standardized measurement of deployed sites is great (WCAG-EM), but we also need to be able to push those vendors which are building tools like Content Management Systems. OpenACR is built to try to build on WCAG-EM, but be focused on procurement.
13:48:13 <laura> present+ Laura_Carlson
13:48:33 <maryjom> maryjom has joined #ag
13:48:34 <alastairc> q?
13:48:35 <AWK> ... 2. related to WR's point about ATAG. Regulators are typically unaware of other resources, like having the auth tool methods in the same document for this reason
13:48:37 <alastairc> ack Charles
13:49:34 <AWK> CH: thinking about KW's point - by prioritizing paths we are hinting at having a "conformance claim scope"
13:49:56 <GreggVan> q+
13:50:06 <AWK> ... for automated testing there isn't another bullet about whether we are using sampling and how
13:50:09 <Jon_Avila> q+
13:50:15 <alastairc> ack GreggVan
13:50:40 <AWK> GV: First two bullets - they seem dangerous for conformance
13:50:41 <Jon_Avila> Perhaps we could take out the "rather than whole product".
13:50:59 <Jon_Avila> q-
13:51:03 <AWK> ... add "for order of intervention" to bullet
13:51:37 <AWK> AC: Part of the point is that these are strategies that people do use today.
13:51:43 <AWK> AC: Survey
13:51:53 <kevin> agenda?
13:51:54 <alastairc> zakim, take up next item
13:51:55 <Zakim> agendum 2 -- conformance Survey -- taken up [from alastairc]
13:52:09 <AWK> TOPIC: Question 1 Scene Setting
13:52:09 <alastairc> https://www.w3.org/wbs/35422/conformance-updates-test/results/
13:52:19 <kevin> rrsagent, make minutes
13:52:20 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
13:53:09 <AWK> AC: do we want WCAG 3 to be able to replace WCAG 2.x as the standard of choice for regulators?
13:53:28 <jkatherman> jkatherman has joined #ag
13:53:30 <Lisa> Q+
13:53:42 <jkatherman> present+
13:53:52 <kevin> s/TOPIC: Question/Subtopic: Question/
13:53:56 <kevin> rrsagent, make minutes
13:53:58 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
13:54:06 <GreggVan> q+
13:54:09 <alastairc> ack Lisa
13:54:38 <AWK> Lisa: Confused about survey. Did it change?
13:55:00 <alastairc> ack greg
13:55:02 <AWK> AC: Subgroup reviewed an earlier version, perhaps that was it?
13:55:10 <julierawe> julierawe has joined #ag
13:55:17 <julierawe> present+
13:55:27 <julierawe> (IRC booted me so am rejoining)
13:55:51 <AWK> GV: Since people have difference preferences, there will be compromised
13:56:30 <AWK> q?
13:56:52 <Heather> wendyreid, I can scribe after you.
13:57:04 <Monica> Monica has joined #AG
13:57:10 <AWK> AC: a few people are unsure what the compromises will be
13:57:26 <AWK> ... comments on harmonization
13:57:55 <AWK> ... kevin points out that we are not regulators but should consider their needs
13:57:55 <GreggVan> q+
13:58:16 <alastairc> ack GreggVan
13:58:47 <nat_tarnoff> q+
13:59:02 <AWK> GV: we need to keep the focus on access by users with disabilities to all content
13:59:12 <nat_tarnoff> q-
14:00:01 <wendyreid> scribe+
14:00:28 <Jon_Avila> My comment was just that we needed to create something that had some framework beyond 100% conformance - I think the ideas in the survey in other questions show good ideas to support that.
14:00:50 <Lisa> Q+
14:01:03 <alastairc> ack Lisa
14:01:19 <wendyreid> Lisa: Reminding you to refresh results, if you're encouraging people to update as we go
14:01:25 <wendyreid> alastairc: I need to read things first, but will do
14:01:40 <wendyreid> ... move on to question 2
14:01:44 <alastairc> TOPIC: Conformance idea: Define "essential paths" and allow for site conformance for some paths
14:01:47 <nat_tarnoff> I looked to the other monitro, thanks though!
14:02:01 <wendyreid> alastairc: This was drawn from one of the proposals, sort of a concept of an essential path
14:02:23 <wendyreid> ... taking in a definition of essential, and page titled criterion, talking about "purpose" in WCAG2
14:02:36 <wendyreid> ... the idea is you have more important paths, specifically for a website not user
14:03:08 <wendyreid> ... having three levels, level 1 is scoping down to essential paths, meeting provisions, content in all paths meet core requirements and essential paths meet supplemental provisions
14:03:23 <wendyreid> ... we had quite a few responses, two choice
14:03:30 <wendyreid> ... in conformance or associated documentation
14:03:55 <wendyreid> ... in the answers I was able to review ahead of time
14:04:05 <wendyreid> ... the main points I caught were [reading Detlev's point]
14:04:14 <wendyreid> ... how we do reliably define a path
14:04:33 <wendyreid> ... that seems like it should be objective that differnt people would apply in the same way to different products
14:04:34 <Charles> +1 to reliable definition of path
14:04:41 <wendyreid> ... different products using paths in different ways
14:04:50 <wendyreid> ... should be a compliance thing rather than a conformance thing
14:05:13 <GreggVan> q+
14:05:15 <alastairc> - Additional documentation will be difficult to develop & track.
14:05:15 <alastairc> - Useful for “partial conformance”.
14:05:15 <alastairc> - WCAG-EM would need updating.
14:05:15 <alastairc> - Need to define essential paths (probably different term).
14:05:15 <alastairc> - Every path on a page is there for a reason, if you remove it, the purpose of the page changes.
14:05:16 <alastairc> - Prioritization is understandable, but there should still be a clear expectation that the rest of the site will eventually be reviewed.
14:05:16 <alastairc> - Anything which allows for a conformance claim to be made against a whole based on a sample is problematic.
14:05:49 <Jon_Avila> Some regulations have specific pages that need to be covered - I wonder if we should consider essential pages?
14:06:24 <alastairc> ack GreggVan
14:06:39 <wendyreid> GreggVan: Any time we say that conformance to part means conformance to whole, there's no logic to that
14:06:42 <kevin> +1 to Gregg
14:06:51 <wendyreid> ... if one wants to say we want paths to be part of scoping, that is a different question
14:06:53 <wendyreid> ... it
14:07:04 <wendyreid> ... it's not to do with conformance, it's part of the claim
14:07:10 <wendyreid> ... that's scoping, not conformance
14:07:13 <Monica> Monica has joined #ag
14:07:13 <julierawe> julierawe has joined #ag
14:07:13 <jkatherman> jkatherman has joined #ag
14:07:13 <maryjom> maryjom has joined #ag
14:07:13 <joryc> joryc has joined #ag
14:07:13 <shoobe01> shoobe01 has joined #ag
14:07:13 <Heather> Heather has joined #ag
14:07:13 <Jon_Avila> Jon_Avila has joined #ag
14:07:13 <Detlev> Detlev has joined #ag
14:07:13 <Gez> Gez has joined #ag
14:07:13 <ShawnT> ShawnT has joined #ag
14:07:13 <Makoto_U> Makoto_U has joined #ag
14:07:13 <CClaire> CClaire has joined #ag
14:07:13 <Charles> Charles has joined #ag
14:07:13 <nat_tarnoff> nat_tarnoff has joined #ag
14:07:13 <Wilco> Wilco has joined #ag
14:07:13 <sam-estoesta> sam-estoesta has joined #ag
14:07:13 <stevekerr> stevekerr has joined #ag
14:07:13 <jtoles> jtoles has joined #ag
14:07:13 <filippo-zorzi> filippo-zorzi has joined #ag
14:07:13 <shadi> shadi has joined #ag
14:07:13 <Jennie_Delisi> Jennie_Delisi has joined #ag
14:07:13 <Lisa> Lisa has joined #ag
14:07:13 <giacomo-petri> giacomo-petri has joined #ag
14:07:13 <stevef> stevef has joined #ag
14:07:13 <AWK> AWK has joined #ag
14:07:13 <srvjordi> srvjordi has joined #ag
14:07:18 <wendyreid> ... a path through something is not the whole
14:07:49 <hdv> q?
14:07:56 <kevin> agenda?
14:08:01 <kevin> rrsagent, make minutes
14:08:02 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
14:08:10 <kirkwood> q?
14:08:14 <alastairc> q?
14:08:25 <wendyreid> GreggVan: It doesn't have any place in saying something conforms
14:08:26 <filippo-zorzi> filippo-zorzi has joined #ag
14:08:26 <Monica> Monica has joined #ag
14:08:26 <julierawe> julierawe has joined #ag
14:08:26 <jkatherman> jkatherman has joined #ag
14:08:26 <maryjom> maryjom has joined #ag
14:08:26 <joryc> joryc has joined #ag
14:08:26 <shoobe01> shoobe01 has joined #ag
14:08:26 <Heather> Heather has joined #ag
14:08:26 <Jon_Avila> Jon_Avila has joined #ag
14:08:26 <Detlev> Detlev has joined #ag
14:08:26 <Gez> Gez has joined #ag
14:08:26 <ShawnT> ShawnT has joined #ag
14:08:26 <Makoto_U> Makoto_U has joined #ag
14:08:26 <CClaire> CClaire has joined #ag
14:08:26 <Charles> Charles has joined #ag
14:08:26 <nat_tarnoff> nat_tarnoff has joined #ag
14:08:26 <Wilco> Wilco has joined #ag
14:08:26 <sam-estoesta> sam-estoesta has joined #ag
14:08:26 <stevekerr> stevekerr has joined #ag
14:08:26 <jtoles> jtoles has joined #ag
14:08:26 <shadi> shadi has joined #ag
14:08:26 <Jennie_Delisi> Jennie_Delisi has joined #ag
14:08:26 <Lisa> Lisa has joined #ag
14:08:26 <giacomo-petri> giacomo-petri has joined #ag
14:08:26 <stevef> stevef has joined #ag
14:08:26 <AWK> AWK has joined #ag
14:08:26 <srvjordi> srvjordi has joined #ag
14:08:34 <Adam> q+ AWK
14:09:15 <wendyreid> alastairc: Going to see if I can play this back, if we're talking about conformance, specifically the term conformance, saying the whole of a thing conforms when a subset is including, it doesn't conform
14:09:18 <alastairc> q?
14:09:20 <kirkwood> +1 to Gregg
14:09:22 <wendyreid> GreggVan: Paths is a piece
14:09:24 <Adam> q+ Giacomo
14:09:29 <Adam> q+ stevekerr
14:09:29 <wendyreid> ... there are many kinds of a thing
14:09:35 <wendyreid> ... what does critical mean for example
14:09:40 <alastairc> ack awk
14:09:51 <stevekerr> stevekerr has joined #ag
14:09:51 <jkatherman> jkatherman has joined #ag
14:09:51 <LenB> LenB has joined #ag
14:09:51 <filippo-zorzi> filippo-zorzi has joined #ag
14:09:51 <Monica> Monica has joined #ag
14:09:51 <julierawe> julierawe has joined #ag
14:09:51 <maryjom> maryjom has joined #ag
14:09:51 <joryc> joryc has joined #ag
14:09:51 <shoobe01> shoobe01 has joined #ag
14:09:51 <Heather> Heather has joined #ag
14:09:51 <Jon_Avila> Jon_Avila has joined #ag
14:09:51 <Detlev> Detlev has joined #ag
14:09:51 <Gez> Gez has joined #ag
14:09:51 <ShawnT> ShawnT has joined #ag
14:09:51 <Makoto_U> Makoto_U has joined #ag
14:09:51 <CClaire> CClaire has joined #ag
14:09:51 <Charles> Charles has joined #ag
14:09:51 <nat_tarnoff> nat_tarnoff has joined #ag
14:09:51 <Wilco> Wilco has joined #ag
14:09:51 <sam-estoesta> sam-estoesta has joined #ag
14:09:51 <jtoles> jtoles has joined #ag
14:09:51 <shadi> shadi has joined #ag
14:09:51 <Jennie_Delisi> Jennie_Delisi has joined #ag
14:09:51 <Lisa> Lisa has joined #ag
14:09:51 <giacomo-petri> giacomo-petri has joined #ag
14:09:51 <stevef> stevef has joined #ag
14:09:51 <AWK> AWK has joined #ag
14:09:51 <srvjordi> srvjordi has joined #ag
14:09:51 <giacomo-petri> giacomo-petri has left #ag
14:09:54 <giacomo-petri> giacomo-petri has joined #ag
14:09:58 <alastairc> q?
14:10:14 <wendyreid> AWK: I agree completely with part of what Gregg is saying, we absolutely want to make sure that the goal of someone who wants to meet WCAG3 is access
14:10:28 <Rachael> q+ to ask how  we would define critical paths
14:10:37 <wendyreid> ... but I like paths because we've done the approach where you have to meet everything and we've seen its not successful or better for end users
14:10:46 <Lisa> Q+
14:11:05 <alastairc> Two topics: 1) Having a sub-set of a thing to claim conformance, 2) Defining particular paths.
14:11:07 <wendyreid> ... I'd like to see something like paths, paths in combination to assertions and recognizes their responsibilities
14:11:18 <wendyreid> ... providing something like an SLA for problems that people encounter
14:11:21 <wendyreid> ... people do this today
14:11:28 <giacomo-petri> giacomo-petri has joined #ag
14:11:28 <stevekerr> stevekerr has joined #ag
14:11:28 <jkatherman> jkatherman has joined #ag
14:11:28 <LenB> LenB has joined #ag
14:11:28 <filippo-zorzi> filippo-zorzi has joined #ag
14:11:28 <Monica> Monica has joined #ag
14:11:28 <julierawe> julierawe has joined #ag
14:11:28 <maryjom> maryjom has joined #ag
14:11:28 <joryc> joryc has joined #ag
14:11:28 <shoobe01> shoobe01 has joined #ag
14:11:28 <Heather> Heather has joined #ag
14:11:28 <Jon_Avila> Jon_Avila has joined #ag
14:11:28 <Detlev> Detlev has joined #ag
14:11:28 <Gez> Gez has joined #ag
14:11:28 <ShawnT> ShawnT has joined #ag
14:11:28 <Makoto_U> Makoto_U has joined #ag
14:11:28 <CClaire> CClaire has joined #ag
14:11:28 <Charles> Charles has joined #ag
14:11:28 <nat_tarnoff> nat_tarnoff has joined #ag
14:11:28 <Wilco> Wilco has joined #ag
14:11:28 <sam-estoesta> sam-estoesta has joined #ag
14:11:28 <jtoles> jtoles has joined #ag
14:11:28 <shadi> shadi has joined #ag
14:11:28 <Jennie_Delisi> Jennie_Delisi has joined #ag
14:11:28 <Lisa> Lisa has joined #ag
14:11:28 <stevef> stevef has joined #ag
14:11:28 <AWK> AWK has joined #ag
14:11:28 <srvjordi> srvjordi has joined #ag
14:11:50 <wendyreid> ... they identify key paths and pages, and being clear they know there are gaps and commit to fixing those within a clear timeline
14:11:59 <wendyreid> ... acknowledging their service offerings
14:12:04 <joryc> joryc has joined #ag
14:12:12 <wendyreid> ... most site owners can't or won't assess every nook and cranny of the entire site
14:12:14 <wendyreid> +1 AWK
14:12:17 <alastairc> q?
14:12:28 <wendyreid> AWK: can we do this in a way that ensures full access
14:12:28 <kirkwood> the reality is the “you can’t be 100% conforment” is true however in practice often essential paths and pages are more vigilantly texted for accessibility. We are the ruler not the measurer? no?
14:12:36 <alastairc> ack giacomo
14:12:42 <Makoto_U> +1 to AWK
14:12:48 <Wilco> q+
14:13:01 <wendyreid> giacomo-petri: I mentioned previously I agree with the representative sample, I also acknowledge that for some products it is easy to determine the essential paths
14:13:14 <wendyreid> ... such as an ecommerce website, but other websites can be harder to determine
14:13:17 <wendyreid> q+
14:13:22 <Rachael> +1 to difficulty of determining essential
14:13:25 <Adam> +1 to giacomo-petri
14:13:27 <wendyreid> giacomo-petri: It is due to the nature of the service
14:13:34 <kevin> +1 to exploring ideas about how to encourage improvements, -1 to this being part of conformance
14:13:49 <kevin> +1 to challenge of 'essential'
14:13:51 <Charles> i disagree that ecommerce example of path is easy to define. there are too many variables.
14:13:51 <wendyreid> ... the ones most accessed by users, but this could be subjective, different audits may post different results
14:14:21 <GreggVan> q+
14:14:35 <Charles> q+
14:14:38 <wendyreid> alastairc: One is being able to determine an approach that is a subset of the whole and can be used to determine conformance, and how would you do it
14:14:39 <alastairc> ack stevekerr
14:14:59 <wendyreid> stevekerr: You mentioned the two topics, this is about the subset representing the whole
14:15:08 <alastairc> q+ on defining paths, and whether it compares to selecting pages.
14:15:23 <wendyreid> ... being able to call it conformance as a whole or a part, I raised my hand in response to Gregg, having full conformance visibility is important
14:15:43 <Charles> +1 to stevekerr. this is partial conformance.
14:15:44 <wendyreid> ... what about if you have 5 parts of a product, 4/5 are conformant, but now you have some transparency
14:15:44 <AWK> q+
14:15:46 <AWK> q-
14:15:50 <Charles> q-
14:15:56 <wendyreid> ... what parts of the products address user needs
14:16:19 <alastairc> ack Rachael
14:16:19 <Zakim> Rachael, you wanted to ask how  we would define critical paths
14:16:20 <wendyreid> ... this product does not meet full conformance, but with this topic and others, is it not beneficial to be able to claim conformance to parts that make up the whole
14:16:40 <wendyreid> Rachael: I've always really liked the idea of essential paths, the challenge is coming up with an adequate definition
14:16:47 <wendyreid> ... I like the idea of being able to scope to these
14:17:01 <wendyreid> ... we're focused on these areas and this is where we claim conformance
14:17:15 <wendyreid> ... my concern really is using part to declare whole
14:17:16 <Charles> +1 to Rachael path=scope not whole
14:17:17 <Adam> +1 to Rachael
14:17:19 <nat_tarnoff> Agree they are needed for scoping, but I agree with Rachael
14:17:26 <alastairc> ack  Lisa
14:17:26 <laura> +1 to Rachael
14:17:42 <giacomo-petri> +1 to Rachael
14:17:45 <wendyreid> Lisa: Having read the different proposals, paths are only used to define scope
14:17:51 <AWK> I'm interested in the history also, don't recall it
14:17:54 <wendyreid> ... important features, can you send the email, can you label the email
14:18:08 <wendyreid> ... provide different statements for different features or parts
14:18:16 <wendyreid> ... in reality, that is already what everyone does
14:18:26 <wendyreid> ... are we allowing people to make accessibility statement for a scope
14:18:50 <wendyreid> ... the reason I like it is it allows people, including regulators, to do more on the really important stuff
14:19:28 <wendyreid> ... for the whole site, we have gold, automated testing on some provisions, on some other paths we have automated, user, professional testing, it sounds like a lot but its limited scope
14:19:41 <wendyreid> ... the power of the paths, it allows people to do more on the most important things
14:20:12 <alastairc> q?
14:20:15 <wendyreid> ... do we need to define essential paths, we have some things like anything to do with health and wellbeing, rights, even legisalators clarify what they consider an essential path
14:20:28 <alastairc> ack Wilco
14:20:56 <wendyreid> Wilco: I find this an interesting idea, it also feels clunky to me, essential paths/pages, ultimately the goal is the whole thing is accessible
14:21:14 <wendyreid> ... where I find WCAG falls short is its a fixed set of guidelines without much flexibility, what I think we should consider
14:21:44 <alastairc> q+ to also mention quality standards
14:21:57 <wendyreid> ... what is the role of quality management systems, Accessibility for all, ISO 9001, EN [missed this], it isn't just about indiividual things, but processes that validate and ensure quality over time
14:22:14 <wendyreid> ... what's essential can change, can be defined by organizations as they grow and evolve
14:22:22 <wendyreid> ... avoid a snapshot style evaluation
14:22:34 <wendyreid> ... there's an intersection here, there's a lot to learn from security and quality
14:22:43 <kevin> q+
14:22:45 <Makoto_U> q+
14:22:52 <Adam> scribe+
14:23:02 <alastairc> ack wendyreid
14:23:06 <Wilco> EN 17161 Design for all,
14:23:07 <AWK> +1 process+assertions+paths would be great
14:23:09 <Lisa> +1 to wilco
14:23:15 <Adam> wendyreid: I agree with Wilco
14:23:19 <Adam> ... this is a good idea
14:23:27 <kevin> s/EN [missed this]/EN 17161 Design for all/
14:23:32 <Adam> ... but I also think it would be too narrow for us to focus only on paths
14:23:39 <Adam> ... I think it’s possible to find a definition of “paths”, “parts”
14:23:51 <Adam> ... on large websites where you have millions of pages, e-commerce, etc.
14:23:51 <Charles> all paths are meandering
14:23:54 <Adam> ... there are identifiable paths
14:23:59 <Adam> ... determined by use case or business case
14:24:07 <kevin> rrsagent, make minutes
14:24:08 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
14:24:16 <Adam> ... but also by “how many people go through these places?”
14:24:16 <Adam> ... focus on the most visited
14:24:20 <Adam> ... another thing to consider
14:24:26 <Adam> ... the process that goes into the generation of those pages
14:24:34 <Adam> ... products that use design systems, or component libraries, for example
14:24:47 <Adam> ... where the underlying systems have been, or could be, assessed for accessibility conformance
14:24:59 <Adam> ... so one could also assert these systems have been assessed
14:25:09 <Adam> ... and have really granular accessibility conformance reporting
14:25:28 <Adam> ... “we’re aware of this area, but not this area” and “here’s our remediation process”
14:25:43 <Adam> ... a lot of people have processes and use systems like these
14:25:46 <alastairc> q?
14:25:49 <Wilco> +1 Wendy
14:25:49 <alastairc> ack GreggVan
14:26:14 <wendyreid> GreggVan: Examples from real cases, it was decided the path didn't include ads, the ads had discounts
14:26:22 <wendyreid> ... PWD didn't have access to the discounts
14:26:36 <nat_tarnoff> That sounds like a scoping problem.
14:26:58 <wendyreid> ... related products weren't included, the other was the state of Minnesota, the only necessary pages were services for PWD
14:27:32 <nat_tarnoff> +q
14:27:36 <wendyreid> GreggVan: People make strange decisions when determining these things
14:27:37 <alastairc> ack alastairc
14:27:37 <Zakim> alastairc, you wanted to comment on defining paths, and whether it compares to selecting pages. and to also mention quality standards
14:27:46 <Detlev> q+
14:28:14 <wendyreid> alastairc: Playing devils advocate, right now in a conformance claim, people pick pages, does parts make a difference, on Wilco's point, quality standards
14:28:25 <wendyreid> ... it's come up several times, it turns into quite a different standard
14:28:34 <Wilco> q+
14:28:39 <wendyreid> ... on the security levels, you're assessing a particular area, the risk for each
14:28:44 <kirkwood> if the elevator is inaccessible, is the building inaccessible?
14:29:12 <wendyreid> ... you pick what you do in that org, how to address, the choose your own adventure standards, do bring a much higher level of cost and effort
14:29:20 <wendyreid> ... at the end of the day, we'd still need the provisions
14:29:26 <wendyreid> ... that's the most useful bit
14:29:39 <wendyreid> ... we'd be potentially giving up a lot
14:29:54 <wendyreid> ... we didn't progress much further to see what it would be like as a quality-type standard
14:30:28 <wendyreid> ... third point, if we're trying to introduce flexibility, it's either the coverage of the pages or conformance units, how many conformance units are you including, which provisions are you saying you conform to
14:30:35 <wendyreid> ... how many for each conformance unit?
14:30:49 <wendyreid> ... the main push back I am hearing is being able to claim conformance for a whole
14:30:54 <alastairc> ack kevin
14:30:56 <wendyreid> ... when only testing a subset of the whole
14:31:25 <wendyreid> kevin: That last point, I agree, I don't care what you put in the scope, as long as the scope is clear and makes it clear not everything is passing
14:31:32 <wendyreid> ... sensible for us to provide guidance on it
14:31:55 <Charles> +1 to kevin which is why we still need a ‘partial conformance’ claim
14:31:58 <alastairc> q+ on what's needs to be solved for this idea to get somewhere
14:31:59 <wendyreid> ... just off the back of Wilco's stuff, is there an aspect of this where there is something else, another standard or process standard
14:32:11 <giacomo-petri> +1 to kevin (not in our scope)
14:32:20 <wendyreid> .... we have WCAG, this thing meets requirements and therefore accessible, and that only applies to the thing
14:32:30 <Lisa> +1 to kevin
14:32:35 <giacomo-petri> but essential as well
14:32:36 <wendyreid> ... a separate thing is "this is a quality assessment process"
14:32:48 <wendyreid> ... that then allows for trying to make WCAG do everything
14:32:49 <alastairc> q?
14:32:52 <alastairc> ack Makoto_U
14:33:08 <kirkwood> Kevin made a good point about process standard
14:33:16 <wendyreid> Makoto_U: I wanted to say that it is difficult to define what is an essential path, there is no issue as long as it's define in the conformance requirement
14:34:09 <wendyreid> ... it would be false to claim the site is compliant if part is compliant, it's a subjective judgement, but clearly defining what falls into the conformance claim, it is clear to them, we need to leave it to content owners
14:34:17 <kirkwood> +1 to Makoto
14:34:20 <alastairc> q?
14:34:23 <alastairc> ack nat_tarnoff
14:34:24 <wendyreid> ... for those that don't have legal requirtements or pressure, this would be helpful too
14:34:36 <Charles> q+ on language. change ‘essential path’ to ‘your scoped path for a partial claim’
14:34:36 <wendyreid> nat_tarnoff: I'm just wondering if there's layers to this
14:35:06 <wendyreid> ... we know that essential paths are important to getting the users what they need to do, but there might be things in the way that are important but not essential
14:35:32 <alastairc> qv?
14:35:44 <alastairc> ack Detlev
14:35:45 <wendyreid> ... what conformance means is clear on what is an essential path may be, the end user can define that, they cover their essential paths, we cover other things in WCAG-EM, conformance ascends by parts
14:36:18 <GreggVan> q+  to say "Interesting idea.  that in CLAIMS we allow people to specify the SCOPE in more than just pages.    THat is a claim can be  Pages, or Paths, or Function, or classes   - but the word "essential" or other subjective terms cannot be used.   It must be clear what the exact scope is.
14:36:29 <wendyreid> Detlev: Just to remind us, with WCAG 2, the object of conformance is pages, if we go beyond that to paths or processes, it's no different than claiming the pages within the path today
14:36:43 <wendyreid> ... why WCAG1 or 2 haven't been able to do that, the effort.
14:37:19 <wendyreid> ... the other thing is users don't look at a11y statements, they encounter a problem, they may then find the statement, but they just face a barrier, the user experience is the corner stone
14:37:51 <AWK> In general, even procurement people who are buying a product and should be reviewing the conformance statements don't do it.
14:37:52 <wendyreid> ... to bring it into view to the user, you'd have to label things, but clients don't want to do this, maybe only in cases in legacy pages or older areas of a site
14:38:03 <alastairc> ack Wilco
14:38:34 <wendyreid> Wilco: The reason I brought up quality management wasn't to suggest WCAG gets one, or W3C needs to make one, a new version is already coming,
14:38:51 <wendyreid> ... I brought it up because the problems we raise are better addressed there
14:39:12 <wendyreid> ... how do we write a conformance model that works well alongside a quality model
14:39:23 <wendyreid> ... how can we offload some of these problems to those standards
14:39:28 <alastairc> ack alastairc
14:39:28 <Zakim> alastairc, you wanted to comment on what's needs to be solved for this idea to get somewhere
14:39:32 <wendyreid> alastairc: Keep it simple, refer to the quality standard
14:39:38 <kevin> +1 to not reinventing the wheel
14:39:42 <wendyreid> ... good point from Wilco
14:39:55 <wendyreid> ... what would be needed for this proposal to get somewhere?
14:40:16 <wendyreid> ... there's two topics, definition of essential paths, and proportion of a product is conformance based on a subset
14:40:26 <wendyreid> ... proportion of a product, what if we're not calling it conformance
14:40:38 <wendyreid> ... it's not level 1 of conformance, it's partial conformance or something like that
14:41:04 <wendyreid> ... you're stating your scope, this scope doesn't include everything, that might solve this problem
14:41:12 <wendyreid> ... a later proposal has a variation of this
14:41:18 <hdv> +1 to call it partial conformance
14:41:53 <wendyreid> ... on the definition side, I don't see how we could come up with a definition that covers a range of products, they have limited paths but many pages, or more limited things like a watch app
14:42:02 <wendyreid> ... if we leave that aspect to the person making the claim
14:42:14 <wendyreid> ... it clears the way for it
14:42:15 <wendyreid> q+
14:42:37 <alastairc> ack Charles
14:42:37 <Zakim> Charles, you wanted to comment on language. change ‘essential path’ to ‘your scoped path for a partial claim’
14:42:40 <wendyreid> alastairc: Two aspects, we give up on trying to define what paths, but we give an informative description, or we don't give it a name like conformance
14:43:01 <wendyreid> Charles: I got on queue to say the same thing, thinking of it as inverted. Conformance is everything
14:43:13 <wendyreid> ... a partial conformance claim requires a scope, the author has to define
14:43:21 <wendyreid> ... they have to define their partial conformance claim
14:43:29 <alastairc> ack GreggVan
14:43:29 <Zakim> GreggVan, you wanted to say "Interesting idea.  that in CLAIMS we allow people to specify the SCOPE in more than just pages.    THat is a claim can be  Pages, or Paths, or
14:43:32 <Zakim> ... Function, or classes   - but the word "essential" or other subjective terms cannot be used.   It must be clear what the exact scope is.
14:43:53 <wendyreid> GreggVan: An interesting idea we allow people to specify scope in claims, it can be pages, paths, functions, etc.
14:44:11 <wendyreid> ... the word essential or other subjective terms cannot be used, there's no way of testing your claim
14:44:12 <alastairc> q+ on normalising partial claims
14:44:16 <wendyreid> ... I don't know what is essential
14:44:23 <wendyreid> ... there's no subjective term in that
14:44:27 <Charles> +1 to GreggVan on ‘essential’.
14:44:48 <wendyreid> ... it could be a claim of conformance, I would think we probably should use partial conformance
14:45:11 <wendyreid> ... with the following scope, they'll not understand. I like partial conformance
14:45:11 <kirkwood> +1 to partial conformance
14:45:58 <wendyreid> ... if regulations can change the scope needed, if the regulation doesn't require the whole site, allowing the claim to be more flexible, and owners have flexibility. Even small companies can have hugely complex websites
14:46:02 <alastairc> ack wendyreid
14:46:11 <Detlev> isn*t "partial conformance" the scope does not meet all requirements? That is different of conforming fully, but only in certain parts
14:46:22 <Adam> wendyreid: I also agree that we can say partial conformance for this
14:46:44 <Adam> ... there are a lot of parts, even for simple websites
14:46:54 <Adam> ... I do worry about us getting bogged down in “what ifs”
14:47:01 <Adam> ... of people interpreting this in a negative fashion
14:47:13 <Adam> ... we should threat model people trying to get around it
14:47:24 <shadi> +1 to wendyreid getting held back by edge cases "what-if"
14:47:24 <hdv> +1 to wendy, don't need to spec our way out of finding loopholes
14:47:25 <Adam> ... if we try to “spec” our way out of someone trying to find loopholes
14:47:27 <hdv> q?
14:47:40 <hdv> q+
14:47:50 <kevin> +1 to Wendy's point on avoiding to try to account for every bad approach
14:47:58 <Adam> ... if we try to define a conformance model that tries to account for every bad actor, we’ll tie ourselves in knots
14:48:09 <Adam> ... we need to make this easy for people to create an environment of conformance
14:48:13 <Adam> ... can’t focus on edge cases
14:48:16 <alastairc> q?
14:48:18 <alastairc> ack alice
14:48:21 <alastairc> ack alastairc
14:48:21 <Zakim> alastairc, you wanted to comment on normalising partial claims
14:48:52 <wendyreid> alastairc: Goal is conformance, we should have notches on the bar leading to conformance
14:49:11 <alastairc> ack hdv
14:49:18 <wendyreid> ... it is a subset that is defined, we don't call it full conformance, we make it clear its normal and on the pathway
14:49:46 <wendyreid> hdv: I want to +! wendyreid and loopholes, as a regulator we see people using loopholes, but it's because they are on their journey towards conformance
14:50:03 <wendyreid> ... we don't need to work those things into the conformance models
14:50:26 <wendyreid> ... in response to alastairc, regarding partial conformance, one thing we see is orgs doing a lot to getting a sticker or the equivalent
14:50:33 <wendyreid> ... they want proof to say they did the thing
14:50:54 <Charles> if normalizing partial conformance, it may require normalizing partial conformance claims. very few sites make claims.
14:50:58 <wendyreid> ... we had a logo of a little green man to put on websites, we know its nonsense, but we saw people wanted the signifier
14:51:10 <stevekerr> q+
14:51:18 <alastairc> DRAFT RESOLUTION: Adjust paths idea to: 1) Define paths as a unit of conformance, 2) Have one or more levels of partial conformance that include paths.
14:51:23 <wendyreid> ... we can figure out wording that equivalent to partial but encouraging to people wanting to improve their work
14:51:44 <Rachael> q+
14:51:47 <kevin> q+
14:51:53 <wendyreid> +1
14:51:55 <shadi> q+
14:52:04 <alastairc> ack stevekerr
14:52:15 <Rachael> Suggested edit to DRAFT RESOLUTION: Adjust paths idea to: 1) Define paths as a unit of conformance, 2) Have one or more levels of partial conformance that include paths. 3) Expand on paths in external documentation such as policy and quality documents
14:52:48 <wendyreid> stevekerr: On Hidde's point, on the topic of encouraging people trying to full conformance status, if we move forward with paths, is it something we put in a policy doc to prioritize full conformance
14:52:52 <hdv> s/as a regulator we see people using loopholes/as a regulator we see problems but they are very rarely about definition-based loopholes/
14:53:08 <Wilco> q+
14:53:10 <wendyreid> ... provide recommendations on full conformance, how to prioritize critical paths, paths to full conformance
14:53:21 <wendyreid> ... helps people try to reach their goals and transparency
14:53:31 <alastairc> ack Rachael
14:53:41 <wendyreid> Rachael: Chair hat on, make a suggested edit to include a point on paths
14:53:48 <wendyreid> ... started a parking lot on these topics
14:53:58 <alastairc> ack kevin
14:54:03 <wendyreid> alastairc: Haven't decided on a quality doc so more to talk about
14:54:11 <wendyreid> kevin: How is path different from process in WCAG2
14:54:21 <GreggVan> q+
14:54:32 <wendyreid> alastairc: I did try to define it differently, more of a name difference that people will take to have a wider meaning
14:54:32 <alastairc> ack shadi
14:55:16 <wendyreid> shadi: Exactly my point, thanks Kevin, the thought here, essential or not, it was building on essential in WCAG2, we have squishy terms in WCAG2 that can be testable, maybe we can build such a definition
14:55:54 <wendyreid> ... definition that provide that clarity, not all content is equal, even if it is partial conformance, the point is, can we separate out primary tasks or things to be done on a website
14:56:03 <wendyreid> ... using WCAG2 type definitions might help ehre
14:56:09 <wendyreid> ... primary path or selected path
14:56:18 <wendyreid> ... subtype of processes that accomplish certain things
14:56:27 <alastairc> q?
14:56:32 <Charles> q+
14:56:32 <alastairc> ack Wilco
14:56:32 <wendyreid> ... ensure different people come to the same outcome
14:56:33 <nat_tarnoff> Attempt: Path - a set of pages or screens needed to complete a major task. Process - a set of pages or screens not considered a major task. Example Ecom: Purchase is a path. Adding to wishlist a process.
14:56:34 <alastairc> q+
14:56:44 <wendyreid> Wilco: Sorry if this is obvious to others, what problem does this solve?
14:56:45 <shadi> q+
14:56:57 <wendyreid> ... thinking about the historic problems slide, this doesn't click with those
14:56:59 <alastairc> ack shadi
14:58:00 <wendyreid> shadi: This is responding to a couple of things, one of the issues with WCAG2 is that its harsdly met in practice because there is always something somewhere, I think this better reflects the user experience, there is a difference if the site says the primary functions meet a higher level
14:58:15 <wendyreid> ... there is a different expectation than all functions meet requirements
14:58:27 <wendyreid> ... trying to make these notches on the ruler more correlative to the user experience
14:58:31 <wendyreid> ... or to user expectations
14:58:34 <Wilco> q+
14:58:51 <GreggVan> q+  to say    1)   there is no path in W2 -- only process.        so they are not the same -- Paths does not exist - for the same reason that it should not exist in conformance here - (only in Scoping - maybe)         and 2) Essential is only used in exceptions -- and is something a site/author need to be ready to defend in adjudication (court, judge, jury, regulator).
14:58:51 <wendyreid> ... level 1 is less accessible or expectation, not necessarily by removing requirements, but where the requirements occur
14:59:08 <wendyreid> ... regulators can say how far, or timelines to reach different levels
14:59:23 <wendyreid> ... more notches on the ruler to allow regulators to provide the rule, more focused on the experience
14:59:26 <Wilco> q-
15:03:06 <laura> rrsagent, make minutes
15:03:08 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html laura
15:03:27 <Jennie_Delisi> Jennie_Delisi has joined #ag
15:03:32 <Jennie_Delisi> present+
15:04:02 <Heather> scribe+
15:04:04 <alastairc> present+
15:04:08 <alastairc> scribe-
15:10:54 <SydneyColeman> SydneyColeman has joined #ag
15:11:04 <SydneyColeman> present+
15:13:04 <Heather> present+
15:16:00 <Rachael> q?
15:16:02 <alastairc> q?
15:16:03 <Heather> Rachael: Intention is to finish off the queue and then go back to the draft survey, which had a proposal for a way forward.
15:16:03 <Rachael> ack GreggVan
15:16:04 <Zakim> GreggVan, you wanted to say    1)   there is no path in W2 -- only process.        so they are not the same -- Paths does not exist - for the same reason that it should not exist
15:16:04 <Zakim> ... in conformance here - (only in Scoping - maybe)         and 2) Essential is only used in exceptions -- and is something a site/author need to be ready to defend in adjudication
15:16:04 <Zakim> ... (court, judge, jury, regulator).
15:16:59 <alastairc> qv?
15:17:47 <Heather> GreggVan: 1) There is no path in WCAG 2, only process. 2) Essential was raised; essential was only used in the exception, not in the provision. The problem is that if you claim the exception, you'll need to prove it in court, or defend your decision that it is an exception. Cautions the use of using exception.
15:17:48 <Rachael> ack Charles
15:18:40 <Jennie_Delisi> Jennie_Delisi has joined #ag
15:18:45 <Jennie_Delisi> present+
15:19:27 <Rachael> ack alastairc
15:19:33 <Heather> Charles: Has heard the use of essential, prioritized, critical... all of these words suggest an audience for whom that is true. I don't think that is our place in providing a definition of path within this resolution, whether we call it path or process. Don't think we should qualify that path; that's up to the author making the claim. Example is
15:19:34 <Heather> the upsell in an e-commerce site to add what you forgot.
15:20:09 <Adam> s/the upsell/... the upsell/
15:21:29 <Rachael> q?
15:21:45 <Heather> alastairc: One aspect of the proposal was to use the terminology of essential from WCAG 2 and page title. We could use those in a site context; it's select a subset of paths that maybe a partial conformance. It would be a way to level on the way to conformance. We are trying to define essential paths as something that would work across all the
15:21:45 <Heather> different types of site and product that we need WCAG to apply to. I can see paths working as a unit of conformance where the regulator or the author is selecting what goes into a claim, but it's something which would need to be objective and work across the different types of sites.
15:22:02 <Adam> s/different types of site/... different types of site/
15:22:35 <alastairc> I think parts 2 and 3 would be new
15:22:39 <Detlev> 2 sounds vague
15:22:43 <Heather> Rachael: [Proposing draft resolution]; calls out that there is a scope for declaring conformance in addition to views called task flows; not sure if I see an difference between what we're talking about here or paths in general. Needs help understanding what the difference is.
15:22:53 <Jon_Avila> Jon_Avila has joined #ag
15:23:02 <GreggVan> q+
15:23:33 <alastairc> q+
15:23:40 <Rachael> ack GreggVan
15:23:46 <Charles> path / flow / process can be grouped but are not same
15:24:01 <janina> janina has joined #ag
15:24:04 <Heather> GreggVan: We were talking about paths being in scoping conformance claims; you have it as conformance for number one, number two, you have it in conformance, number three, you seem to have thrown it out. none of your choices are to have paths to be something that is part of scoping.
15:24:35 <Rachael> ack alastairc
15:24:44 <Heather> Rachael: Was thinking that Unit of conformance would be conformance; clarified draft resolution language, posted above.
15:25:18 <Detlev> thanks!
15:25:20 <Heather> alastairc: Clarifying that it's saying that we would try out in the conformance model including meeting certain levels of provisions - that's what number 2 means.
15:25:39 <GreggVan> q+
15:26:01 <Wilco> q+
15:26:06 <Heather> Rachael: To clarify for people who joined late, wants to restate the goal for this 2-day period is to have a series of strategies that we as a group think we have enough weight or approaches that have enough likelihood of success that we can all agree on.
15:26:17 <Heather> GreggVan: Are we agreeing to three different points?
15:26:30 <Rachael> ack GreggVan
15:26:34 <Heather> Rachael: We would be agreeing to do 3 different points that seem to have come out of the conversation.
15:26:34 <Rachael> ack Wilco
15:26:54 <Heather> Wilco: Is this a decision from the group to do this, or that we'll explore this as a resolution?
15:27:13 <GreggVan> q+
15:27:19 <Heather> Rachael: Explore is used in number 2. 1 is included in the current path. 3 is expanding on the external documentation.
15:27:21 <Jon_Avila> Does a path include the whole page they go through?
15:27:29 <Jon_Avila> q+
15:27:38 <Heather> Rachael: agreed to say 'explore' instead of 'expand'
15:27:48 <Heather> Wilco: Better, thanks,
15:28:26 <AWK> AWK has joined #ag
15:28:29 <Heather> GreggVan: We have it as a way to conform, or as a way for reporting a partial conformance. Maybe explore, it should be as part of claims.
15:28:42 <Heather> Rachael: Reposted revision of Draft Resolution above.
15:28:52 <GreggVan> +1
15:28:57 <Lisa> +1
15:28:58 <Jon_Avila> q-
15:28:58 <hdv> +1
15:29:06 <Rachael> ack GreggVan
15:29:06 <Heather> Rachael: Is everyone happy with that before we vote?
15:29:10 <JeroenH> +1
15:29:12 <wendyreid> +1
15:29:13 <nat_tarnoff> +1
15:29:14 <Makoto_U> +1
15:29:18 <Rachael> Proposed resolution: Adjust paths/task flows idea to: 1) Explore paths/task flows as a unit of conformance in scope, 2) Explore one or more levels of partial conformance that include paths/ task flows. 3) Explore paths / task flows in external documentation such as policy, wcag-em, etc.
15:29:19 <SydneyColeman> +1
15:29:19 <Heather> Rachael: no other concerns heard.
15:29:20 <Adam> +1
15:29:20 <ShawnT> +1
15:29:20 <Jon_Avila> +1
15:29:21 <wendyreid> +1
15:29:21 <Heather> +1
15:29:21 <CClaire> +1
15:29:23 <BrianE> +1
15:29:23 <GreggVan> +1
15:29:24 <alastairc> +1
15:29:26 <Charles> +1
15:29:26 <joryc> +1
15:29:27 <Rachael> +1
15:29:28 <Wilco> 0 Don't mind this but don't know the value of this
15:29:30 <Detlev> +1 ( but we have been exploring for many years...)
15:29:36 <Monica> +1
15:29:38 <Gez> +1
15:29:41 <AWK> +1
15:29:43 <filippo-zorzi> +1
15:29:44 <jtoles> +1
15:29:45 <Jennie_Delisi> +1
15:29:53 <kevin> q+
15:29:55 <kirkwood> +1
15:29:57 <Rachael> ack kevin
15:30:00 <Heather> Rachael: Acknowledging Detlev, that we have explored this previously.
15:30:05 <LenB> +1
15:30:38 <Heather> Kevin: Not averse to this; thinks its fine. How long do we explore this for? What's the end point? How do we determine what is and is not valuable?
15:30:38 <alastairc> q+
15:31:06 <janina> present+
15:31:08 <Heather> Rachael: When we talk about 'explore' here, that we are saying that we are going to build this into the proposal and present it to this group, and assess if it's better or not.
15:31:08 <Rachael> ack alastairc
15:31:31 <Heather> alastairc: Agree to Rachael's comment. It's not the proposal that is in the survey, it's an adjustment of that. The next step is to put something in the draft.
15:31:39 <Heather> Rachael: No -1 in the poll; moving forward.
15:32:24 <Heather> Rachael: RESOLUTION Adjust paths/task flows idea to: 1) Explore paths/task flows as a unit of conformance in scope, 2) Explore one or more levels of partial conformance that include paths/ task flows. 3) Explore paths / task flows in external documentation such as policy, wcag-em, etc.
15:32:40 <Heather> RESOLUTION: Adjust paths/task flows idea to: 1) Explore paths/task flows as a unit of conformance in scope, 2) Explore one or more levels of partial conformance that include paths/ task flows. 3) Explore paths / task flows in external documentation such as policy, wcag-em, etc.
15:33:23 <GreggVan> q+
15:33:41 <Heather> Rachael: draft straw poll. We were talking about this concept of essential tasks, paths or essential task flows, or whatever we're going to call that concept - do we ant to continue to explore. The concept of 'essential path'?
15:34:10 <julierawe> q+
15:34:42 <Heather> alastairc: If you've got a definition of essential path that was pulling through - is it essential to the website, is it part of the website. Does it seem to be feasible to have that kind of definition that is going to work across a variety of definition that is going to work across the interfaces that WCAG shoulda apply to.
15:34:47 <Charles> q+
15:35:03 <Jon_Avila> q+
15:35:27 <Rachael> ack GreggVan
15:35:29 <Heather> shadi: Suggests that get started with the resolution and see how that definition of task flow evolves and gets used. Have a second definition of critical task flow, or similar. Pragmatically, let's start with that.
15:35:41 <Heather> Rachael: Hears suggestion; wants to capture thoughts
15:36:02 <alastairc> In the current adjusted form, path becomes a conformance unit you can use (but claimants choice as to which are included), with advice, there is no sub-set going on.
15:36:38 <kirkwood> +1 to Gregg
15:36:39 <Rachael> ack julierawe
15:36:45 <jyasskin> jyasskin has joined #ag
15:36:50 <Heather> GreggVan: Thinks Shadi has it right; we should not use the word essential anywhere except in exceptions. To say that critical paths are, there's no way of doing it; thinks we should just drop the terms critical and essential, except in the exceptions nd with the understanding that those are going to have to be adjudicated. Continue to explore the
15:36:50 <Heather> idea of paths.
15:37:08 <Heather> julierawe: Wants to double check that the resolution is to see if we are aligned to explore all three of these things?
15:37:12 <Rachael> ack Charles
15:37:16 <Heather> Rachael: Yes.
15:37:37 <maryjom> +1 to dropping "essential" as noted in my comments on the previous question.
15:37:48 <Rachael> ack Jon_Avila
15:37:57 <Heather> Charles: Agrees with Gregg to drop essential or critical from it, but that we need to define these things as group able or relatable. They're all similar, but they can be groups and have their own definitions.
15:38:47 <hdv> q+
15:39:06 <Heather> Jon_Avila: 1) There are certain paths that maybe less commonly used, like resetting your password. It's hard to define a term like essential because they may fall into different categories. 2) Thinks that from WCG 2 and beyond, just because a path may be through a certain page, other parts of that page could be barriers that would prevent access to
15:39:06 <Heather> that path on that page.
15:39:28 <Heather> Rachael: When a path touched a page, the scope was to include the whole page - based on previous conversations.
15:39:36 <alastairc> q+
15:39:43 <Rachael> ack hdv
15:39:54 <Rachael> ack alastairc
15:40:15 <Heather> hdv: Sounds like we might try to get a resolution to explore essential paths more, and whether the essential part is what we are going to call it. Doesn't think we need to go too much more into detail.
15:40:22 <Heather> Rachael: Yes, that's what I'm trying to get to.
15:40:37 <AWK> Important paths and we need to define what important means
15:40:43 <Rachael> Straw poll: Should we continue to explore the concept of "essential or critical paths" to enable requiring these as part of a conformance claim? +1 to support exploring essential paths, -1 to discourage exploring essential paths, 0 if in the middle
15:40:46 <Heather> alastairc: There are concerns raised on this topic.
15:40:50 <Lisa> +1
15:40:53 <julierawe> +1
15:40:55 <laura> laura has joined #ag
15:40:55 <GreggVan> -1
15:40:55 <shadi> +1
15:40:56 <Rachael> -1
15:40:56 <shoobe01> +1
15:40:56 <Heather> Rachael: Puts in straw poll.
15:40:57 <Wilco> -1
15:40:57 <Charles> -1
15:40:59 <ShawnT> +1
15:41:01 <Adam> -1
15:41:02 <Jennie_Delisi> +1
15:41:03 <nat_tarnoff> +1
15:41:04 <hdv> +1
15:41:04 <wendyreid> +1
15:41:06 <laura> -1
15:41:06 <alastairc> -1, should be regulator/compliance thing.
15:41:07 <kirkwood> -1
15:41:08 <Makoto_U> -1
15:41:09 <AWK> +1
15:41:09 <SydneyColeman> +1
15:41:10 <kevin> -1
15:41:11 <Heather> -1
15:41:11 <stevef> 0
15:41:13 <maryjom> +1 ...but not using "essential" as it is currently defined
15:41:13 <janina> +1 because there are some paths we insist must conform
15:41:14 <BrianE> 0
15:41:15 <JeroenH> +1
15:41:17 <CClaire> -1
15:41:19 <Gez> 0
15:41:24 <Jon_Avila> +0
15:41:34 <Detlev> 0
15:41:36 <filippo-zorzi> 0
15:41:37 <shadi> q+
15:41:39 <LenB> -1
15:41:45 <Heather> Rachael: Around the concept of essential. We are doing paths, we are only discussing the use of 'essential' to define a path or a subset of paths.
15:41:46 <giacomo-petri> 0
15:41:46 <shadi> q-
15:41:46 <Rachael> ack shadi
15:41:49 <janina> q+
15:41:59 <Rachael> ack janina
15:42:10 <wendyreid> q+
15:42:19 <shadi> +1 to janina
15:42:20 <alastairc> q+
15:42:26 <jkatherman> jkatherman has joined #ag
15:42:33 <atya> atya has joined #ag
15:42:34 <Rachael> ack wendyreid
15:42:38 <hdv> q+
15:42:54 <Heather> janina: I think what we're trying to say with essential and critical is that there are some kinds of activities that we really want to see them being fully accessible and we want them as part of any conformance claim. I think we need to turn our focus as to how we define the ones we really care about.
15:42:59 <maryjom> +1 to janina
15:43:08 <GreggVan> -1  unless there is a univeral definition of what essential or critical and everyone will know which parts are accessible if i say just "i did the essential" parts
15:43:17 <Heather> Rachael: Thanks for the clarification; acknowledges that Shadi agrees with it. Will probably redo the straw poll
15:43:27 <AWK> +1 to Janina
15:43:41 <shadi> +1 to wendyreid
15:43:43 <atya> +1
15:43:47 <kirkwood> COGA path ?
15:43:50 <giacomo-petri> +1
15:43:56 <GreggVan> what does "types of " mean
15:43:58 <Rachael> q?
15:44:01 <Rachael> ack alastairc
15:44:03 <Heather> wendyreidAgree with you, I think based on our previous discussion, one of the things that is compelling is the idea of partial conformance and almost having a ladder (Tier 1, Tier 2,e tc). Having an iterative path, and building towards something.
15:44:14 <GreggVan> is a type definitive and comprehensive>
15:44:14 <Jon_Avila> Paths are really helpful as without them it's hard for a purchaser/user know what the conformance level actually means in a practical way to people
15:44:15 <Heather> Rachael: Acknowledges general support to that.
15:44:20 <wendyreid> s/wendyreidAgree/wendyreid: Agree/
15:44:30 <giacomo-petri> q+
15:44:44 <Charles> q+
15:45:03 <GreggVan> q+
15:45:18 <shadi> q+
15:45:32 <Rachael> ack hdv
15:45:35 <Heather> alastairc: Chair hat off; there are a couple of ways this can go. If you're trying to find whatever it is (essential, critical, important) I don't think that's going to be objective enough to use in conformance. That doesn't mean we can't use the concept. It doesn't mean we can't have more levels and notches. The key for me is whether you want that
15:45:35 <Heather> term to be used in conformance, which may imply different people would define the same paths for the same product, and is skeptical that would be the case.
15:45:53 <Heather> alastairc: Let's keep the building blocks simple, and allow them to be used in various ways.
15:46:11 <alastairc> hdv - but could we define a term (like essential) that defines which paths to include for each bar?
15:46:11 <Adam> s/term to be used in conformance/... term to be used in conformance/
15:47:11 <Detlev> q+
15:47:12 <Rachael> ack giacomo-petri
15:47:15 <Heather> hdv: I think more talks about lowering the bar, maybe that's something we should say explicitly. Finding ways to show the path to full conformance by distinguishing levels of partial conformance is better, and the use for partial conformance could be useful. There is a regulatory part which spots are considered critical or essential in a
15:47:15 <Heather> specifically case.
15:47:20 <Rachael> ack giacomo-petri
15:47:21 <Heather> giacomo-petri: Voted
15:47:24 <kirkwood> we need a deeper dive on accessible paths. (and affects on accessiliby on the  cumulative mulitpage related accessibility issues)
15:47:38 <Wilco> q+
15:47:56 <Rachael> ack Charles
15:47:57 <jyasskin> q+
15:48:10 <GreggVan> q+  to say   "we should explore the idea of saying that  "these paths" conform where the paths are defined by the author.   esp as part of partical conformance.  but we should not be using words that people would all think meant something different like   "i did the *important* or  *essential* or *critical* paths or even  "these types of paths"   since i dont know what they actually mean by those paths.
15:48:23 <hdv> s/more talks about lowering the bar/I want to make clear we're not talking about lowering the bar/
15:48:26 <AWK> AWK has joined #ag
15:48:30 <Heather> giacomo-petri: Voted '0' because I'm in the middle. Echoing alastairc, essential is difficult as an objective term in conformance. It might be more difficult to claim conformance if the essential flows can demonstrate the progress. I am more in favor of still exploring the essential path and not for conformance.
15:48:46 <Rachael> ack GreggVan
15:48:46 <Zakim> GreggVan, you wanted to say   "we should explore the idea of saying that  "these paths" conform where the paths are defined by the author.   esp as part of partical conformance.
15:48:49 <Zakim> ... but we should not be using words that people would all think meant something different like   "i did the *important* or  *essential* or *critical* paths or even  "these types
15:48:49 <Zakim> ... of paths"   since i dont know what they actually mean by those paths.
15:48:57 <hdv> s/Finding ways to show/Having essential or critical paths helps us show/
15:49:02 <Heather> Charles: Building off alastairc point, my understanding of this straw poll of whether or not we pursue essential or critical. In part 3 of the resolution and not parts 1 and 2.
15:49:51 <SydneyColeman> q+
15:50:12 <giacomo-petri> s/It might be more difficult to claim conformance if the essential flows can demonstrate the progress./It might be more difficult for larger companies to claim conformance, compared to small properties. Essential flows can be a way to demonstrate progress and conformance. That said,
15:50:12 <hdv> s/the use for partial conformance could be useful/and critical or essential paths or whatever we call them can help find out, I already see my regulatory colleagues do that today too, it's a pragmatic way to find out what affects most people/
15:50:15 <Heather> GreggVan: "we should explore the idea of saying that "these paths" conform where the paths are defined by the author.   esp as part of partical conformance.  but we should not be using words that people would all think meant something different like "I did the *important* or  *essential* or *critical* paths or even  "these types of paths"   since I
15:50:15 <Heather> don't know what they actually mean by those paths.
15:50:16 <Rachael> zakim, close queue
15:50:16 <Zakim> ok, Rachael, the speaker queue is closed
15:50:23 <Rachael> q?
15:50:35 <Rachael> ack shadi
15:50:40 <Heather> Rachael: Felt conversation was circling, closing the queue.
15:50:43 <hdv> s/ There is a regulatory part which spots are considered critical or essential in a/and of course some of this puzzle is to be solved by regulators, but our definitions for paths can help inform some of it and be useful./
15:51:03 <Detlev> q-
15:51:22 <alastairc> hard to define in a way that applies across the variety of things WCAG applies to, and would be reasonably objective.
15:51:27 <SydneyColeman> q-
15:51:44 <AWK> +1 Shadi
15:52:02 <Heather> shadi: Hearing general agreement is that the challenge is how to define 'paths' or 'tasks' or whatever we call it. What I don't hear consensus on is what we call it at the end, or if it's part of conformance or not, or in what way. We agreed to explore that earlier; we need to double down and define that. Everything else will emerge later.
15:52:45 <Rachael> ack Wilco
15:52:57 <Heather> shadi: In WCAG 2, we have things like accessibility support where there's extensive guardrails and definition of how you define something and how you would probably need even more extensive definition. We need to see where it fits in and how else we can use that int he rest of the WCAG document.
15:54:28 <Rachael> ack jyasskin
15:54:31 <laura> +1 to wilco
15:54:38 <Heather> Wilco: voted '-1' because it seemed like a prioritization problem. The ultimate goal is to reduce accessibility barriers as an organization. The other part of that is how impactful that barrier is. Thinks that having one part of this in the conformance model and not the other wish cue that prioritization problem in an uncomfortable way. These kinds
15:54:38 <Heather> of problems that I think are much better solved in a quality management system and don't fit well into WCAG.
15:55:53 <Heather> jyasskin: 1) The goal to have website owners or regulators talk about paths probably affects the conformance model itself because the current conformance model is only on page at a time. 2) Does this group want to add more work, or just accept that regulators and website owners can talk about paths, but not actually make requirements or define what
15:55:53 <Heather> an essential path is?
15:56:06 <Heather> Rachael: Goal is to both get it done and get it right, and there's a balance to that.
15:56:15 <Detlev> q+
15:56:24 <Adam> s/of problems that I think are/... of problems that I think are/
15:56:27 <Heather> Rachael: Wants to understand where people are at on using the term 'partial conformance'
15:56:27 <alastairc> zakim, open the queue
15:56:27 <Zakim> ok, alastairc, the speaker queue is open
15:56:27 <Rachael> TOPIC: Partial conformance
15:56:28 <Adam> s/an essential path is/... an essential path is/
15:56:31 <Rachael> zakim, open queue
15:56:31 <Zakim> ok, Rachael, the speaker queue is open
15:56:31 <Detlev> q+
15:56:31 <GreggVan> q+
15:56:36 <Jon_Avila> We have partial conformance today in 2- but partial is non-conformance.
15:56:42 <Rachael> ack Detlev
15:56:47 <Heather> Rachael: This is a side step, please keep points concise as possible.
15:57:05 <Jon_Avila> q+
15:57:18 <Rachael> qq+ to define terms
15:57:35 <Heather> Detlev: Not entirely ensure when we talk about partial conformance, such as a page that does not meet all requirements, therefore is partially conformant. Asks for clarity for clarity on the two terms.
15:57:37 <janina> q+
15:57:45 <wendyreid> q+
15:57:47 <alastairc> q+ on 99% of sites being partial, and we should make that normal, just need a score
15:57:56 <Rachael> "partial conformance" is when the scope does not meet all of the provisions.
15:58:18 <Rachael> "conformance of parts" is when the scope is smaller than the full site
15:58:19 <Heather> Rachael: Asks that for the purposes of the conversation, that we need to come up with terminologies. Partial conformance is when the scope does not meet all the provisions; Conformance of parts is when the scope is smaller than the full site.
15:58:35 <Rachael> ack Rachael
15:58:35 <Zakim> Rachael, you wanted to react to Detlev to define terms
15:58:37 <Rachael> ack GreggVan
15:59:15 <giacomo-petri> q+
15:59:15 <hdv> q+
15:59:44 <Jennie_Delisi> q+ re branding impact of partial conformance
16:00:14 <Heather> GreggVan: If you're only claiming it for some pages, you don't have to do partial conformance, you just state those pages as being in your scope, and you say these pages conform. Within my scope, not everything conforms. Doesn't think there is a need to disclose any further than that, because when you make a statement of partial conformance, you
16:00:14 <Heather> would state what doesn't conform. You could say this is a statement of partial conformance which is a subset of non-conformance. It's a partial conformance either way.
16:00:15 <Rachael> ack Jon_Avila
16:00:17 <Heather> q+
16:00:18 <nat_tarnoff> If we only conform pages, GreggVan makes sense. If we conform for products, then Partial is non-conformant.
16:00:27 <Adam> s/would state what doesn't conform/... would state what doesn't conform/
16:00:55 <Rachael> qq+ for scribe change
16:01:05 <kevin> +1 to 'partial' conformance to being a wide area
16:01:39 <Heather> Jon_Avila: Partial conformance, wonders if there's a non-conformance. If there is one thing that metes one of the criteria, then you're partially conformant. I agree with Gregg that we would need some sort of way to explain what that means to make it useful. The whole point of understand nonconformance is for the user to understand or determine if
16:01:39 <Heather> this is acceptable or not.
16:02:04 <Rachael> ack Rachael
16:02:04 <Zakim> Rachael, you wanted to react to Jon_Avila to discuss scribe change
16:02:36 <Detlev> I'll pick up
16:02:50 <Rachael> ack janina
16:05:06 <shadi> +1 to janina
16:05:17 <maryjom> +1 to janina
16:05:23 <wendyreid> +1 to Janina
16:05:25 <janina> https://www.w3.org/TR/accessibility-conformance-challenges/https://www.w3.org/TR/accessibility-conformance-challenges/
16:05:45 <Rachael> ack wendyreid
16:05:47 <Heather> janina: We need to think about partial conformance because that's the reality of the world. We're never going to get any site to fully conform, unless it's really simple and doesn't have a lot of pages. It's not a question of 'do we deal with it' it's 'how we deal with it.' I think we've taken that is about as far as we can go. There are places
16:05:47 <Heather> where we don't want partial conformance (password reset, credit card data, etc). We might come close, but may be arguably not sufficient.
16:05:50 <AWK> +1 to Janina
16:06:11 <Adam> s/where we don't want partial conformance/... where we don't want partial conformance/
16:07:12 <janina> AG's FPWD of Challenges with Conformance: https://www.w3.org/TR/accessibility-conformance-challenges/
16:08:16 <Rachael> ack alastairc
16:08:16 <Zakim> alastairc, you wanted to comment on 99% of sites being partial, and we should make that normal, just need a score
16:08:21 <Heather> wendyreid: +1 to Janina's comment. The challenge is that we're talking about it like it isn't the current reality. There's probably fewer examples of companies and organizations not taking this kind of approach than taking this kind of approach. You have to scope the work, regardless of where you're at today. The partial, path-based model, or user
16:08:21 <Heather> journey-based model is more much reflective of how people are actually working. It's really hard to do an entire website regardless of its size. We need to be mindful of how we explain the progression of this. The partial conformance model is the one that makes the most sense. Someone in a legal department at a company is probably grimacing at the
16:08:21 <Heather> idea of claiming partial conformance. How are people doing this current? How do we adopt some of those principles and define them into our conformance process?
16:08:51 <Adam> s/journey-based model is more much reflective/... journey-based model is more much reflective/
16:08:54 <Adam> s/idea of claiming partial conformance/... idea of claiming partial conformance/
16:09:22 <Charles> +1 to janina in that getting a part to conform encourages getting the next part
16:09:22 <BrianE> q+
16:09:28 <Heather> alastairc: Similar to Wendy, Out of the thousands of audits I've been involved in, and there was 1 for each fully and not, and all the rest were 'partial conformance' - maybe we need rebranding of that term, acknowledge that reality, and provide the differentiation for that 99% of cases.
16:09:46 <Rachael> ack giacomo-petri
16:10:21 <Wilco> +1 Giacomo
16:10:42 <shadi> q+
16:10:42 <laura> +1 Giacomo
16:10:59 <Heather> giacomo-petri: Trying to solve something that is not in our scope for conformance. Conformance then determines compliance. A WCAG audit should serve as a validation of those processes or snapshot of where we are now within a product, rather than being the sole measurement of accessibility. This is out of our scope. We should provide meaningful
16:11:00 <Heather> guidance for polymers, but is not convinced that it should be part of a conformance itself, since any definition of partial compliance will still be somehow subjective.
16:11:06 <Rachael> ack hdv
16:11:17 <Heather> Rachael: Curious to understand where people are on this concept of declaring smaller scopes as a stepping stone.
16:11:21 <Wilco> q+
16:11:28 <Adam> s/guidance for polymers/...guidance for policy makers/
16:11:37 <shadi> +1 to hdv
16:12:20 <alastairc> Probably terms that don't have "conformance" in the term.
16:12:32 <stevekerr> +1 to hdv
16:13:05 <Heather> hdv: Agrees with a lot of people that partial conformance is non-conformance. It's the same. Full conformance is impossible. We need to get closer to the reality of how organizations work today, how they improve accessibility, we need to be closer to that reality. It would be better for regulators to understand how to compare different companies,
16:13:05 <Heather> and to prioritize. It would be helpful to define the vocabulary to understand where people are.
16:13:05 <kirkwood> substantial, provisional, limited
16:13:05 <Rachael> ack Jennie_Delisi
16:13:05 <Zakim> Jennie_Delisi, you wanted to discuss branding impact of partial conformance
16:13:07 <Makoto_U> +1 to hdv
16:13:11 <kirkwood> reg terms
16:13:19 <maryjom> +1 to Hidde. There is a vast amount of work between non-conformance and full conformance. Plus delivery of content (whether web content or software) is so rapid today, reaching and then keeping full conformance is pretty close to impossible.
16:13:24 <giacomo-petri> s/Conformance then determines compliance. A WCAG audit should serve as a validation of those processes or snapshot/current regulations only refer to WCAG, so in our real world you’re either conformant or you’re not, and that alone almost determines compliance. The problem is that there should be additional ways to assess the accessibility of a
16:13:24 <giacomo-petri> product or company's processes; a WCAG audit should ideally serve as a validation of those processes or snapshot
16:14:00 <hdv> s/It's the same. Full conformance is impossible. /But while it is technically the same, the space between 0 and 1 is huge, almost all sites are partially conformant, so we need richer vocabulary to express where people are between 0 and 1/
16:14:13 <GreggVan> q+
16:14:29 <shadi> +1 to Jennie_Delisi
16:14:30 <Rachael> ack Heather
16:14:35 <Heather> Jennie_Delisi: Supports Janina's concepts and HDV's. We saw an increase in WCAG 2.X maturation of adoption. They adopted it as this pass-fail concept. One of the branding concepts that Shadi brought up in the subgroup that I think might be helpful to consider because the word partial conformance speaks to that pas-fail. Only a single score. If we
16:14:35 <Heather> instead we could consider multiple rulers.
16:14:35 <hdv> s/we need to be closer to that reality./we need to be closer to that reality, like Wendy said./
16:14:45 <alastairc> scribe+
16:14:55 <Adam> s/product or company's processes/... product or company's processes/
16:15:05 <alastairc> Heather: Anyone saying "fully conformance" I didn't trust as credible.
16:15:09 <Adam> s/instead we could consider multiple rulers/... instead we could consider multiple rulers/
16:15:30 <alastairc> ... Whether it's by task / workflow, it's a way to broaden the landscape for the assessment.
16:15:42 <Detlev> scribe: Detlev
16:15:47 <alastairc> ... it would help regulators make decisions about what they should be asking for.
16:15:48 <Rachael> q?
16:16:21 <Detlev> Heather: Regulator sneed to understand what non-confornance means
16:16:23 <alastairc> ... e.g. if company A says we have a process for taking in requests about WCAG issues, that's better than company B which doesn't make commitments about fixing things.
16:16:28 <Rachael> ack BrianE
16:16:31 <alastairc> scribe-
16:16:43 <Detlev> ...sorry I was waiting for the eyrly scribe to scribe Heather...
16:16:57 <Heather> thank you Detlev
16:17:19 <Heather> scribe-
16:17:29 <AWK> AWK has joined #ag
16:17:29 <joryc> q+ to say if we get into more granularity we would need a change to regulations to protect orgs who are more specific in their stated conformance, nobody is fully conformant and it is impossible to be so, yet anything other than full conformance yields legal risk. Also orgs will not universally be able to reveal their process nor promise resolution
16:17:31 <joryc> timelines.. and neither of that should be in WCAG, that should be in the regualtions.
16:17:38 <alastairc> s/scribe: Detlev/scribe+ Detlev
16:17:46 <GreggVan> Q+  to say  -- nutrition labels keep being raised and there are two ways to look at that.  1)  there are 4 or 5  types of disability and you must conform for each or report which you do not conform for.    (this might be legitimate but im not sure anyone would want to do that)   or   2)  there are dimensions and you pass if you do some of each  but we are not saying how much of each you must do.  If you do - then you are back to #1.  In all cases
16:17:46 <GreggVan>  it is binary if you want to require it.    Nutrition labels can be informative and vague because products are not required to meet some nutrition value.  Whenever they are - then a specific number is specified for each dimention and you either pass or fail if you meet that threshold or not
16:17:48 <Rachael> ack shadi
16:17:50 <Detlev> BrianE: Not clear whether partial conformance means 80% 20% within a provision or between provisions
16:18:12 <Detlev> shadi: in support of Jenny, hidde and others...
16:18:44 <Rachael> q+ to point to the fpwd
16:19:00 <Detlev> ...it is also the reality of users - like stars of hotels - that sets expectations, levels are communicating something - that is missing in WCAG
16:19:37 <Rachael> ack Wilco
16:19:41 <Detlev> ...maturity model / process oriented is the standard and WCAG conforms the outcome would not work without more granularity
16:20:00 <kevin> rrsagent, make minutes
16:20:02 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
16:20:36 <GreggVan> s/dimention/dimension/
16:20:49 <Detlev> Wilco: WCAG is useful in process-oriented environment because you can measure frequency occurence impact of issues - so you can then change - it is really a snapshot. This is what organisation need.
16:21:35 <Rachael> ack GreggVan
16:21:35 <Zakim> GreggVan, you wanted to say  -- nutrition labels keep being raised and there are two ways to look at that.  1)  there are 4 or 5  types of disability and you must conform for each
16:21:38 <Zakim> ... or report which you do not conform for.    (this might be legitimate but im not sure anyone would want to do that)   or   2)  there are dimensions and you pass if you do some
16:21:38 <Zakim> ... of each  but we are not saying how much of each you must do.  If you do - then you are back to #1.  In all cases
16:21:40 <Detlev> ...to Hodde'S point: THe NL government has a label that includes other things, is there a plan, is there a follow-up etc - we need to look beyond the requirements in WCAG 3 - and that does not fit well into WCAG
16:22:10 <Detlev> GreggVan: We are mixing up requirements and informative information
16:22:54 <Detlev> …"nutrition labels" are informative, but they are not requirements, otherwise they would need to be binary thresholds
16:23:28 <laura> +1 to Wilco and Gregg
16:24:15 <AWK> AWK has joined #ag
16:24:46 <Rachael> ack joryc
16:24:46 <Zakim> joryc, you wanted to say if we get into more granularity we would need a change to regulations to protect orgs who are more specific in their stated conformance, nobody is fully
16:24:49 <Zakim> ... conformant and it is impossible to be so, yet anything other than full conformance yields legal risk. Also orgs will not universally be able to reveal their process nor promise
16:24:49 <Zakim> ... resolution
16:24:49 <Detlev> ...2nd thing We say: because no one can meet WCAG, we should change what it means - but it still informs behavior as a benchmark, enforcement is another thing. Everything under regulation either passes or fails. We should stop using informative examples for the conformance discussion
16:26:14 <hdv> s/Hodde/Hidde
16:27:02 <laura> +1 to Jory
16:27:03 <Rachael> ack Rachael
16:27:03 <Zakim> Rachael, you wanted to point to the fpwd
16:27:27 <Detlev> joryc: processes / roadmaps are a non-started from a legal perspective - processes are very flexible and not so useful from a conformance perspective - there should not be a stigmatization of levels or conformance - the reality is that companie don't talk publicly about meeting regulations
16:28:12 <Detlev> Rachael: three options...
16:28:28 <Rachael> 1) within the scope % of provisions met 2) smaller scope than whole 3) within a provision % met
16:29:16 <Detlev> Rachael: The percentage of how many items passed for a provision was considered too complex
16:29:44 <Detlev> ...not acceptable - so mire movement on a smaller scope, not 3)
16:30:01 <Detlev> ...thanks for the side-step.
16:30:10 <Detlev> ...what to skip user testing now
16:30:27 <Detlev> ...(Rachael sharing screen)
16:31:31 <Detlev> Rachael: Discussin levels of conformance like automatable / core / core plus
16:32:14 <Detlev> ...reporting results from the survey question 4
16:33:14 <kirkwood> [coud u put in link to results again?]
16:33:37 <Detlev> Rachael: The summary about those reluctant to have levels: limits of automation / changing or fluctuating levels
16:33:43 <alastairc> s/coud u put in link to results again?]/
16:33:44 <giacomo-petri> q+
16:33:53 <joryc> q+ to say automation is inadequate now, but may be as good as humans soon. Let's not make assumptions about its future capabilities
16:33:54 <Jon_Avila> q+
16:33:59 <Rachael> ack giacomo-petri
16:34:08 <Detlev> Rachael: Should automatic testing be a level?
16:34:46 <Detlev> giacomo-petri: Automation is not objective parameter - who is responsible to determine what can be automation?
16:35:17 <Wilco> +1 Gaicomo
16:35:20 <Detlev> ...it is essential for continuous monitoring, but we cannot mandate it - what platfor? Where is the validity?
16:35:21 <Rachael> ack joryc
16:35:21 <Zakim> joryc, you wanted to say automation is inadequate now, but may be as good as humans soon. Let's not make assumptions about its future capabilities
16:35:23 <kirkwood> do we consider ai to be automation?
16:35:42 <GreggVan> q+
16:36:30 <Rachael> ack Jon_Avila
16:36:34 <Detlev> joryc: Calling out that in many cases that in many cases is (will be) as good as human evaluation - we should focus on outcomes - the focus is can this method produce reliable results, not how you arrive there
16:36:45 <kirkwood> +1
16:37:06 <alastairc> +1, I hadn't even considered the cross-platform issues.
16:37:12 <AWK> AWK has joined #ag
16:37:17 <wendyreid> q+
16:37:17 <Rachael> ack GreggVan
16:37:23 <Detlev> Jon_Avila: Agrees - it depends on various parameters - AI will change a lot of that. We cannot rely on it as a base though
16:37:44 <Lisa> Q+
16:37:49 <AWK> Q+
16:37:49 <Rachael> Does anyone want to speak FOR using automation as a way of defining a conformance or partial conformance level?
16:37:49 <Heather> +1 to Jory - focus on outcomes and not process. Automation has a cost which may not be feasible for small businesses whose strategy is to hire knowledgeable developers.
16:38:15 <Detlev> GreggVan: Automation is undefined - different tools lead to different results - there is no correlation between what might be tested automatically and the iportance of issues
16:38:19 <Rachael> q?
16:38:22 <Rachael> ack wendyreid
16:38:27 <laura> +1 to Gregg
16:38:29 <Detlev> Rachael: plus one if you agree
16:39:25 <Detlev> wendyreid: questino of when you do the automation - can happen during development, or on the productino website through crawlers, or explict scan - we need a definition of what places we mean when we talk automation
16:40:24 <Rachael> ack Lisa
16:40:25 <Detlev> ...for orgs building towards a11y automation is a tool in the toolchest, nit the whole story, but helpful especially for big companies - there you need it or it wont get done
16:40:33 <giacomo-petri> +1 to wendyreid
16:40:43 <LenB> +1 to wendyreid
16:41:24 <Detlev> Lisa: we have seen event-based automated testing - need to define relevance to user issues - its nit the kind or regex pattenr matching - future wull sho interestign tools
16:41:26 <Rachael> ack AWK
16:42:40 <LenB> q+
16:43:23 <Detlev> AWK: the goal was not to emphasize automated for its own sake, but make it part if the process - it is the lowest-hanging fruit - there's merit of it being a piece of it- the baseline should not be just automated. But we shouldn't think it cannto be trusted - manual testers also have issues
16:43:30 <jyasskin> q+
16:43:43 <Detlev> ...we need to define what the rules are, ACT is a good starting point
16:43:48 <Charles> automation seems policy. not conformance. your org may decide to use automation within their strategy and policy.
16:44:06 <alastairc> q+ on what can we take from the idea/results
16:44:12 <Rachael> ack LenB
16:44:15 <Detlev> Rachael: any comments to draft resolution?
16:44:20 <AWK> AWK has joined #ag
16:44:26 <joryc> can you define "onramp within external documentation"?
16:44:37 <kevin> rrsagent, make minutes
16:44:38 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
16:44:50 <hdv> was just going to queue with same question as joryc, a reword would be helpful!
16:45:18 <jkatherman> jkatherman has joined #ag
16:45:24 <Detlev> LenB: Expanding on Wendy's comments - turn everything into clear language - need to include clear language provided by automation tools
16:45:40 <Rachael> ack jyasskin
16:45:47 <Detlev> ...it is not just checking code. Appreciate conversation
16:46:15 <Detlev> jyasskin
16:46:50 <Francis_Storr> Francis_Storr has joined #ag
16:47:02 <Francis_Storr> present+
16:47:03 <Detlev> jyasskin: you don't want to constrain the requirement to what can be automatically checked
16:47:14 <Rachael> ack alastairc
16:47:14 <Zakim> alastairc, you wanted to comment on what can we take from the idea/results
16:47:22 <Detlev> ...user-generated contend may be checked with automated ruls, the rest stricter
16:48:14 <shadi> q+
16:48:29 <Detlev> alastairc: Not much sympathy for automated as its own level - but particular requirements could be labelled as "should be automatable", regardless of tools used, like detect alt text in pages (nit whether it is correct)
16:48:41 <AWK> AWK has joined #ag
16:48:56 <Detlev> Rachael: (reading revised draft of resolution)>
16:48:58 <Rachael> ack shadi
16:49:00 <GreggVan> +1
16:49:10 <Lisa> Q+
16:49:34 <shadi> https://www.w3.org/WAI/standards-guidelines/act/implementations/
16:49:45 <Detlev> shadi: Resonding to Alastair: ACT rules implementation where vendors indicate which rules are implemented show the incentive to provide such information
16:50:02 <AWK> @rachael That doesn’t speak to crafting provisions to be automatically testable to the extent possible
16:50:04 <alastairc> Yes - but ACT doesn't cover everything yet, we can probably provide a little preview of the theoretical automatability...
16:50:06 <Detlev> ...that covers some of that idea of Alastair's
16:50:12 <Rachael> ack Lisa
16:50:14 <Heather> Propose: draft RESOLUTION: Do not use automation [testing] as a conformance level... (assuming we are talking about automation testing only)
16:50:50 <Detlev> Lisa: have to be careful not downplaying potential of tools in the future that may replace expert testing form today.
16:51:16 <joryc> +1 Lisa. I wouldn't bet against emergent tools not being to detect any kind of issue in the next 3 years
16:51:23 <Detlev> ...if you say "you can't rely on tools" people will de disincentivised from developing things
16:51:23 <Rachael> proposed RESOLUTION: Do not use automation as a conformance level but explore it as an onramp within external or informative documentation such as labeling requirements as potential for automation
16:51:26 <alastairc> +1 on being agnostic to the tools
16:51:39 <julierawe> +1 to Lisa comment
16:51:40 <GreggVan> +1  to lisa  comment
16:51:43 <Adam> +1
16:51:44 <giacomo-petri> q+
16:51:45 <GreggVan> +1 to resoultionh
16:51:48 <Rachael> ack giacomo-petri
16:51:49 <joryc> q+
16:51:53 <Jon_Avila> +1
16:51:54 <Detlev> 0
16:51:59 <Charles> +1
16:51:59 <Heather> -1 is this only automation testing? if so include it in the definition
16:52:02 <shoobe01> +1
16:52:14 <LenB> +1
16:52:26 <shadi> q+
16:52:30 <alastairc> +1
16:52:30 <wendyreid> q+
16:52:32 <BrianE> +1
16:52:37 <julierawe> +1 to giacomo-petri comment about needing to constantly update what is automated
16:52:38 <Rachael> ack joryc
16:52:38 <Detlev> giacomo-petri: Like the idea of having a labelling via automatic checks - but can be change that over the future, since things will change?
16:52:41 <Heather> q+
16:52:42 <alastairc> giacomo-petri - is that a conformance thing? Sounds like other documentation...
16:53:08 <Detlev> joryc: Who is doing the labelling wehat is automatable?
16:53:24 <Detlev> Rachael: We cwould do it, but not in normative cintent
16:53:43 <alastairc> The idea was to say how automatable it is, not to call out whether particular tools are doing it.
16:54:18 <Rachael> ack shadi
16:54:19 <Detlev> joryc: There may be things that do better testing already right now - understanding what id possible needs to be stored in people's knowledge, it changes quickly
16:54:23 <giacomo-petri> s/Like the idea of having a labelling via automatic checks/Like the idea of having a banchmark for tool vendors and labelling automatic checks
16:54:51 <Detlev> shadi: instead of us labelling what is automatable, we require vendors to show what they can automate
16:55:22 <Detlev> ...adresses Lisa's concern, we would not pre-emt that choice, if someone can dempnstrate it cna be done
16:55:28 <GreggVan> q+ to suggest     "Do not use automatic-testable as a conformance level but explore it as an onramp within external or informative documentation with inviation to test-tool makers to report what they can test automatically (which will change continually)   But do not say anything negative against using automatic testing since it will play an increasing
16:55:50 <julierawe> +1 to shadi comment about letting marketers say what they have automated testing for—doesn't seem like WCAG 3 should be getting into what is and isn't automatable
16:55:57 <Rachael> ack wendyreid
16:56:32 <GreggVan> "Do not use automatic-testable as a conformance level but explore it as an onramp within external or informative documentation with inviation to test-tool makers to report what they can test automatically (which will change continually)   But do not say anything negative against using automatic testing since it will play an increasing role in accessibility.
16:56:33 <julierawe> +1 to wendyreid
16:56:37 <jyasskin> +1 wendyreid
16:56:37 <kevin> +1 to Wendy
16:56:58 <CClaire> +1 to wendyreid
16:57:13 <Detlev> wendyreid: The best we can do as spec creators is make clear what is a successful result for each criterion - because we don't know what tools there will be - its different on an org's level where automation can be built into the production process
16:57:29 <Rachael> draft RESOLUTION: Do not use automatic-testable as a conformance level but explore it as an onramp within external documentation including an invitation to test-tool makers to report what they can test automatically (which will change continually). Explore defining success and do not say anything negative against using automatic testing since it will play an increasing
16:57:43 <Rachael> q?
16:57:46 <hdv> +1 wendyreid
16:57:59 <GreggVan> +1 to WendyReid
16:58:01 <AWK> AWK has joined #ag
16:58:02 <Makoto_U> +1 to wendyreid
16:58:07 <Detlev> ...the thing we are looking for is user outcomes, how you get there in terms of testing methodology does not matter - but we should talk about waht is possible
16:58:09 <Rachael> ack Heather
16:58:19 <Rachael> ack GreggVan
16:58:19 <Zakim> GreggVan, you wanted to suggest     "Do not use automatic-testable as a conformance level but explore it as an onramp within external or informative documentation with inviation to
16:58:22 <Zakim> ... test-tool makers to report what they can test automatically (which will change continually)   But do not say anything negative against using automatic testing since it will
16:58:22 <Zakim> ... play an increasing
16:58:33 <Detlev> Heather: Include the word "testable" in resolution
16:58:55 <Detlev> GreggVan: one part is missing
16:59:04 <Detlev> Rachael: changed
16:59:05 <Rachael> proposed RESOLUTION: Do not use automatic-testable as a conformance level but explore it as an onramp within external documentation including an invitation to test-tool makers to report what they can test automatically (which will change continually). Explore defining success and do not say anything negative against using automatic testing since it will play an increasing role in accessbility
16:59:08 <Heather> +1
16:59:10 <giacomo-petri> +1
16:59:10 <julierawe> +1
16:59:11 <Adam> +1
16:59:11 <wendyreid> +1
16:59:14 <GreggVan> +1
16:59:14 <LenB> +1
16:59:14 <shoobe01> +
16:59:15 <Makoto_U> +1
16:59:15 <BrianE> +1
16:59:16 <Lisa> 0
16:59:16 <Francis_Storr> +1
16:59:17 <shoobe01> +1
16:59:20 <CClaire> +1
16:59:21 <Rachael> +1
16:59:26 <Charles> +1
16:59:28 <Detlev> 0 can't think, scribijng...
16:59:31 <alastairc> +1
16:59:31 <kevin> +1
16:59:34 <kirkwood> +1
16:59:35 <AWK> +.9
16:59:44 <Jon_Avila> +1
16:59:44 <janina> +1
16:59:47 <JeroenH> +1
16:59:51 <maryjom> +1
16:59:52 <stevekerr> +1
16:59:58 <jtoles> 0
17:00:00 <hdv> +1
17:00:11 <joryc> +1 with the notice that most testing tools will not be built by "Test tool makers" as we currently think of that category
17:00:24 <filippo-zorzi> +1
17:00:39 <Detlev> RESOLUTION: Do not use automatic-testable as a conformance level but explore it as an onramp within external documentation including an invitation to test-tool makers to report what they can test automatically (which will change continually). Explore defining success and do not say anything negative against using automatic testing since it will
17:00:39 <Detlev> play an increasing role in accessbility
17:00:39 <GreggVan> +1 ro Jory comment,
17:00:59 <Detlev> Rachael: No question 3...
17:01:13 <Detlev> Now queustion 3, sorry
17:01:24 <alastairc> s/No question 3/Now question 3
17:01:35 <Rachael> TOPIC: Usablility testing Survey #3
17:01:37 <Detlev> Rachael: Role of usability testing
17:01:39 <alastairc> s/Now queustion 3, sorry/
17:02:04 <Lisa> q+
17:02:08 <Detlev> Rachael: (reading the questions)
17:02:23 <Detlev> ...more no's than yesses
17:02:55 <Detlev> ...Slight preference for assertions
17:03:55 <Detlev> Rachael: No side said it is not as reliable for covering the whole scope; that the results of other checks and usability testing are different;  should not be required
17:04:20 <Detlev> ...high value in usability testing but cannot replace formal checks
17:04:42 <Charles> q+
17:04:45 <giacomo-petri> q+
17:04:48 <GreggVan> q+
17:04:52 <Detlev> ...good to discover problems
17:04:59 <wendyreid> q+
17:05:05 <Rachael> Ack Lisa
17:05:18 <alastairc> The difference between "user testing" and "usability testing" is just because the proposal included "user" and I default to "usability".
17:06:52 <Detlev> Lisa: Objected to the question, my proposal had a component of user testing together with another form of testing, so a statement would include both, e.g. with automated ans user testing, or with expert testing. So thid provides guard rails - was involve in project with Shadi to develop methodology to make it reliable.
17:07:25 <Detlev> ...if we would include it, we would increase usefulness / coverage for the end user
17:07:56 <jyasskin> q+ to ask for an example WCAG requirement that could be satisfied by usability/user testing
17:08:09 <Detlev> ...there is a decoupling between conformance testign and user testing right now, currently. Our proposal would bridge that gap
17:08:38 <Detlev> ...what would be a user testing result to knoe that you ment the outcome?
17:09:23 <LenB> LenB has joined #ag
17:09:45 <Detlev> Lisa: If you did expert and user testing on critical paths would really help - policy makers may say health care also needs user testing
17:10:24 <Detlev> ...would put it in a framework for policy makers to demand it in some circumstances, e.g. context of high importance for PwD
17:10:47 <julierawe> +1 to Lisa comment about importance of user testing to improve accessibility gaps
17:10:49 <Detlev> ...so many users are being left out - so we should make inroads to closing this gap
17:11:16 <Detlev> Rachael: Pleas clarify ho thi is different from assertions (which cover user testing)?
17:12:57 <Detlev> Lisa: The assertions look lie 2nd class citizens - this would enable people to say this is a core thing to bring it in full front of a policy. No it looks a bit like triple A where it is likely to be overlooked. If it is part of a testing suite, it is more visible and can be made a requirement in certain situations
17:13:15 <jyasskin> q-
17:13:20 <Detlev> ...we can build the framework, policy makers can the ndecvide where to require it
17:13:47 <Lisa> Q+
17:13:55 <Detlev> Rachael: So the question is, should user testing be made more prominent in our draft?
17:14:24 <Detlev> come back in an hour...
17:14:52 <Rachael> come back in 15 minutes.
17:14:58 <Detlev> We come back in 15 minutes!
17:31:29 <jyasskin> scribe+
17:31:41 <alastairc> q?
17:31:53 <Adam> q?
17:31:56 <jyasskin> Adam: Last context was "should user testing be made more prominent?" Picking up with that.
17:31:56 <Adam> ack Charles
17:32:13 <alastairc> qq+
17:32:20 <Lisa> Q+ to say I think it should be part of conformance
17:32:29 <jyasskin> Charles: There's an inconsistent use of language. "Usability testing" vs "user testing". "User" implies that we're testing a user. Should be "usability testing" if we're talking about testing a product.
17:32:58 <Monica> Monica has joined #AG
17:33:08 <jyasskin> Charles: 2 main concerns. "or": Idea in survey question is that the scope meets requirements with expert testing _or_ usability testing. But usability testing can't be an "or" because the testing itself requires expert assessment in creating or evaluating the test.
17:33:48 <Rachael> q+ to say I'd like to see usability testing be prominent but not required
17:33:52 <jyasskin> Charles: Usability testing is even more subjective than the automation discussion we just had. Tons of methodologies. Scripts, paths, things person conducting test must know. All requires expertise.
17:34:16 <jyasskin> Charles: When we consider usability testing, must have diverse users, and I agree. But people conducting test must also include people with disabilities.
17:34:22 <Adam> ack alastairc
17:34:22 <Zakim> alastairc, you wanted to react to Charles
17:34:44 <Adam> ack giacomo-petri
17:34:47 <jyasskin> alastairc: Terminology: I agree. I use "usability testing", but some bits of the proposal were copy/pasted and used "user testing". We're talking about "usability testing".
17:34:52 <Charles> user research and usability testing. not user testing.
17:35:17 <Makoto_U> +1 to Charles
17:35:19 <ShawnT> ShawnT has joined #ag
17:35:25 <jyasskin> giacomo-petri: Re automation: Usability testing is fundamental but should not be used as a metric for conformance. Woudl need to define what makes it repeatable and reliable enough to determine conformance.
17:36:01 <jyasskin> giacomo-petri: Proposal defines a number of users. Feedback of a single user could significantly affect conformance even if it's individual. Structured assessment is more reliable.
17:36:29 <jyasskin> giacomo-petri: Usability testing is essential to evaluate real-world cases. It's just not a way to meet conformance because of variability and context dependence. Works best as a parallel system.
17:36:35 <Adam> q?
17:36:40 <Adam> ack giacomo-petri
17:36:44 <Makoto_U> +1 to giacomo-petri
17:36:45 <Adam> ack GreggVan
17:37:24 <wendyreid> +1 giacomo!
17:37:29 <Adam> +1 giacomo-petri
17:37:32 <jyasskin> GreggVan: First, we don't require any testing at all. We require that you conform. You can make a claim, an assertion, that you conform, but nowhere do we require that you test your site, or how you test your site or what method. Adding usability as something you "must" do to conform, would say you must test, and we'd have to say exactly how you must test your site.
17:37:49 <jyasskin> GreggVan: No basis in any law or regulation for testing. We're outcome based, and testing doesn't guarantee an outcome.
17:38:18 <jyasskin> GreggVan: Second, user testing itself doesn't require any change to the site. Lots of people do usability testing and then make no changes. Testing itself has no impact. It's good for making people aware of things.
17:38:58 <jyasskin> GreggVan: Third, if you require testing of any kind, have to define exactly how it's done in order to count. E.g. testing with 1 user with 1 disability. Have to specify how many of which types of disability. Degree. Combinations. Blows up very quickly.
17:40:13 <jyasskin> GreggVan: Finally, comment that assertions make it a second-rate requirement. Say we had a requirement to do usability testing. How do you conform to that? You make an assertion that you did usability testing, and the assertion is the claim. If you aren't required to make a claim of conformance, no way to check unless they said they did.
17:40:16 <Adam> ack wendyreid
17:40:20 <Makoto_U> +1 to outcome-based
17:41:00 <Charles> Charles has joined #ag
17:41:07 <Charles> present+
17:41:10 <jyasskin> wendyreid: 2 things are true: agree with a lot of Lisa and a lot of giacomo. None of us would deny the value of usability testing for the quality of our products. Similar to automation discussion, it's not helpful for us to say "do X type of testing", or being overly prescriptive in how you measure achievement.
17:41:20 <Charles> usability testing provides results. those results provide insights. but insights can be cherry-picked by bias.
17:41:35 <Adam> +1 to wendyreid
17:41:38 <Rachael> +1 to not everyone can do user testing
17:41:43 <jyasskin> wendyreid: If we say "you must do X testing", makes it really challenging to let different organizations achieve the criteria. Small nonprofit might not have the resources to do expert or usability testing.
17:41:57 <ShawnT> present+
17:42:08 <Charles> +1 to GreggVan having insights does not = taking action
17:42:44 <jyasskin> wendyreid: Agree that it's valuable to do this kind of testing. In certain contexts it might be necessary. Leave that to the regulatory side. Could totally see a regulation like EIA say "here's how you meet generally, but health care industry must to user testing for appointment-making flows." But we shouldn't say that because WCAG should be as achievable as possible. Single developer to multinational.
17:42:46 <Adam> ack Lisa
17:42:46 <Zakim> Lisa, you wanted to say I think it should be part of conformance
17:42:48 <Makoto_U> +1 to wendyreid
17:43:15 <jyasskin> Lisa: Disagree on one point. Want to be as achievable as possible, but not at the price of user groups being included in accessible outcomes. Clarifications:
17:43:43 <jyasskin> Lisa: Have to have methodology. Have to say what's included. Don't emphasize disability but functional impairments. Contracts since people can have more than 1.
17:44:35 <wendyreid> s/EIA/EAA/
17:44:40 <jkatherman> jkatherman has left #ag
17:44:54 <jyasskin> Lisa: Talking about this being a process that confirms certain outcomes, where outcomes are an aim of WCAG. If someone who's a screenreader user can submit their information using a form. Would be a way to confirm conformance of the form. Think of paths -- have to do a tax form -- talk about functional impairments: can you confirm that this form conforms to WCAG: accessible to people with these functional impairments.
17:45:26 <alastairc> q+ on how to include, variable results and coverage problematic, scale of org/product problematic, needs focusing or being optional.
17:45:38 <jyasskin> Lisa:  Alternative mechanism of confirming your path conforms. It's the best way for a lot of things. For COGA. In subgroup we talked about not all violations are equal. Not everyone agrees with this. E.g. alt tags on submit button are more important than in a footer.
17:46:03 <Adam> q?
17:46:21 <Adam> ack Rachael
17:46:21 <Zakim> Rachael, you wanted to say I'd like to see usability testing be prominent but not required
17:46:21 <jyasskin> Lisa: Since footer isn't the primary task of the page. Helps close the gap. A way of conforming that doesn't require you to buy tools or a subscription. Allows you to focus on the disabled user with functional impairments on success of completing task.
17:46:48 <Charles> a usability participant can complete a task, but that cannot confirm anything outside of their instruction. nor can it confirm any particular method was used.
17:46:57 <Lisa> that is why it should be part of conformence, not just prominent in the document
17:47:31 <jyasskin> Rachael: <chair hat>We'd talked as a group about exploring usability testing, even putting out a note. That history is there; ongoing conversation.</chair hat> Usability testing is incredibly valuable. Could be more prominent. Note. Highlighting in some form. Don't see how we require it. Gets really interesting in legislation and compliance. Have functional performance criteria. Dont' think those are sufficient as written in most legislation.
17:47:52 <alastairc> q-
17:48:03 <jyasskin> Rachael: Value in exploring how we encourage usability testing in various ways. Support them as alternatives in compliance.
17:48:18 <jyasskin> Adam: Can we begin drafting a resolution?
17:48:40 <jyasskin> Rachael: Sounds like we have some strong support for having it in; more strong support for having it not be a required level of conformance.
17:49:20 <jyasskin> q+
17:49:25 <Adam> q?
17:49:31 <Adam> ack jyasskin
17:49:37 <Adam> scribe+
17:49:44 <Adam> jyasskin: wanted to suggest something perpendicular to this
17:50:04 <Adam> ... it was suggested that we make this more prominent even thought it’s kind of an assertion
17:50:10 <Adam> ... that worries me as a third new idea
17:50:18 <Adam> ... and think this would be better handled in the policy document
17:50:18 <Lisa> Q+
17:50:33 <Monica> Monica has joined #AG
17:50:35 <giacomo-petri> +1
17:50:45 <GreggVan> +1
17:50:59 <kirkwood> +1
17:51:05 <Adam> ack Lisa
17:51:15 <Wilco> Wilco has joined #ag
17:51:25 <GreggVan> q+
17:51:48 <wendyreid> q+
17:52:05 <jyasskin> Lisa: At no point was I suggesting that we require it at a base level of conformance. Would be an alternative way of confirming. Might be something like, Resolution is that we're not going to require it, but proposal was to make a way of conforming through user testing. With possibly other testing.
17:52:08 <alastairc> q+
17:52:18 <jyasskin> Lisa: Question isn't relevant to proposal.
17:53:03 <jyasskin> Adam: Maybe amend to "allow usability testing to be part of one method of confirming conformance." It's already allowed in some cases, but not others. E.g. can you use a form.
17:53:11 <jyasskin> s/Adam/Lisa/
17:53:20 <Adam> q?
17:53:27 <Adam> ack GreggVan
17:54:12 <jyasskin> GreggVan: Nothing I'm saying has anything to say about the enormous value of usability testing. It's enormously valuable.  Existing usability testing rarely includes disabled people, and it's often just one disability.
17:54:43 <jyasskin> GreggVan: Lisa said it should be an alternate way of proving conformance. We don't currently have any way of proving conformance. Usability testing can't be an alternative to something we don't have.
17:55:16 <jyasskin> GreggVan: Don't have any requirement that people prove it. Only in court.
17:55:16 <Adam> ack wendyreid
17:55:24 <Rachael> q+
17:56:08 <Lisa> +1 to wendy
17:56:24 <jyasskin> wendyreid: Maybe a through path. Thinking when Lisa was speaking that while putting it into the conformance requirements raises challenges. We could still put it in the spec itself as a way to pass tests, as a way to achieve different outcomes. Option for us: when you have a specific requirement, provide more explanatory language around ... we have tests for each, but more information about achieving the tests.
17:56:28 <Charles> if a usability test confirms an outcome for a task it still may not confirm an outcome of a single provision let alone any other provision.
17:57:21 <jyasskin> wendyreid: e.g. for "abbreviations explained", test is that explanation is available. Maybe an additional test that a user is able to find or understand the explanation. Could be ways to introduce that as a method. Sometimes usability testing might be more feasible than having an expert or automation. Showing that that holds equal standing to other testing methods.
17:57:25 <Adam> ack alastairc
17:57:55 <kevin> +1 to Wendy's idea to have usability testing as a viable test for a requirement
17:58:24 <giacomo-petri> q+
17:58:48 <jyasskin> alastairc: Trying to figure out the potential proposal. Reading Lisa's proposal was "could do expert testing or usability testing", and treating those as equivalent or alternatives. Acknowledging GreggVan's point that we don't specify how people test, If we include that in informative documentation about how people test things, problematic. There's a level of requirements it's being put equivalent to. Testing for conformance and usability
17:58:48 <jyasskin> testing are inherently different. Variability of results.
17:59:41 <Charles> usability testing is also usually conducted against a prototype versus a final production instance.
17:59:53 <Adam> ack Rachael
17:59:53 <jyasskin> alastairc: Coverage is a problem. Scale of organizations. Either has to be really focused: e.g. on a particular requirement. Do it as methods? Not an efficient way of testing individual requirements. Not the best use of usability testing, which is best for gathering insights and improving things overall. Very focused or optional. Cost difference between manual and usability testing, would be rarely used.
18:00:47 <jyasskin> Rachael: I find the idea of ... it's not a method, but a procedure ... having usability testing as part of the procedure for testing is interesting. Want WCAG3 to be as future proof as possible. Kiosks often don't have a screen reader. Not testing availaibility but alternatives. You can test that through user testing.
18:00:48 <GreggVan> q+
18:01:19 <Adam> ack giacomo-petri
18:01:20 <jyasskin> Rachael: Best practices could be under a requirement, and tie usability testing to best practices. Potential but more work. Chair hat off, I'm excited about exploring that direction.
18:02:20 <Adam> q?
18:02:23 <Adam> ack GreggVan
18:02:23 <jyasskin> giacomo-petri: Agree with Rachael and alastairc about exploring user testing in procedures. Should be very focused. Say you have a contrast ratio that's barely below the threshold. From a user testing point of view, might be ok, but technically doesn't meet the standard. User testing isn't objective enough in those scenarios. Makes it impossible to make a conformance claim based on that kind of user testing.
18:02:25 <Heather> +1 to Giacomo's comment
18:02:25 <alastairc> That is a problem, where we have to draw a line (e.g. contrast), usability testing will give results above and below that line.
18:02:48 <Makoto_U> +1 to giacomo-petri
18:02:58 <Adam> q+ to +1 the procedure idea, and to note that on the point of *who* must be included in a study, we can help specify important functional needs and user groups that are applicable to particular provisions
18:03:22 <jyasskin> GreggVan: Also think we should note ... if it's so important, why can't we get it in there. Best practice idea is good, but those are often tied to requirements. Tie this one to a guideline rather than a requirement. In COGA doc, really good things people should look for or do, that you can't tie to a requirement. But can tie them to guidelines.
18:03:26 <Charles> q+
18:04:16 <Adam> q-
18:04:20 <jyasskin> GreggVan: Name the best groups to use in user testing. Types and degrees and combinations: 150-175. If the provision and best practice is to make it accessibile to people with cognitive disabilities, should not test with blind people. For each provision, give advice to test with people having these disabilities and look for these things.
18:04:41 <Rachael> +1 to guidance around usability testing on who to test with
18:05:12 <jyasskin> GreggVan: That's where you get great advice about things to look for. Test with the groups that it's specifically targeted for. Gets over the requirement that usability testing represent the entire population. but each provision doesn't represent the needs of the whole world. Something here that helps. Not in requirements, but for thigns we can't figure out how to put into requirements.
18:05:13 <Adam> ack Charles
18:06:06 <Rachael> q+
18:06:22 <jyasskin> Charles: Rachael used the word "procedure", which made me think of something included in GreggVan's comment. If we decide to provide informative guidance on the value of usability testing, and an approach to usability testing, and how to use it on specific provisions. We should have an actual test procedure to go along with that. Otherwise variability and nuance still applies. No way to consistently get measurable results from usability
18:06:22 <jyasskin> testing.
18:06:25 <Adam> ack Rachael
18:06:28 <jyasskin> Charles: Constrained type of test for a specific purpose.
18:06:54 <Wilco> q+
18:07:03 <Adam> ack Wilco
18:07:08 <jyasskin> Rachael: If we had those procedures, we'd want a note that was separate on usability testing that we could reference. With detailed information, so our normative document isn't too repetitive.
18:07:16 <Charles> a test procedure would be both for the administrator and the users
18:07:32 <Lisa> +1 to wilko
18:07:48 <Adam> q?
18:07:48 <GreggVan> q+
18:07:56 <jyasskin> Wilco: Heard a couple times that usability testing isn't deterministic. Push back a little: if you get enough people, often 3-5, you're able to get a solid understanding of the issues people will run into. Reliability is not that of a traditional accessibility audit, but not bad either.
18:08:08 <jyasskin> Wilco: Inter-rater reliability of traditional audits is also only about 80%
18:08:09 <Adam> ack GreggVan
18:08:21 <Wilco> no i'm not
18:08:39 <Rachael> q+
18:08:47 <Charles> +1 to Wilco‘s point that expert assessment also varies
18:09:01 <ShawnT> ShawnT has joined #ag
18:09:16 <jyasskin> GreggVan: Wilco, you're basing your nubmers on studies of homogeneous users. If we test 3 people, blind, deaf, cerebral palsy, not enough. Even within blind, is it low vision, very-low vision. Variance is directly dependent on variance of the population. Have to have a large number to cover variations. Can only have 2-3 of each type, but easily 100 combinations.
18:09:20 <Adam> ack Rachael
18:09:22 <Lisa> Q+
18:09:40 <GreggVan> q+
18:10:02 <Heather> q+
18:10:08 <Wilco> +1 Rachael, these are well established practices
18:10:14 <jyasskin> Rachael: Chair hat off: each group needs representation of 3-5, and each category needs that. We need a document with methodology. Standard to divvy based on user groups. Original point: each provision doens't need to be test with every disability. Also wouldn't be the only way you'd test, just a way. Provides more flexibility.
18:10:17 <Adam> ack GreggVan
18:10:38 <Rachael> +1 which is why we need clearer and more diverse functional needs
18:10:59 <Wilco> I did not say usability testing is deterministic
18:11:00 <jyasskin> GreggVan: Just saying that even within the groups, there are many layers of difference. It's helpful but not deterministic. If we focus it, could be helpful with fewer people.
18:11:01 <Adam> ack Lisa
18:11:05 <alastairc> There's also still an interpretation issue, if some people get past a barrier but other's don't, how do you figure that as a result?
18:11:21 <Charles> it sounds like we would benefit from an ACT parallel for usability like AUT (accessibility usability testing)
18:11:55 <Heather> q-
18:12:51 <jyasskin> Lisa: We've been part of projects making reminder programs and apps for people with dementia. We found that the number of 5 worked. Didn't lose participants because of low usability. Even with quite severe cognitive impairments. If you take something like MCI, have memory functional impairments, attention, processing speed. In those 5 people, you hit an enormous representation in the cognitive space.
18:12:57 <Adam> q?
18:13:01 <jyasskin> Lisa:  Don't think it's a huge number of people to test with. Even testing with 1 person really seemed to address 80% of the issues from the original design that wasn't made by experts.
18:13:09 <Heather> q+
18:13:27 <jyasskin> Lisa: In a way can be easier for some designers to go on the testing, fix, test again. Instead of trying to understand a huge requirement document.
18:13:28 <Adam> ack Heather
18:13:42 <ShawnT5> ShawnT5 has joined #ag
18:14:00 <Lisa8> Lisa8 has joined #ag
18:14:37 <jyasskin> Heather: Keep going back and forth on the "sufficient representation" term. Types of disabilities, how many. Over time you'll test different people and different combinations. Thinking about getting customer feedback from people who use the product and disclose the disabilities in their support tickets. Consider that in the testing portion? In the wild, as more people use it. Good for feedback, but hard for a requirement.
18:14:39 <Adam> q?
18:14:53 <ShawnT> present+
18:14:55 <wendyreid> +1
18:15:11 <GreggVan> q+
18:15:19 <Adam> ack GreggVan
18:15:25 <Lisa8> +1
18:15:25 <SydneyColeman> SydneyColeman has joined #ag
18:15:28 <Charles> q+
18:15:32 <jyasskin> GreggVan: What procedures? We have guidelines, requirements, nothing called "procedures"
18:15:39 <Adam> q?
18:15:44 <jyasskin> Rachael: In informative docs, there's a test procedure section.
18:15:52 <SydneyColeman> can you repost the proposed language -- wifi kicked me out of irc
18:15:55 <Wilco> q+
18:16:28 <SydneyColeman> thxxx
18:16:46 <jyasskin> GreggVan: I'd include usability testing in the Understanding document as a way to understand issues and better meet the guidelines. That'll allow us to put much more in there.
18:16:57 <Adam> q?
18:17:05 <Adam> ack Charles
18:17:27 <GreggVan> q+
18:17:34 <jyasskin> Charles: Resolutions with "include", is this still exploratory? Or are we saying "include it"?
18:17:43 <alastairc> include where appropriate...
18:17:55 <Adam> ack Wilco
18:17:56 <jyasskin> Rachael: We could change it to say to explore it.
18:18:18 <jyasskin> Wilco: I had to read this 3 times to sort of understand it. You're saying "usability testing isn't required"?
18:18:21 <Adam> q?
18:18:24 <Adam> ack GreggVan
18:18:32 <kirkwood> recommended?
18:19:09 <Wilco> Does that mean no assertion on usability testing?
18:19:12 <jyasskin> GreggVan: We could add "is not required but". I think this is a great idea. Overcomes all objections about objectivity since it doesn't have to pass. We should also put as much as we can in the guidelines themselves. Allows us to catch everything we couldn't get in, and get it in front of people.
18:19:25 <SydneyColeman> q+ where will draft resolutions be published?
18:19:32 <Adam> q?
18:19:35 <Rachael> q+ to answer
18:19:38 <Lisa8> Q+
18:19:55 <Heather> q+
18:19:58 <Adam> q?
18:20:02 <jyasskin> Rachael: In the Timeline
18:20:02 <Rachael> q-
18:20:05 <Adam> q?
18:20:09 <Adam> ack Lisa8
18:20:13 <Adam> ack Lisa
18:20:36 <Rachael> Resolutions to date: https://www.w3.org/WAI/GL/wiki/WCAG_3_Timeline#status
18:20:38 <Lisa8> t RESOLUTION: Usability testing will not be required for general conformance but, for relevant requirments, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:20:54 <jyasskin> Lisa: To Wilco's point, to conform to an assertion that mentions usability testing, you'd need to do usability testing. Want to add a word. ^
18:20:57 <Wilco> This sounds meaningless. What we're saying is usability testing isn't required except where it is.
18:21:03 <GreggVan> +1 for lisa add
18:21:09 <Adam> q?
18:21:19 <jyasskin> Rachael: "Core conformance"?
18:21:25 <Adam> ack Heather
18:21:28 <jyasskin> Lisa: Don't want to say it's not in core conformance.
18:21:33 <julierawe> q+
18:21:43 <Adam> qq+ GreggVan
18:21:51 <Adam> ack GreggVan
18:21:51 <Zakim> GreggVan, you wanted to react to Heather
18:21:52 <jyasskin> Heather: When you do usability testing, have to consider user and assistive technology, and we're not mentioning any assistive tech in this resolution. Not sure how I feel about this, but raising it.
18:22:19 <jyasskin> GreggVan: +1, but i think that'll be included in the writeup. Specific to provision: might say "usability with appropriate technology".
18:22:49 <jyasskin> GreggVan: Also agree with Lisa's addition. Wouldn't be in the conformance section, but to conform to certain provisions might need to do usability testing.
18:23:03 <Adam> ack julierawe
18:23:24 <Detlev> I am confused by Gregg's explanation
18:23:25 <GreggVan> q+
18:23:28 <jyasskin> julierawe: Phrase "for relevant requirements": maybe "provisions"?
18:23:34 <Adam> ack GreggVan
18:23:40 <Rachael> q+
18:23:44 <Rachael> q-
18:24:08 <Adam> q?
18:24:20 <jyasskin> GreggVan: Somebody said we shouldn't use provisions. But if we have recommendations and best practices, those are also provisions. Should be "relevant provisions". Might be attaching to guidelines. Shouldn't narrow down to requirements.
18:24:36 <alastairc> I was thinking requirements+assertions (and wouldn't be needed in assertions), but with best-practices we should say provisions.
18:24:59 <Detlev> q+
18:25:01 <Lisa8> Q+
18:25:05 <kevin> rrsagent, make minutes
18:25:06 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:25:13 <Adam> ack Detlev
18:25:17 <alastairc> qq+
18:25:27 <janina> q+
18:25:33 <GreggVan> q+
18:25:59 <jyasskin> Detlev: Don't quite understand separation of requirements from other provisions. If you want to conform, need to meet all requirements. In this phrasing, you wouldn't need usability testing to ascertain that you conform to all requirements. So usability testing would be something extra? Above the level of requirements? Bolstering requirements that would be asserted another way?
18:26:00 <Adam> ack alastairc
18:26:00 <Zakim> alastairc, you wanted to react to Detlev
18:26:47 <Adam> ack Lisa
18:26:48 <jyasskin> alastairc: We have 3 types of things in the guidelines: requirements, best practices, and assertions. Assertions could say "we have usability tested this thing and acted on the results". But in requirements or best practices, you could establish you're meeting it by doing some usability testing. probably very specific. Not requiring anyone to do that. Just a way.
18:27:07 <jyasskin> Lisa: Answering my problem: Could write that we're conforming to a guideline through user testing.
18:27:24 <Adam> ack janina
18:27:27 <jyasskin> alastairc: If you make a conformance claim, you'd say "we meet this requirement", and you'd know that because you did usability testing.
18:28:00 <jyasskin> janina: Nitpicky: Don't know about "general". Might be other adjectives. Don't know exactly what it means.
18:28:25 <Lisa8> Q+
18:28:26 <GreggVan> q+
18:28:30 <Adam> q?
18:28:33 <Adam> ack GreggVan
18:28:37 <Heather> q+
18:28:57 <jyasskin> GreggVan: "Not included in conformance section"
18:29:03 <Adam> draft RESOLUTION: Usability testing will not be included in conformance section but, for relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:29:03 <Rachael> draft RESOLUTION: Usability testing will not be included in the conformance section. For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:29:09 <Adam> q?
18:29:13 <Adam> ack Lisa
18:29:35 <GreggVan> q+
18:29:39 <jyasskin> Lisa: "General" was there because some assertions have user testing in them. It is part of conformance in some assertions.
18:30:20 <jyasskin> Lisa: This might make it hard to refer to usability testing. We don't know what the conformance section will look like.
18:30:28 <jyasskin> GreggVan: There's no testing in the conformance section.
18:30:54 <jyasskin> Lisa: We don't know that. If we don't mention any testing, I don't have a problem with this, but if we do mention automated testing, I do have a problem excluding usability testing.
18:31:05 <alastairc> q+
18:31:22 <jyasskin> GreggVan: Is there an intention of putting testing in the conformance section?
18:31:25 <jyasskin> alastairc:
18:31:30 <alastairc> q-
18:31:33 <Rachael> q+
18:31:41 <jyasskin> alastairc: Not there now, but haven't discussed it.
18:31:49 <jyasskin> GreggVan: "unless conformance section includes testing.
18:32:04 <jyasskin> Lisa: Put "general" back in?
18:32:13 <kevin> rrsagent, make minutes
18:32:14 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:32:21 <julierawe> q+
18:32:22 <jyasskin> Lisa: Can look at the minutes to understand it.
18:32:23 <Adam> ack Heather
18:32:29 <Heather> proposed to simplify this RESOLUTION: Usability testing with persons with disabilities will not be required for WCAG 3 conformance.
18:32:30 <Heather> WCAG 3 Provisions Understanding document may include a recommendation for topics to include in usability testing as a means of identifying issues with persons with disabilities.
18:32:30 <Detlev> what exactly is the "cnformance section"? is there one in each guideline? Or each requirement?
18:32:44 <alastairc> It's the section that says how you claim conformance: https://www.w3.org/TR/wcag3/#conformance
18:33:10 <Detlev> thanks, Alastair
18:33:12 <Adam> q?
18:33:16 <Lisa8> -1 it is required in some assertions
18:33:29 <Rachael> q+
18:33:32 <alastairc> assertions are not part of the conformane section
18:33:32 <Adam> ack GreggVan
18:33:33 <jyasskin> Heather: First, not requiring it. Second, For each provision, can document what to test.
18:34:05 <alastairc> "Each WCAG 3 Provision's Understanding document "
18:34:27 <jyasskin> GreggVan: Don't think the second sentence works.
18:34:35 <Adam> q?
18:34:43 <Lisa8> -1
18:34:56 <jyasskin> GreggVan: Instead of "general", could we use "overall conformance"?
18:34:59 <Lisa8> i can live with that
18:35:01 <Adam> ack Rachael
18:35:11 <Lisa8> RESOLUTION: Usability testing will not be required for overal conformance but, for relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:35:41 <jyasskin> Rachael: <chair hat>We have 2 things going on. Have agreement on 1, and not on the other. Suggesting we start with "draft RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines."
18:36:06 <Adam> q?
18:36:12 <jyasskin> Rachael: For the second, we need to talk a bit. Some of us don't want usability testing at the required level. Lisa wants to include usability in some assertions and require those assertions.
18:36:27 <Adam> ack julierawe
18:36:52 <GreggVan> q+
18:37:07 <Adam> ack GreggVan
18:37:10 <jyasskin> julierawe: We're having a lot of discussion about what can and can't be done with usability testing. Compare to discussion about automated testing. We don't know yet what form some of this will take. People are aiming for such specificity with usability testing, and it's so different from automated testing.
18:37:12 <alastairc> Well, usability testing and automated testing are quite different...
18:37:14 <Rachael> q+
18:37:17 <Rachael> q-
18:37:49 <Adam> q?
18:37:49 <jyasskin> GreggVan: Reason is that automated testing was talking about levels. With this one, we're trying to keep as much as possible on the table. The other one was just off the table.
18:38:43 <Lisa8> +1
18:38:45 <GreggVan> +1
18:38:46 <janina> +1
18:38:53 <Makoto_U> +1
18:39:05 <Adam> RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:39:07 <ShawnT> +1
18:39:09 <julierawe> +1
18:39:10 <filippo-zorzi> +1
18:39:11 <GreggVan> +1
18:39:11 <Monica> +1
18:39:17 <Rachael> +1
18:39:17 <Adam> draft RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:39:24 <Lisa8> +1
18:39:26 <janina> +1
18:39:27 <BrianE> +1
18:39:27 <ShawnT> +1
18:39:28 <alastairc> +1
18:39:28 <Detlev> +1
18:39:28 <julierawe> +1
18:39:29 <GreggVan> +1
18:39:29 <CClaire> +1
18:39:30 <Makoto_U> +1
18:39:36 <Rachael> s/RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines./
18:39:37 <alastairc> s/RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines./
18:39:41 <Heather> +1
18:39:41 <kirkwood> +1
18:39:54 <Charles> +1
18:39:59 <Adam> q?
18:40:07 <kevin> rrsagent, make minutes
18:40:08 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:40:15 <Jon_Avila> Jon_Avila has joined #ag
18:40:15 <kevin> +1
18:40:15 <Rachael> +1
18:40:15 <Jon_Avila> rrsagent, draft minutes
18:40:16 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html Jon_Avila
18:40:23 <Wilco> 0, this has been widdled down to meaninglessness
18:40:24 <Detlev> I never knew hat doh actually menas...
18:40:54 <GreggVan> q+
18:41:09 <jyasskin> Rachael: For the second part, are we listing this in Conformance in some way? Don't think anyone has proposed to make it requirement. Would we ever have a provision that required usability testing at the most basic level of conformance?
18:41:11 <Adam> ack GreggVan
18:41:16 <janina> q+
18:41:26 <Rachael> q+ to answer Gregg
18:41:55 <Wilco> q+
18:42:19 <jyasskin> GreggVan: Thought we were circling around "in order to conform at any level", might be in conformance level. Lisa said that if other testing is there, wanted to keep this open for discussion. I thought that a long time ago, we'd said that testing was non-normative and so can't be in conformance section. Wouldn't want to say "you have to test this in exactly the way we tell you to."
18:42:31 <jyasskin> GreggVan: Might provide *a* way of testing, but never a required way of testing.
18:42:50 <Adam> ack janina
18:42:54 <Rachael> q-
18:42:55 <jyasskin> Rachael: Don't think we have a resolution on that yet. I've drafted one.
18:42:59 <Lisa8> Q+ to say some sections of conformence section  could be non normative
18:43:15 <alastairc> I don't recall a resolution to that effect, but generally we resolve to include things, not to exclude things.
18:43:15 <kirkwood> I do think Gregg brings up a good point
18:43:17 <kevin> s/t RESOLUTION: Usability testing will not be required for general/Draft RESOLUTION: Usability testing will not be required for general/
18:43:24 <kevin> rrsagent, make minutes
18:43:25 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:43:32 <shadi> +1 to janina
18:43:32 <Rachael> q+
18:43:44 <Adam> q?
18:43:46 <jyasskin> janina: Just because we've never done it, wouldn't want to conclude we can't. But can't see how. At the fundamental level, it would be RFC2199 MUST something. What's the "something" that would include usability testing? Maybe SHOULD. Can't quite formulate that either.
18:44:07 <Rachael> q+ to say there is a difference between being in the conformance section and being in am assertion referenced by conformance
18:44:19 <jyasskin> janina: Think what we did before needs to be what we do in the future. Doesn't mean we omit usability testing, but "how" we include it. +1000 to best practices.
18:44:28 <jyasskin> s/RFC2199/RFC2119/
18:44:42 <Charles> +1 to janina on aligning usability testing to ‘must’
18:45:00 <Adam> ack Wilco
18:46:12 <jyasskin> Wilco: Think usability testing is phenomenally useful, but there's a scope problem. Organizations are required to have fully conforming websites. They already don't measure that; they measure samples. Automated tools. When you get to usability testing, there are even fewer pages you end up covering with those processes. Different layers. Automated can do whole sites; audits a couple dozen. Usability is smaller. How do you bring that together in
18:46:12 <jyasskin> one thing?
18:46:25 <Adam> s/one thing/one thing/
18:46:27 <GreggVan> q+
18:46:27 <Adam> q?
18:46:31 <Adam> ack Lisa
18:46:31 <Zakim> Lisa, you wanted to say some sections of conformence section  could be non normative
18:46:34 <jyasskin> Wilco: If usability becomes a requirement, that means far fewer pages can conform because you can't run that many usability studies.
18:47:38 <jyasskin> Lisa: Don't think we need to decide that now. Some sections can be normative with an informative subsection. Would we necessarily make the entire section normative? Even in a normative section, could say what you SHOULD do. Mention or reference to testing in a SHOULD section.
18:47:57 <jyasskin> Lisa: in WCAG 2, we have partial conformance, that's not a MUST. Don't know what the section will look like.
18:48:29 <jyasskin> janina: I think we're making progress. Maybe need to talk some more. Don't see a place for user testing in the normative section. Lots of room in the informative section. Hope to have future conversations.
18:48:35 <alastairc> q?
18:48:56 <jyasskin> janina: Lots of constraints to consider. I don't see how we could make a SHOULD work, but don't want to say never.
18:48:56 <Adam> ack Rachael
18:48:56 <Zakim> Rachael, you wanted to say there is a difference between being in the conformance section and being in am assertion referenced by conformance
18:49:40 <alastairc> Conformance is currently a pretty short section, and fairly short in WCAG2 as well.
18:49:40 <kevin> s/RESOLUTION: Usability testing will not be required for overal conformance but, for relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines./Draft RESOLUTION: Usability testing will not be required for overal
18:49:40 <kevin> conformance but, for relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines./
18:49:49 <jyasskin> Rachael: Chair hat off, I'm comfortable saying that testing shouldn't be part of the conformance section. It's how we level conformance, but not how we test pieces of assertions or content or requirements. I'm comfortable saying we can't require something that has to have usability testing at the base level.
18:49:51 <kevin> rrsagent, make minutes
18:49:52 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:50:06 <jyasskin> Rachael: We should be able to say "we're not going to do things". We can always change our minds, but we need to be able to move forward.
18:50:12 <Lisa8> Q+
18:50:13 <Adam> ack GreggVan
18:50:58 <jyasskin> GreggVan: Was going to call the question. Resolution to not include a requirement for any type of testing in conformance. How you test, we won't specify anything about testing. How you get there is up to you.
18:51:16 <Adam> ack Lisa
18:52:18 <Jon_Avila> What about usability testing in assertions?
18:52:25 <jyasskin> Lisa: In my proposal in the conformance group, I'd suggested a framework, which in the conformance section, you could state how you tested. And people could check if it conforms to their policy.
18:52:27 <GreggVan> q+
18:52:37 <alastairc> q+
18:52:37 <Adam> ack GreggVan
18:53:14 <Lisa8> https://docs.google.com/document/d/1BuZOGxddoZbPRmPB-CoNVfqSCiD0Cm3oaGeDQ3yJRI4/edit?tab=t.yh4z4j1ssfsv#heading=h.5605qb835j63
18:53:19 <kevin> i/GreggVan: Reason is that automated testing was/RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines./
18:53:27 <jyasskin> GreggVan: You're talking about htings that would be included in a claim. Doesn't preclude saying that if you make a claim, you need to say how you tested for it. But not saying that if you make a claim you must have tested it in this way. Since we don't require that you make a claim, nothing about requirements for making a claim are requirements.
18:53:30 <kevin> rrsagent, make minutes
18:53:32 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:53:39 <Adam> q?
18:53:39 <Adam> ack alastairc
18:54:11 <jyasskin> alastairc: Conformance section is quite short. Might be the shortest section. Useful that it doesn't specify too much.
18:54:13 <Lisa8> the proposal discusses testing in conformance even if it doesn't say how to test
18:54:36 <Rachael> q+
18:54:39 <Lisa8> Q+
18:54:40 <jyasskin> alastairc: Think you were saying people can use usability testing for _them_ to know they're meeting requirements, but we want to do the slight of hand of not saying how people meet requirements.
18:54:40 <Adam> ack Rachael
18:54:51 <jyasskin> Rachael: We never captured the previous resolution, so pasting that in.
18:55:05 <Adam> ack Lisa
18:55:09 <Rachael> RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.
18:55:38 <alastairc> q+
18:55:47 <GreggVan> q+
18:55:49 <jyasskin> Lisa: Depends on the wording. Proposal didn't say how you had to test. Gave a framework of saying how you tested. If resolution is that we don't discuss testing in Conformance section, then we're throwing out that proposal. If we don't insist on how someone tests, in Conformance, that's fine.
18:55:55 <kevin> s/RESOLUTION: For relevant provisions, we will include usability testing in procedures in the informative (understanding type) documents as a means of identifying issues and better meeting the guidelines.//
18:55:59 <Adam> ack alastairc
18:56:00 <Lisa8> https://docs.google.com/document/d/1BuZOGxddoZbPRmPB-CoNVfqSCiD0Cm3oaGeDQ3yJRI4/edit?tab=t.yh4z4j1ssfsv#heading=h.5605qb835j63
18:56:14 <kevin> rrsagent, make minutes
18:56:15 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
18:56:23 <jyasskin> alastairc: WCAG2 didn't talk about ?? statements either, so we wouldn't put that into Conformance, but it could go elsewhere.
18:56:35 <GreggVan> q+
18:56:40 <alastairc> s/didn't talk about ?? statements/didn't talk about EARL statements
18:56:44 <Adam> ack GreggVan
18:57:15 <jyasskin> GreggVan: Thought Lisa had a good point. Provision said we wouldn't include any requirement. ... Maybe we shoudl say "in order to conform"
18:57:29 <Lisa8> ok
18:57:40 <kevin> qq+
18:58:14 <kirkwood> +1
18:58:15 <Detlev> +1
18:58:18 <GreggVan> +1
18:58:19 <Lisa8> we get back to the problem of assertions
18:58:20 <Rachael> +1
18:58:26 <Adam> draft RESOLUTION: We will not require usability testing in order to conform
18:58:36 <alastairc> draft RESOLUTION: we will not include any requirement for any kind of testing in order to conform
18:58:42 <Jon_Avila> +0 I wonder about assertions with usability?
18:59:08 <jyasskin> kevin: Let's revisit this first thing tomorrow?
18:59:14 <Jon_Avila> I wonder if we could allow alternative conformance methods?  For example, usability or technical?
18:59:17 <alastairc> Jon_Avila - assertions aren't affected
18:59:29 <jyasskin> Rachael: Active people will email to finalize the wording.
18:59:41 <jyasskin> various: sleeping? We'll make it work.
18:59:53 <Jon_Avila> Thank you all.
18:59:59 <CClaire> Thank you
19:00:03 <julierawe> Thank you
19:00:16 <Charles> Charles has left #ag
19:00:43 <kevin> rrsagent, make minutes
19:00:45 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html kevin
19:01:49 <kevin> zakim, end meeting
19:01:49 <Zakim> As of this point the attendees have been Heather, AWK, Adam, stevef, kevin, Jennie_Delisi, shadi, filippo-zorzi, Lisa, wendyreid, LenB, sam-estoesta, jtoles, Rachael, stevekerr,
19:01:52 <Zakim> ... Charles, nat_tarnoff, CClaire, BrianE, Makoto_U, ShawnT, julierawe, Detlev, Gez, Jon_Avila, hdv, kirkwood, mgifford, GreggVan, Laura_Carlson, jkatherman, alastairc,
19:01:52 <Zakim> ... SydneyColeman, janina, Francis_Storr, .9
19:01:52 <Zakim> RRSAgent, please draft minutes v2
19:01:53 <RRSAgent> I have made the request to generate https://www.w3.org/2026/05/11-ag-minutes.html Zakim
19:02:00 <GreggVan> draft RESOLUTION: We will not require specific kind(s) of testing for testing of requirements though there may be assertions about testing and it may be part of requirements if one makes a claim.
19:02:00 <Zakim> I am happy to have been of service, kevin; please remember to excuse RRSAgent.  Goodbye
19:02:00 <Zakim> Zakim has left #ag
19:12:00 <laura> laura has left #ag
21:32:14 <kirkwood> kirkwood has joined #ag
22:41:50 <kirkwood> kirkwood has joined #ag