12:26:48 RRSAgent has joined #eo 12:26:48 logging to https://www.w3.org/2022/05/13-eo-irc 12:26:50 RRSAgent, make logs public 12:26:50 Zakim has joined #eo 12:26:52 Meeting: Accessibility Education and Outreach Working Group (EOWG) Teleconference 12:26:52 Date: 13 May 2022 12:30:33 Wilco has joined #eo 12:30:38 present+ 12:30:59 Laura has joined #eo 12:31:09 eoncins has joined #eo 12:31:19 present+ 12:31:30 present+ 12:31:49 present+ 12:32:07 present+ 12:32:23 Scribe: kevin 12:33:28 Topic: "Evaluation Tools" vs. "Test Tools" terminology 12:33:38 Michele has joined #eo 12:33:43 present+ 12:34:00 present+ Daniel 12:34:15 krisanne: There are pros and cons to both or either terminolgy 12:34:26 sharron: What is the goal of the discussion? 12:35:24 shawn: The goal is to open up the discussion, realise that we have this difference and explore whether we need to change the terminology 12:36:04 sharron: This may need to go to survey as well. Might be worth exploring the rationale for the positions and then open it to the larger group. 12:36:23 Howard has joined #eo 12:36:35 ... As Wilco indicates, most people in the field to refer to testing tools but internally we talk about evaluation tools. 12:36:38 present+ Howard 12:36:48 ... Would be interested in the academic view on this as well. 12:37:38 Vera: Not sure on academia. Testing probably makes more sense to most users but there are tools that will simulate impairments that couldn't really be called 'testing. 12:38:06 q+ 12:38:12 shawn: Just to clarify is to ask for different perspectives. There is no need to add qualifiers 12:38:27 ack wi 12:38:33 BrianE has joined #eo 12:38:39 present+ 12:38:55 Wilco: I did a bit of an informal walkthrough of industry tools. I found that it is a bit of a mix between 'checking' and 'testing'. 12:38:55 present+ 12:39:23 ... 'Evaluation' and '@@@' is sometimes used. Rarely 'auditing' is used. 12:39:50 ... In the ACT project I am trying to use the most familiar language. 'Testing' makes most sense in that space. 12:40:10 q+ 12:40:29 ... 'Evaluation' seems more nuance and is more difficult for people who don't have English as a first language. 12:40:33 s/@@@/validation 12:40:44 ack ver 12:40:47 q+ to say process vs tools 12:41:30 Vera: In terms of what the words mean, I would like to go back on what I said earlier. 'Evaluation' seems more broad but it does actually cover aspects of the simulation tools as they are testing aspects of things too. 12:41:38 ack sha 12:41:38 shawn, you wanted to say process vs tools 12:41:40 q+ 12:42:01 shawn: Is the process 'evaluation' and the tools 'test' tools? 12:42:50 krisanne: Is there one way to describe the process? I also wonder if WCAG3's move away from pass/fail approach mean that we have to find a broader term. 12:43:08 ack dan 12:43:34 dmontalvo: I think there are different context that will make one phrase easy to find to cover it all. 12:44:09 ... The 'test tools' do tend to talk about 'testing' things but the broader evaluation might include other tools that aren't necessarily 'testing' something. 12:44:11 q+ 12:44:33 ack dmon 12:44:51 ... Maybe in the ACT space 'testing' is appropriate but 'evaluation' can be used more broadly. 12:45:24 q+ to ask +1 Daniel, leave as is ? 12:45:33 ack wil 12:45:39 Wilco: 'Test tool' doesn't usually work without being prefaced by 'accessibility'. 'Evaluation' needs this qualifier slightly less to set the tools appart. 12:46:13 Scribe: Sharron 12:46:52 q+ 12:47:18 Kevin: The context on that side of things is really improtant. Evaluation refers to the process - I would not say we test things, we talk to testing teams, we try to get them to include this but when we are acting, we are evaluation a product. 12:47:31 q+ to ask if "evaluation" is not more related to a procedure and a "test" is more related to a product? 12:47:39 ack sha 12:47:39 shawn, you wanted to ask +1 Daniel, leave as is ? 12:47:58 ...do I talk about testing tools? yeh maybe. Do I talk about evaluation tools? yeh maybe. They re interchangable and that is the problem here. 12:48:30 Shawn: Maybe we go back to the original questions and end up that since we have used both, they both have hsiotroy, maybe we just leave as is. 12:48:32 Scribe: kevin 12:48:50 ack lau 12:48:51 Daniel: So leave in the ACT as testing and where it is now as Evaluation? 12:49:47 Laura: As a term evaluation seems more inclusiive of all the various ways in which we look at products. In a QA context it makes more sense to be evaluation. 12:49:59 Scribe: Kevin 12:50:54 eoncins: I agree that both terms can be use interchangable. For me 'evaluation' is a procedure but 'testing' refers more to the tool. 12:51:16 ... I would be looking to understand the distincion within the context rather than having just one. 12:51:23 ack eon 12:51:23 eoncins, you wanted to ask if "evaluation" is not more related to a procedure and a "test" is more related to a product? 12:51:29 q+ 12:52:31 Howard: Looking over some of the resources and my own coause I use both terms. EIther one would works. My preference is to use 'evaluation tools' but they are interchangable. 12:53:20 ack how 12:53:25 krisanne: Feeling tends to be that they both work but it is imporant to consider the context. For example being asked to look at a product to be selected would be an 'evaluation' not necessarily a 'test'. 12:53:34 +1 to krisanne 12:54:23 +1 to Sharron 12:54:35 Sharron: Agree with the context being important; we evaluate products before we buy and systems before we use, but we will test systems that we have built. 12:54:48 krisanne: Can we live with them co-existing? 12:55:11 Sharron: Yes, we don't necessarily want to limit the language unless there is a need to. 12:55:33 krisanne: There is such a wide variety of different tools that it seems difficult to constrain our anguage. 12:56:04 Wilco: I think that is reasonable. 'Testing' works in ACT, 'evaluation' can be used elsewhere. 12:57:06 Topic: Evaluation Tools List 12:57:41 Vera: Main thing we have been working on is the tool submission form. 12:58:09 ... ALso, the process behind that to send the form to ithub and list maintainer for review. Thanks to Shawn for info on how the process currently works. 12:58:09 https://master--wai-evaluation-tools-list.netlify.app/list-of-evaluation-tools/submit-a-tool 12:58:52 Vera: A big change that has been implemented is that the top menu bar has changed. 12:59:03 ... Is there anyone that can explain what has prompted that change? 12:59:55 shawn: The WAI website has the minimal header which is used for resources where people are likely to be working in that resource for a reasonable length of time. 13:01:15 ... For example this is used in COGA guidance, Understanding and Techniques, WCAG EM Report Tool. 13:01:41 ... We don't have to use this though. This group can choose what approach to actually take. 13:02:29 ... So the question would be, how important is the screen real estate for the Tools list and submission form. 13:02:54 ... Are people going to be using this list in a focused way and looking to avoid the distraction. 13:03:21 ... Or is this a high traffic entry point that we could take advantage of by including a fuller navigation? 13:04:29 Vera: That explains a lot on the reasoning on it. I was a bit surprised because earlier user testing we saw people were confused as they didn't knw what this was a part of or where they could find more information. 13:05:00 ... I would really advise, based on this testing, not to go for the minimal toolbar. 13:05:19 shawn: Quick check if people want to agree to Vera's recommendation 13:05:22 +1 on having navigation 13:05:48 +1 on having navigation 13:05:51 +1 to Vera 13:05:54 shawn: Need to check whether we want consistency on other tools as well though 13:06:02 +1 to having navigation 13:06:31 Vera: We have been working with the course list team to take consistent approaches. 13:07:18 ... We are still looking at how people can update their tool entries. Possibly a link from GitHub to a pre-filled form 13:08:13 Vera: On the form we haven't changed many of the fields. We were considering making it multi-step but this was not possible with the set up. 13:08:23 q+ to ask about date format 13:08:37 ...We have grouped the fields into related elements 13:09:19 ... Have changed the features input to encourage more bullet point lists of features rather than just marketing text. 13:10:00 shawn: Why are the date formats different? 13:10:31 Vera: This may be because I am using a Dutch browser set up. 13:10:54 krisanne: My browser shows dd/mm/yyyy which supports this. 13:11:14 q+ 13:11:14 Vera: It might be better to remove this from the label is this could cause confusion. 13:12:07 ack shaw 13:12:07 shawn, you wanted to ask about date format 13:12:34 ack laur 13:13:08 Laura: If we remove the format from the label, then there are concerns that the placeholder may disappear when the field is tabbed into. 13:13:36 shawn: I agree. The best thing would be if the label had the system format as well although I am not sure how possible that is. 13:13:48 CarlosD has joined #eo 13:14:01 krisanne: This doesn't appear to be a placeholder since I can tab through each of the date components. 13:14:23 present+ 13:14:49 q+ 13:14:58 Laura: I just want to flag that having placeholder only is not somethign that we would want 13:15:40 BrianE: I think these are a text field and will pick up system format. This will be in conflict with any fixed label which would be difficult to overcome. 13:16:07 ... Also, looking into date inputs as they have not been great from accessibility perspective. 13:16:36 Howard: I like having both, even with the inconsistency. I think people will figure it out and the label is more prominent and I wouldn't want to lose it. 13:17:12 krisanne: Yes, this may be that the need of some would outweight the inconveinience of others. 13:17:52 shawn: But having the conflict would be wrong from a user perspective 13:18:39 krisanne: And going back to my browser it is showing mm-dd-yyyy rather than what is in the label, dd-mm-yyyy. 13:19:18 Vera: Is there a need for a decision on this now? Or can we look more into this? Also, if anyone has other resources, that would be a help if we can bring this to a survey. 13:19:21 +1 to removing label if we are using date input type. That's confusing. 13:19:58 +1 to remove label if it can be made consistent with the input field 13:20:10 s/it can be/it can't be 13:20:38 Vera: One other difference to bring to the group today. Lanugage has a similar input field to that of Features. 13:20:45 shawn has joined #eo 13:20:46 ack how 13:21:24 ... Language has a large list. You can add multiple languages by adding them one at a time. 13:21:51 ... Only the last added language can be removed. That is a slight limitation but it does make the form that bit cleaner. 13:22:10 q+ 13:22:31 ack dmon 13:23:05 dmontalvo: If you have three languages and you want to remove the first of them, then you have to remove all three and then add in the last two? 13:24:08 Vera: Yes, and that is the same for all users. We haven't looked at the accessibility but my view is that the user experience is not great. 13:24:30 dmontalvo: Yes, that does seem a bit cumbersome! 13:26:22 Vera: Following approval we were planning to contact the tool vendors to update their details. We think that we could get approval to publish before we do this and then publish a populated list. 13:26:32 krisanne: Thanks so much 13:26:59 Sharron: It will be good to give an incentive to vendors update their information. 13:27:25 Vera: Yes, there is a lot of outdated information 13:27:35 Topic: Selecting Evaluation Tools 13:28:28 krisanne: Just looking at the opening page for the list of evaluation tools. There has been some discussion on the requirements of this in thepast. 13:28:36 shawn has joined #eo 13:28:49 ... Before we go through the update we just wanted to check that there was nothing additional to add to the requirements. 13:28:51 https://www.w3.org/WAI/test-evaluate/tools/selecting/ 13:29:14 https://github.com/w3c/wai-selecting-eval-tools/wiki/Requirements-Analysis-for-2021-Revision 13:29:19 q+ 13:30:34 ack shaw 13:30:50 shawn: Sorry, I didn't send this out until late last night. Briefly though, there was a longer verson of this page some time ago. Then when the site was redesigned in 2017 we worked on tersifying the content (more succinct and focussed). 13:31:27 ... The 2017 has a much smaller scope. In 2021 there was a suggestion to broaden it again to include more user stories and to expand it a bit. 13:32:54 ... This was an individual perspective which discussion in EO decided that our default still is succinct and focussed but there are resources where there are options to be more narrative. 13:33:14 ... The Selecting Tools resource falls into the first group of resources. 13:33:17 q+ 13:34:40 Vera: Looking forward to other perspectives on this and understanding everyones views on the requirements. I am particularly interested in the user experience for someone landing on the tools list page and then coming here to understand how to select tools and use the full list. 13:34:54 q+ 13:35:04 ack Vera 13:35:20 krisanne: I like the idea of something being a friendly welcome space when it comes to tools like this. We want to encourage people to use them and user stories can help in that. 13:35:33 ... Having something that is informative and not overwhelming can be a big help in this. 13:35:46 ack ver 13:35:49 ack carl 13:36:28 CarlosD: I think we are missing a reference to WCAG test rules in this page. I don't know if we need to call this ACT or WCAG test rules. 13:36:52 ... I think it needs to be referenced here as something to consider when people are selecting evalution tools. 13:37:15 q+ 13:37:17 shawn: It would be most useful if you could add a GitHub issue to the repo 13:37:26 +1 to Carlos 13:37:53 ack ver 13:38:33 Vera: I am aware of the ACT rules as Wilco contact the team. We are looking at how ths can be woven into the tools list and the selecting tools page. 13:38:55 ... We are also looking at how tools support the ACT rules and whether we can highlight this in the listings. 13:39:33 krisanne: If anyone has comments, please do put them into the Github so we don't lose them but we will have more opportunities to feedback on the rewrite. 13:39:53 Topic: Easy Checks Next Gen 13:40:27 https://www.w3.org/WAI/EO/wiki/Easy_Checks_Next_Gen 13:41:21 Sharron: There has been a huge amount of work on this brilliant idea to help support people getting a feeling on the accessibility of a site. 13:41:39 ... For a few years it was one of the most highly commented on and appreciated resources. 13:41:55 ... The comments have become less positive as it has become quite outdated. 13:42:21 ... That we have a talented team to research and update this resource is really exciting. 13:42:56 Vera: We haven't made our plan just yet but we are all excited to work on this. Two main challenges: 13:43:09 ... - Updating the information; and 13:43:41 ... - The findability, structure and information architecture to ensure peopel can find what they need easily 13:44:33 krisanne: The idea of being able to filter the checks is really helpful and should help to cut down on the complexity of the resource and the amount of text that needs to be presented to users. 13:45:05 +1 to excitement! 13:45:09 q+ 13:45:46 ack ver 13:46:25 Vera: I was wondering in terms of following a user journey starting with these checks there is something after the checks to learn more. 13:46:42 ... How do we help users go on to fix or address the issues that they have found. 13:46:54 ... Also perhaps, what does it mean and who does it impact 13:47:13 shawn: Sounds wonderful but need to be really careful on scope creep 13:47:42 Vera: Agreed, although if we can link to other existing resources that answer these questions 13:48:18 Sharron: Yes, this is something that we have done more and more. As we have more resources available we can build that bigger picture of support and related resources. 13:49:45 krisanne: Again, there will be opportunities as this progresses to feedback on the shape of the resource. 13:50:26 shawn: I am beyond thrilled that this work is happening and that Vera and the team are taking this work on. 13:51:18 Topic: Work for this Week 13:51:37 krisanne: The Curricula module review is closing today 13:52:26 Sharron: Something I learned at AccessU is a thing called Blooms taxonomy that is language for learning objectives. 13:52:43 dmontalvo: Yes, this is something that we are trying to align to as much as possible. 13:54:36 ... There are a revisions to this taxonomy which can make it difficult to use but it is good to see that people are recognising that we are doing this 13:55:41 krisanne: Please do get comments and feedback on that survey today if you haven't had a chance to do so. 14:02:57 trackbot, make minutes v1 14:02:57 Sorry, Sharron, I don't understand 'trackbot, make minutes v1'. Please refer to for help. 14:03:08 trackbot, end meeting 14:03:08 Zakim, list attendees 14:03:08 As of this point the attendees have been Wilco, krisanne, Vera, eoncins, kevin, Michele, Daniel, Howard, Laura, BrianE, CarlosD 14:03:16 RRSAgent, please draft minutes 14:03:16 I have made the request to generate https://www.w3.org/2022/05/13-eo-minutes.html trackbot 14:03:17 RRSAgent, bye 14:03:17 I see no action items