14:56:49 RRSAgent has joined #eval 14:56:49 logging to http://www.w3.org/2012/02/16-eval-irc 14:56:51 RRSAgent, make logs world 14:56:53 Zakim, this will be 3825 14:56:53 ok, trackbot; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 4 minutes 14:56:54 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 14:56:54 Date: 16 February 2012 14:57:13 chair: Eric 14:57:36 WAI_ERTWG(Eval TF)10:00AM has now started 14:57:42 +Shadi 14:57:43 Kathy has joined #eval 14:57:59 Liz has joined #eval 14:58:13 ericvelleman has joined #eval 14:58:29 Detlev has joined #eval 14:58:52 + +1.703.227.aaaa 14:58:53 regrets: Denis, Richard 14:59:12 +Liz 14:59:21 zakim, aaaa is Katie 14:59:21 +Katie; got it 14:59:41 + +1.502.632.aabb 14:59:50 Sarah_Swierenga has joined #eval 14:59:56 +Detlev 15:00:12 zakim, aabb is Elle 15:00:12 +Elle; got it 15:00:16 +Kathy 15:00:28 +Don 15:00:35 +Eric 15:00:40 Zakim, mute me 15:00:41 Detlev should now be muted 15:00:50 +Sarah 15:02:08 zakim, who is on the phone? 15:02:08 On the phone I see Shadi, Katie, Liz, Elle, Detlev (muted), Kathy, Don, Eric, Sarah 15:03:38 Elle has joined #eval 15:03:39 scribe: Sarah 15:03:44 scribenick: Sarah_Swierenga 15:03:57 zakim, mute me 15:03:57 Kathy should now be muted 15:04:07 http://www.w3.org/WAI/ER/2011/eval/minutes.html 15:04:08 kerstin has joined #eval 15:04:17 +[IPcaller] 15:04:20 agarrison has joined #eval 15:04:24 zakim, ipcaller is me 15:04:24 +vivienne; got it 15:05:00 123mogya 15:05:12 zakim, mute me 15:05:12 vivienne should now be muted 15:05:21 s/123mogya/ 15:05:25 I'm in another call for 5 mins 15:06:16 Topic: CSUN 15:06:30 csun plans - nothing formal has been confirmed 15:06:38 +[IPcaller] 15:07:01 zakim, ipcaller is Kerstin 15:07:01 +Kerstin; got it 15:07:25 zakim, mute me 15:07:25 Kerstin should now be muted 15:07:41 thurs afternoon at 4:20 - discussion of this work at csun 15:07:59 zakim, unmute me 15:07:59 Kathy should no longer be muted 15:08:34 kathy will start an email identifying who is presenting and when. 15:08:39 ack me 15:08:42 q+ 15:09:41 Mike_Elledge has joined #eval 15:10:11 +Mike 15:10:13 ack viv 15:10:50 +[IPcaller] 15:10:57 zakim, mute me 15:10:57 vivienne should now be muted 15:11:01 zakim, Alistair 15:11:01 I don't understand 'Alistair', shadi 15:11:09 zakim, ipcaller is Alistair 15:11:09 +Alistair; got it 15:11:18 zakim, mute me 15:11:18 Shadi should now be muted 15:11:32 Topic: Relationship between WAI-ACT and Eval TF 15:11:36 zakim, mute me 15:11:36 Kathy should now be muted 15:11:40 ack me 15:12:00 http://www.w3.org/WAI/ACT/ 15:12:46 this task force is partially funded and supported through WAI-ACT. 15:12:59 Tim has joined #eval 15:13:17 this is the fifth or so in a series of projects set up like this...a fairly common approach 15:13:50 typically there are invited experts, but the funding will mostly be under the W3C process 15:14:22 q? 15:15:14 eric will provide more info if requested, and info is available at the link just above in this thread. 15:15:37 sorry shadi has the additional info 15:15:48 agenda point 3 15:16:17 Topic: Section 5 15:16:23 zakim, mute me 15:16:23 Shadi should now be muted 15:17:31 should the end report include all of the techniques or just the results? 15:17:56 ack me 15:18:23 Has there been a recent version of the Methodology? If so, can you post the URL? 15:18:36 ok 15:18:39 zakim, mute me 15:18:39 Shadi should now be muted 15:18:49 http://www.w3.org/WAI/ER/conformance/ED-methodology-20120209.html 15:18:54 cheers 15:19:46 Eric: we don't want to rewrite wcag techniques, but what do we want here? 15:21:07 +Tim_Boland 15:21:30 Eric: Do we want to check every page for every element, technique, component? 15:21:43 Detlev's Mail here: http://lists.w3.org/Archives/Public/public-wai-evaltf/2012Feb/0055.html 15:22:10 q+ 15:22:19 Eric: 4.2 clarifies this. Detlev proposes not to select a particular order 15:22:30 q? 15:22:49 Eric: Once we have identified a problem, we don't need to identify it again on other pages 15:22:51 q+ 15:22:56 ack mike 15:23:07 Here#s my proposal: http://lists.w3.org/Archives/Public/public-wai-evaltf/2012Feb/0055.html 15:23:17 q+ 15:23:31 q+ 15:23:36 Mike: would change wording to make it clear that if people are evaluating on an 'exception' basis, we make sure people know it is different."targeted" doesn't seem to get at that. 15:23:50 q? 15:23:55 ack me 15:25:00 Shadi: depends on the aim of the evaluation. If just yes/no, then it's enough to identify an error on one page and then not address it again. However, if we want a more quantitative approach we would indicate how prevalent the issue was. 15:25:11 *q 15:25:41 Shadi: If we want to talk about how close to compliant a page is, then we'll need more details in addition to the yes/no. 15:25:48 zakim, mute me 15:25:48 Shadi should now be muted 15:25:57 q+ Elle 15:25:58 ack me 15:27:04 zakim, unmute me 15:27:04 Kerstin should no longer be muted 15:27:12 Kathy: Agrees with Shadi. We need to decide yes/no, but also need to decide on frequency, e.g., one missing alt text vs missing alt text throughout the site. When working with development teams, it's important to identify where the errors are occuring. 15:27:26 q+ 15:27:34 zakim, mute me 15:27:34 Kathy should now be muted 15:27:40 q? 15:27:40 ack ker 15:27:48 Eric: Earlier discussion - we want to know where errors are occurring. 15:28:13 q+ to say could have both approaches in the document 15:28:41 Kerstin: On huge pages, evaluators should look for more than a few errors. Finding one failure and then moving on to another page isn't enough. 15:29:06 q+ 15:29:13 Kerstin: Doesn't see why we should have to identify where every error occurs, e.g., navigation bars 15:29:42 zakim, mute me 15:29:42 Kerstin should now be muted 15:30:06 ack elle 15:30:09 q? 15:30:10 In that instance we just say "All pages--Logo does not have alt text." 15:30:13 ack me 15:30:16 Eric: Believes we have agreement here. We can say in the report that evaluator should give several examples and indicate that this problem may occur elsewhere on the site. 15:30:24 q+ 15:31:29 Elle: Totally agrees, from a development team standpoint, errors should be specifically identified. However, they have an associated document specifying the location and extent of errors. Global vs. regional elements in the test cases. 15:31:32 +1 15:31:59 +1 15:32:05 Elle: Global and regional elements may also be referred to as "common" elements. 15:32:23 ack viv 15:32:57 Vivienne: "Site wide issues" is another term for items that occur on a number of pages. 15:33:45 Vivienne: Usually points out where the problems are, but also how to correct the issues. Different levels of evaluation and recommendations. 15:34:12 Eric: This is important for audits and reporting. 15:34:51 q+ 15:34:58 Eric: ISO testing schemes include what is wrong, but also what the repair possibilties would be. 15:35:43 zakim, mute me 15:35:43 vivienne should now be muted 15:35:44 Vivienne: Pointing to best practices is helpful. As practitioners we need to be proactive about recommendations. 15:35:55 ack me 15:36:08 Eric: Maybe this should go into the reporting section, rather than section 5. 15:36:13 Vivienne, I agree totally, we request remediation support with all our audits (saves time) and I evaluate against our own corporate best practice 15:36:53 ack me 15:36:55 shadi, you wanted to say could have both approaches in the document 15:36:55 zakim, mute me 15:36:56 vivienne should now be muted 15:36:57 Vivienne: Maybe this should also be included in scope. For example, we are going line by line or highlighting various items on each page. 15:37:52 Shadi: Likes the concept of identifying the global elements that would only be evaluated once. The target of the evaluation should be clear from the beginning and in the reporting section. 15:38:06 q+ 15:39:11 zakim, mute me 15:39:11 Shadi should now be muted 15:39:13 Shadi: Options 1) yes/no - don't evaluate for that again if found on one page; 2) yes/no, plus more info about the nature of the error on more pages; and 3) adding recommendations for repair. We could describe all three in this document. 15:39:16 ack me 15:40:33 Kathy: Working with clients has similar experiences to Vivienne. Have common elements and issues, and then refers back to the original place where the issue was identied. That way the info is associated with each page. Some common issues are applicable to a specific set of pages, but not the whole site. 15:41:44 Kathy: Reporting options, those usually depend on the level of accessbility expertise within the development team. Repairs might not be needed, as long as the issues are identified, if the team knows how to address the issues. 15:42:01 Eric: It should be clear from the start what level of evaluation is needed. 15:42:17 zakim, unmute me 15:42:17 Kerstin should no longer be muted 15:42:17 Kathy, great point 15:42:18 Kathy: Yes, this could save costs over time. 15:42:26 zakim, mute me 15:42:26 Kathy should now be muted 15:42:28 ack ker 15:43:19 Kerstin: Agrees with Shadi and Kathy's add-ons. We should write use cases for the three options, for comparative testing purposes. 15:43:23 ack me 15:43:27 q? 15:43:48 zakim, mute me 15:43:48 Kerstin should now be muted 15:44:24 q+ 15:45:44 Detlev: Clarification of draft text - when issue is found multiple times, then we should have a place to note it, but we still need to make sure the page does or does not have that problem. Each page should be checked for everything to make sure it does/does not have that problem. For example, language element should be checked on every page, rather than assuming that the CSS would have that for every page. 15:45:45 zakim, umute me 15:45:45 I don't understand 'umute me', kerstin 15:45:56 Zakim, mute me 15:45:56 Detlev should now be muted 15:45:59 q? 15:46:11 i write in a mail 15:46:28 zakim, mute me 15:46:28 Kerstin was already muted, kerstin 15:46:32 ack ker 15:46:54 zakim, mute me 15:46:54 Kerstin should now be muted 15:47:26 q+ 15:47:26 *q 15:47:28 Eric: With suggesting repairs, it could be more than the evaluator to handle...might be many ways to repair a site, and one repair could cause a problem somewhere else. 15:47:48 Eric: We could just point to the W3C website where the problem is described. 15:47:49 q? 15:47:56 zakim ack me 15:48:02 +q 15:48:03 ack me 15:48:57 q+ 15:49:11 Vivienne: Don't have to suggest a repair, unless you know what it would be. But, best practices should be included from W3C. We shouldn't always be expected to be experts in development. 15:49:24 zakim, mute me 15:49:24 vivienne should now be muted 15:49:52 q+ 15:50:00 q? 15:50:23 I would be more comfortable to point them back to WCAG 2.0 Techniques, rather than suggest repairs. 15:51:05 Elle: If a company site owner requests recommended repairs, the accessibility expert should set the expectation about the level of recommended repairs. Has had experience with one repair causing another problem. 15:51:44 ack me 15:51:49 ack me 15:51:52 mute me 15:51:53 Eric: Recommendations are usually expected, but pointing to W3C is good. 15:51:55 -q 15:52:19 q+ 15:52:22 excellent point, Kathy 15:52:35 -Tim_Boland 15:53:06 q? 15:53:52 for what it's worth, our company depends on the development support found in remediation guidance with audits (makes a cheaper remediation project in the end as compared to teaching devs on the job) 15:54:39 Kathy: Often gives suggestions for repair, but Kathy has a development background. Since there's more than one way to fix a problem, suggestions are given in that context. Works with developers to come up with the best solution. Accessibilty experts might not have an answer, but they can reinterate what needs to be done to address the problem, but not the specific code to fix it. 15:55:00 zakim, mute me 15:55:01 Kathy should now be muted 15:55:45 ack me 15:55:49 q+ 15:55:50 Eric: Evaluation section - do we want to say that people need to go into the depths of the techniques or refer them to W3C? 15:55:55 q+ 15:55:58 ack viv 15:56:05 ack ker 15:56:13 zakim, mute me 15:56:13 Kerstin should now be muted 15:56:15 agree with kerstin 15:56:44 q? 15:56:53 Vivienne: Recommends being as specific as possible. Don't assume that people will know how to use the WCAG docs, althought it is much more work for the evaluator. 15:57:21 ack me 15:57:23 zakim, mute me 15:57:23 vivienne should now be muted 15:57:26 Vivienne: Example, titles vs labels - evaluator needs to identify sufficient techniques 15:57:49 q+ to say we should include guidance on how to *use* the techniques 15:58:54 Detlev: Even though sufficient techniques is the best, it may not be practical. These can't be checkpoints. Evaluator would ask whether all images have alternative text, but to report every technique would be too burdonsome. 15:59:09 Eric: Will work with Detlev's draft into the next version. 15:59:09 ack me 15:59:11 shadi, you wanted to say we should include guidance on how to *use* the techniques 15:59:13 Zakim, mute me 15:59:14 Detlev should now be muted 16:00:19 For replicable results, we do need to all be checking the same thing - the easiest way to achieve this might be to base things on sufficient techniques and failure conditions. 16:00:34 Shadi: When indicating pass/fail, but this methodology should guide the user about what the problem is from an accessibilty standpoint and apply to the WCAG2 technique to fix it. 16:00:34 agreed, Allistair 16:00:54 unmute me 16:01:18 bye 16:01:22 bye 16:01:24 -Katie 16:01:25 Sarah: Have a good week. End scribing. 16:01:25 bye 16:01:25 bye 16:01:26 -Kathy 16:01:27 bye :) 16:01:29 -Elle 16:01:30 -Alistair 16:01:30 -vivienne 16:01:33 -Detelv 16:01:35 vivienne has left #eval 16:01:36 -Don 16:01:38 -Shadi 16:01:42 -Sarah 16:01:45 bye 16:01:50 bye 16:01:50 -vivienne 16:02:04 -Eric 16:02:31 -Mike 16:02:37 -Kerstin 16:02:49 -Liz 16:04:11 -Detlev 16:04:14 WAI_ERTWG(Eval TF)10:00AM has ended 16:04:16 Attendees were Shadi, +1.703.227.aaaa, Liz, Katie, +1.502.632.aabb, Detlev, Elle, Kathy, Don, Eric, Sarah, vivienne, Kerstin, Mike, Alistair, Tim_Boland 16:37:30 rrsagent, end meeting 16:37:30 I'm logging. I don't understand 'end meeting', shadi. Try /msg RRSAgent help 16:37:49 trackbot, end meeting 16:37:49 Zakim, list attendees 16:37:49 sorry, trackbot, I don't know what conference this is 16:37:57 RRSAgent, please draft minutes 16:37:57 I have made the request to generate http://www.w3.org/2012/02/16-eval-minutes.html trackbot 16:37:58 RRSAgent, bye 16:37:58 I see no action items