14:58:16 RRSAgent has joined #eval 14:58:16 logging to http://www.w3.org/2012/12/20-eval-irc 14:58:18 Liz has joined #eval 14:58:18 RRSAgent, make logs world 14:58:18 Zakim has joined #eval 14:58:20 Zakim, this will be 3825 14:58:20 ok, trackbot; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 2 minutes 14:58:21 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 14:58:21 Date: 20 December 2012 14:58:53 zakim, this is eval 14:58:53 shadi, I see WAI_ERTWG(Eval TF)10:00AM in the schedule but not yet started. Perhaps you mean "this will be eval". 14:58:53 MartijnHoutepen has joined #eval 14:59:00 zakim, this will be eval 14:59:00 ok, shadi; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 1 minute 14:59:08 WAI_ERTWG(Eval TF)10:00AM has now started 14:59:15 +Liz 15:00:23 +Katie_Haritos-Shea 15:00:36 my phone has trouble calling in 15:00:39 +MartijnHoutepen 15:01:48 Kathy has joined #eval 15:02:27 +Kathy 15:02:36 Liz has joined 15:02:44 +Shadi 15:02:52 +Mike 15:03:23 Ryladog has joined #eval 15:03:27 +ericvelleman 15:03:35 -ericvelleman 15:03:49 +Peter_Korn 15:03:55 sorry, problem with my phone, thing will not do what I want.. 15:04:30 this ruins my Christmas feeling :-) 15:04:54 +ericvelleman 15:07:58 korn_ has joined #eval 15:08:09 Zakim, mute me 15:08:09 MartijnHoutepen should now be muted 15:08:20 scribe: Kathy 15:08:30 zakim, mute me 15:08:30 Shadi should now be muted 15:08:38 Eric: Welcome, last call for this year 15:08:48 agenda: http://lists.w3.org/Archives/Public/public-wai-evaltf/2012Dec/0016.html 15:10:10 Eric: Next Topic: 2. Disposition of Comments 15:10:29 Eric: a number of people have added comments. 15:11:22 Eric: new approach to help people follow the discussions; the main document to look at is the editor draft 15:11:51 Eric: main way to provide feedback is the survey 15:13:31 Eric: look at the diff version to look at the changes 15:13:57 +[Oracle] 15:14:00 Eric: Eric will send out emails about topics to discuss 15:14:02 -Peter_Korn 15:14:34 korn has joined #eval 15:14:38 Eric: he is grouping comments together 15:15:41 q? 15:15:51 Zakim, Oracle has Peter_Korn 15:15:51 +Peter_Korn; got it 15:16:02 Topic: #3. Surveys 15:16:53 https://www.w3.org/2002/09/wbs/48225/evaltfq6/ 15:17:04 Eric: we will now discuss the survey 15:18:07 Eric: Start talking about DoC_ID_31 - Change states to web pages 15:18:07 https://www.w3.org/2002/09/wbs/48225/evaltfq6/results#x2631 15:18:58 q+ 15:19:17 https://www.w3.org/2007/10/htmldiff?doc1=http%3A%2F%2Fwww.w3.org%2FWAI%2FER%2Fconformance%2FED-methodology-20120915&doc2=http%3A%2F%2Fwww.w3.org%2FWAI%2FER%2Fconformance%2FED-methodology-20121213#specialcases 15:19:22 q+ 15:19:31 q? 15:19:49 Peter: Maybe we should re-write the paragraph 15:19:51 Tim has joined #eval 15:19:59 http://www.w3.org/TR/WCAG-EM/#specialcases 15:20:50 Peter: maybe we should have definition of web app 15:21:43 +1 to change 15:21:44 q+ 15:21:46 Peter - maybe we should change state to change 15:22:44 q- 15:22:55 q- 15:23:01 ack me 15:23:07 Peter: maybe need to describe the actions and data required for the page state 15:23:25 ack me 15:23:33 zakim, unmute me 15:23:33 Shadi was not muted, shadi 15:23:37 Shadi, we cannot hear you 15:23:48 zakim, unmute me 15:23:48 Shadi was not muted, shadi 15:24:12 +1 15:24:26 changing states to changes 15:24:31 [[+1 to not using techie jargon like "page state"]] 15:24:35 Eric: what do people think about changing change state to changes 15:24:49 -Shadi 15:25:09 +1 15:25:15 Eric: should we rewrite this 15:25:16 +1 15:25:23 +Shadi 15:26:18 Shadi: agrees with Peter. We need to rewrite this section 15:26:35 Eric: next discussion DoC_ID_37 - Automatic Evaluation thoughts 15:27:23 Eric: we did add some information on automation. Some comments on using just automation but that is not enough 15:27:35 q+ 15:27:54 Eric: different proposal on where we can add this information - reporting 15:28:14 Peter: 17% of WCAG 2.0 is automateable 15:28:46 q- 15:28:47 q+ 15:29:06 Peter: need to also think about web app 15:29:16 Eric: no one suggested adding it as another step 15:29:34 Peter: we can state that is may be a component with the limitations that.... 15:29:45 ack me 15:30:05 +Tim_Boland 15:30:27 Kathy: limitations with the tools for web apps 15:30:55 Eric: will come up with a text proposal within the document 15:31:26 Eric: does anyone think this needs to be a separate step 15:31:40 Peter: maybe an optional step with the limitations stated 15:32:00 Eric: should it be in the reporting section 15:32:02 q+ 15:32:10 ack me 15:32:10 Peter: yes, should be in reporting section 15:34:01 Shadi: on the fence; limitation of tools is so big. I like the idea as an optional step. We didn't forget about tools but that we are stating the limitation. It is not a required step 15:34:12 Shadi: we can clearly message as a supporting step 15:35:09 Shadi: The advice before was old when it there was more static pages from WCAG 1.0 days 15:35:25 Shadi: it needs to be updated 15:35:59 q+ 15:36:19 Tim: consulting on a project, they think that the use of automated tools is sufficient. So it is important to note that it is not sufficient 15:36:50 Shadi: if it is a separate step then we can explain the role of tools and we can answer the questions about how it could fit in 15:37:03 q+ 15:37:07 Tim: It needs to be consistent across WAI on the use of tools 15:37:38 Peter: we should go to some length about tools in the explanation within the document 15:38:09 Peter: automated tools alone will not get the results needed 15:38:14 ack me 15:38:15 q- 15:38:16 http://www.w3.org/WAI/eval/selectingtools 15:39:10 Shadi: Tim we can follow up separately. The document for selecting tools needs to be updated. These tools are useful. David estimated 15% could be automated for failure 15:39:36 Shadi: if we talk about conformance then this percentage goes down 15:39:54 Shadi: automated tools cover small portion 15:39:57 q+ 15:40:49 Shadi: make sure that the shed false light; tools are important. The are just a part or component 15:40:53 zakim, mute me 15:40:53 Shadi should now be muted 15:41:24 Peter: in addition to automated tools. Tools that are no automated are also useful 15:41:48 Peter: we need to make the clarification on automated tools vs tool assisted evaluation 15:41:52 ack me 15:42:00 q+ 15:42:18 ack me 15:42:59 Shadi: agree; the document selecting tools has some of that information 15:43:01 q+ 15:43:14 Shadi: we want to describe how it fits in the process 15:43:18 q- 15:43:22 ack me 15:44:14 Kathy: there are also reporting tools. We should include all three 15:44:58 Eric: I have the input for the new editor draft. I will add a step. 15:45:04 Eric: where does it go? 15:45:28 Eric: maybe audit the selected sample 15:45:39 q+ 15:45:43 ack me 15:45:43 q+ 15:46:08 ack me 15:46:19 Kathy: maybe not the last step. Should be in the order that you would conduct the review 15:46:41 Martin: need to rewrite the section and think about where it goes 15:47:08 zakim, mute me 15:47:08 MartijnHoutepen should now be muted 15:47:35 Eric: I will make a proposal 15:47:47 +1 15:47:51 +1 15:48:00 +1 15:48:18 +1 15:48:23 Eric: anything else on this one? 15:48:34 Eric: let's move on to DoC_ID_49 - Extend target with more SC 15:48:40 https://www.w3.org/2002/09/wbs/48225/evaltfq6/results#xq5 15:48:56 Topic: Input for one page web applications 15:49:12 Are one page web applications covered sufficiently in the current version of the WCAG-EM? If you think not, where should we add this? 15:49:14 q- 15:49:17 q+ 15:49:36 Eric: saw a lot of discussion on this. We want to add the proposal to the next draft 15:49:59 Peter: testing web application is a fundamentally different process. The approach, documentation will be different 15:50:18 Peter: not sure if this is best to have a separate steps 15:50:32 q- 15:50:46 Eric: would you say this is not sufficient for web apps 15:50:57 Peter: yes, this not sufficient yet 15:51:21 Eric: Maybe we should have more discussion on this topic 15:51:58 Peter: we should point people to where we are talking about web applications 15:52:01 q+ 15:53:22 q? 15:53:22 Eric: we will point to the sections with web app 15:53:35 Kathy: also ask about what is missing 15:53:48 Eric: we are at the end of the call; are there any other issues 15:53:56 Eric: Very Merry Christmas 15:54:22 Eric: I will send out an agenda 15:55:05 Eric: Next meeting will be Jan 10 15:55:38 happy holidays, 15:55:41 -Tim_Boland 15:55:42 ack me 15:55:47 -[Oracle] 15:55:49 -Mike 15:55:51 -Katie_Haritos-Shea 15:55:52 -Shadi 15:55:52 -MartijnHoutepen 15:55:53 -ericvelleman 15:55:56 trackbot, end meeting 15:55:56 Zakim, list attendees 15:55:56 As of this point the attendees have been Liz, Katie_Haritos-Shea, MartijnHoutepen, Kathy, Shadi, Mike, ericvelleman, Peter_Korn, Tim_Boland 15:55:58 -Liz 15:56:02 ericvelleman has left #eval 15:56:04 RRSAgent, please draft minutes 15:56:04 I have made the request to generate http://www.w3.org/2012/12/20-eval-minutes.html trackbot 15:56:05 RRSAgent, bye 15:56:05 I see no action items 15:56:05 -Kathy 15:56:06 WAI_ERTWG(Eval TF)10:00AM has ended 15:56:06 Attendees were Liz, Katie_Haritos-Shea, MartijnHoutepen, Kathy, Shadi, Mike, ericvelleman, Peter_Korn, Tim_Boland