14:59:54 RRSAgent has joined #eval 14:59:54 logging to http://www.w3.org/2014/03/06-eval-irc 14:59:56 RRSAgent, make logs world 14:59:56 Zakim has joined #eval 14:59:58 Zakim, this will be 3825 14:59:58 ok, trackbot; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 1 minute 14:59:59 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 14:59:59 Date: 06 March 2014 15:00:43 agenda+ welcome 15:00:52 agenda+ test-run 15:01:03 agenda+ DoC 15:01:11 Liz has joined #eval 15:01:14 Mike_Elledge has joined #eval 15:01:14 agenda+ F2F 15:01:18 Having difficulty joining 15:01:25 agenda+ other issues 15:01:46 WAI_ERTWG(Eval TF)10:00AM has now started 15:01:53 +Liz 15:01:54 I just started Zakim, if you tried it earlier it wasnt possible to join 15:01:59 +Mike_Elledge 15:02:22 +Kathy_Wahlbin 15:02:30 +MartijnHoutepen 15:02:33 could somebody start the telco, I am looking for a telephone that works 15:02:39 Martijn? 15:02:42 ok 15:03:20 Eric - did you use +1.617.761.6200 The pin/code for this meeting is: 3825 15:03:38 I had problems but I just let it keep ringing and I finally got in 15:04:57 http://www.w3.org/WAI/ER/2011/eval/minutes 15:06:25 zakim, take up next 15:06:25 agendum 1. "welcome" taken up [from MartijnHoutepen] 15:06:33 agenda? 15:06:58 zakim, take up next 15:06:58 agendum 1 was just opened, MartijnHoutepen 15:07:38 Vivienne has joined #eval 15:08:05 + +31.65.127.aaaa 15:08:12 +[IPcaller] 15:08:23 zakim, IPcaller is me 15:08:23 +Vivienne; got it 15:08:27 aaaa is me 15:08:44 Zekim, aaaa is me 15:08:55 Zakim, aaaa is me 15:08:55 +EricVelleman; got it 15:09:31 zakim, take up next 15:09:31 agendum 2. "test-run" taken up [from MartijnHoutepen] 15:09:43 chair: EricVelleman 15:09:53 scribe: MartijnHoutepen 15:10:28 EV: some last minute remarks, added an 'all pages' field, and did some editorial changes 15:10:36 q+ 15:10:44 ack kathy 15:12:38 Detlev has joined #eval 15:12:49 KW: there's an accessibility problem in the survey for people using screen magnifying software 15:13:05 EV: we'll look in to that 15:13:19 +Detlev 15:13:37 Zakim, mute me 15:13:37 MartijnHoutepen should now be muted 15:13:53 zakim, mute me 15:13:53 Kathy_Wahlbin should now be muted 15:14:36 EV: we have to choose a website 15:14:55 q+ 15:15:17 ack me 15:15:39 DF: will we do just one website? or more? 15:16:10 DF: suggested a website as well 15:16:31 zakim, mute me 15:16:31 Vivienne should now be muted 15:18:24 q+ 15:18:34 q+ 15:18:41 ack me 15:18:54 http://www.w3.org/2014/02/27-eval-minutes 15:23:36 q+ 15:24:16 q+ 15:26:59 DF: more website give us a better view of the methodology 15:27:11 Liz: agree with DF 15:27:30 ack me 15:27:36 EV: Its a lot of work, don't know if we can ask that of people 15:27:41 q- liz 15:27:50 q+ 15:28:04 KW: good to test it on different websites, different types of websites 15:28:37 KW: this will be one of the critiques we will get : we tested it on too similar sites 15:29:05 KW: share concern with number of people who will do a total evaluation 15:30:17 q+ 15:31:54 MH: scared that not to many people do the same site 15:31:56 q- 15:32:03 q- De 15:32:48 EV: if we open it up, people can include the evaluating they are doing at the moment 15:33:14 q- 15:33:22 DF: most important to ask the community for websites, to get a broader view 15:34:00 KW: agree with DF, but we need a disclaimer that the data will become public 15:34:20 KW: make a note that partial info is also welcome 15:35:12 q+ 15:35:27 EV: keeping it at level A will decrease the effort people have to give, increase chance to get feedback 15:35:49 EV: group decided to do AA 15:35:52 zakim, mute me 15:35:52 Kathy_Wahlbin should now be muted 15:36:25 DF: make an open call asking people to nominate websites 15:36:32 sorry guys I have to go now 15:37:34 DF: we can tell people that we don't need people to expect to do total evaluation, but make an emphasis on the feedback on the methodology 15:38:06 sorry, phone stopped, dialing in again.. 15:38:09 -Vivienne 15:38:40 +EricVelleman.a 15:39:23 EV: i expect lots of people to volunteer their website for evaluation 15:39:42 q+ 15:39:53 DF: we don't need a lot, but more variation then we have now, and we need more testers 15:40:05 q- Det 15:40:47 DF: we can start with the sites we have, and need to make a open call for more sites 15:41:17 ME: agree with MH, we should ask people to do one site, use that feedback on maybe a next site 15:42:03 ME: most valuable for us is if we use one or two sites 15:42:07 I meant more importantly: mor testers =more problems people may encounter using WCAG EM 15:42:38 DF: we need more testers 15:43:30 EV: we need to discuss this in a next telco, but i'd like to start the survey 15:43:40 EV: right now 15:44:42 DF: agree, starting now is ok to hurry up proces, but like to include more testers 15:45:47 EV: proposal : Start with the 3 websites we have? 15:46:12 DF: consensus was starting with one, adding more later 15:46:28 q+ 15:46:33 q- mi 15:47:57 MH: let's start with one, the sooner we get results the better 15:48:39 fine 15:48:45 EV: or we could do a two-way rocket: first one of our 'own', after that make it more open. 15:48:47 Can we also agree that we have a second public call for evaluation soon? 15:48:48 +1 15:48:49 fine 15:49:21 EV: talk about opening up the survey to include more website next week, start with one asap 15:49:23 three 15:49:33 +1 15:49:44 4H 15:49:48 4h +1 15:49:52 +1 15:50:00 I don't mind really 15:50:37 ev: start with 4h , others we'll discuss next week 15:51:05 EV: I'll make a scope suggestiong, please comment on that before monday morning 15:51:09 q+ 15:51:09 +1 15:51:13 EV:q- 15:51:17 +1 15:51:18 q- 15:51:18 +1 15:51:41 EV: is this ok? 15:51:57 DF: what feedback are you expecting? 15:52:24 EV: i'll figure out a suggestion with sarah and mail it to the list 15:52:58 DF: can you ask for consensus to add an open call ? 15:53:07 +1 15:53:12 +1 15:53:13 +1!!! 15:53:13 +1 15:53:17 +1 15:53:18 +1 15:53:47 EV: we'll discuss this next week, and i'll make a changed survey so we can discuss this 15:54:26 EV: survey will be launched monday evening, i'll sort things out with shadi w3c 15:54:39 EV: how long should we keep it open? 15:54:41 q+ 15:54:53 EV: proposal to keep it open to 10th april 15:55:19 DF: is there a deadline for final publication? 15:55:50 EV: last december.. we didn't make that 15:56:32 EV: like to finish it 15:57:21 EV: if necessary we can change it later 15:57:38 EV: if we do an open call, we'll take longer to finish 15:57:53 EV: to process everybody's results 15:57:59 Zakim, take up next 15:57:59 I see a speaker queue remaining and respectfully decline to close this agendum, MartijnHoutepen 15:58:16 q- 15:58:19 Zakim, take up next 15:58:19 agendum 3. "DoC" taken up [from MartijnHoutepen] 15:58:30 Zakim, take up agendum 4 15:58:30 agendum 4. "F2F" taken up [from MartijnHoutepen] 15:59:07 EV: we have a preliminary agenda 15:59:25 EV: no quorum there, so everything will be discussed in the group 15:59:35 Zakim, take up next 15:59:35 agendum 3. "DoC" taken up [from MartijnHoutepen] 15:59:43 Zakim, take agendum 5 15:59:43 I don't understand 'take agendum 5', MartijnHoutepen 15:59:49 bye 15:59:50 -Kathy_Wahlbin 15:59:52 bye 15:59:53 -Detlev 15:59:59 bye! 16:00:06 trackbot, end meeting 16:00:06 Zakim, list attendees 16:00:06 As of this point the attendees have been Liz, Mike_Elledge, Kathy_Wahlbin, MartijnHoutepen, +31.65.127.aaaa, Vivienne, EricVelleman, Detlev 16:00:09 -Liz 16:00:09 -Mike_Elledge 16:00:14 RRSAgent, please draft minutes 16:00:14 I have made the request to generate http://www.w3.org/2014/03/06-eval-minutes.html trackbot 16:00:15 RRSAgent, bye 16:00:15 I see no action items