13:52:38 RRSAgent has joined #eval 13:52:38 logging to http://www.w3.org/2014/06/12-eval-irc 13:52:40 RRSAgent, make logs world 13:52:40 Zakim has joined #eval 13:52:42 Zakim, this will be 3825 13:52:42 ok, trackbot; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 8 minutes 13:52:43 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 13:52:44 Date: 12 June 2014 13:54:52 Vivienne has joined #eval 13:58:19 WAI_ERTWG(Eval TF)10:00AM has now started 13:58:26 +[IPcaller] 13:59:01 richard has joined #eval 13:59:03 zakim, IPcaller is me 13:59:03 +Vivienne; got it 13:59:35 Detlev has joined #eval 13:59:52 +MartijnHoutepen 13:59:54 +[IPcaller] 14:00:01 zakim, ipcaller is me 14:00:01 +shadi; got it 14:00:42 Mike_Elledge has joined #eval 14:00:59 zakim, mute me 14:01:00 +Detlev 14:01:00 Vivienne should now be muted 14:01:14 agenda: http://lists.w3.org/Archives/Public/public-wai-evaltf/2014Jun/0007.html 14:01:15 +Mike_Elledge 14:01:22 Zakim, mute me 14:01:23 Detlev should now be muted 14:01:39 zakim, mute me 14:01:39 MartijnHoutepen should now be muted 14:01:41 alistair has joined #eval 14:02:36 regrets: Sarah, MaryJo 14:03:09 zakim, who is on the phone? 14:03:09 On the phone I see Vivienne (muted), MartijnHoutepen (muted), shadi, Detlev (muted), Mike_Elledge 14:04:27 zakim, ipcaller is alistair 14:04:27 sorry, alistair, I do not recognize a party named 'ipcaller' 14:04:29 +[IPcaller] 14:04:48 zakim, ipcaller is alistair 14:04:48 +alistair; got it 14:05:14 http://lists.w3.org/Archives/Public/public-wai-evaltf/2014Jun/0010.html 14:05:34 Is it me scribing then? 14:05:42 scribe: Detlev 14:05:54 ack me 14:06:11 Shadi posts link to final editor draft 14:06:15 Topic: Update on final Editor Draft 14:06:17 http://lists.w3.org/Archives/Public/public-wai-evaltf/2014Jun/0010.html 14:07:26 Finalising draft: Please go down disposition of comments and ensure everything is cloded one by one 14:07:48 Shadi: we should finalise the draft for the WG to revie 14:07:58 Kathy has joined #eval 14:08:29 Shadi: addressing questions regarding reorganisation of the text 14:08:29 +Kathy_Wahlbin 14:08:43 zakim, mute me 14:08:44 Kathy_Wahlbin should now be muted 14:09:12 Topic: Potential reorganization of sections in the Editor Draft 14:09:16 http://lists.w3.org/Archives/Public/public-wai-evaltf/2014Jun/0011.html 14:09:29 http://www.w3.org/WAI/ER/conformance/ED-methodology-20140610 14:09:58 http://www.w3.org/WAI/ER/conformance/ED-methodology-20140610#step1d 14:10:01 Shadi: Addressing several suggestions - first reg. step 1e 14:10:17 Step 1.d (define evaluation procedures) seems more related to the 14:10:17 use of techniques (or other methods) during evaluation (i.e. Step 4) 14:10:17 than to Step 1 14:10:44 Bad echo!!! 14:10:55 better now 14:11:35 Shadi: section 1d was flagged in test run: people were not sure what exactly to d 14:12:15 Shadi: suggest keeping the suggestions from step 1d and move to step 4 14:12:47 +1 14:12:54 Shadi: info on techniques role for testing seems a better fit in step 4 14:12:57 +1 14:13:01 +1 14:13:05 +1 14:13:07 +1 14:13:45 Resolution: move section 1d to step 4 14:14:01 http://www.w3.org/WAI/ER/conformance/ED-methodology-20140610#step3d 14:14:17 Shadi: Next on is step 3d (complete processes) 14:15:24 Shadi: (describes content of section 3d) 14:17:48 sorry Shadi, I can hear little of what you're saying 14:18:11 -shadi 14:18:15 maybe I can summarize this point? 14:18:23 ack me 14:19:15 q+ 14:19:15 please do, yes 14:19:22 q+ 14:19:25 ack me 14:19:28 q+ 14:19:33 zakim, mute me 14:19:33 MartijnHoutepen should now be muted 14:19:48 Shadi: suggestion to move parts of 3d (complete proccesses) move selection of pages that are part of the process to step 4 (explained by Martjin) 14:20:16 ack me 14:20:17 Kathy: We still need to identify complete processes in step 3 14:20:36 ack me 14:20:40 + +1.617.492.aaaa 14:20:42 zakim, mute me 14:20:42 MartijnHoutepen should now be muted 14:20:43 q+ 14:20:44 zakim, mute me 14:20:44 Kathy_Wahlbin should now be muted 14:20:55 zakim, aaaa is me 14:20:55 +shadi; got it 14:21:42 Vivienne: How does moving the choosing of the sample (incl. complete processes) to step 4 ensure that we have actuall ycovered the whole process? 14:21:55 zakim, mute me 14:21:55 Vivienne should now be muted 14:22:42 Shadi: (explaining) 1. Mark start of process in step 3 / 2. specify the exact sample in step 4 14:23:25 ack mike 14:24:04 Mike: Important to retain the idea to include complete processes in sample - step 3 still needed 14:24:29 ack det 14:26:38 Detlev: processes with decision points are often too complex to be covered exhaustively anyway - step 4 is picking those pages and states on pages that are present and need to be evaluated, as type 14:27:07 Shadi: Step 3 still valid for making the complete processes included 14:28:05 I'm fine with that as you identified just now Shadi. As long as the step stays in 3 that we identify any complete processes 14:28:32 +1 14:28:37 Shadi: OK to move evaluation of complete processes to step 4 - first two steps in algorithm remain in step 3 - items 3 and 4 in algorithm (looking at branches) go to step 4 14:28:42 1+ 14:28:46 +1 14:28:47 +1 14:29:27 Resolution: Move items 3 and 4 in algorithm in step 3d to step 4 14:29:52 http://www.w3.org/WAI/ER/conformance/ED-methodology-20140610#step4a 14:29:55 http://www.w3.org/WAI/ER/conformance/ED-methodology-20140610#step4c 14:30:48 http://www.w3.org/WAI/ER/conformance/ED-methodology-20140610#step1d 14:30:52 Shadi: Fourh point in Email was mergin 4a and 4c (referring to mailing list discussion a while back) 14:31:34 +1 14:31:41 q+ 14:32:15 ack mike 14:32:58 Mike: Makes sense to merge 4a and 4c - important not to refer to alternative version pages as compliant before they have been checked (and passed WCAG) 14:33:53 q+ 14:34:06 q+ 14:34:52 Detlev: repeating some content of the discussion of checking of pages with alternative versions 14:35:41 ack me 14:35:49 Shadi: Tow issues: what we want in the nethodology regarding the process of checking alternative versions, second merge the text (then it has to be updated anyway) 14:36:13 Vivienne: Not sure why these to sections 4a nad 4c should be merged 14:37:07 Vivenne: important to have them as separate steps - important to identify it as second steps where we discover references to alternative versions 14:38:32 Shadi: Point is that the alternative is usually identified during sampling/testing so it belongs together - now the two connected steps are interrupted by step 4b complete processes 14:38:53 q+ 14:39:37 Shadi: none of the information should be removed - the issue is moving it to those sections in the methodology where it is needed 14:39:51 zakim, mute me 14:39:51 Vivienne should now be muted 14:39:55 ack ali 14:40:17 Alistair: OK with merging 4a and 4c 14:40:50 Alistair: cursory check on default pages will be needed to check whether alternative versions are properly linked to default pages 14:41:52 Alistair: if the link is fine, evaluation should move to alternative version, homing in on default version would be unfair since the alternative stands in for it 14:42:38 Alistair: Methodology needs to rest on definition of "conforming alternative version" 14:43:50 Shadi: Alistair's case refers to a situation where the alternative version intends to be a full replacement of the default page - bu tthere are many other cases where only some content is renderd on alternative version pages 14:44:48 that's my understanding also, Shadi 14:44:49 Alistair: once a page is seen as conforming alternative version needs to be thrown out of the sample 14:45:17 Shadi: Understanding is that page and conforming version need to be seen as one entity 14:45:52 Alistair: Must not include issues for which conforming alternatives exist 14:46:12 Shadi: commissioner may want to know what is needed to avoid alternative version altogether 14:46:41 q- 14:46:42 q? 14:46:51 -q 14:46:56 +1 14:46:58 q+ 14:47:01 +1 14:47:03 Merge ok by me 14:47:15 I have an alternative suggestion 14:47:16 +1 14:49:24 Suggestion to move section 4c to place 4b so it is adjacent to 4a - keeping checing SCs and checking alternative versions close together 14:49:43 Shadi: having them as separate checkpoints is a bit unnatural 14:49:51 I agree (/pesonally) 14:50:01 q+ 14:50:13 +1 14:50:22 ack me 14:50:30 q- det 14:50:34 Resolution: Merge step 4a and 4c, make sure that content is preserved 14:51:26 Martjin: moving 4b back could mean that you lose a check whether a complete process as an alternative accessible version 14:51:40 Marttjin: swapping may not work well therefore 14:51:45 zakim, mute me 14:51:45 MartijnHoutepen should now be muted 14:52:18 q+ 14:52:39 Martjin: 4d is needed on every page as well 14:52:45 ack ali 14:52:50 Shadi: difficult to design it so that it flows well 14:53:58 Alistair: Wonders whether 4 c and 4d should be merged to ensure that the five conformance requirements are check in sync 14:55:18 Alistair: $c and $d are linked - this should be checked first to then split off into checking accessible alternatives, for those without alternaitves you would check all SCs 14:55:28 step 4a+4c+4d == ¨Check each page for the conformance requirements¨ 14:56:21 Shadi: There were no requirements to remove info - changed order has a different flavour 14:56:33 q+ 14:56:43 q- 14:56:43 q- 14:57:10 Shadi: will ty to take a stab at reordering step 4 sections 14:57:15 -Kathy_Wahlbin 14:58:02 Shadi; Last issue is to merge 3a 3b and 3c because they are small and some evaluators were confused 14:58:08 Shadi; Last issue is to merge 3a 3b and 3c because they are small and some evaluators were confused 14:58:43 Shadi: Wants to merge without losing any info - would be more straighrfoerward guidance 14:58:52 ack me 14:58:55 +1 14:59:21 Martlin: Likes hoe 3 a - b- c- maps onto 2 a - b -c 14:59:39 Martjin: Seemd natural in the test run 15:00:28 Shadi: Some comlpained about frequent cross-referencing between sections, so this is what should be addressed 15:00:34 zakim, mute me 15:00:34 MartijnHoutepen should now be muted 15:00:55 sure 15:01:02 Topic: Next steps 15:01:31 Shadi: will finish final editor draft together with Eric 15:01:46 Shadi: Final draft brought to WG review 15:02:35 Shadi: Either TF wants to see editor draft first or Shadi and Eric are given carte blanche to finsalise it and move it to WG review 15:02:38 q+ 15:03:08 Go straight to review by other groups 15:03:28 Mike: Would like to take a final look at the draft 15:03:44 ack mike 15:04:05 Shadi: fair dos - we discussed a lot of changes today, also not all comments addressed 15:04:06 q+ 15:04:09 I'd like another look 15:04:26 Alistair: straight to review 15:04:30 agree with alistair 15:04:51 Detlev: don't mind if you finalise and it goes straight to review 15:05:30 Either way! 15:05:43 yes please just because there are lots of changes 15:06:43 Alistair: no worth to have a version to look at without option to change it over again 15:06:56 Shadi: Sure changes could still be made 15:07:24 Alistair: why not going via the list so people can review it and object if they find issues 15:08:26 Detlev: What we discussed today aren't substantial changes 15:08:55 ack me 15:09:03 Shadi: if preview is wanted that should respected 15:09:03 q- 15:09:09 q+ 15:09:39 Vivienne: will go with wht group as a whole decides - may still be useful to look at the changes, also on the list 15:10:17 Shadi: to be clear: sending it to the WG means there wil be a survey where anybody can provide feedback 15:10:37 Vivienne: easy with that 15:11:17 zakim, mute me 15:11:17 Vivienne should now be muted 15:11:21 Shadi: another few weeks needed to address coments from WG review proccess 15:11:49 Mike: will go with group as a whole, yields to majority 15:12:55 Shadi: suggests to wrap up comments (earliest on Monday for ppl to look at) - WCAG meting already on Tuesday so it's tight 15:13:24 Shadi: will send update to list ppl can then agree / object to sending to to WG review 15:13:54 ack me 15:13:55 okay, good night all 15:14:00 Bye 15:14:02 -alistair 15:14:03 Thanks all! Especially Shadi and Eric!! 15:14:03 -MartijnHoutepen 15:14:05 -Detlev 15:14:07 -shadi 15:14:08 -Mike_Elledge 15:14:38 -Vivienne 15:14:39 WAI_ERTWG(Eval TF)10:00AM has ended 15:14:39 Attendees were Vivienne, MartijnHoutepen, shadi, Detlev, Mike_Elledge, alistair, Kathy_Wahlbin, +1.617.492.aaaa 15:14:56 trackbot, end meeting 15:14:56 Zakim, list attendees 15:14:56 sorry, trackbot, I don't know what conference this is 15:15:04 RRSAgent, please draft minutes 15:15:04 I have made the request to generate http://www.w3.org/2014/06/12-eval-minutes.html trackbot 15:15:05 RRSAgent, bye 15:15:05 I see no action items