13:55:38 RRSAgent has joined #eval 13:55:38 logging to http://www.w3.org/2012/08/16-eval-irc 13:55:40 RRSAgent, make logs world 13:55:42 Zakim, this will be 3825 13:55:42 ok, trackbot; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 5 minutes 13:55:43 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 13:55:43 Date: 16 August 2012 13:55:56 zakim, this is evaltf 13:55:56 sorry, shadi, I do not see a conference named 'evaltf' in progress or scheduled at this time 13:55:58 zakim, this is eval 13:55:59 shadi, I see WAI_ERTWG(Eval TF)10:00AM in the schedule but not yet started. Perhaps you mean "this will be eval". 13:56:10 zakim, this will be eval 13:56:10 ok, shadi; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 4 minutes 13:56:11 Detlev has joined #eval 13:56:59 vivienne has joined #eval 13:57:50 Liz has joined #eval 13:58:36 WAI_ERTWG(Eval TF)10:00AM has now started 13:58:44 + +1.301.975.aaaa 13:59:04 +Detlev 13:59:10 +[IPcaller] 13:59:11 zikim, aaaa is Liz 13:59:14 richard has joined #eval 13:59:31 +??P12 13:59:35 +MartijnHoutepen 13:59:37 zakim, ??p12 is me 13:59:37 +shadi; got it 13:59:39 zakim, ??P12 is me 13:59:39 I already had ??P12 as shadi, vivienne 13:59:57 zakim, IPcaller is me 13:59:57 +vivienne; got it 14:00:06 +??P15 14:00:08 Zakim, mute me 14:00:08 Detlev should now be muted 14:00:11 zakim, mute me 14:00:11 MartijnHoutepen should now be muted 14:00:42 korn has joined #eval 14:00:50 aurelien_levy has joined #eval 14:00:52 zakim, who is on the phone? 14:00:52 On the phone I see +1.301.975.aaaa, Detlev (muted), vivienne, shadi, MartijnHoutepen (muted), ??P15 14:01:00 zakim, mute me 14:01:00 vivienne should now be muted 14:01:41 + +1.517.353.aabb 14:02:02 zakim ??p15 is richard 14:02:04 +hhalpin 14:02:10 Zakim, aaaa is Liz 14:02:10 +Liz; got it 14:02:11 zakim, aabb is Mike 14:02:12 +Mike; got it 14:02:32 Zakim, Oracle has Peter_Korn 14:02:32 sorry, korn, I do not recognize a party named 'Oracle' 14:02:34 +[Oracle] 14:02:40 zakim, ??p15 is richard 14:02:40 +richard; got it 14:02:42 Zakim, Oracle has Peter_Korn 14:02:42 +Peter_Korn; got it 14:02:55 zakim, who is on the phone? 14:02:55 On the phone I see Liz, Detlev (muted), vivienne (muted), shadi, MartijnHoutepen (muted), richard, Mike, hhalpin, [Oracle] 14:02:57 [Oracle] has Peter_Korn 14:03:20 i think it's me 14:03:27 + +1.978.760.aacc 14:03:36 zakim, hhalpin is aurelien_levy 14:03:36 +aurelien_levy; got it 14:03:55 zakim, aacc is Kathy 14:03:55 +Kathy; got it 14:04:11 zakim, who is on the phone? 14:04:13 On the phone I see Liz, Detlev (muted), vivienne (muted), shadi, MartijnHoutepen (muted), richard, Mike, aurelien_levy, [Oracle], Kathy 14:04:13 [Oracle] has Peter_Korn 14:04:36 Mike_Elledge has joined #eval 14:05:16 q+ 14:05:45 q+ 14:05:46 ack me 14:06:07 zakim, mute me 14:06:07 MartijnHoutepen should now be muted 14:06:45 q- 14:08:48 scribe: Mike 14:08:53 scribenick: Mike_Elledge 14:09:10 Mike will scribe today. 14:09:41 The new comments. Reminder sent out survey last week and updated draft. 14:09:47 http://www.w3.org/WAI/ER/conformance/ED-methodology-20120730 14:10:26 Dated July 30. Complete document. See editor notes for changes. 14:10:33 https://www.w3.org/2002/09/wbs/48225/WCAG-EM20120730/results 14:11:21 Will show approval or not. May get more comments from WCAG working group. Hopefully will also approve publication. 14:11:52 http://www.w3.org/WAI/ER/conformance/comments-20120730 14:11:54 At stage where most public comments addressed in doc, and gotten approval from this group to go ahead and publish. 14:12:37 Revised doc based on survey, pls review by next Monday, if not sooner. Will incorporate comments into working draft. Need 3-4 days to look over them. 14:12:47 huge apologies all for not doing my review this week - I wasn't able to get the survey done and wish I'd been able to do my share. Sorry 14:13:24 http://www.w3.org/WAI/ER/conformance/comments-20120730#c2 14:13:33 Kathy has joined #eval 14:14:34 Will not go over comments now. Mostly simple changes and fixes. A couple will need more thought and discussion. One is #2: Link document from Wane Guage? Does not have official standing, but want discussions to elicit more comments. 14:14:41 q+ 14:15:08 ack korn 14:15:39 Want agreement to open issue on referencing related resources. Will work on issue after publication. 14:16:24 s/Wane Gauge/WAI Engage 14:16:38 Connection is not as clear as usual. But we will persevere! 14:17:43 Peter: LIke the idea of what WAI is trying to do, so want to explore linkages. Maybe in appendix some foreshadowing. Different roles in website dev, some roles have different impacts on WCAG criteria. 14:17:46 appendix for these type of links +1 14:17:56 q+ 14:18:05 q- 14:18:14 Peter: "May find this info helpful." To provide reference, for information purposes. 14:18:22 Shadi: Before publication? 14:18:43 ack me 14:18:45 P: Doesn't need to be before draft publication. Yes to final. 14:19:48 V: In some WCAG criteria, have related resources. Provided but not endorsed statement. Some additional help, not required. Keep for next pub working draft. Not needed for this one. 14:19:56 zakim, mute me 14:19:56 vivienne should now be muted 14:20:48 Sh: Okay, great. No objections. We can revisit. When we pub next working draft, ed outreach working group will be involved. Asked them to complete review. Then joint mtg at Tech Plenary. Spend full day talking about it. 14:21:05 Sh: Editorial refinements when have full doc standing. 14:21:07 http://www.w3.org/WAI/ER/conformance/comments-20120730#c5 14:21:46 http://www.w3.org/WAI/ER/conformance/comments#c001 14:22:13 q+ 14:22:17 Sh: #5 from Detlev. More guidance on defining minimum stds for web browsers and AT. Baseline. Before A. Chen commented, asked to completely remove it. Proposed resolution: open issue on how to provide tool support. 14:22:50 Will be fairly tricky. What guidance should we provide. Issue has been present since beginning. 14:22:58 ack korn 14:23:09 P: Will we note in draft what issues are, so public can know that there is known issue? 14:23:32 Sh: Yes, usually have pointers asking for feedback. Linking to issue will also be helpful. 14:23:58 Sh: In status section of document. What input looking for. 14:24:01 P: Makes sense. 14:24:38 Sh: We will entertain motion to accept resolution of this issue to address both comments. 14:24:43 fine with me... 14:24:44 http://www.w3.org/WAI/ER/conformance/comments-20120730#c6 14:24:47 +1 14:24:59 +1 14:25:05 +1 14:25:22 +1 14:25:40 -Kathy 14:26:01 q+ 14:26:05 ack me 14:26:05 Sh: #6 from Detlev. Ambiguity between "tool" for eval tools and AT. When reading doc usually not mixed. Not referenced at same time. Need longer revision, nonetheless. Propose we work on with Ed Outreach. 14:26:07 +1 14:26:14 ack detlev 14:26:15 +Kathy 14:26:51 D: Maybe introduce abbreviations of UA and AT. Whatever way, not a big issue if clear from context. But prefer clear-cut definitions throughout. 14:27:16 Zakim, mute me 14:27:16 Detlev should now be muted 14:28:01 Sh: Don't disagree. Usually at beginning of section is defined. Not so unclear from context, not major issue, but still good to go over this. Acronyms or something else, should address with editorial staff. 14:28:14 http://www.w3.org/WAI/ER/conformance/comments-20120730#c17 14:29:25 #17 from Kathy Waldin and Detlev. Tricky one. Two distinct examples from webpage (?). Could be more depending on situation. Not straightforward to get this right. Evaluator' 14:29:54 's call on how many pages are appropriate. Suggestion to keep working on this to get it right, including public comment. 14:29:56 +1 14:30:11 q+ 14:30:13 Sh: Does this need to be fixed for next draft? 14:30:14 ack me 14:30:33 D: Fine to open to discussion then. Don't hold back publishing draft. 14:30:39 Zakim, mute me 14:30:39 Detlev should now be muted 14:30:43 K: I agree. Warrnets further discussion. 14:30:58 Sh: Worth discussing, won't be easy. 14:31:08 q+ 14:31:12 K: Can clarify it though. Get input. 14:31:13 ack me 14:31:33 Tim has joined #eval 14:31:33 q+ 14:31:51 D: Adding page states into draft. If page has several different states should be indentified, just like pages. If no objection, would like to add to draft. 14:32:10 Zakim, mute me 14:32:10 Detlev should now be muted 14:32:33 Sh: You raised that as comment. Proposed resolution to include state of webpage. May apply to more than one section. 14:32:51 Sh: Should be addressed in this draft. 14:32:58 ack korn 14:33:48 P: Treatment of web apps and advice to evaluators on how to look at web applications is large and significant. Adding "page states" won't be sufficient. Putting reminder in before publication is fine but won't have finished by doing that. 14:34:18 is "state of webpage" or "page state" well defined? Do we need definition? 14:34:40 Sh: Anticipate comments on web apps. See #13B. Not only "states of web page" but also section of document. Address more comprehensively than in previous drafts. Keep comments coming. 14:35:18 P: Thinking of opening issue about deeper review of web apps. We should remember. 14:36:01 Sh: This group also welcome to put comments on public draft. Ideally get it before, but if not can add them there. For everyone to review and comment. 14:36:04 +Tim_Boland 14:36:17 http://www.w3.org/WAI/ER/conformance/comments-20120730#c32 14:36:46 Kathy has joined #eval 14:37:30 Sh: #32: Providing a11y statement in document. Owner commits to remove any problems within ten days. Purpose response within ten days. Will get lots of comments. 14:37:39 T ?: Why ten? 14:38:20 s/T ?/TB/ 14:38:35 q+ 14:38:38 Sh: Anticipate quite some comments. Open an issue in any case. Look into more detail. What are conditions of a11y statement based on EVAL, we should put conditions and requirements. 14:38:40 +1 for me 14:38:51 +1 14:39:22 P: Uncomfortable with suggesting that a11y statement has to include resposnej/compliance within a atime period. 14:39:46 Sh: Peter please look at it and respond--by Monday? 14:39:59 P: How best done? 14:40:16 Sh: Just respond to latest email for group to respond to comments. 14:40:22 P: Sent an hour ago? 14:40:25 Sh: Yes. 14:40:31 P: Will do that now. 14:41:00 Sh: Maybe put in some more about your discomfort and proposed revision. 14:41:06 P: Yep. 14:41:29 Sh: Also, do you oppose opening issue to discuss? 14:41:35 P: Don't mind at all. 14:41:49 no opposition 14:42:00 I agree with Peter - it is not in our remit to specify how and when corrections should be made 14:42:04 Sh: Keep as is and discuss, or not publish. Two choices. Can take out and come back later. 14:42:18 no objection 14:42:22 http://www.w3.org/WAI/ER/conformance/comments-20120730#c34 14:42:24 Sh: Seems some agreement. Will be good discussion. 14:42:28 http://www.w3.org/WAI/ER/conformance/comments-20120730#c35 14:42:52 Sh: #34 and #35. Objectivity and repeatiblity of methodology. 14:43:31 http://www.w3.org/WAI/ER/conformance/comments#c004 14:43:53 Sh: Evaluator has responsibility for objective assessment. ? Also says it's important for methodology to be objective. Also needs to be "Goodness" criteria. 14:44:34 Will be a lengthier discussion. Our plan is to have first final version by December. 14:44:47 Open issue to come back to this later. Won't be easy to address now. 14:44:59 q+ 14:45:00 no, I'm okay with doing it later 14:45:04 +1 14:45:06 ack me 14:45:08 Sh: Needs to be resolved/discussed before publication? 14:46:01 D: Not sure it makes sense to open. Since not sure how we define goodness and objectivity. How can we define it? Don't see need to discuss. 14:46:21 ericvelleman has joined #eval 14:46:53 Sh: Part of reason to define understanding of what it is. If evalutors follow methodology should have same outcome. But method not only factor. Many variables. 14:47:06 I'm fine with that discussion 14:47:21 + +31.65.127.aadd 14:47:33 q* 14:47:38 Sh: How do we reduce variability in methodology. Worth discussion. May not be able to address in next draft. May depend on practice after publication in Dec. 14:47:38 q+ 14:47:56 q- 14:48:02 can we have a recap on the face 2 face meeting in lyon ? 14:48:05 Erik: In Ministry of Interior--not a good place to get Internet. 14:48:08 q- 14:48:53 Sh: Completes all the comments we agreed to discuss later. Since no objections except #32, may be able to close comments and approve publication of this draft next week. 14:49:08 I support Aurelien's suggestion 14:49:26 q+ 14:49:26 q+ 14:49:33 Sh: Look at two comments: #29 and #30. For those we will add to proposal hopefully tomorrow. 14:49:46 Sh: Will go over Lyons meeting at end of call. 14:50:44 q- tim 14:50:48 T: Comments we will have after draft, will we note still under discussion. So people will know they haven't disappeared. 14:51:02 Sh: Will ask for specific comments on those. 14:51:10 q- korn 14:51:15 P: What is review period for public review. 14:51:36 Sh: Typically 3 weeks with W3C. Will extend to 4 weeks to be sufficient. 14:52:21 P: Just realizing what is consuming time WCAG to ICT and 376, somewhat longer review period will be wise. Espec. how much text came in at end of editor's draft. 14:52:30 q- 14:52:42 Sh: Let's talk about it next week. Need to make Dec deadline as well. 14:53:15 http://www.w3.org/WAI/ER/conformance/comments-20120730#c24 14:53:23 Sh: #29 & #30 will send out proposals. Another comment needs more time for discussion: Use of templates #24. 14:53:44 http://www.w3.org/WAI/ER/conformance/comments-20120730#c13a 14:54:07 Sh: Several comments mentioned our emphasis on templates. Related comment #13a to reduce it. Will be implemented in next draft, unless objections. 14:55:16 Sh: Encourages evaluators to review templates themselves so can identify issues that might not otherwise be found. Some webpages are using templates but hard to see on web page. For instance, identify templates adn where they are. 14:55:22 Sh: Can then find them on pages. 14:55:36 q+ 14:55:54 ack me 14:55:55 Sh: Detlev said makes sense/doesn't make sense to evaluate tetmplates. What do you all thik. 14:56:33 q+ 14:56:52 V: I particularly look at templates, so don't have to mention issue on each page separately. Call Site-wide issues. Will provide visual map on template. Will refer to template area when find on pages. 14:57:18 -Liz 14:57:21 V: Will clutter otherwise. Still put Pass/Fail, but refer so don't have to discuss on every page. 14:57:40 ack me 14:57:41 Sh: Template, repeated content, and 14:57:41 ack me 14:58:02 ack me 14:58:10 D: Can you explain how you evaluate template? Use page with template, or extract template? 14:58:34 Zakim, mute me 14:58:34 Detlev should now be muted 14:59:10 V: Ask commissioner to point me to common templates that are used. Then evaluate common elements on that template. Quite often have to evaluate specific areas, but will review common areas, like navigation, footer, etc. separate from content. 14:59:24 V: Make sure content is still looked at. 14:59:27 ack me 15:00:03 D: Still wonder if look at template do you look at page that contains that template, or look at template itself. 15:00:19 V: Separate template. 15:00:55 D: Look at skip links on page to make sure they go to right place. 15:01:07 Zakim, mute me 15:01:07 Detlev should now be muted 15:01:33 V: Yes, but can look at common areas. 15:01:41 zakim, mute me 15:01:41 vivienne should now be muted 15:01:52 ME: Like looking at templates within Dreamweaver. 15:02:20 Sh: Depends on type of template. Many types, including empty templates like Detlev said. 15:02:40 Topic: Upcoming face-to-face meeting 15:02:46 Sh: Need to discuss and decide on how much emphasis to put on templates. Everyone encouraged to comment. 15:03:35 Sh: Lyons meeting: Monday and Tuesday. Potentially meet Tuesday with Educ Outreach Working Group, they publish the WAI resources on the home page. Excellent communication and education skills. 15:03:43 q+ 15:04:22 Sh: Monday will be working on closing comments still open. Assuming publishing beg of December, 4 week comment period beg October, will use time to discuss thornier topics. 15:05:03 Sh: Will be a subgroup, so can't make final decisions. Will have to bring back solutions. Need people to register so know who will be there. 15:05:30 P: Registration. If know can't come, can we register in negative? 15:05:41 Sh: No, unfortunately. 15:05:50 ME: Mike Elledge can't come either. 15:06:15 P: Any possibility for teleconferencing to discussions? 15:06:15 good suggestion (phone participation)! 15:06:34 that would be great if possible 15:06:53 Sh: Depends on agenda. Will request phone participation. Sometimes difficult to coordinate, vote. Will think about more. 15:06:59 +1 15:07:54 Sh: Also will be early in day for US or late for Australia. Don't want to exclude, but sometimes better to just have a follow-up. 15:07:58 -Tim_Boland 15:08:06 q- 15:08:15 Sh: Maybe discuss particular topics on phone. 15:08:59 Thank you very much Shadi! 15:08:59 okay, thanks Shadi. 15:08:59 Sh: Please review comments. Hope you'll be in agreement with proposed solutions. Wrap up via email. Then publish. 15:08:59 ack me 15:09:01 bye 15:09:02 vivienne has left #eval 15:09:02 yesbye 15:09:03 -Kathy 15:09:04 Ciao. 15:09:05 -[Oracle] 15:09:06 -vivienne 15:09:08 bye 15:09:11 -Detlev 15:09:13 -shadi 15:09:14 -aurelien_levy 15:09:14 -Mike 15:09:15 - +31.65.127.aadd 15:09:18 ericvelleman has left #eval 15:09:18 -richard 15:09:25 leave #eval 15:09:29 MartijnHoutepen has left #eval 15:09:53 -MartijnHoutepen 15:09:55 WAI_ERTWG(Eval TF)10:00AM has ended 15:09:55 Attendees were +1.301.975.aaaa, Detlev, MartijnHoutepen, shadi, vivienne, +1.517.353.aabb, Liz, Mike, richard, Peter_Korn, +1.978.760.aacc, aurelien_levy, Kathy, Tim_Boland, 15:09:55 ... +31.65.127.aadd 15:16:26 korn has left #eval