13:56:54 RRSAgent has joined #eval 13:56:54 logging to http://www.w3.org/2013/07/25-eval-irc 13:56:56 RRSAgent, make logs world 13:56:56 Zakim has joined #eval 13:56:58 Zakim, this will be 3825 13:56:58 ok, trackbot; I see WAI_ERTWG(Eval TF)10:00AM scheduled to start in 4 minutes 13:56:59 Meeting: WCAG 2.0 Evaluation Methodology Task Force Teleconference 13:56:59 Date: 25 July 2013 13:58:28 ericvelleman has joined #eval 13:58:31 Liz_ has joined #eval 13:59:05 MartijnHoutepen has joined #eval 13:59:10 WAI_ERTWG(Eval TF)10:00AM has now started 13:59:17 +Liz 13:59:47 + +31.30.239.aaaa 13:59:56 Vivienne has joined #eval 14:00:00 Zakim, aaaa is me 14:00:00 +MartijnHoutepen; got it 14:00:17 + +31.65.127.aabb 14:00:26 +[IPcaller] 14:00:27 +Shadi 14:00:31 zakim, IPcaller is me 14:00:31 +Vivienne; got it 14:00:50 Zakim, aabb is me 14:00:50 +ericvelleman; got it 14:01:12 + +1.313.322.aacc 14:01:25 chair: Eric 14:01:38 regrets: Detlev 14:01:56 Mike_Elledge has joined #eval 14:02:23 korn has joined #eval 14:02:28 Mike will be scribe 14:02:49 I'll be on the call in a few moments.. 14:02:50 zakim, aacc is Mike_Elledge 14:02:51 +Mike_Elledge; got it 14:02:58 scribe: Mike_Elledge 14:03:04 zakim, mute me 14:03:04 MartijnHoutepen should now be muted 14:03:33 EV: Welcome 14:03:38 Kathy has joined #eval 14:03:48 Ev: Weather report NV 14:03:57 +Kathy 14:04:37 EV: Following next week, next two telco will be cancelled 14:05:32 EV: We'll be working on rewrite of reporting section, including sample reports. 14:05:36 +Peter_Korn 14:05:50 zakim, mute me 14:05:50 Vivienne should now be muted 14:06:12 Ev: Before publishing will have add continents level to document 14:06:18 Zakim, who is talking? 14:06:29 korn, listening for 10 seconds I heard sound from the following: Mike_Elledge (20%), ericvelleman (85%) 14:06:50 EV: Will have discussion next on agenda items. 14:07:19 Item 2: 14:07:52 MoeKraft has joined #eval 14:08:06 zakim, mute Mike_Elledge 14:08:07 Mike_Elledge should now be muted 14:08:08 +MoeKraft 14:08:08 https://www.w3.org/2002/09/wbs/48225/evaltfq10/results 14:08:23 Eric, I sent mine by email as I was too late to respond to the survey 14:09:00 EV: Survey #10. Number of people have responded. Go through survey answers and results need some discussion. Generally accepted resolution. If any problem can come back later. 14:09:29 Ev: Worked on comments in survey in coming week. New editor draft for next week. 14:09:51 EV: Going through survey comments. First, could everyone find results of survey? 14:09:52 I can't get into it 14:09:56 yes 14:09:58 yes 14:10:02 PK: Yes. 14:10:13 ack me 14:10:22 EV: Does it need another backslash. 14:10:31 VC: Tells me can't take survey. 14:10:54 EV: Is there something I can do to open it up? 14:10:57 https://www.w3.org/2002/09/wbs/48225/evaltfq10/results 14:11:03 S: Anyone else have issue? 14:11:23 VC: Can't get into task force stuff. 14:11:31 EV: Strange. 14:11:44 VC: Can you check my password. 14:11:53 S: Will Follow-up offline. 14:12:05 VC: Can see, but can't respond to questions. 14:12:16 EV: Reopened it. Should be okay. 14:12:39 q+ 14:13:00 q? 14:13:08 EV: Change to Core Functionality. All accepted. Frederick suggested change. Functionality relied upon. A different concept. Why changed to Core Functionality. 14:13:34 q- 14:13:42 PK: Have CF. Functionality isn't relied on for web pages, it what's core. Better as you've suggested it. 14:13:59 zakim, mute me 14:13:59 Vivienne should now be muted 14:14:01 EV: Any objection to change? 14:14:32 EV: Okay. No objections to change as proposed. Will get back to Frederick. 14:14:59 q+ 14:15:23 EV: #2: Number of comments, acceptance of resolution. To add defintion of term conformance. Not to add Satisfy Success Criteria. Couldn't find in document. So why proposed not to include it. 14:16:21 PK: Agree with idea not use Satisfy as SC. WRT WCAG document thought about new section what does document mean for conformance. Challenges wrt site where can't test every page or user interaction w every page. 14:16:40 PK: Why don't disagree, feel should move ahead. Taking stab at it. Want to discuss now? 14:17:02 EV: Good to discuss, since will start to rewrite. New Seciton on Conformance. 14:18:11 PK: My recollection is agreed to section, talk about conformance has to be lookd at differently when sampling. Conformance = looked at everything. Not what we can do. Our review has to do what have been able to do. 14:18:33 PK: Have sketched out some points for Conformance Section. What to hear? 14:18:48 q+ 14:18:53 EV: This is about definitions. Maybe 14:19:16 * shadi, still can't get in - changed my password okay, but can't get into the survey 14:19:24 PK: WcAG work had Glossary terms, then had key terms separately. May want to do that with conformance. 14:19:26 q- 14:19:38 EV: Later agenda point. 14:20:31 Success Criteria - For each guideline, testable success criteria are provided to allow WCAG 2.0 to be used where requirements and conformance testing are necessary such as in design specification, purchasing, regulation, and contractual agreements. In order to meet the needs of different groups and different situations, three levels of conformance are defined: A (lowest), AA, and AAA (highest). Additional information on WCAG levels can be found in Underst[CUT] 14:20:31 MK: Don't talk about success creterion, but criteria. Quick search in WCAG there is def for SC. Since trying to use common terms, should we define SC or link back. Here's the definition I found. 14:20:54 MK: from the guidelines. 14:21:03 MH: Already in documents? 14:21:19 EV: Thought we had but don't. 14:21:33 MK: Simple to add that link. 14:21:55 EV: 43 times in document, maybe relevant. 14:22:26 q+ 14:22:39 EV: Everyone agrees? But question is Satisfies SC. that is not really something we're looking at. Therefore point back to SC. But can add defintion since it's in there 43 times. 14:23:08 PK: Going back to first item. Common Functionality is #2, change to Core Functionality if make change. Capture somewhere. 14:23:14 EV: Will change. 14:23:25 PK: Common webpages becomes core webpages? 14:23:34 EV: Didn't talk about it. 14:24:03 PK: Looking at definition. Mean common to be core. 14:24:29 EV: Add defition of SC (Moe), Turn Common to Core (PK) webpages. 14:24:39 +q 14:24:41 PK: Change 3A to reflect that. Same concept. 14:25:19 EV: let's vote. Adding SC to terms and definitions list. Objections? Add reference to WCAG. 14:25:36 PK: That's my queston. Do as relied upon. 14:25:45 EV: Anyone object> 14:26:06 Shadi: Abbreviated change since it will be major, so everyone can see. 14:26:17 PK: Where do we use Satisfy Success Criteria? 14:26:28 EV: A third item! 14:27:11 EV; Docuemnt doesn't talk about satisfying SC. So make one change; other isn't relevant. 14:27:18 EV: Change SC? 14:27:41 PK: WCAG doesn't define SC. ONly Satisfaction. Not in Glossary terms. 14:28:13 It is in Layers and Guidance. 14:28:30 Who was just speaking? 14:28:46 PK: Put in whole paragraph. Doesn't make sense to me. 14:29:00 EV: Thought there was a concise definition. 14:29:12 ?: Do say meeting success criteria. 14:29:32 ?: Moe can you mention reference again? 14:29:37 PK: Reappears in 4. 14:30:13 Scribe: MK was ? previously. 14:30:23 Methodology Requirement 1.d: Specify the techniques and failures (that have been documented by W3C and others as meeting the Success Criteria) that will be used to evaluate WCAG 2.0 Success Criteria. (Optional). 14:30:26 EV: Read out status. Get to root of issue. 14:31:07 MK: 3rd paragraph...not necessary to use specific techniques...emply methods that meet WCAG 2.0 success criteria. 14:31:16 PK: Then in next paragraph also appears. 14:31:30 MK: Good practice to follow WCAG techniques 14:31:55 EV: Step 4...to which there is no matching content are considered to be satisfied... 14:32:17 MK: Also in Step 4c "met WCAG success criteria when..." 14:32:33 EV: Change met to satisfies to be consistent? 14:32:47 PK: Bigger change, refer to meet in various places. 14:32:50 S: 14:33:01 PK: Use meet in many, satisfy in a few. 14:33:14 S: Would using Satisfy satisfy MK 14:33:18 's concern. 14:33:31 MK: Was trying to find Satisfying 14:33:53 EV: Introduction in 4 provide link to satisfying success criteria. 14:34:08 EV: Problem if we substitute satisfy for meet? 14:34:43 PK: My concern. Use meet many places. Need more careful review and audit, Rather than global search and replace. Need to understand Meet first. 14:34:56 q? 14:34:58 PK: Not prepared to vote on it. 14:35:11 on another subject, so no problem 14:35:54 Shadi: IN some place use Meet in WCAG. Interchangeable. Layers of Guidance, bullet item sufficient and advisory techniques, uses meeting success criteria. Agree that needs more careful look through. 14:36:04 q? 14:36:07 q- 14:36:14 EV: Not an easy search and replace. 14:36:17 ack me 14:37:12 MH: Different subject. Can wait if necessary. Point out that common functionality to core agree, but core webpages not the same. Common webpages are typical to webpages. So not in favor of change. 14:37:20 EV:. Let's come back to it. 14:37:34 zakim, mute me 14:37:34 MartijnHoutepen should now be muted 14:38:29 EV: Just add definition of success criteria. Meet vs. Satisfy. Do we add defition to this document. Walk through document, find out if used in same way, or can be interchangeable. 14:38:41 EV: Someone volunteer? 14:39:05 S: Let you and I look at it. Then see if we've missed any occurrances. 14:39:10 EV;Fine. 14:39:34 EV: Adding definition...satisfies into document? 14:39:46 PK: Look into after your and Shadi's review. 14:40:34 PK: Question those places where we are using WCAG terms, quoting directly. Why not hyperlink? Have items in glossary if we're using it differently. 14:40:38 +1 14:41:07 EV: If use meet or satisfies...so many times just add iinto terms and definitions. 14:41:56 PK: More generally. Website is something we define. Relies upon from WCAG 2.0. Would put sentence at top of terms and defs section "Where there is a difference between us and WCAG define below." 14:42:09 -Shadi 14:42:09 PK: Webpage would be one. Complete processes would be one." 14:42:31 q? 14:42:50 Ev: Shadi and I will look into. Also defning things already defined in WCAG 2.0. 14:42:51 +Shadi 14:42:57 q? 14:43:03 q+ 14:43:25 EV: Proposal to change common web pages to Core. MH already commented. 14:44:01 q+ 14:44:07 +q to speak to Shadi 14:44:19 Shadi: React to Peter's comment. Need to look back, don't feel comfortable to removing terms. They are essential. They are relied upon to differentiate form wCAG. 14:45:01 Shadi: With success criteria ppl should know what it is and we link back. Should look back at clarity, satisfy vs. meet, make sure we don't define something new. 14:45:41 Shadi: Not as essential to eval process as technologies relied upon is. Want to clarify the impact of removing them. 14:46:11 EV: Want to be able to go through document without having to go to another. Reason to add some things already in WCAG 2.0 14:46:12 q? 14:46:41 q- 14:46:55 q- 14:46:56 PK: Don't feel so strongly about it. Complete processes used 3x, in methodology, link to WCAG. Would be more compact. But don't feel strongly about it. Fine with key words remaining. 14:47:09 q- m 14:47:42 EV: Core webpages. Would like to know what others think. Use common for webpages and keep core for functionality. Anyone? 14:47:48 q+ 14:48:01 q+ 14:48:42 PK: We talked about...will look at survey results. Thinking about and reacting to...starting to become convinced by Martijn's arguments. 14:48:43 ack me 14:48:54 K: Agree with Martijn. 14:50:01 Shadi: Recall discussions about more general misunderstandings for someone reading new evaluating some pages, editorial, core gets into more critical aspects, more importanly how we call them 14:50:09 and refer to them in document. 14:50:17 EV: Leave discussion for now. 14:50:46 EV: A number of commmetns, can read them on discussion list 14:51:30 EV: Changes to scope of document. Detlev comment. Not on call. Leave for next time. Should be in changes to scope, maybe? Also still discussion. Leave for the moment discuss next week. 14:51:57 EV: Leaves us time to discuss PK conformance and smaple size. 14:52:28 EV: What influences sample size. Discussion lacking on that. GEts itno confidence level of results. 14:53:15 Ev: Idea to make list of all parameters that should be considered. Need volunteer to do some writing. Want 12 items to each have short description. So we can all agree what we're talking about. 14:53:27 EV: Maybe a few persons would like to do. 14:53:33 http://lists.w3.org/Archives/Public/public-wai-evaltf/2013Jul/0028.html 14:53:39 MK: Is that the list... 14:53:45 EV: See in IRC. 14:53:46 q+ 14:54:03 q+ 14:54:05 EV; 7.1 get to 12 points there. 14:54:22 q- 14:54:23 MK: Want short description? Will do. 14:54:25 q- 14:54:26 q? 14:54:32 ack me 14:54:47 VC: Sent another one to the list. Not sure how to get to the 12. 14:55:01 VC: Have emailed to list. Should be near top. 14:55:30 zakim, mute me 14:55:30 Vivienne should now be muted 14:55:33 VC: Put a few lines describing what I meant. 14:55:40 MoeKraft has joined #eval 14:55:54 http://lists.w3.org/Archives/Public/public-wai-evaltf/2013Jul/0038.html 14:55:54 mK: Great 14:56:13 EV: Section on Conformance. 14:56:45 Mike - the last comments were from Kathy not Moe 14:57:24 PK: The 4 general bullets: 1. Restate WCAG 2.0 for single page if there isn't a violation at AA, AAA . Can't reasonably evaluate every page. The WCAG defines subset, to ascertain how it is likely to confrorm. 14:57:44 PK: Then provide some confidence level as it applies to entire website. 14:58:11 EV: First reaction. Sent a short proposal to list? 14:58:21 PK: Want to develop it further. 14:58:26 EV: First reaction? 14:58:42 Ev: Just blown away... 14:58:57 EV: Put it on the mail as you presented it. Start discussion there. 14:59:18 EV: Will be working on section, maybe keep it empty for the moment. 14:59:36 EV: Last agenda point. 15:00:01 PK: Didn't get to survey. Can we get to it later? Keep 2-16 open? 15:00:27 EV: Have to put some kind of deadline on it. Bec want to work on changes proposed there. When can we get to it? 15:00:44 EV: Keep open until Sunday evening. Also for others. :^) 15:00:55 s/mK/Kathy/ 15:01:21 EV: I reach 6 already, look at again. If you find soemthing add it there. Will start working on it anyway. Will keep open to Sunday. 15:01:29 EV: Anyone else? 15:01:50 EV: Have a nice day tomorrow and very pleasant weekend. Please look at survey if you haven't. 15:01:51 ack me 15:01:52 bye 15:01:52 Bye. 15:01:53 -Peter_Korn 15:01:57 -MoeKraft 15:01:59 Eric, do you still want me to do the survey even though I've emailed my responses? 15:02:02 -Kathy 15:02:04 -Liz 15:02:06 -Shadi 15:02:09 -MartijnHoutepen 15:02:10 Vivienne, yes, please do 15:02:11 You;re welcome, Shadi. 15:02:14 -Mike_Elledge 15:02:18 ericvelleman has left #eval 15:02:21 thanks Eric, will do. 15:02:21 -ericvelleman 15:02:22 trackbot, end meeting 15:02:22 Zakim, list attendees 15:02:23 As of this point the attendees have been Liz, +31.30.239.aaaa, MartijnHoutepen, +31.65.127.aabb, Shadi, Vivienne, ericvelleman, +1.313.322.aacc, Mike_Elledge, Kathy, Peter_Korn, 15:02:23 ... MoeKraft 15:02:23 korn has left #eval 15:02:30 RRSAgent, please draft minutes 15:02:30 I have made the request to generate http://www.w3.org/2013/07/25-eval-minutes.html trackbot 15:02:31 RRSAgent, bye 15:02:31 I see no action items 15:02:34 -Vivienne