14:26:27 RRSAgent has joined #rd 14:26:27 logging to http://www.w3.org/2011/09/22-rd-irc 14:26:29 RRSAgent, make logs world 14:26:29 Zakim has joined #rd 14:26:31 Zakim, this will be 7394 14:26:31 ok, trackbot; I see WAI_RDWG()11:00AM scheduled to start in 34 minutes 14:26:32 Meeting: Research and Development Working Group Teleconference 14:26:32 Date: 22 September 2011 14:26:36 Agenda+ Welcome & Logistics (Regrets, Agenda Requests, Comments) 14:26:36 Agenda+ CFP Distribution (update and collation of lists already sent to and other perspective venues) 14:26:36 Agenda+ Fixing the Judging and Selection Criteria - http://lists.w3.org/Archives/Public/public-wai-rd/2011Sep/0030.html 14:26:36 Agenda+ Any Other Business 14:26:44 chair: Shadi 14:26:48 regrets: Simon 14:49:04 4 pm BST/ZULU 14:49:22 yes, in 10 minutes 14:52:40 WAI_RDWG()11:00AM has now started 14:52:47 +??P3 14:54:05 Zakim, ??P3 is me 14:54:05 +Mario; got it 14:57:06 pthiessen has joined #rd 14:57:16 +??P25 14:57:31 zakim, ??P25 is Joshue 14:57:31 +Joshue; got it 14:58:29 pthiessen has joined #rd 14:59:34 vivienne has joined #rd 15:00:20 +??P14 15:00:27 zakim, ??p14 is me 15:00:27 +shadi; got it 15:00:34 zakim, who is on the phone? 15:00:34 On the phone I see Mario, Joshue, shadi 15:00:41 unmute 15:00:52 giorgio has joined #rd 15:01:10 +??P34 15:01:16 +??P37 15:01:24 zakim, ??p37 is me 15:01:24 +vivienne; got it 15:01:40 markel has joined #rd 15:01:41 Zakim, ??P34 is me 15:01:45 +Peter; got it 15:02:02 Zakim, mute me 15:02:02 Peter should now be muted 15:02:13 zakim, who is on the phone? 15:02:13 On the phone I see Mario, Joshue, shadi, Peter (muted), vivienne 15:02:22 +??P15 15:02:23 zakim, mute me 15:02:23 vivienne should now be muted 15:02:32 +??P21 15:02:37 zakim, mute me 15:02:37 Joshue should now be muted 15:03:01 zakim, mute me 15:03:01 Mario should now be muted 15:03:16 zakim, unmute me 15:03:16 Joshue should no longer be muted 15:03:54 + +1.361.279.aaaa 15:04:07 zakim, aaaa is me 15:04:07 +Mate; got it 15:04:46 yeliz has joined #rd 15:04:48 zakim, ??p15 is Markel 15:04:52 +Markel; got it 15:05:00 zakim, ??p21 is Giorgio 15:05:06 +Giorgio; got it 15:05:07 zakim, mute me 15:05:10 Joshue should now be muted 15:05:21 zakim, who is on the phone? 15:05:21 On the phone I see Mario (muted), Joshue (muted), shadi, Peter (muted), vivienne (muted), Markel, Giorgio, Mate 15:05:55 I'll do that 15:05:56 (I can scribe) 15:06:10 scribe: Joshue 15:06:12 scribe: Joshue 15:06:22 zakim, take up agendum 1 15:06:22 agendum 1. "Welcome & Logistics (Regrets, Agenda Requests, Comments)" taken up [from shadi] 15:06:41 agenda? 15:06:48 SAZ: Are there any agenda requests? 15:06:51 +??P11 15:06:57 zakim, ??P11 is yeliz 15:06:57 +yeliz; got it 15:07:08 zakim, mute me 15:07:08 Mate should now be muted 15:07:08 zakim, mute yeliz 15:07:09 yeliz should now be muted 15:07:28 zakim, take up next 15:07:29 agendum 2. "CFP Distribution (update and collation of lists already sent to and other perspective venues)" taken up [from shadi] 15:08:01 SAZ: The CFP was out, it has been sent to several groups and others have forwarded - which is great. 15:08:23 SAZ: What more can we do to promote it? I have gotten requests for clarification 15:08:30 SAZ: What promotion has been going on? 15:08:42 SAZ: Has anyone been circulating it? 15:08:43 q+ 15:08:48 ack 15:08:49 I sent it through our university 15:08:52 q+ 15:08:54 ack markel 15:09:12 Markel: I did send it to people I have been following who are involved in a11y metrics. 15:09:34 Markel: I gave them the link, sent to 8 different research groups. 15:09:37 SAZ: Great 15:09:40 ack giorgio 15:09:48 q+ 15:09:49 Giorgio: I sent it to three or four other people. 15:10:08 one list that comes to my mind i webaim 15:10:08 JOC: I also send it to about 6 academic colleagues. 15:10:10 ack me 15:10:25 SAZ: Are there lists etc that we could send it to? 15:10:25 oh no 15:10:30 zakim, umute Peter 15:10:30 I don't understand 'umute Peter', Joshue 15:10:37 I wonder if it could also be published in the newsletters? 15:10:39 hmm irc I suppose 15:10:47 for example, SIGACCESS or SIGWEB newsletters? 15:10:49 zakim, who is muted? 15:10:49 I see Mario, Joshue, vivienne, Mate, yeliz muted 15:10:50 WIll just type for now :) 15:11:21 or usability newsletters 15:11:29 I was planning to forward the CFP to OS mailing groups like mozilla accessibility, screen reader groups etc. 15:11:30 or may be we don't have enough time? 15:11:33 yes, some of them 15:11:34 SAZ: +1 to usablity newsletter 15:11:34 Did we get anything at the WAI-IG list? 15:11:39 SAZ: Do they have CFPs? 15:11:41 Zakim, mute me 15:11:41 Peter should now be muted 15:11:57 what about groups in LinkedIn? 15:12:07 zakim, unmute yeliz 15:12:07 yeliz should no longer be muted 15:12:17 SAZ: We should avoid double contacting. 15:12:25 q+ peter markel 15:12:30 q- 15:12:33 Yeliz: I get regular newsletter from usability news .com 15:12:37 q- 15:12:48 Yeliz: The editor can be contacted about the call? 15:12:52 SAZ: Great 15:13:01 Yeliz: Or HCI Int 15:13:25 http://lists.ics.forth.gr/mailman/listinfo/hciinternational 15:13:25 Yeliz: The editor can be contacted about the call also and they upcoming events, announcements etc. 15:13:54 http://usabilitynews.bcs.org/ 15:14:14 SAZ: For everyone in the group, if you do have a mailing list etc that you think interested then please check with me first. 15:14:28 sigaccess - http://www.sigaccess.org/community/newsletter/ 15:14:35 I would suggst the mailing list of webaim.org 15:14:35 Would it be easier to put the groups on a wiki? (avoid extra work for Shadi) 15:14:46 SAZ: I just want to check we don't crosspost. 15:14:48 +1 webaim 15:14:50 +1 Peter 15:14:52 sigweb - http://www.sigweb.org/community/newsletters 15:15:03 SAZ: I was thinking about that Peter, yes. Why not? 15:15:42 SAZ: So do insert list into wiki, so we don't crosspost etc 15:15:54 DBWorld - http://www.cs.wisc.edu/dbworld/ 15:16:22 Yeliz: If you are ok I can send a mail to a couple of groups SIGWEB, HCI Int etc 15:16:24 SAZ: Great 15:16:47 Interaction design - http://www.interaction-design.org/ 15:16:57 SAZ: I'll put up that wiki page, so Yeliz please add to wiki. 15:17:00 zakim, mute yeliz 15:17:00 yeliz should now be muted 15:17:14 yes, I'll do that 15:17:16 I have to check with Klaus to send it also to ICCHP authors. 15:17:37 SAZ: So please check wiki if you are going to send. 15:17:51 I can also post it on the W4A Linkedin group and also Facebook group? 15:18:02 oh, I see... 15:18:07 yes you are right 15:18:07 SAZ: Yes, this message went to the WAI-IG list 15:18:19 SAZ: Thats the announcement you should use. 15:18:36 q+ 15:18:40 zakim, unmute yeliz 15:18:40 yeliz should no longer be muted 15:18:40 SAZ: Try to avoid writing your own. 15:18:59 (mozilla.dev.accessibility@googlegroups.com) 15:19:01 Yeliz: I can also post to W4A, on their FB page etc 15:19:03 zakim, mute yeliz 15:19:03 yeliz should now be muted 15:19:16 I think SIGCHI does also have a list for the CFP 15:19:21 zakim, unmute yeliz 15:19:21 yeliz should no longer be muted 15:19:24 SAZ: I don't know if relevant but happy to 15:19:33 Yeliz: WebAIM newsletter? 15:19:40 Hmm perhaps your right Shadi - will focus more on research groups. 15:19:48 zakim, mute yeliz 15:19:48 yeliz should now be muted 15:19:49 SAZ: Ok, I'll check that myself. 15:20:21 zakim, unmute yeliz 15:20:21 yeliz should no longer be muted 15:20:25 http://ec.europa.eu/information_society/activities/einclusion/newsletter/index_en.htm 15:21:00 SAZ: I have sent it to the Commission. 15:21:15 zakim, mute yeliz 15:21:15 yeliz should now be muted 15:21:16 Yeliz: It would be good to inform the eInclusion. 15:21:22 SAZ: I'll do that. 15:21:42 (Jutta at http://idrc.ocad.ca/ Inclusive Design Research Centre) 15:21:58 (oh ok :) 15:22:00 SAZ: I have sent it there also. 15:22:19 SAZ: Lets move on. 15:22:30 zakim, next agendum item 15:22:30 I don't understand 'next agendum item', Joshue 15:22:39 zakim, unmute me 15:22:39 Joshue should no longer be muted 15:22:45 zakim, take up next 15:22:45 I see a speaker queue remaining and respectfully decline to close this agendum, shadi 15:22:50 q? 15:22:52 zakim, mute me 15:22:52 Joshue should now be muted 15:22:57 q- y 15:23:00 zakim, take up next 15:23:00 agendum 3. "Fixing the Judging and Selection Criteria - http://lists.w3.org/Archives/Public/public-wai-rd/2011Sep/0030.html" taken up [from shadi] 15:23:32 http://lists.w3.org/Archives/Public/public-wai-rd/2011Sep/0030.html 15:23:43 alright, sorry 15:23:49 scribe: Markel 15:23:52 i'm on it 15:25:11 zakim, unmute yeliz 15:25:11 yeliz should no longer be muted 15:25:14 SAZ: regarding Yeliz's email on the criteria...we don't expect many contributions..we need high quality submissions and need to justify rejections...some of you are knowledgeable in organising conferences 15:25:45 YY: the CFP says that each submission will be reviewed by three reviewers 15:26:11 YY: it is necessary to establish the criteria even if we don't expect many submission 15:26:19 +1 to Yeliz. I liked your ideas that you outlined in your mail. Feedback is important either way. Whether successful or not. 15:26:27 YY: the SC should have the same criteria 15:26:55 q+ 15:26:56 YY: novelty is difficult one because we said that already submited papers are welcomed 15:27:03 SAZ: any though? 15:27:19 s/though/thoughts 15:27:24 [[criteria including relevance, clarity, soundness and power of the arguments, generality of results/claims, novelty]] 15:27:51 YY: what would be the impact? soundness is an important one but we don't one to scare people 15:27:55 ack g 15:27:57 zakim, mute yeliz 15:27:57 yeliz should now be muted 15:28:23 GB: the criteria in the CFP are general enough to judge the papers- 15:28:24  15:28:33 impact could also be included 15:28:55 +impact perhaps easiest to measure 15:29:19 GB: it is difficult to measure clarity or novelty without seen the submissions...maybe these decisions have to be taken after reviews 15:29:23 Yes, totally agree with Giorgio. 15:29:39 GB: let's discuss about forms and tools for reviewers 15:29:51 Have we a scoring mechanism/ 15:30:22 +q 15:30:26 GB: we need to say which criteria are important and what we mean by that criteria 15:30:40 GB: I was pointing to the latter aspect 15:30:45 SAZ: both are necessary 15:30:48 One is weighting and one is the core value of the paper. 15:30:59 GB: I agree but the second one is more difficult 15:31:14 appropriatness? 15:31:24 Appropriateness 15:31:25 ? 15:31:27 new one? 15:31:32 s/weighting/wieghting 15:31:40 SAZ: impact, significance, relevance will get more clear once we have the definitions 15:31:41 why don't we try to formulate 1-sentence descriptions of these criteria? 15:31:44 ack me 15:31:51 I don't see anything on the academic authenticity? 15:32:21 Mario: GB's idea is a good one, I've reviewed for ICCHP for years but I've never seen such thing 15:32:26 -Joshue 15:32:44 Mario: we need for the reviewer to put their 15:32:52 Mario: rationale? 15:33:20 SAZ: should we start with a wiki page or should we discuss it now? 15:33:36 g+ 15:33:38 SAZ: we have to emphasize that other groups could benefit from this 15:33:48 Mario: not now in the call 15:33:58 GB: I'd go for a wiki page 15:34:02 I agree with a wiki page, would allow us all to add things as we go through it 15:34:18 GB: based on my experience reviewing papers 15:34:27 I agree with Giorgio 15:34:45 GB: the rationale is to improve the reliability and consistency of reviewers when evaluating a paper 15:34:46 zakim, unmute yeliz 15:34:46 yeliz should no longer be muted 15:34:59 SAZ: if we do it publicly we can get more input 15:35:07 zakim, mute me 15:35:14 Mario should now be muted 15:35:23 if shadi could create an empty page for that I'll keep working on it. 15:35:26 yes 15:35:46 good. 15:35:51 SAZ: let's list the CFP criteria and look at definitions; can it be done by wednesday morning? 15:36:07 SAZ: YY, is that ok? 15:36:25 YY: I can also contribute adding definitions or some question for each criteria 15:36:40 YY: defining is difficult but useful for authors and reviewers 15:36:59 YY: is good for authors to get feedback so that they can improve their submission 15:37:34 YY: my only doubt is again regarding to last week discussion with Shawn 15:37:53 YY: about academia vs industry 15:38:01 zakim, mute yeliz 15:38:01 yeliz should now be muted 15:38:05 so we need people of this group that are notacademians to review our proposals. 15:38:23 SAZ: there are two aspects (1) criteria and (2) how we define them 15:39:03 SAZ: GB made a good point 15:39:03 I agree 15:39:05 nono 15:39:07 q+ 15:39:11 to get a different perspective, its important 15:39:21 we need academic reviewers but knowledgeable on the topic 15:39:25 ack g 15:39:51 too academic 15:39:52 :-D 15:39:57 GB: I meant that in the wiki page should be reviewed by people who don't call themselves from academia 15:40:16 I agree with Giorgio 15:40:17 + 15:40:18 +1 15:40:23 GB: YY, SH, GB and MV are from the same family 15:40:43 GB: but SAZ, SLH's point of view in necessary 15:40:52 SAZ: let's have a balance SC 15:41:17 yes, that's why I think it was good to have Shawn 15:41:18 :) 15:41:24 q+ 15:41:33 ack g 15:41:56 very good idea. 15:41:57 GB: to improve the CFP and the symposium we need to know how we will get feedback from participants 15:42:05 +1 15:42:13 GB: where participants are presenters and attendants 15:42:20 +1 feedback form - consistency could be improved 15:43:02 SAZ: we have lots of things: define criteria, review from non-academic people, review form, etc.great ideas 15:43:07 zakim, unmute yeliz 15:43:07 yeliz should no longer be muted 15:43:09 SAZ: other thoughs? 15:44:01 YY: one last thing about rebuttal process...in some conferences...SH really likes it....after the review authors are allowed to submit his comments back to the SC 15:44:08 q+ 15:44:29 ack g 15:44:31 zakim, mute yeliz 15:44:31 yeliz should now be muted 15:44:46 zakim, unmute yeliz 15:44:46 yeliz should no longer be muted 15:44:47 GB: we don't have enough time 15:44:48 q+ 15:44:53 I agrre 15:44:56 agree 15:45:37 ack y 15:45:45 GB: we are asking 1000 word abstracts and the most typical answer we can get from authors is that there was no enough room for explanations 15:45:55 zakim, mute yeliz 15:45:55 yeliz should now be muted 15:46:07 YY: I agree with GB, maybe it'd be useful for subsequent seminars 15:46:46 for the first one, I agree 15:46:48 definitelye 15:47:02 we can have in mind for the following ones 15:47:19 I agree Shadi 15:47:25 ok 15:47:51 SAZ: any other thoughT? 15:48:29 SAZ: another question related to the process...is participation..agreement was that accepted papers authors will have a bit of time 15:48:33 not more than 10min 15:48:48 SAZ: should have read the papers in advance 15:49:18 SAZ: there will be a panel : weminar chairs and some open questions 15:49:36 SAZ: all depending on the number of papers and questions... 15:50:06 SAZ: there will be physical limitations 15:50:15 wha kind of capcity can we handle? 15:50:16 SAZ: of how many people we can accept 15:50:36 SAZ: I have to check that 15:50:43 q+ 15:50:43 SAZ: I remember 150 15:50:57 SAZ: members of the RDWG should have a seat 15:51:26 ack g 15:51:36 SAZ: if we wanna do some other criteria such as first come first serve basis 15:51:57 -Mate 15:51:58 ok 15:52:02 GB: I agree on RDWG members, accepted papers + authors of rejected papers 15:52:09 SAZ: good point 15:52:23 sounds good 15:52:47 SAZ: do we need invitees? 15:53:00 why not? 15:53:03 sure 15:53:06 SAZ: relevant people that don't have time to submit 15:53:12 good 15:53:12 I agree with that 15:53:34 zakim, unmute yeliz 15:53:34 yeliz should no longer be muted 15:53:41 SAZ: once we have that we can open to first come served 15:53:58 YY: we can give priority from...research groups 15:54:10 what about people from industry? 15:54:14 for example, yahoo accessibility group, Google accessibility group 15:54:40 SAZ: somebody from WCAG...back to the SC 15:54:41 zakim, mute yeliz 15:54:41 yeliz should now be muted 15:54:42 q+ 15:55:01 ack g 15:55:16 GB: I'd be happy if Google, Yahoo or Amazon join but perhaps we have to be clear on the criteria for invitations. 15:55:37 GB: Inviting sb who is highly cited is a good idea 15:55:51 GB: excluding or missing groups might be a problem 15:56:10 put criteria on the wiki? :) 15:56:12 who and why 15:56:19 SAZ: we need a criteria for this too: who do we invite, who has priority? 15:56:23 Let's also think about these criteria in the Wiki. 15:56:38 SAZ: with 150 people we can accomodate most people 15:57:13 SAZ: people have to think who do we want on the phone 15:57:16 the real question is how many reservd seat are there, and how are they assigned. 15:57:34 SAZ: one criteria could be sb how could add value 15:58:12 SAZ: anything else to raise? 15:58:35 SAZ: thank you very much, I'll set the wiki pages 15:59:04 SAZ: we have an agenda for next week 15:59:08 good night all 15:59:10 byee 15:59:11 ok. thanks and bye 15:59:11 cheers 15:59:13 bye! 15:59:14 Thanks and bye! 15:59:19 -yeliz 15:59:20 :-) 15:59:22 vivienne has left #rd 15:59:24 -vivienne 15:59:26 bye 15:59:27 -shadi 15:59:29 markel has left #rd 15:59:30 -Peter 15:59:38 -Markel 15:59:44 -Mario 16:01:18 trackbot, end meeting 16:01:18 Zakim, list attendees 16:01:18 As of this point the attendees have been Mario, Joshue, shadi, vivienne, Peter, +1.361.279.aaaa, Mate, Markel, Giorgio, yeliz 16:01:19 RRSAgent, please draft minutes 16:01:19 I have made the request to generate http://www.w3.org/2011/09/22-rd-minutes.html trackbot 16:01:20 RRSAgent, bye 16:01:20 I see no action items