14:55:57 RRSAgent has joined #decision-xg 14:55:57 logging to http://www.w3.org/2010/12/09-decision-xg-irc 14:56:32 Meeting: Decision-xg 14:56:47 chair: Jeff Waters and Don McGarry 14:57:04 Agenda: http://www.w3.org/2005/Incubator/decision/wiki/Decision_Mtg_18_Agenda 14:57:19 Scribe: Jeff Waters 14:57:32 ScribeNick: jeffw 14:57:51 Topic: Welcome 14:58:50 Piotr has joined #decision-xg 15:00:23 jeffw: Welcome to the Dec 9, 2010 meeting of the Decisions incubator! 15:00:42 jeffw: You can find the agenda at http://www.w3.org/2005/Incubator/decision/wiki/Decision_Mtg_18_Agenda 15:01:29 jeffw: We are pleased to have Dr. Jill Drury and Dr. Gary Klein join us to discuss their decision research. 15:03:17 jeffw: There is http://audioconference.mitre.org 15:09:08 what is the valid meeting ID? 15:09:09 jeffw: (various of us got on to the web conferencing system) 15:11:55 TOPIC: The Mitre Corporation: CoAction: Enabling Collaborative Option Awareness for Joint Actions 15:12:43 garyKlein: Collaborative behavior is not often supported by the technology. So I can see you are connected, but I don't know much else which indicates the problem. 15:13:25 garyKlein: The papers I sent out on option awareness, and I read Eva's position paper, so I thought it might be useful to talk about the connection we made earlier between decision spaces and situation spaces. 15:13:59 garyKlein: From what I read in the paper, alot of the info communicated about the decision in the paper deals with the situation space. It may convey something about the options, but really that is about the state of the world 15:14:33 garyKlein: rather than the assessment of the options which we call the decision space. Situation Awareness is defined in 3 levels and its important to not the 1st level is the elements in the space, 15:15:27 garyKlein: but 2 and 3 are projections, deriving the meaning of the chess pieces and the status of the near future. The reason I bring this up is because most common operational pictures are about situation awareness 15:16:09 garyKlein: to support decision-making, but in order to do that, it needs to be mapped into the decision space. So when a doctor needs to decide if you have a virtus or a bacterial infection, 15:16:39 garyKlein: then we look for certain things but that's to map to whether we give you or not an antibiotic. So the comparison of options, to give or not, is the decision space. 15:19:28 jeffw: (summarized his thoughts on that) 15:19:49 jill: we weren't first to come up with this, but we've added some new notions 15:20:33 garyKlein: We've been interacting with a number of the researchers in this work. You've generally got the outline, Jeff, you take dots on a map as level 1, then you consider what courses of action might be taken, 15:21:09 garyKlein: and then the meaning is brought by a mental model, and then a further model as to what they will do next and that figures into the decision space as to the options I will consider. 15:21:39 garyKlein: and this distinction was exciting to me. I was trying to understand the differences between decision support systems, some were just databases of things and some were comparing options. 15:22:33 garyKlein: one is in terms of situation space, i.e. dots on a map, but that is just the beginning of considering the decision space of comparing options. To jointly visualize options and futures is the decision space. 15:24:09 garyKlein: You can see on our slide the 17 options and we're comparing a sample uncertainty analysis, running them a thousand times with adjusting factors they will impact in environment, and 15:26:18 garyKlein: we see some low levels of dissidence (which is the cost in this example), whereas other options result in tight set of results, robust options result in good 15:27:05 garyKlein: The middle line in the box is the median, the box width is the interquartile range, and the end of the line points ... this is the standard representation of a box plot 15:27:26 garyKlein: The dots are the outliers. 15:27:36 marion: How do you know what the outcomes would be? 15:28:27 garyKlein: there is a model that we used in this case 15:30:01 garyKlein: So you have options, these go into the models and the endogenous and exogenous variables go into the forecasting models with uncertainty/sensitivity analysis go into plausible futures which drive a scoring model 15:30:21 jill: the work we've done is model agnostic, so you could use your own with your own number of parameters 15:31:02 garyKlein: so whether you use your own cognitive model or some other model, there is always some model applied to bridge to the decision space and choose among the options. A computational model formalizes this 15:31:34 garyKlein: and allows us to do more future analysis than a person would be able to do. 15:32:29 garyKlein: these are ideas behind our decision display which allow the box plots to be seen by the users and they can adjust the parameters/weighting on the different aspects of the box plots, max/min/median etc. 15:32:55 garyKlein: Level 2 is perception and comprehension of relationships between factors underlying the option outcomes 15:33:08 garyKlein: maybe there is something I can do to mitigate that factor. 15:33:40 marion: is that a drill-down on the edges, the relationship of the variables, that is drill-down on the arrows, to see what is independent of what. 15:34:23 garyKlein: I'm trying to quell the spread of disease and I'm finding 10% antiviral and there are cases turning out badly and people are dying anyway and I drill down and find that is where I didn't hit my 10% target 15:34:57 garyKlein: so there is a tipping point in the viral situation example, so I'm looking at the drill-down info to get important choice options and level 2 gets you there. 15:35:40 garyKlein: level 3 might be a quality assurance program to assure I get my anti-virals distributed, but there is a cost to that, so does that reduce the number to offset the cost 15:38:49 garyKlein: I hope we can collaborate and participate in future meetings to follow-up on this. 15:39:31 jeffw: (summarized the significance of the work on both sides and invited Jill and Gary to participate in future meetings and collaborate off-line and in the wiki) 15:40:09 garyKlein: just to finish up, here is an example of decision-makers who have their own decision-space, but also a mutual decision space where for example sending 4 fire engines due to congestion 15:40:21 marion: do you have a feedback loop? 15:41:32 garyKlein: yes, and all of these are cost evaluations of whatever could occur for each of the possible options. So police and fire working together (4 fire trucks and 2 squad cars independently), but 15:42:19 garyKlein: we find that if 1 more squad car is sent, then fire only needs to send 2 and you only discover that with considering the joint decision space, which is not obvious, and we just finished role-playing 15:43:07 garyKlein: experiment which shows this in some detail. So let me give you a taste of what we are doing with collaborative validation, technology can support the collaborative task, but joint work is impacted 15:44:20 garyKlein: by type of task, type of interdependence, type of coordination, and characteristics of the task environment. So when I'm looking at the protocols, are we communicating the rationalization, 15:45:14 garyKlein: the justification (the external values we're trying to achieve), and we've looked at the structure of the decision (the network of factors that impact a decision), also looking at the types of coordination, 15:46:05 garyKlein: are we communicating during the process (like loading a couch onto a truck), are we engaged in plans with schedules, do we have routines (like driving on road has rules so less communication required) 15:46:51 garyKlein: and there are collaborative behaviors, and I can skip to different class of task processes, and interdependence and it all comes together, the situation awareness, the task process, the coordination 15:48:43 garyKlein: with what we need to discuss to collaborate correctly. I'd like to talk more about these things. 15:48:59 jeffw: Thanks much, Gary and Jill 15:49:44 jeffw: Let's follow up on all of this next time but also online in meantime through email and wiki. I'd like to make sure the papers are accessible to all, so we can link them. 15:49:57 eblomqvi: How can I get the papers? 15:50:15 garyKlein: I can send them to all on the list. 15:51:56 TOPIC: International Semantic Web Conference and Workshop on Ontology Patterns 15:52:43 eblomqvi: My report is I tried to look around and find something related to our work and I didn't find anything very closely related to decision format but the conference in general, the semantic web challenge 15:53:04 eblomqvi: on linked data etc. are interesting. I will post links to the challenge page and you can look at those with demos 15:53:07 http://challenge.semanticweb.org/ 15:53:41 eblomqvi: it's under previous challenges and you can see this year and last year's, the semantic web challenge is applications of semantic web technology to make things useful and nice that 15:54:43 eblomqvi: use link data and other things as well, one was like wikipedia but dbpedia, using linked data and allowing people to create that, doing it the wiki way, and Jeff you've been talking about the 15:55:13 eblomqvi: application that uses some forms for different things and this may be related and inspiration for looking at that 15:55:15 shortipedia 15:55:42 http://shortipedia.org/index.php/Main_Page 15:56:24 eblomqvi: for the workshop, I presented our position paper and there was some nice discussion, people seemed to think it was needed and interesting, but no one there who was acutally working with decisions, 15:57:16 eblomqvi: then we also proposed modeling problems for the pattern writing and one was selected, how to represent ordered lists, and so this was one of the things we worked on at the workshop 15:58:02 http://ontologydesignpatterns.org/wiki/Submissions:List 15:58:09 eblomqvi: and the conclusion was yes it would be nice, so I've reengineered the ontology into three patterns and I posted them in the ontologydesignpatterns portal and I put the links here 15:58:44 eblomqvi: so this list pattern is there and hopefully we will have some comments and it's there and we can try to use it. 16:00:08 eblomqvi: I mentioned the modeling problems and I got some interesting ideas and also today, so we have a new set of ideas to model with. 16:01:47 TOPIC: CDEP in RDF 16:01:58 jeffw: Here is the link http://www.w3.org/2005/Incubator/decision/wiki/CDEP_Examples_in_RDF 16:02:32 marion: distinction between situation space and decision space seems new, but presenting options has been around in some time, although not necessarily bringing it out to the user. 16:03:26 garyKlein: this frequency approach has taken off and allows people to understand the uncertainty much better than in the past. 16:04:25 jeffw: Thanks all for attending. It has been an interesting hour, we're getting wonderful new ideas and I look forward to exchanging links, papers, slides, etc. and collaborating off-line as we head to the next incubator meeting in 2 weeks. 16:04:38 I've submitted the criterion and criterion setter pattern to the ODP portal 16:04:47 http://ontologydesignpatterns.org/wiki/Submissions:CriterionSetter 16:04:54 jeffw: Thanks Piotr! 16:05:21 ah, I didn't notice that! I'll have a look as soon as I can, Piotr 16:06:04 http://ontologydesignpatterns.org/wiki/Submissions:Criterion 16:08:00 Piotr has left #decision-xg 16:48:03 rrsagent, set log public 16:48:13 rrsagent, draft minutes 16:48:13 I have made the request to generate http://www.w3.org/2010/12/09-decision-xg-minutes.html jeffw 16:48:49 zakim, bye 16:48:49 Zakim has left #decision-xg 16:48:54 rrsagent, bye 16:48:54 I see no action items