07:57:58 RRSAgent has joined #mmsem 07:57:58 logging to http://www.w3.org/2006/07/11-mmsem-irc 07:58:00 jacco has joined #mmsem 07:58:13 zakim, what conferences 07:58:13 raphael, you need to end that query with '?' 07:58:16 zakim, what conferences? 07:58:16 I see no active conferences 07:58:18 scheduled at this time is INC_MMSEM(F2F)3:00AM 07:58:32 zakim, this is INC_MMSEM(F2F) 07:58:32 raphael, I see INC_MMSEM(F2F)3:00AM in the schedule but not yet started. Perhaps you mean "this will be INC_MMSEM(F2F)". 07:59:17 jacco has changed the topic to: W3C Multimedia Semantics Incubator Group face to face meeting, Amsterdam, Day 2 07:59:38 rrsagent, draft minutes 07:59:38 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 08:00:06 rrsagent, make logs public 08:00:33 zakim, this is INC_MMSEM(F2F) 08:00:33 ok, raphael; that matches INC_MMSEM(F2F)3:00AM 08:01:05 IoannisPratikakis has joined #mmsem 08:01:26 Meeting: W3C Multimedia Semantics Incubator Group face to face meeting, Amsterdam, Day 2 08:02:12 Agenda: http://lists.w3.org/Archives/Public/public-xg-mmsem/2006Jul/0009.html 08:02:16 Chair: Raphael 08:02:23 JeffP has joined #mmsem 08:03:19 +Jeff_Pan 08:05:54 rrsagent, draft minutes 08:05:54 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 08:06:27 zakim, ??P1 is meeting_room 08:06:27 +meeting_room; got it 08:07:31 Topic: Demos by Patrizia & Giovanni 08:10:14 anadioti has joined #mmsem 08:11:11 rrsagent, draft minutes 08:11:11 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 08:11:16 vasileios has joined #mmsem 08:11:44 Thomas has joined #mmsem 08:12:07 scribe: Thomas 08:12:30 regrets: Susanne Boll 08:13:03 alessio has joined #mmsem 08:13:46 hi all 08:14:20 Hi alessio 08:14:38 hi all, from Naples, Italy 08:14:40 are the slides online? 08:14:49 participants: Ioannias, Vasileios, VassilisThomas, Raphael, Patrizia, George, Lynda, Jacco, Giovanni, Christian, Jeff, Pasquale, Alessio, Massimo 08:15:07 rrsagent, draft minutes 08:15:07 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 08:15:16 lynda has joined #mmsem 08:15:22 hi all 08:15:34 Hi Massimo 08:17:01 Patrizia presenting slides at http://www.w3.org/2005/Incubator/mmsem/meetings/f2f-amsterdam/mmsem-member-presentation-pat3.ppt 08:18:22 Patrizia explaining links with MUSCLE, mm ontology requirements effort etc 08:21:07 thristo has joined #mmsem 08:21:28 thristo has left #mmsem 08:23:32 Patrizia explains the 4M (MultiMedia Metadata Management) Infrastructure 08:23:43 massimo, which software do you use for the extraction of MPEG-7 descriptors? 08:23:50 christian has joined #mmsem 08:23:53 present: Ioannias, Vasileios, VassilisThomas, Raphael, Patrizia, George, Lynda, Jacco, Giovanni, Christian, Jeff, Pasquale, Alessio, Massimo 08:23:54 Hi Massimo: Yes, the irc log is public, we can either edit the minutes later to ensure the context of your texts are properly specified, or we can send it to the mailing list so that we don't have to dig it out from the minutes later. 08:23:57 we have extended emir and mpeg-7 encoder 08:24:07 VassilisT has joined #mmsem 08:24:15 rssagent, pointer 08:24:20 rrsagent, pointer 08:24:20 See http://www.w3.org/2006/07/11-mmsem-irc#T08-24-20 08:24:44 massimo, see above for the log 08:25:03 Hi Jeff/Jacco, ok 08:27:35 giovannit has joined #mmsem 08:27:37 +massimo 08:27:50 Other resources, slides, minutes etc at http://www.w3.org/2005/Incubator/mmsem/#Meetings 08:28:29 Raphael asking Patrizia: can you give an example of how to use the Algorithms Thesaurus? 08:28:44 -massimo 08:29:21 Patrizia: Algorithms Thesaurus used to establish provenance information 08:30:17 Patrizia: ... to define formal processes that include the algorithms used 08:30:21 q+ on expressive power 08:30:42 q+ 08:30:43 present+ Roberto 08:33:00 jeff asks about the expressive power wrt swrl and owl that patrizia needs 08:33:00 jeff: what expressive power do you need from owl and swrl 08:33:53 Patrizia: not thought very deeply about this, but we need some formal way to express rules 08:34:20 there is not yet a schedule for when the work on the algorithms ontology will be finished 08:34:39 A question to Massimo:: Can you give an example of the existing relations in the Algorithms ontology ? 08:35:42 q+ 08:36:13 we thought of a sort of definition on how algorithms can be combined together 08:36:41 on the base of the multimedia object, the problem and the possible solutions 08:38:36 jeff: asks what kind of rules you need, for example, do you need disjunction in the head, or do you need the vocabulary of the ontology in the rules 08:38:55 an example (thought now): suppose we need to obtain the contours of objects in an image and locate salient features (more specifically, how it is possible to extract features and locate a fracture on a Xray image) 08:39:01 Patrizia: not sure, but we assume the rules are built on top of the ontology 08:39:50 jeff: what are the rules used for? 08:40:11 Patrizia: I'm not sure yet: we've just started 08:42:21 Giovanni presents DBin, on the DBin website there is a screen demo to follow 08:42:59 DBin: http://dbin.org 08:47:49 DBin provides brainlets: environments for specific data/tasks that customize the user interface 08:56:02 Patrizia: can people modify the ontology? 09:00:57 Giovanni: creators of brainlets define the ontologies, you can install/deinstall ontologies 09:02:31 jacco has joined #mmsem 09:03:13 rrsagent, draft minutes 09:03:13 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 09:03:49 Raphael: please show how to annotate a photo 09:06:42 Giovanni: you can use any property given by the ontologies of the brainlet to add annotations to resources 09:12:35 -meeting_room 09:12:53 -meeting_room offline ... 09:13:03 we're calling back in ... 09:13:06 ok 09:13:25 nice 09:13:29 +??P1 09:13:47 zakim, +??P1 is meeting_room 09:13:47 sorry, jacco, I do not recognize a party named '+??P1' 09:13:51 zakim, ??P1 is meeting_room 09:13:51 +meeting_room; got it 09:18:27 Having short coffee break 09:18:57 ok 09:19:02 Topic: Multimedia Annotation Exercise Session 09:24:07 Jeff has joined #mmsem 09:24:57 Vassilis has joined #mmsem 09:25:18 Raphael explains set up of the annotation session. 09:26:12 I was out for minute, can you send the URL again? 09:26:15 Mostly personal photos of beaches, anything, any tool, any vocabulary is allowed 09:26:32 jeff, no url has been sent yet 09:26:35 World Cup photos: http://www.apa-images.at/cms/site/EN/breakingnews.html;jsessionid=agCHvRUiTwE7 09:28:20 World cup videos: http://www.euronews.net/create_html.php?page=detail_info&article=368313&lng=2 09:28:26 +massimo 09:30:22 Video: http://today.reuters.com/tv/videoChannel.aspx?storyid=2ba9545293e136702fab402c94af125ea8560bc1 09:30:41 Photos: http://photos.reuters.com/Pictures/default.aspx 09:32:20 Video Clip: http://www.rap2k.com/clip-1218-mas-que-nada-feat-black-eyed-peas-sergio-mendes.html#open 09:32:28 Lyrics: http://en.wikipedia.org/wiki/Mas_Que_Nada 09:32:45 Official Web Site: http://www.blackeyedpeas.com and http://www.brasil66.com/ 09:36:41 Temporary URLs of media files: http://homepages.cwi.nl/~troncy/tmp/W3C/ 09:38:27 -massimo 09:38:43 thanks massimo 09:39:04 massimo, you can phone in, we will just mute you 09:39:19 ok, i'll retry! 09:41:26 alessio_ has joined #mmsem 09:46:40 v has joined #mmsem 09:48:02 anadiotis has joined #mmsem 10:23:11 there is now a Beach ontology at: http://homepages.cwi.nl/~troncy/tmp/W3C/ 10:23:22 for annotating the personal photos 10:26:22 Massimo, please, DCC me the file 10:26:24 you're flooding 10:35:17 -Vassilis 10:41:34 -Jeff_Pan 10:41:50 lunch break 10:42:09 rrsagent, draft minutes 10:42:09 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 10:44:24 see you later (sorry for the previous flooding) 10:56:27 -meeting_room 10:56:29 INC_MMSEM(F2F)3:00AM has ended 10:56:31 Attendees were Vassilis, Jeff_Pan, meeting_room, massimo 11:25:14 zakim, this will be INC_MMSEM(F2F)3:00AM 11:25:14 ok, jacco; I see INC_MMSEM(F2F)3:00AM scheduled to start 265 minutes ago 11:25:24 IoannisPratikakis has joined #mmsem 11:26:22 INC_MMSEM(F2F)3:00AM has now started 11:26:29 +??P0 11:26:48 zakim, ??P0 is meeting_room 11:26:48 +meeting_room; got it 11:33:28 Sample RDF output : http://www.flickr.com/services/feeds/photos_public.gne?id=11026577@N00&tags=http://www.flickr.com/photos/11026577@N00/187187881&format=rss2 11:33:37 my annotations are at 11:33:51 http://homepages.cwi.nl/~jrvosse/spool/try.rdf, http://homepages.cwi.nl/~jrvosse/spool/try2.rdf, http://homepages.cwi.nl/~jrvosse/spool/ct.rdf 11:44:05 More sample RDF output : http://homepages.cwi.nl/~anadioti/RDF/rembrandt.rdf 11:46:32 massimo, which annotation tool have you used for the extraction of the massimo.mp7 file? 11:47:20 our 4M 11:47:59 +Vassilis 11:48:39 massimo, is this tool publicly available? 11:49:18 it's developed under the MUSCLE NoE, so i don't know the copyright policy 11:49:53 so, I assume there is no currently available version for download and testing 11:50:40 the thing we are thinking to propose to MUSCLE is if we can give an URI where people can connect and upload multimedia object, when MUSCLE will finish we would like to open the code 11:51:00 Massimo, does '4M' support other descriptors than MPEG-7 ones ? 11:51:18 not at the moment 11:51:55 we started the developement less than one year ago, we would like to add some more features 11:52:19 ALL: go on http://homepages.cwi.nl/~troncy/tmp/W3C/multimedia/ 11:52:38 have you used the MPEG-7 XM software for '4M'? 11:52:44 no 11:53:16 we started with vizir (emir) and mpeg7encoder, it's all written in java 11:54:00 we compiled XM6.1 on a windows pc (terrible experience) and we've use it to compare the results 11:55:12 massimo, i can see from the massimo.mp7 file that the descriptors have been extracted for the whole image (i.e. not region-based). Is this right? 11:55:18 but 4M extracts more features than XM now: some less for images, a lot more for audio, some for video 11:57:47 yes you're right 11:58:19 that is the next module under developing 12:00:54 alessio has joined #mmsem 12:03:11 +Jeff_Pan 12:03:52 http://www.csd.abdn.ac.uk/~jpan/w3c/mm-annotation/mm-annotation.rdf 12:05:47 my "handmade" rdf file is at http://www.uni-koblenz.de/~franz/manual.rdf 12:06:25 jeff, should be 12:06:34 without the slash in the end 12:08:04 Jeff, all RDF files are at: http://homepages.cwi.nl/~troncy/tmp/W3C/multimedia/annotations/ 12:08:08 yours too 12:09:17 thanks 12:11:51 jeff, can you put a real url to an image in your rdf:about 12:11:56 ? 12:12:18 ok 12:12:38 rrsagent, draft minutes 12:12:38 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 12:14:04 jacco, done 12:14:18 http://www.csd.abdn.ac.uk/~jpan/w3c/mm-annotation/mm-annotation.rdf 12:14:46 Round table - details about what everyone did and how 12:15:26 Vassilis and Ioannis used PhotoStuff 12:15:35 (i can't see the last rdf) 12:15:48 scribe: anadiotis 12:15:56 Limitations: no low-level feature extraction, no automatic segmentation 12:16:23 jeff, we get an access denied on your RDF page 12:16:32 it should be fine now 12:16:58 ? 12:16:59 Could have used M-OntomatAnotizer, that deals with issues, but not yet publicly available 12:17:36 Thomas : tried to use PhotoStuff + Protege 12:17:50 Issues : could not load ontology to Protege 12:17:58 Did manual annotations.. 12:18:42 Massimo : obtained MPEG-7 using 4M 12:19:09 RDF: foafer, image annotator (notepad to add the coordinates, and google to check). MPEG-7: 4M. OWL: Swoogle 12:19:17 george used 2 different methods: uploaded picture to flickr, added regional annotations. 12:19:22 Also added URL of picture. 12:19:35 Then created RSS of this. 12:20:00 rellero_ has joined #mmsem 12:20:06 Template Newsml of picture, found news codes, sample file -> converter for RDF 12:21:27 Jacco : tried to upload WordNet - crashed Protege 12:21:53 Then used Raphael's beach ontology 12:22:08 Raphael : created beach ontology with Protege 12:22:33 Then used it with PhotoStuff to annotate the pictures 12:22:49 (opps SWOOP2.3 for owl not swoogle) 12:22:54 PhotoStuff does not support properties 12:23:45 (it does in the latest version - Raphael was using a previous one) 12:24:09 Lynda : could not produce an RDF 12:24:23 tried to find all the ontologies 12:25:00 also tried with NewsML, but could not find the NewsCodes 12:25:05 jacco: I used http://www.mindswap.org/2003/PhotoStuff/webstarts/PhotoStuff-3.33/PhotoStuff-20060531.zip 12:25:11 syntax was difficult to use too 12:29:11 Giovanni + Christian : set up environment, fixed broken soccer ontology, loaded ontologies 12:29:18 giovanni: set up an environment in dbin.org to annote images 12:31:15 Giovanni + Christian : Found a simplified MPGE-7 ontology 12:31:45 Inserted new images by navigating the ontology and creating new 'image' instance 12:32:55 added line to say place was a geo:spatialthing 12:34:27 The owl-full bug is fixed, see 12:34:28 http://www.csd.abdn.ac.uk/~jpan/w3c/mm-annotation/mm-annotation.rdf 12:34:44 Giovanni : also used geographic ontology 12:35:35 Giovanni : in the end everything is exported in a single RDF file 12:36:55 wrap-up by Raphael : everyone went for images 12:37:03 initially at least 12:38:25 Giovanni : why is precise region-drawing important? Aren't most use cases covered by rectangle selction? 12:39:32 Ioannis : Precise region marking helps achieving better feature extraction 12:41:30 Raphael : purpose of the hands-on exercise was to show issues with ontology-based annotation 12:41:57 Raphael : discussion on the roadmap follows 12:42:09 Topic: MMSem XG roadmap 12:43:51 http://www.w3.org/2006/07/10-mmsem-minutes.html 12:48:04 +massimo 12:48:58 Music use case: id of track, diff perf. of the same song; different encodings 12:49:18 id3 tags, CDDB data, musicbrainz 12:49:48 classification of music on rythm,tempo,gentre, which ontologies to use 12:50:22 lyrics: paper about finding music based on lyrics 12:50:44 thierry: there is a more or less standard linguistic annotation scheme 12:51:00 (by us/ISO) 12:52:07 chalaschek has joined #MMSEM 12:53:06 present+ Chris 12:53:45 link text of lyrics to audio? manual/automatic 12:54:08 or use mpeg-7 linguistic scheme 12:54:52 rrsagent, draft minutes 12:54:52 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 12:55:35 thierry was talking 12:55:46 now giovanni 12:55:54 thanks 12:57:28 raphael: we first need to describe the problem of the use case, than the general solution. only highlight specific tools as example 12:58:26 -massimo 12:58:37 thomas: what is the intention of listing these problems, this is not in the context of the real use case? 12:58:51 What is the added value of SW? 12:59:08 Raphael: Yes, this will be key to all use cases 12:59:58 Thomas: yes, so we need a real scenario in which these problems occur 13:00:59 raphael: we can be creative and can reuse all relevant RDF out there on the web, as long as it fits in a real scenario 13:01:57 giovanni: music browsing, with intelligent "next" button, or locating scenario 13:02:27 we can show how the problems listed so far relate to the use case 13:02:55 Thomas:music browsing is too generic, need a real specific scenario 13:04:55 patrizia: is a tool from vienna that does similar stuff 13:05:38 action: patrizia to find pointer to this tool 13:06:34 Rapahel: structured annotation of the lyrics? 13:06:56 Thierry: we could do that, but we are not so strong in classifaction 13:08:40 looking at http://freedb.org 13:11:11 jacco : aim is to produce readable documents, so compact and specific use-cases are required 13:12:23 agreed 13:13:29 Low level feature extraction use case: 13:13:53 which use case are we talking about? 13:14:19 current tools represent results of extraction in XML/MPEG7, why do we need RDF/OWL? 13:15:06 Jeff, this is use case http://www.w3.org/2006/07/10-mmsem-minutes.html#action04 13:15:41 Christian, there is overlap with Massimo's use case 13:15:49 Christian: there is overlap with Massimo's use case 13:16:07 So we should provide a link 13:16:09 thanks 13:16:21 q+ 13:17:17 Advantages of RDF: combine with background knowledge, bootstrap and infer more information 13:18:08 Patrizia:we also have the semantics of the algorithm 13:19:12 Vassilis: two issues: we must have use cases that cover a broad range of languages and vocabularies 13:19:38 not all use cases should be based on mpeg-7, not all shou 13:19:59 not all use cases should be based on mpeg-7, not all should only use RDF, but also different flavours of OWL 13:20:20 otherwise we cannot show interoperability 13:22:01 ack me 13:22:09 Vassilis: we should use many metadata standards, not just three 13:22:14 all agree 13:23:52 Ioannis: we need spatio-temporal relations to be supported 13:26:54 q+ 13:27:53 ack Vassilis 13:28:46 Vassilis: spatio temporal relations are, from a language perspective, just relations, so there is not a issue 13:29:31 q+ 13:29:34 the problem could be on the reasoning level 13:30:26 yes the problem is on the reasoning level 13:31:05 ack Jeff 13:32:27 jeff: I agree with Vassilis, can do something even if spatio-temporal reasoning is not supported 13:33:30 Unstructured tagging use case: http://www.w3.org/2006/07/10-mmsem-minutes.html#action03 13:34:19 show limitation of tags, using tags across modalities or applications 13:35:05 show first efforts to bring more structure to tagging, show advantages and common approaches 13:36:21 show how it is possible to use SW technology to use, for example picasa tags in flickr, or from blogging app to another 13:36:45 thomas: I agree 13:37:18 other issues are navigation between tags, clustering etc 13:38:09 jacco: maybe reuse existing flickr2rdf converters etc 13:38:30 make use case that works cross modality 13:39:10 Next use case: News (http://www.w3.org/2006/07/10-mmsem-minutes.html#action05) 13:39:42 Raphael: I will work with people of the newsml/iptc community 13:41:06 use case should show what you can do more if you convert all current vocabs. to RDF and link to other material already out there 13:41:25 including: cross modality search on news images and text 13:42:03 recognize different version of the same story 13:42:43 make explicit links among different versions 13:43:02 patrizia: should speach be added? 13:43:44 reuse exisiting metdatda, convert to RDF 13:45:43 Massimo (by SMS): audio is not only music 13:45:47 all agree 13:46:26 who is here? 13:46:30 zakim, who is here 13:46:30 raphael, you need to end that query with '?' 13:46:33 zakim, who is here? 13:46:33 On the phone I see meeting_room, Vassilis, Jeff_Pan 13:46:34 On IRC I see chalaschek, rellero_, alessio, IoannisPratikakis, anadiotis, Vassilis, Jeff, jacco, giovannit, christian, vasileios, RRSAgent, Zakim, raphael, Massimo, pasquale 13:47:50 Raphael pus Massimo's use case sent yesterday on the beamer 13:47:58 s/pus/puts 13:48:28 raphael: is this a representation problem, massimo? 13:49:23 i was only thinking of use cases 13:49:50 but yes, you're right raphael, it could be 13:52:25 BTW, do we have any use cases on videos? 13:53:52 Massimo, could you write this up in terms of a concrete use case? For example one on e-science, or on image transforms on personal photos 13:54:46 news domain and unstructured tagging deal with video, maybe the music use case also 13:56:37 ok we'll think about it 13:56:39 Raphael: lets talk about deadlines 13:57:52 We have a teleconf on the 20th of July, so submit half a page description on the 19th of July, so we can disccus 5 use cases during the teleconf 13:58:24 Thomas has joined #mmsem 13:58:32 Thomas will be on vacation but will contact George before 14:01:17 Skip 3, 16 august teleconf because of vacations 14:01:44 proposal: next teleconf on 31 august? 14:01:52 resolved 14:02:20 next teleconfs: 20 July and 31 August? 14:02:22 have we decided who is goin to do be the editor of this deliverable? 14:02:52 no, we will do the individual use cases first 14:03:35 raphael: we do not yet have talked about the structure of the document 14:04:40 q+ 14:05:07 ack jeff 14:05:32 jeff: agrees with Vassilis, can we use the time left to look ahead? 14:06:20 raphael: we will all be contributors to the XG notes, but we also need editors 14:06:52 Vassilis volunteers to be one of the editors 14:07:56 obections to Vassilis being an editor? 14:08:01 Resolved 14:08:09 Any more voluteers? 14:08:26 No, want to see what the documents are going to look like 14:08:49 rrsagent, draft minutes 14:08:49 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 14:09:04 Topic: next f2f 14:10:01 proposal: co-locate with next ISWC conference in November, Athens, Georgia 14:10:44 Vasilis: There are many other competing events like ruleml, rif, owl2 14:10:51 q+ 14:11:01 s/Vasilis/Vassilis 14:11:33 Other posibility is to co-locate with SAMT in Athens, Greece 14:12:00 But this will be the second f2f in Europe 14:12:52 could be thougth the possibility of a videocon too ? 14:13:59 5 november is tutorials only 14:14:19 http://iswc2006.semanticweb.org/program/dates.htm 14:14:28 could be a good idea make next f2f in Venice 14:14:34 giovanni : having the f2f coincide with ISWC workshops/demos may not be a good idea, since people in the XG will attend the workshops/. Maybe before ISWC? 14:18:26 action: Raphael and Jeff to contact US partners and propose f2f date and location 14:18:54 yannis has joined #mmsem 14:19:21 Vassilis: Workshop in Athens on cultural domain, presence from this XG will be appreciated 14:20:02 action: Vassilis to write proposal on the agenda for 20 jult teleconf 14:20:11 any other business? 14:21:23 Jeff: we skipt discussing future deliverables, if any has an idea or volunteers to be an editor, send mail to public mailing list 14:21:47 Chairs close the meeting and thank all particpants 14:21:53 hi all and thank you! 14:22:19 -Jeff_Pan 14:22:20 -Vassilis 14:22:21 INC_MMSEM(F2F)3:00AM has ended 14:22:22 rrsagent, draft minutes 14:22:22 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 14:22:23 Attendees were meeting_room, Vassilis, Jeff_Pan, massimo 14:22:24 see you soon 14:22:40 bye all 14:22:41 bye 14:22:49 see you next time :) 14:23:19 alessio has left #mmsem 14:48:30 scribe: jacco 14:48:50 regrets: SusanneBoll 14:48:56 rrsagent, draft minutes 14:48:56 I have made the request to generate http://www.w3.org/2006/07/11-mmsem-minutes.html jacco 14:49:58 chalaschek has joined #MMSEM 15:27:07 Massimo has left #mmsem 15:52:33 pasquale has joined #mmsem 16:30:19 Zakim has left #mmsem