MMSem Goals
- Use SW technologies to make existing multimedia metadata standards interoperable:
- Leverage and combine existing formats
- Show the added value of the SW formal semantics:
- Practical applications and services that provide extra functionality by using, for example, subsumption reasoning or rule-based approaches
- Multi-platform applications, adapted to any device that accesses the web
- Provide best practices for annotating and using multimedia content on the Web:
- Practical use cases that identify the users, the type of content and the type of metadata that they want to provide
MMSem Activities
- 37 group participants:
- of whom 3 Invited Experts (Susanne Boll, Oscar Celma, Chrisa Tsinaraki)
- from 15 organizations (AIT, CNR, CWI, DERI Innsbruck, DERI Galway, DFKI, IBBT, IVML-NTUA, IIT, IWA-HWG, K-Space, Uni. of Maryland, Motorola, Oracle, Uni. of Aberdeen)
- 18 teleconferences (bi-weekly frequency)
- 2 Face to Face meetings
MMSem Deliverables
Finalized Documents:
Working Documents:
Living Documents (wiki page):
Image Annotation on the Semantic Web
- Latest Version: http://www.w3.org/2005/Incubator/mmsem/XGR-image-annotation/
- Editors: Raphaël Troncy, Jacco van Ossenbruggen, Jeff Z. Pan and Giorgos Stamou
- Abstract:
The goals of this document are to explain the advantages of using Semantic Web languages and technologies for the creation, storage, manipulation, interchange and processing of image metadata. In addition, it provides guidelines for Semantic Web-based image annotation, illustrated by use cases.
Image Annotation on the Semantic Web
- Based on photo annotation use cases:
- personal photos, cultural heritage, national TV archive, NASA space, biomedical images
- Assemble list of known issues: integrate heterogeneous vocabularies, separation of concerns
- Initial list of vocabularies and tools for annotation: the wiki living pages
- Initial list of benefits of using SW technologies for representing the annotations
Multimedia Annotation Interoperability Framework
- Current Draft: http://www.w3.org/2005/Incubator/mmsem/XGR-interoperability/
- Editors:
- Currently edited by Vassilis Tzouvaras and Jeff Z. Pan
- + extensive contributions from authors of use cases
- Goals:
This document will use a bottom-up approach to provide a simple extensible framework to improve interoperability of applications related to some key use cases discussed in the XG.
Multimedia Annotation Interoperability Framework
- Why and How combining several Multimedia Metadata formats?
- but broader view: not only images!
- Use cases organized in 3 layers:
Managing Personal Photos
- Combining EXIF, MPEG-7, IPTC and DIG35 metadata using RDF and OWL schemas
- Generating digital photo albums (use case)
Facetting Music Songs
- ID3 Tags + low-level features extraction + lastFM recommendations + FOAF profiles + ...
- Auto-construction of playlist (similar bit rate), Personalization, Browsing music store
(use case)
Bringing NewsML in the Semantic Web
- Converters available online, http://newsml.cwi.nl/demos/
- Conversion of NewsML G2 metadata into OWL
- Conversion of IPTC NewsCode into SKOS
- Linking various terminologies: NewsCodes, WordNet, LSCOM
- Facetting news stories with associated pictures and videos
Managing your Web 2.0 Personomy
- Multiple tagging platforms for various media (photo, video, music, bookmark, etc.):
- Flickr, YouTube, DailyMotion, Myspace, Last.fm, Del.icio.us, etc.
- Search, annotate cross-platforms (use case)
- Alpha demo
MPEG-7 and the Semantic Web
- Current Draft: http://www.w3.org/2005/Incubator/mmsem/XGR-mpeg7/ based on:
- Contributors: Oscar Celma, Stamatia Dasiopoulou, Suzanne Little, Chrisa Tsinaraki, Raphaël Troncy
- Goals:
This document targets the developers and researchers in multimedia semantics. It describes the four current OWL/RDF proposals of MPEG-7, as well as a comparison of the different modeling approaches in the context of practical applications. Any harmonizations aiming at providing a single ontology of MPEG-7 will not be done in the framework of this XG.
Multimedia Vocabularies on the Semantic Web
- Latest Version: http://www.w3.org/2005/Incubator/mmsem/XGR-vocabularies/
- Editor: Michael Hausenblas
- Abstract:
This document gives an overview on the state-of-the-art of multimedia metadata formats. The focus is on their usability within the Semantic Web, in particular formalizations of these existing vocabularies.
Multimedia Semantics: Relevant Tools and Resources
- Living Wiki page
- Editor: Zeljko Obrenovic
- Key Reference for:
- Existing Image, Audio and Video annotation tools
- Try to use FOAF and DOAP files for every tools we report
- Libraries and OWL/RDF Converters for numerous multimedia metadata standards
- Further links of projects, events and readings about multimedia semantics
Liaison
Liaison outside of W3C
Liaison within W3C
MMSem Future
- Consensus to charter a follow-up XG Activity
- Industry partners should get involved now: transition to real use cases and industrial scenarios:
- Chartering process