Presentation

Jeff Z. Pan
Department of Computing Science, University of Aberdeen
Co-Chair
W3C Multimedia Semantics Incubator Group (MMSEM XG)

29 November 2006
Slides: http://www.w3.org/2005/Incubator/mmsem/talks/VIE2006/Overview.html

MMSEM Homepage http://www.w3.org/2005/Incubator/mmsem/
Public Mailing List: http://lists.w3.org/Archives/Public/public-xg-mmsem/

Topics

• What are Incubator Groups
• MMSEM: Day to Day
• Mission
• Deliverables
• Use Cases
  • Interoperability
  • Representation
• MMSEM: Future

Incubator Activity

• Targeting innovative specs, guidelines, applications
  • Not ready for Rec track (need work, consensus building)
• Benefits
  • Rapid start of Incubator Group (XG)
  • Rapid finish within one year
  • W3C infrastructure leveraged
  • Consensus-building within W3C culture
  • Smooth transition to the W3C Rec Track, if desired and approved

Possibility for Quick Jump to Rec Track

• Charter development and AC review can be started before XG finishes

MMSEM: Day to Day

• Duration: May 2006 - May 2007
• 29 group participants:
• from 13 organizations
• plus 1 Invited Expert
• Bi-weekly teleconferences
• Face 2 Face meeting
  • 10-11/07 (CWI, Amsterdam)
  • 08-09/12 (SAMT-2006, Athens)

Mission

• Use SW technologies to integrate existing multimedia metadata standards:
  • Leverage and combine existing approaches
• Show the added value of the SW formal semantics:
  • Practical applications and services that provide extra functionality by using, for example, subsumption reasoning or rule-based approaches
  • Multi-platform applications, adapted to any device that accesses the web
• Provide best practices for annotating and using multimedia content on the Web:
  • Practical use cases that identify the users, the type of content and the type of metadata that they want to provide

Deliverables

• XG Report on Image Annotation on the Semantic Web
  • Editor: Jacco van Ossenbruggen, Raphael Troncy, Giorgos Stamou and Jeff Z. Pan
• XG Report on using Semantic Web languages and tools for multimedia metadata interoperability
  • Editor: Vassilis Tzouvaras
• XG Report with use cases showing best practices for annotation multimedia content on the Web and the advantages of having explicit semantics for such annotations.

Use Case: Interoperability

• Music Use Case
  • Identify uniquely song vs performance vs CD track (ID3 tags)
  • Lyrics aligned with audio (linked with video clip)
  • How to find musically equivalent song?
• Tagging Use Case
  • Identify uniquely tags
  • How to reuse tags between heterogeneous system (e.g. Flick vs YourTube)
  • Process the existing tags (clouds): towards emergent semantics
• News Use Case
  • Identify uniquely news stories
  • NewsML G2 architecture: annotation of images (EXIF), videos (MXF, EBU, MPEG-7) + semantics (thesaurus)
• MPEG-7 metadata interoperability Use Case

Use Case: Representation

• Algorithm representation Use case
  • Keep trace of all processes, transformations of an image, actions taken in a workflow, etc.
  • Needs to define proper ontologies and rules to describe diagnosis, and decision process
• Bio-medical Image Use Case

MMSEM: Future

• Possible new Rec Track Working Group on
  Multimedia Annotation Interchange Format
  • Use SW technologies to integrate existing multimedia metadata standards
  • Both deliverables can serve as starting points of LC
  • 2nd Face to Face Meeting in Athens (Dec 2006)
    • Decide whether to declare intension to move the Rec Track
    • Start work on building wider community consensus
    • Start drafting WG charter (to be done by March 2007)