Nearby: Latest version, SWBPD Home, MM Task Force, Tools, Vocabularies, mail archive

Image Annotation on the Semantic Web: Overview of Relevant Resources

Status: this document is no longer actively maintained. Please update your links to point to the new version maintained by the W3C Multimedia Semantics Incubator Group.

This document is based on unfinished work performed in the context of the multimedia task force of the W3C Semantic Web Best Practices and Deployment Working Group. All information provided here serves purely as a list of examples, and inclusion on this page does not imply endorsement by the W3C membership or the Working Group.

This collection of resources was developed in the context of Image annotation on the Semantic Web.

To do

• Check newer documents for additions and improvements
• Add more example entries
• Provide short descriptions for each entry
• Provide links to actual examples
• Make DOAP profile for this page

Examples of image annotations on the Semantic Web

• Photo annotation and social networking
  • Introduction & background reading (see Easy Image Annotation for the Semantic Web, ILRT Tech report)
  • FOAF co-depiction "Co-depiction is simply the state of being depicted in the same picture as someone else. We're cataloguing this using FOAF RDF documents, sharing and collecting these in the Web, as a way of documenting in a visual way some connections between people."
  • w3photo "envisions a royalty-free archive of conference pictures from WWW1 to Today -- searchable by the Semantic Web and ready for your tools". It uses various vocabulary, including Dublin Core, FOAF, CYC, Creative Commons, FotoNotes etc.
    • Image region vocabulary
    • Example RDF files
    • More examples
  • CONFOTO "is an experimental sharing and annotation service for conference photos. It utilizes common RDF vocabularies (dc, foaf, rev, cc, ical, w3photo) to combine simple tagging with rich annotations (e.g. depicted persons, related events, ratings). RDF data is accessible via SPARQL, URIQA, or a link at the bottom of each page."
  • FotoNotes "The goal of the Fotonotes specification is to make it significantly easier for individuals and groups to share meaningful information about (a) what is visually depicted within the photograph and (b) what is contextually (and/or personally) significant about what is (or is not) visually represented."
• Other image annotation projects
  • RDF Schema for EXIF
  • Photo metadata software/notes by Gerald Oskoboiny
  • SWAD-Europe catalog of image annotation projects
  • Masahide Kanzaki's Image Annotator
    • RDF example
  • RDFpic by Lafon and Bos
• Combining RDF and MPEG7
  • Introduction and background reading (IEEE Multimedia papers, Part I and Part II)
  • Jane Hunter et al on annotation of fusion cell images (see SWWS 2001 paper, ISWC04 paper, etc)
    • MPEG-7 fragment in OWL
    • ABC ontology in RDF
  • Troncy et al on combining XML and RDF for audio visual archiving within INA (see ISWC2003 paper) (note: AV-annotation is also relevant for images)
  • Chrisa Tsinaraki et al on MPEG-7 and OWL (Coupling OWL with MPEG-7 and TV-Anytime for Domain-specific Multimedia Information Integration and Retrieval, see RIAO 2004 paper)
• Using RDF for describing visual resources in the art domain
  • Laura Hollink et al on spatial semantics, also using WordNet, Sumo, VRA, AAT etc in RDF (ISWC 04 workshop paper,K-CAP 2003 paper). See Laura's Visual Ontology page for up to date version of the RDF/OWL schemata.
  • Schreiber et al on annotation templates (IEEE IS paper)
  • Schreiber et al on use of home grown RDF-version of Getty AAT/ULAN/TGN and IconClass for image annotation (see K-CAP 2001 paper)
  • HP's and other Simile work on describing paintings etc (see HP's Data conversion techreport)
• Embedding RDF image annotations in other formats
  • Van Ossenbruggen et al on embedding RDF in SMIL (see QuestionHow work)
    • RDF-annotated SMIL example
  • Ivan Herman et al on embedding RDF in SVG (also relevant accessibility issues here) (see Computer Graphics Forum paper).
  • Adobe's XMP

Non-RDF based work that is relevant

• flickr
• EXIF "stands for Exchangeable Image File Format, and is a standard for storing interchange information in image files, especially those using JPEG compression. Most digital cameras now use the EXIF format. The format is part of the DCF standard created by JEITA to encourage interoperability between imaging devices."
• Getty images collection, annotations and vocabularies
• IconClass iconographic classification system, thesaurus for describing icons and other visual art
• Mark Davis's work on Media Streams
• MPEG-7 Related:
  • IBM's MPEG-7 work for TRECvid
  • Caliph & Emir are MPEG-7 based Java prototypes for digital photo and image annotation and retrieval supporting graph like annotation for semantic metadata and content based image retrieval using MPEG-7 descriptors.

Projects and events that are relevant

• Workshops
  • ESWC/Multimedia and the Semantic Web
  • EWIMT 2004, 2005.
• Projects
  • aceMedia European FP6 project
    • aceMedia's multimedia ontology collection
  • K-Space European FP6 Network of Excellence
• The NINCH Guide to Good Practice in the Digital Representation and Management of Cultural Heritage Materials

Acknowledgments

Thanks to Libby Miller and Benjamin Nowack for the pointers and descriptions.

check this page for markup validity

$Id: Resources.html,v 1.7 2007/09/19 11:05:53 rtroncy Exp $