Use Case: Multimedia Adaptation

use case related to issue 6084

Overview

The aspect of interactivity in web applications with respect to user centred content adaptation is becoming more demanding. Adaptation can cover the following contexts:

• adaptation of media based on constraints of a specific user profile (e.g. age or time restriction for videos)
• adaptation of media to particular user requests (e.g. provide a summary of a sport event, present the funny parts of a audio interview, etc.)
• adaptation as part of an interactive generation process (e.g. show me a video that presents interviews on topic X in a biased fashion taken from a particular collection, interactive advertisements - see examples below) => here it is important to distinguish between media that were created to form a collection (see the examples below) or media items that are collected on a more arbitrary basis from different collections (see the cultural heritage examples at Audiovisual archive as a Cultural Heritage Institution
• adaptation of media in an interactive environment based on group behaviour (e.g. advertisements on large electronic billboards based on the clustering of information collected from mobile phones accessed in a specified area around that screen, adapting the style of media in a public environment based on user activity - content on screens and audio in a bar)

The challenge for this wg is to establish annotations that facilitate

• various processes in multimedia generation (e.g. search, manipulation, collaging)
• constraints for a particular context
• a set of specialised tags that allow the creation of rhetoric flow (we focus on the coherence not on the linking)
• a set of specialised tags that facilitate the emotional/experiential flow

This topic is closely related to Multimedia Presentation

Related Resources

• Vox Populi is a system for the automatic generation of biased Video Sequences. It uses rhetorical annotations to generate video sequences. The annotation schema encodes the verbal information contained in the audio channel, identifies the claims the interviewees make, and the argumentation structures they use to make those claims.
• Model of canonical media processes: This links to a collection of papers that describe interactive systems in which media material is adapted based on a defined model of canonical media production processes. The most interesting paper of those is the one that describes the model Canonical processes of semantically annotated media production
• The Computer is personal again: An interactive advertisement campaign by HP (so far in flash - but could also be generated based on semantic annotation => that is the challenge). Here some other examples: Get the girl - chocolate advertisement inside a love story, Shout - deo advertisement where shouting the word 'goal' navigates the player through the game , Stella - beer advertisement a interactive video story.