W3C Logo Ubiquitous Web Domain

Summary of the Second W3C Web and TV Workshop

8-9 February 2011
Hosted by Fraunhofer-FOKUS, Berlin, Germany

Berlin Workshop Attendees
Netflix Logo
IPTV Forum Japan Logo
Tomo-Digi Logo

Workshop Support

Open Media Web
Webinos

FP7 and EU logos The workshop has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n°248687 (Open Media Web) and n°257103 (webinos).

Check the Sponsorship program and become a sponsor for the Workshop.

On February 8th and 9th, 2011, W3C (the World Wide Web Consortium) held the second workshop on "Web and TV" to hold technical discussions on presumed important topics for smarter integration of Web and TV and identify outcomes that may be easily fed into the newly created Web and TV Interest Group.

Executive Summary

During the wrap-up session, workshop co-chairs provided a draft list of topics as starting point for discussion. Active discussion helped improve the list. Votes were held on possible next steps for most items.

There was consensus to use the Web and TV Interest Group to centralize and coordinate discussions on topics relevant to the Web and TV space, through the group's public mailing-list <public-web-and-tv@w3.org> (see the archives of the list), where candidate topics for the creation of task forces within the group may be suggested. Task forces that are supported by IG participants will be created to move these topics forward. Possible outcomes for each Task Force are: the creation of a new Working Group, new requirements for existing Working Groups, identification of work that is satisfactorily done outside W3C and has industry-wide consensus. See the Web and TV Interest Group Charter for more details.

Workshop chairs suggest the following conclusions as a list of candidate topics for possible task forces or monitoring activities within the Web and TV IG:

  • Adaptive streaming over HTTP: The IG needs to assess whether the MPEG DASH specification may be licensed on a royalty free basis for integration as a core Web technology, through discussions with 3GPP and MPEG DASH working group members. Due to timing constraints, Web and TV IG chairs prepared and sent a first letter to 3GPP members on DASH as a workshop outcome. Discussions on adaptive streaming integration should include potential support for DRM.
  • Home networking: device discovery and real-time communications between devices are pre-requisites for most home networking scenarios. As mentioned during the wrap-up session, the draft charter of the Web Real-Time Communications working group is under review by the W3C Membership as of 28 February 2011. Device discovery is also being discussed for inclusion in the next charter of the Device APIs and Policy (DAP) Working Group. The Web and TV IG should monitor and coordinate these discussions. A working group dedicated to device discovery and/or higher level functionalities for second-screen scenarios may need to be chartered if these groups do not address home networking scenarios requirements.
  • Metadata: the Web and TV IG should propose a vision on metadata and work on a roadmap for convergence between W3C developments and industrial developments or television and radio standardisation activities.
  • Accessibility: the Web and TV IG welcomes participants with expertise on accessibility as early as possible. The IG should see if and how to harmonize WCAG 2.0 with various accessibility regulations from the TV world, and explore how works on multimodal interactions and Accessible Rich Internet Applications (WAI-ARIA) enable the design of applications that work on heterogeneous devices.
  • Profiling / Testing: the Web and TV IG should work with the working groups responsible for the definition of standards that may need profiling (HTML and CSS WG in particular) to address specific requirements from TV actors. Workshop participants are strongly encouraged to contribute to the testing effort on Web technologies they need.
  • Extensions to HTML5: several functionalities have been discussed at the workshop (support for multiple tracks, secure device identification, support for « trick modes » (common video playback functions, e.g. pause, play, fast forward, fast rewind, slow forward, slow rewind, jump to previous or future frame) and recording, synchronization of video content, needs for specific content metadata). The Web and TV IG should monitor and coordinate ongoing works in other groups (HTML, DAP, WebApps, external organizations) and suggest new APIs of functionalities to be addressed by existing or newly dedicated working groups.

Introduction

The purpose of the workshop was (1) to hold technical discussions on presumed several important topics for smarter integration of Web and TV that based on the analysis of the key use cases and important requirements we had already gathered in the first workshop in September 2010, and (2) to arrange the workshop result suitable for being easily fed into the Web and TV Interest Group (see the charter of the Web and TV IG), e.g. to suggest it creating specific task forces and so on. Main presumed topics were:

  • HTML5 and TV
  • Standardization Needs
  • Accessibility
  • Hot Topics
    • Integrating P2P and the Web for TV content distribution
    • Role of DRM for Web and TV (including overview of ongoing work on interoperable and open DRM systems that work accross devices)
    • (Micro-) Payment for Web and TV
    • Support for "second screen" scenarios

Please see the call for participation for details.

The workshop attracted 114 attendees from various industries including broadcasters, telecom companies, cable operators, OTT (over the top, video delivered over a network that is not offered by that network operator) companies , content providers, device vendors, software vendors, standardization organizations, Web application providers, researchers, and Governments. Some of the attendees had come from outside Europe, especially from US and Japan. The US attendees consisted mainly of IT companies, cable operators and OTT companies. As for Japan, the attendees consisted mainly of broadcasters, CE manufactures and telecom companies. Please see the list of attendees for details.

The minutes of the workshop are available on W3C Web servers:

At the beginning of the workshop, we held an introductory section with the aim of setting the scene, and we clarified the relationship between workshops and the Interest Group in detail during the section. Please see the slide for the detail.

During the workshop, we had eight sessions consisting of brief presentations of the attendees' position papers followed by dedicated discussions on the topics. One of the sessions was held with flavor of panel discussion. The topics for the sessions were:

  • Web&TV: Use cases and Technologies
  • Second-Screen Scenarios
  • Panel on HTTP Adaptive Streaming
  • Content Protection
  • Metadata / Semantic Web
  • HTML5 and TV: Gap Analysis
  • Accessibility
  • Profiling / Testing

The geographical distribution of the presenters were:

  • Europe: BBC, Condition-ALPHA, EBU, Ericsson, Fraunhofer, Irdeto, Opera, ParisTech, Philips, Matroska, MPEG DASH, NoTube project and UK DTG
  • US: CableLabs, Cisco, Connected Media Experience, Intel, Microsoft, MIT, Netflix and Qualcomm
  • Japan: NTT, NTT-Communications and Tomo-Digi
  • Korea: KAIST and LG

Some topics had got cross-sectional interest from attendees, i.e., been discussed from several viewpoints in multiple sessions. Among those, popular items were roughly:

  • Dynamic Adaptive Streaming over HTTP (e.g. MPEG-DASH and 3GPP-DASH)
  • Royalty issues related to video technologies (e.g. codecs and streaming technologies)
  • Hybrid broadcast broadband (including HbbTV, DVB, DTG, and DTV/IPTV in Japan)
  • Second-Screen Scenarios (e.g. API for remote control, and synchronization of screens)
  • HTML5 Extension (e.g. ISSUE-152 in HTML-WG, and API for DASH manifest/metadata/representation)
  • Social TV
  • Accessibility
  • Relation between existing TV related technologies and W3C groups (e.g. relation between DLNA and the DAP WG)
  • Profiling/Testing (esp. from the viewpoint of CE devices)
  • Metadata

Main workshop discussions

HTTP adaptive streaming

Most players of the Web and TV world who need to stream video on the Web require some adaptive mechanism to quickly react to network fluctuations and ensure a smooth user experience while watching videos.

The panel on HTTP adaptive streaming showed convergence of interests towards the MPEG DASH specification as a key enabler for video streaming on broadband connections. There was a long debate on the patent policy under which this specification could eventually be released. W3C standards follow a royalty-free patent policy and the potential adoption of DASH for use as a core Web technology would require this solution to be licensed on similar terms.

There was strong support among workshop participants for the IG to get back to 3GPP and MPEG DASH members and assess whether MPEG DASH may be licensed on a royalty-free basis for integration within HTML. As 3GPP members held a meeting the week after the workshop, the Web and TV IG chairs prepared and sent a heads-up message to 3GPP members to express the interest of workshop participants in adopting DASH as a core Web technology and working on its integration within HTML, provided licensing can be made compatible with W3C patent policy.

Integration within HTML may require exposing new functionalities in the browser, such as QoS (Quality of Service) counters, control of the adaptive streaming process, and access to the streaming manifest. The Web and TV IG should prioritize and discuss these needs on a second step.

Content protection

Most video/audio content providers intend to implement some form of content protection to make copying difficult, if not impossible.

The discussion showed that content protection always involves some proprietary solution that cannot be easily integrated in an open stack of technologies and that should not be standardized at this stage.

That being said, parts of the mechanisms used to protect content may still be up for standardization. In particular, a common encryption algorithm would allow to separate the choice of the delivery platform (technical decision) from the choice of a DRM system (business decision).

The IG should evaluate this possibility, probably in relation with discussions on HTTP adaptive streaming. While a complete integration of DRMs in HTML is not deemed necessary, additional functionalities may need to be exposed within the browser to enable support for DRM content, e.g. extensions to the canPlayType() method to report on protected content support or secure device identification to increase protection efficiency.

Second-screen scenarios

Second or Multi-screen scenarios come with a variety of use cases, from using a second device as TV remote controller to shopping, gaming and other interactive scenarios where the TV set drives content on a second screen or gets driven by some second screen.

To work on the Web, these scenarios require some form of real-time synchronization between devices at the browser level. This synchronization is in scope for the Web Real-Time Communications working group, whose draft charter is under review by the W3C Membership as this report is written. Provided this working group gets chartered, many second-screen scenarios would be enabled as a direct consequence. Interested W3C Members are encouraged to review and show support for the draft charter.

For multi-screen scenarios to work smoothly, device discovery must be possible from within a Web browser to actually pair devices together. DLNA comes to mind for home networking scenarios. The Device APIs and Policy (DAP) Working Group is currently looking into re-chartering, and the possibility to work on some form of device discovery mechanism is being discussed on the public public-device-apis@w3.org mailing-list (see the public archives of the mailing-list) and may also prove to be of interest for workshop participants. The Web and TV IG should serve to centralize interest for this topic coming from the Web and TV community, follow these discussions, and react accordingly, e.g. by discussing the creation a working group dedicated to device discovery if this topic ends up not being addressed by the groups mentioned above.

On top of synchronization and device discovery, Web browsers may need to expose additional functionalities such as an API or events dedicated to remote controllers. The Web and TV IG will need to refine requirements, see how these needs fit with ongoing efforts in e.g. the Web applications working group, and agree on next steps.

Metadata / Semantic Web

The session on metadata was the occasion to review different aspects of the technology and its use in Web and TV environments.

The requirements for metadata exposed in the different presentations touched different complementary areas like what is needed to:

  • discover services
  • reference/identify and describe content (including profiles per application or media type)
  • expose this information (manifests on web pages, data for widget consumption, reuse by middleware solutions, etc.) and convince content providers it is for their benefit (provide open access to metadata is vital for visibility)
  • consume content across a variety of platforms and media (access and transactions)
  • develop social interactivity and simplify user access

Several solutions/implementations have been mentioned, including Connected Media Experience, DVB and TV-Anytime, and Hikari-TV implementing the ITU-T specifications for IPTV.

Based on the dicussions held during the workshop, the Web and TV Interest Group should probably take on the following actions:

  • Review the technologies currently used for hybrid web-TV solutions and do a gap analysis with the activities in W3C
  • Coordinate metadata related developments including HTML5 activities on the use of the video tag and its attributes, RDFa in HTML, the Ontology for Media Resources developed by the Media Annotations Working Group, Media Fragments URI developed by the Media Fragments Working Group.
  • Propose a vision on metadata and a roadmap for convergence between W3C developments and industrial developments or television and radio standardisation activities
  • Collect and publicise best practices

Extensions to HTML5

A number of organizations external to W3C have worked on extending existing Web standards to meet requirements for connected TVs in hybrid broadcast/broadband scenarios. These organizations include HbbTV, DVB, and DTV/IPTV in Japan.

Some of these extensions may need to be taken up as core Web technologies, for instance support for trick modes (common video playback functions, e.g. pause, play, fast forward, fast rewind, slow forward, slow rewind, jump to previous or future frame), recording, and downloading content, or control of the active video channel in a broadcast environment.

Extensions are of various kinds, from the introduction of new markup attributes or new DOM events to new API functionalities or specific ontologies, or to mechanisms to synchronize video with other content.

The Web and TV IG should discuss with other organizations, and determine priorities as well as starting points for potential standardization efforts within W3C.

The HTML working group has an open issue (ISSUE-152) on support for multiple audio/video tracks within HTML5 that impacts many actors of the TV world. Since this issue is to be resolved by 22 April 2011, interested workshop participants are encouraged to raise their concerns directly on the HTML mailing-list if their point of view has not already been taken into account.

Accessibility

Most participants pointed out that, in many ways, accessibility in the TV industry has been much better than accessibility on the Web, partly thanks to regulations that companies must comply with to sell TV products.

Accessibility needs to be taken into account right at design time and not as an after thought. While sometimes considered by companies as a regulatory requirement, participants observed that adaptive accessibility can often be leveraged in non-accessible contexts, be it only to watch a movie with subtitles in a sound-sensitive environment.

In particular, accessibility was shown as important for the design of multimodal applications that work on various kinds of devices. Works on Accessible Rich Internet Applications (WAI-ARIA) and multimodal interactions were mentioned as candidate technologies to target heterogeneous environments.

The need to harmonize the Web Content Accessibility Guidelines 2.0, that serve as recommendations for making Web content more accessible, and various existing regulations from the TV world was also pointed out.

The Web and TV IG should seek to include experts in accessibility in discussions as soon as possible.

Profiling / Testing

In the most simple scenario, users pay for a consumer electronic device once and stick with it during several years. Firmware updates incur high costs on the manufacturer and/or operator's side, and are usually restricted to critical ones. This means that specifications implemented in consumer electronic devices need to be extremely stable. This stability contrasts with what often happens on the Web where software updates get distributed much more easily on an automated basis.

HTML5 introduces a number of features that are useful from the point of view of the TV world (e.g. support for video/audio) but HTML5 is not a W3C standard and cannot be considered as stable yet. The need to develop comprehensive test suites to ensure interoperability was stressed out. A few days after the workshop, the W3C confirmed the roadmap for HTML5, setting advancement to Last Call for the HTML5 specification for May 2011, and to final Recommendation by 2014, insisting on the testing effort as key for the success of the specification.

Similarly, consumer electronic devices are much more limited in terms of computing power. Material that is only a few years old is often obsolete from a performance's perspecive. Companies that want to agree on a common platform need to subset and/or profile existing specifications to meet their requirements both in terms of hardware constraints and time-to-market.

Discussion on whether profiles need to be specified at W3C is still open. W3C standards were compared to « toolkits » where standards are designed to be orthogonal and extensible on purpose. Profiles that do not subset specification but impose a particular set of specifications (usually coupled with specific extensions) may best be left to external organizations. On the contrary, subsets of specifications need to be discussed with the working groups that are responsible and own the copyright of the underlying specifications (e.g. the HTML Working Group or the CSS Working Group).

Wrap-up discussions

The following list of topics was discussed and refined during the wrapup session. Several votes were held on some of these topics, represented in the « Support » column below.

Not all of the topics could be addressed during the wrap-up session for lack of time. This rough and incomplete list is to serve as input for the Web and TV Interest Group.

Assessment of support for suggestions raised during the workshop
Work item Next step Support
HTTP Adaptive streaming IG to check on MPEG DASH RF commitment.
Integration within HTML in new WG, as second step.
+30 roughly
-2
Content Protection Common encryption algorithm
Support for key exchange.
canPlayType() extension Capacity to play protected content
Support for multi-track Feedback to HTML5? +15 roughly
Secure device identification 2 volunteers to take the lead on that.
-2
Support for trick modes, recording, downloading content Work item in new DAP charter (or separate group)? +25 roughly
Support for home networking Work item in new DAP Charter (or separate group)?
To be precised.
+25 roughly
-1 (privacy related issue)
Support for real time communications Possible Web Real Time Communications WG
Profiling IG discussion
Testing Testing framework?
Synchronization of video content

See the minutes of the wrap-up session for more details.

The Web and TV IG provides the necessary forum for discussion to move these topics forward. This does not mean that all these topics will be necessarily addressed by the Web and TV IG, as the IG can but address what its participants commit to work on. Workshop participants and companies willing to push a specific topic are strongly encouraged to join the Web and TV IG. Information on participation in the Web and TV IG is available on the Web and TV Interest Group's home page.

In the public list, all workshop attendees (and not only) are encouraged to suggest and discuss topics suitable for the Interest Group.


Francois Daoust (W3C), Jean-Pierre Evain (EBU), Giuseppe Pascale (Opera), Stephan Steglich (Fraunhofer-FOKUS), Second W3C Web and TV workshop chairs.
Email: web-and-tv-ws-chairs@w3.org.

Photo credit: Berlin Panorama by lunamtra, some rights reserved.

$Id: summary.html,v 1.32 2011/07/27 20:44:21 fd Exp $