Skip to contents |
W3C Ubiquitous Web Domain | Multimodal Interaction home

The Multimodal Interaction Activity seeks to extend the Web to allow users to dynamically select the most appropriate mode of interaction for their current needs including any disabilities in order to enable Web application developers to provide an effective user interface for whichever modes the user selects. With multimodal Web applications, users can provide input via speech, handwriting and keystrokes, with output presented via displays, pre-recorded and synthetic speech, audio, and tactile mechanisms such as mobile phone vibrators and Braille strips.

The goal of the Multimodal Interaction Activity is to clearly define how to author concrete multimodal Web applications, for example, coupling a local GUI (e.g., HTML user agent) with a remote Speech I/F (e.g., VoiceXML user agent). The Multimodal Interaction Working Group is important as a central point of coordination within W3C for multimodal activities, and the group collaborates with other related Working Groups, e.g. Voice Browser, Scalable Vector Graphics, Compound Document Formats, Web Applications and Ubiquitous Web Applications.

Highlights Since the Previous Advisory Committee Meeting

The Multimodal Interaction Working Group was rechartered to develop W3C Recommendations that will enable the widespread deployment of multimodal applications including on mobile phones and other devices including cars and home appliances. The updated Multimodal Interaction Working Group charter includes the following specifications:

EMMA was published as a W3C Recommendation on 10 February 2009 (Press Release, Testimonial). Now the group is working hard to extend EMMA's capability and make it fit various multimodal systems including in-car systems and home appliances as well as mobile devices. EMMA promotes the development of rich Web applications that can be adapted to more input modes (such as handwriting, natural language, and gestures) and output modes (such as synthesized speech) at lower cost.

The group is also wrapping up the discussion on new features for the next Working Draft of the Multimodal Architecture and Interfaces (MMI Architecture) . The major new items includes an HTTP profile and an example of an Ink modality component for handwriting recognition.

The group is working on the Disposition of Comments for InkML ad preparing for publishing an updated Last Call Working Draft for the specification. An Implementation Report Plan document is also being prepared in order to advance the specification to a Candidate Recommendation. The group will be requesting implementers to submit Implementation Reports when the specification becomes a CR.

Upcoming Activity Highlights

The group is investigating potential extensions for EMMA to support new features for multimodal applications in various environments. A document on possible EMMA use cases for multimodal environments is expected to be published shortly. The group expects to publish the next Working Draft for MMI Architecture around the next face to face meeting in November, and plans to publish a second Last Call Working Draft for InkML since there were lots of feedback from the public to the first Last Call draft which requires clarifications and modifications of the specification. Also the gorup is starting the work for EmotionML (see also the Emotion Incubator Group Report) and continues the work for the MMI Architecture and InkML.

The group plans to hold the next face to face meeting on November 2-3 during the upcoming TPAC 2009 (W3C Technical Plenary / Advisory Committee Meetings Week) .

Summary of Activity Structure

GroupChairTeam ContactCharter
Multimodal Interaction Working Group
(participants)
Deborah DahlKazuyuki AshimuraChartered until 31 March 2011

This Activity Statement was prepared for the March 2010 W3C Advisory Committee Meeting (Members only) per section 5 of the W3C Process Document. Generated from group data.

Kazuyuki Ashimura, Multimodal Interaction Activity Lead

$Id: Activity.html,v 1.234 2010/02/02 15:52:00 sysbot Exp $
Valid XHTML 1.0!