One Web

The Web is used globally and commonly, so the following is essential:

• Interoperability: Input/Output of various devices
• Internationalization: Processing variety of languages
• Multi-Modality: Combination of various UI modalities
• Accessibility: Needs of various users/cases

Web of Devices: Extending Web's capability

Mobile, CE Devices (e.g., TV), and now Digital Signage

Issues on developing multi-modal intractive systems

• Web contents have been changed much, and multimedia contents are getting more and more populer these days.
• Also many different kinds of input/output modalities are used for interactive systems.
• So it is getting more and more dificult to develop fully accessible and usable systems using conventional ways.

MMI Architecture: One of the possible approaches

As we discussed yesterday, there are more than one approaches to get "there".

W3C MMI Architecture has the following features, and could provide basic framework for next generation Web applications including Web-based Signage systems.

• Integration of multiple modalities on multiple devices using
• Linking Consumer Electronics devices at home, e.g., IPTV, and "Cloud Services"
• Re-use of existing hardware and software resources
• Defining application lifecycle directly using a set of "Lifecycle Events"

MMI Architecture Framework

• MMI Architecture: a universal messaging mechanism
• EMMA: a standard data format for multimodal applications
• SCXML: a smart state transition control mechanism

Example of Multimodal Systems

• AT&T's Speak4it
• Opensteam's Multimodal Personal Health Record (PHR) management system

Multimodal Mashup using MMI Architecture

• Combination of distributed devices that have various input/ouput modalities
• Connecting local devices with so-called "Cloud"
• Interactive data handling using simple set of events; HTML5 Browser could be a GUI modality

Thanks!