Variability in Specifications

W3C Working Draft 29 June 2005

This version:
Latest version:
Previous version:
Dominique Hazaël-Massieux, W3C
Lynne Rosenthal, NIST
See Acknowledgments.


This document details and deepens some of the most important conformance-related concepts evoked in the QA Specification Guidelines, by developing some of the analysis axes that need to be considered while designing a specification and providing advanced techniques, particularly for dealing with conformance variability and complexity.

Status of this document

This is an Editors draft and doesn't have any standing W3C-wise.

This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the W3C technical reports index at http://www.w3.org/TR/.

This document is the third public Working Draft of Variability in Specifications made available by the QA Working Group of the W3C Quality Assurance (QA) Activity for discussion by W3C members and other interested parties. For more information about the QA Activity, please see the QA Activity statement.

This version features a reorganization of the content of the previous version, with a few additional sections completing the description of the various Dimensions of Variability. There are a few open issues, marked with a capitalized ISSUE keyword.

Publication as a Working Draft does not imply endorsement by the W3C Membership. This is a draft document and may be updated, replaced or obsoleted by other documents at any time. It is inappropriate to cite this document as other than work in progress.

The QA Working Group does not expect this document to become a Recommendation. Rather, after further development, review and refinement, it will be published and maintained as a Working Group Note.

You may email comments on this document to www-qa@w3.org, the publicly archived list of the QA Interest Group.

Table of contents

  1. Introduction
  2. Dimensions of Variability (DoV)
  3. Classes of products and specification category
  4. Subdivisions by profiles
  5. Subdivisions by modules
  6. Subdivisions by levels
  7. Umbrella specifications
  8. Discretionary items
  9. Deprecated features
  10. Extensibility
  11. Acknowledgments
  12. References

1. Introduction

Scope and Goals

This document analyzes how design decisions of a specification's conformance model may affect its implementability and the interoperability of its implementations. To do so, it introduces the concept of variability - how much implementations conforming to a given specification may vary among themselves - and presents a set of well-known dimensions of variability.

Its goal is to raise awareness of the potential cost that some benign-looking decisions may have on interoperability and to provide guidance on how to avoid these pitfalls by better understanding the mechanisms induced by variability.

It completes and deepens the concepts evoked in the Specification Guidelines [SPECGL].


Like the Specification Guidelines [SPECGL], the primary audience of this document is editors and authors (henceforth referred to collectively as editors). However, it is also applicable to a broader audience including:

Structure of this document

This document first introduces the concept of dimensions of variability, and then analyzes specific aspects related to these dimensions. Some of the dimensions are discussed in the Specification Guidelines [SPECGL] and are briefly treated here. The rest are discussed in depth. The seven dimensions are presented in a sequence from most to least independence from other design factors. After the seven dimensions, there is a section discussing how a Working Group might organize documents if variability is a factor encouraging the issuance of a package of several documents.

2. Dimensions of Variability (DoV)

Many of the requirements in the Specification Guidelines [SPECGL] address ways in which a specification might allow variation among conforming implementations. For example, a specification might allow implementations to choose between one of two well-defined behaviors for a given functionality, thus two conforming implementations might vary on that aspect.

The ways in which a specification can allow variability are referred to as dimensions of variability (DoV). The QA Working Group has identified the following seven dimensions of variability:

  1. Classes of product - The generic name for the group of products that would implement, for the same purpose, the specification.
  2. Profiles - a subset of a technology that is tailored to meet specific functional requirements of a particular application community.
  3. Modules - A collection of semantically related features that represents a unit of functionality.
  4. Levels - A technology subset that is one of a hierarchy of nested subsets, ranging from minimal or core functionality to full or complete functionally.
  5. Discretionary items - Deliberate and explicit grants of discretion by the specification to the implementations, that describe or allow optionality of behavior, functionality, parameter values, error handling, etc.
  6. Deprecation - The process of marking certain features as outdated and phasing them out.
  7. Extensibility - A mechanism allowing any party to create extensions.

These seven DoV are not necessarily orthogonal to one another. There are many possible associations, dependencies, and interrelationships. As a general policy, this document and the Specification Guidelines do not attempt to legislate correct or proper relationships among the DoV. Rather, they try to clarify the nature of each dimension and suggest that specifications editors make deliberate and well-documented choices.

The dimensions of variability are one of the principal concepts in the Specification Guidelines with respect to organizing, classifying and assessing the conformance characteristics of W3C specifications. The seven DoV get special attention because they are at the core of the definition of a specification's conformance model. Thus there is significant potential for negative interoperability impacts if they are handled carelessly or without careful deliberation.

As a general principle, variability complicates interoperability. In theory, interoperability is best when there are numerous identical, complete, and correct implementations. However, when compared to the alternatives, the net effect of conformance variability is not necessarily negative in all cases. For example profiles — subdivisions of the technology targeted at specific applications communities — introduce variability among implementations. Some will implement Profile ABC, some will implement Profile XYZ, and the two might not intercommunicate well if ABC and XYZ are fairly different. However, if ABC and XYZ are subsets of a large monolithic specification — too large for many implementers to tackle in total -- and if they are well targeted at actual application sectors, then subdivision by profiles may actually enhance interoperability.

Different sorts of variability have different negative and positive impacts. The principal danger is "excessive" variability - variability that goes beyond what is needed for a positive interoperability trade-off and that unnecessarily complicates the conformance model. Specification editors need to carefully consider and justify any variability allowed and its affect on conformance. This can be done by referencing project requirements and use cases and/or explicitly documenting the choices made.

It is even more important to take into account the multiplicative effect on variability created by combining several dimensions of variability. Each pair of dimensions of variability used in a specification needs to be assessed with regard to the variability it creates. The editors should document any limitations on the ways an implementation can combine dimensions. For instance, deprecated features in HTML 4.01 [HTML4] are allowed in the Transitional profile and forbidden in the Strict profile.

Note that the variability addressed by the so-called dimensions of variability is only considered with regard to conformance to a well-defined specification. As such, the changes introduced in the conformance requirements between two versions or two editions of the specification are not considered as dimensions of variability.

3. Classes of products and specification category

The most basic dimension of variability is class of product. The class of product separates the different kinds of implementations a specification may have. For instance, SVG 1.1 [SVG11] defines conformance for six classes of product: SVG document fragments, SVG stand-alone files, SVG included documents fragments, SVG generators, SVG interpreters, and SVG viewers.

Defining these classes of products is thus one of the most important steps in the design of a specification's conformance model. This section provides advice on how to identify classes of products. To do this, it introduces the design concept of specification categories.

Classes of products

From this categorization of specifications, a Working Group can identify the class of products that are affected by the specification. Classes of products can be generalized as either producers or consumers, or as content itself.

For example, identifying which are producers and consumers is clear for a protocol-type specification: the two parties to the dialog are the targets. For a processor-type specification, the processor is the consumer of an XML vocabulary defined in the specification. For content-type specifications, there may be one or more consumers that take the content and "play" or "read" it in some way.

The following is a list of the most common classes of products for W3C specifications:

This list does not exhaust all possibilities. Specifications may have to define their own classes of product if none of these fits.

Specification category

To answer the question "what needs to conform?" it can help to first look at the nature of the specification and categorize it. Often, the scope of the specification can be determined by placing the specification in one, or possibly more, categories based on what the specification describes. This will help the Working Group decide whether they need to address a particular view of the technology, possibly including its variability, or simply declare that the specification(s) are independent of that view. Further, categorization is a first step to determining which Dimensions of Variability are likely to be in scope for the specification.

The following is a non-exhaustive list of specification categories:

From this categorization of specifications, the Working Group can identify the class of products that are affected by the specification.

ISSUE: needs to explain the different categories, how to actually make a specification category analysis

4. Subdivisions by profiles

Profiles, modules and levels are three ways to subdivide a specification into related groups of conformance requirements. Because these three dimensions of variability define subsets of a technology, they share some characteristics in the way they affect conformance and interoperability.

A profile is a subset of the technology that supports a particular functional objective or a subset of a set of technologies defining how they are required to operate together (e.g., XHTML plus MathML plus SVG [X-M-S]).

Profiles can be based on hardware considerations associated with target product classes — for example, SVG Tiny is aimed at mobile phones — or they may be driven by other functional requirements of their target constituencies — for example, a graphical profile tailored for technical illustrations in aircraft maintenance manuals.

Diagram showing how profiles were used in SVG 1.1
Diagram illustrating profiles used to adapt the SVG Technology to different platforms.

The use of profiles to divide the technology is described in the specification. Profiles may or may not be reflected and paralleled by the structure and organization of the specification.

Specifications may define individual profiles or rules for profiles or both. An individual profile defines the requirements for classes of products that conform to that profile. Rules for profiles define validity criteria for profiles themselves — i.e., if others (users, applications, or other standards) define their own profiles of the standard (called derived profiles of the specification), then rules for profiles define the constraints that those derived profiles must satisfy in order to be considered valid profiles of the specification.

For example, XHTML Modularization ([XHTML-MOD], section 3) and Synchronized Multimedia Integration Language (SMIL 2.0), [SMIL20] specifications both define rules for profiles -- what constraints must a profile meet in order to be classified as a "Host Language Profile" or an "Integration Set Profile." SMIL further defines some specific profiles, using the modularization. Separate recommendations -- XHTML Basic [XHTML-BASIC] and XHTML 1.1 [XHTML11] — define specific profiles based on the XHTML modularization.

5. Subdivision by modules

Modules are discrete divisions or functional groupings of the technology and do not necessarily fit in a simple hierarchical structure.

Diagram showing how modules were used in XHTML 1.1
Diagram illustrating modules used to divide XHTML 1.1 in re-usable components.

Modules generally can be implemented independently of one another — e.g., audio vs. video module. That notwithstanding, it is possible for one module's definition (and therefore implementation) to have explicit dependency upon another module. It is not only possible, but also common to implement multiple modules.

6. Subdivision by levels

Functional levels — or in common usage simply levels — are used to group functionality into nested subsets, ranging from minimal or core functionality to full or complete functionally. Level 1 is the minimum or core of the technology. Level 2 includes all of level 1 plus additional functionality. This nesting continues until level n, which consists of the entire technology.

Diagram showing how levels were used in WCAG
Diagrams illustrating levels of conformance in the Web Content Accessibility Guidelines 1.0 [WCAG]
Diagram showing how levels were used in the DOM
Diagram illustrating levels used to build up the Document Object Model.

Levels may result from progressive historical development and enrichment of the technology in a series of specifications, as in the case of CSS and DOM. Levels could also be defined explicitly in a single edition of the specification, as in the Web Content Accessibility Guidelines.

Sometimes, the nesting goal of levels is achieved through profiles. For example, SVG 1.1 [SVG11] together with SVG Mobile [Mobile [SVG-MOBILE] define three nested profiles — Tiny, Basic, Full — which are each targeted at a specific graphics hardware community (mobile phone, hand-held computer, desktop computer).

7. Umbrella specifications

It is not always practical, desirable, or possible to have a monolithic specification - that is, one that presents the requirements for a technology in a single document. The Working Group may produce several documents that act collectively to specify the technology (e.g., Web Ontology Language OWL). There are all sorts of reasons for having or needing a collection or series of specifications to describe a technology. These reasons include:

In these cases, there should be a single document, called an umbrella specification that ties all the documents together. The umbrella specification serves as foundation or "Read me First" document for the entire collection or series. It can provide:

Figure 1: Umbrella specification

Diagram illustrating  the notion of umbrella specification as a composite document specification.

In this figure, the technology is composed of two modules (defining functional division of the technology), a profile (defining the requirement of implementation for a specific device) and a primer (introducing the technology and its basic concepts). An "umbrella specification" document groups them together making it a logical, usable and complete technology.

Examples of umbrella specifications

XML Schema Part 0: Primer Second Edition is a non-normative document intended to provide an easily readable description of the XML Schema facilities, and is oriented towards quickly understanding how to create schemas using the XML Schema language.XML Schema Part 1: Structures and XML Schema Part 2: Datatypes provide the complete normative description of the XML Schema language. This primer describes the language features through numerous examples which are complemented by extensive references to the normative texts.

RDF Primer is one document in a set of six (Primer, Concepts, Syntax, Semantics, Vocabulary, and Test Cases) intended to jointly replace the original Resource Description Framework specifications, RDF Model and Syntax (1999 Recommendation) and RDF Schema (2000 Candidate Recommendation). The Primer is designed to provide the reader with the basic knowledge required to effectively use RDF. It introduces the basic concepts of RDF and describes its XML syntax. It describes how to define RDF vocabularies using the RDF Vocabulary Description Language, and gives an overview of some deployed RDF applications. It also describes the content and purpose of other RDF specification documents.

OWL Guide and OWL Overview are other examples which approach the concept of Umbrella Specification. All documents of the OWL series refer to the Document Roadmap which gives more context.

8. Discretionary items

Discretionary items are defined as deliberate and explicit grants of discretion by the specification to the implementations that describe or allow optionality of behavior, functionality, parameter values, error handling, etc.

Discretionary items are often made available in specifications to give implementers of the technology the opportunity to decide from alternatives when building applications and tools. Discretionary items may be considered necessary because of environmental conditions (e.g., hardware limitations, software configuration, or external systems), locality (e.g., time zone or language), optional choices providing flexibility of implementation, dependence on other specifications, etc. By explicitly mentioning discretionary items, the specification calls attention to variability that will be of interest to both implementers and consumers of the technology. Of course, conformance testers will also want to know about such variability.

Discretionary items come in three basic variants:

1. Discretionary choices
A value or behavior may be chosen from a well-defined enumerated set of two or more possibilities. In some cases, the implementer may be able to provide a parameter that will allow the end-user to choose among all the values/behaviors that the implementer has implemented.
2. Optional features
A well-defined feature may be supported or not (if supported, then the requirements are clear and unambiguous). For example, XML data may be validated or not. Any discretionary item that may fit this definition should be reviewed to determine whether it is significant enough to rise to the level of being a module. A module is substantial enough that a consumer of the technology would probably want to know at time of purchase whether the module has been implemented. Another situation that warrants designating a module occurs when several facets of the technology are affected and must be consistent.
3. Implementation dependent values (or features)
The set of values an element or attribute may have is open-ended and undefined with the possible exception of a required value. For example, character collations have open-ended variation, but specifications that require collation capability will often require one particular collation (based on Unicode code-point values) to establish common ground. An implementation-dependent feature is one whose end result must occur, but the behavior that leads to that end result is discretionary. For example, XQuery [XQUERY] addresses a data store as if it were an XML-style tree structure, but allows the actual storage to be implementation-dependent as long as the fetched values are consistent with the tree structure.

The above have the following common traits: the Working Group recognized that variation is possible, they recognized that users of the technology will need to know the behavior of any given implementation, and they chose not to force uniform behavior. This can be contrasted to other types of implementation-defined behavior that the Working Group chose to leave unspecified. A common example of this is the behavior when multiple errors are present in the input.

Since explicit recognition of discretionary items has benefits for many stakeholders, it is good practice to provide an identifier for each item. Where individual choices have been identified, those can also be given names (exact NMTOKEN values if used as parameters or attributes). This will promote proper comparison of different implementations.

9. Deprecated features

The need for deprecation occurs when features defined in the specification have become outdated and are being phased out, usually in favor of a specified replacement. Discussion of deprecation appears in part 2.4.4 of the Specification Guidelines [SPECGL].

10. Extensibility

To accommodate changes in technology and information on the Web, a specification can be designed for extensibility. A specification is extensible when it provides a mechanism to allow an external party to create extensions. Extensions incorporate additional features beyond what is defined in the specification. Extensibility could apply to a particular module or profile. Additional discussion of extensibility appears in part 2.4.3 of the Specification Guidelines [SPECGL].

11. Acknowledgments

The following QA Working Group and Interest Group participants have contributed significantly to the content of this document:

12. References

These references are informative.

Document Object Model (DOM) Level 3 Core Specification , G. Nicol, S. Byrne, P. Le Hégaret, J. Robie, M. Champion, A. Le Hors, L. Wood, Editors, W3C Recommendation, 7 April 2004, http://www.w3.org/TR/2004/REC-DOM-Level-3-Core-20040407 . Latest version available at http://www.w3.org/TR/DOM-Level-3-Core/ .
HTML 4.01 Specification , D. Raggett, I. Jacobs, A. Le Hors, Editors, W3C Recommendation, 24 December 1999, http://www.w3.org/TR/1999/REC-html401-19991224 . Latest version available at http://www.w3.org/TR/html401 .
XML Information Set (Second Edition) , J. Cowan, R. Tobin, Editors, W3C Recommendation, 4 February 2004, http://www.w3.org/TR/2004/REC-xml-infoset-20040204 . Latest version available at http://www.w3.org/TR/xml-infoset .
Mathematical Markup Language (MathML) Version 2.0 (Second Edition) , D. Carlisle, P. Ion, N. Poppelier, R. Miner, Editors, W3C Recommendation, 21 October 2003, http://www.w3.org/TR/2003/REC-MathML2-20031021/ . Latest version available at http://www.w3.org/TR/MathML2/ .
OWL Web Ontology Language Reference , G. Schreiber, M. Dean, Editors, W3C Recommendation, 10 February 2004, http://www.w3.org/TR/2004/REC-owl-ref-20040210/ . Latest version available at http://www.w3.org/TR/owl-ref/ .
Synchronized Multimedia Integration Language (SMIL 2.0) - [Second Edition] , T. Michel, J. Ayars, Editors, W3C Recommendation, 7 January 2005, http://www.w3.org/TR/2005/REC-SMIL2-20050107/ . Latest version available at http://www.w3.org/TR/SMIL/ .
SOAP Version 1.2 Part 1: Messaging Framework , H. Frystyk Nielsen, J. Moreau, M. Gudgin, N. Mendelsohn, M. Hadley, Editors, W3C Recommendation, 24 June 2003, http://www.w3.org/TR/2003/REC-soap12-part1-20030624/ . Latest version available at http://www.w3.org/TR/soap12-part1/ .
QA Framework: Specification Guidelines , D. Hazaël-Massieux, L. Rosenthal, L. Henderson, K. Dubost, Editors, W3C Working Draft (work in progress), 28 April 2005, http://www.w3.org/TR/2005/PR-qaframe-spec-20050629/ . Latest version available at http://www.w3.org/TR/qaframe-spec/ .
Scalable Vector Graphics (SVG) 1.1 Specification , D. Jackson, J. Ferraiolo, \u85e4\u6ca2, Editors, W3C Recommendation, 14 January 2003, http://www.w3.org/TR/2003/REC-SVG11-20030114/ . Latest version available at http://www.w3.org/TR/SVG11/ .
Mobile SVG Profiles: SVG Tiny and SVG Basic , T. Capin, Editor, W3C Recommendation, 14 January 2003, http://www.w3.org/TR/2003/REC-SVGMobile-20030114/ . Latest version available at http://www.w3.org/TR/SVGMobile/ .
An XHTML + MathML + SVG Profile , M. Ishikawa, Editor, W3C Working Draft (work in progress), 9 August 2002, http://www.w3.org/TR/2002/WD-XHTMLplusMathMLplusSVG-20020809/ . Latest version available at http://www.w3.org/TR/XHTMLplusMathMLplusSVG/ .
XForms 1.0 , R. Merrick, M. Dubinko, L. L. Klotz, T. V. Raman, Editors, W3C Recommendation, 14 October 2003, http://www.w3.org/TR/2003/REC-xforms-20031014/ . Latest version available at http://www.w3.org/TR/xforms/ .
Modularization of XHTML\u2122 , S. Dooley, S. Schnitzenbaumer, F. Boumphrey, T. Wugofski, M. Altheim, S. McCarron, Editors, W3C Recommendation, 10 April 2001, http://www.w3.org/TR/2001/REC-xhtml-modularization-20010410/ . Latest version available at http://www.w3.org/TR/xhtml-modularization/ .
XHTML\u2122 Basic , P. Stark, T. Wugofski, M. Ishikawa, S. Matsui, T. Yamakami, M. Baker, Editors, W3C Recommendation, 19 December 2000, http://www.w3.org/TR/2000/REC-xhtml-basic-20001219 . Latest version available at http://www.w3.org/TR/xhtml-basic .
XHTML\u2122 1.1 - Module-based XHTML , M. Altheim, S. McCarron, Editors, W3C Recommendation, 31 May 2001, http://www.w3.org/TR/2001/REC-xhtml11-20010531 . Latest version available at http://www.w3.org/TR/xhtml11/ .
XML Schema Part 2: Datatypes Second Edition , P. V. Biron, A. Malhotra, Editors, W3C Recommendation, 28 October 2004, http://www.w3.org/TR/2004/REC-xmlschema-2-20041028/ . Latest version available at http://www.w3.org/TR/xmlschema-2/ .
XML Path Language (XPath) Version 1.0 , J. Clark, S. J. DeRose, Editors, W3C Recommendation, 16 November 1999, http://www.w3.org/TR/1999/REC-xpath-19991116 . Latest version available at http://www.w3.org/TR/xpath .
XPointer Framework , N. Walsh, P. Grosso, E. Maler, J. Marsh, Editors, W3C Recommendation, 25 March 2003, http://www.w3.org/TR/2003/REC-xptr-framework-20030325/ . Latest version available at http://www.w3.org/TR/xptr-framework/ .
XQuery 1.0: An XML Query Language , J. Robie, D. Florescu, J. Siméon, D. Chamberlin, S. Boag, M. F. Fernández, Editors, W3C Working Draft (work in progress), 4 April 2005, http://www.w3.org/TR/2005/WD-xquery-20050404/ . Latest version available at http://www.w3.org/TR/xquery .
XSL Transformations (XSLT) Version 1.0 , J. Clark, Editor, W3C Recommendation, 16 November 1999, http://www.w3.org/TR/1999/REC-xslt-19991116 . Latest version available at http://www.w3.org/TR/xslt .
Web Content Accessibility Guidelines 1.0 , W. Chisholm, G. Vanderheiden, I. Jacobs, Editors, W3C Recommendation, 5 May 1999, http://www.w3.org/TR/1999/WAI-WEBCONTENT-19990505/ . Latest version available at http://www.w3.org/TR/WAI-WEBCONTENT .