[contents]

Abstract

This is a Working group internal Draft produced by the Evaluation and Repair Tools Working Group (ERT WG). The purpose of this document is to specify the Evaluation and Report Language (EARL) 1.0. The ERT Working Group encourages feedback about this document as well as implementation of the language in authoring tools, testing tools, search engines, and other relevant tools.

Evaluation and Report Language (EARL) is a general-purpose language for expressing test results. This specification defines a basic vocabulary to describe test results. A companion document gives a more general introduction to the motivation for EARL, and provides more tutorial material.

Status of this document

This section describes the status of this document at the time of its publication. Other documents may supersede this document. The latest status of this document series is maintained at the W3C.

This is the first working group internal draft of the EARL specification since the group was rechartered and began work in 2005. It is intended as one part of a two-part replacement for the existing public working draft. This document focuses on the technical details of the specification, while a companion document describes the motivations for EARL and provides a tutorial introduction to its use. This draft is expected to be obsoleted by a new draft around @@August 2005@@??????

This draft is not complete. In many cases issues are noted, as in the following paragraph:

[Editor's note: there are some items that the working group has discussed but not reached consensus, and others that are known issues which have not yet been discussed]

Comments on this document are actively encouraged, and should be sent to the Evaluation and Repair Tools Working Group. The archives for this list are publicly available.

This draft document may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use W3C Working Drafts as reference material or to cite them as other than "work in progress." A list of current W3C Recommendations and other technical documents can be found at http://www.w3.org/TR/.

Patent disclosures relevant to this specification may be found on the ERT Working Group's patent disclosure page in conformance with W3C policy.

This document has been produced by the Evaluation and Repair Tools Working Group (ERT WG) as part of the W3C Web Accessibility Initiative (WAI). The ERT WG is part of the WAI Technical Activity. The goals of the ERT WG are discussed in the Working Group charter.

Table of Contents

Appendices

1. Introduction

This chapter is informative.

Evaluation and Report Language (EARL) is a language to express test results. Test results include bug reports, test suite evaluations, and conformance claims. The test subject might be a Web site, an authoring tool, a user agent or some other entity. Thus, EARL is flexible. It enables any person, entity, or organization to state test results for any thing tested against any set of criteria.

Stating test results in EARL creates a variety of opportunities. The data can be

A companion document to this specification is intended to provide more introductory material and explanation of the use cases for EARL.

1.1. Test results

EARL statements contain the following information:

The context information
This can include information about who or what ran the test, the date the test was run, and other information about the test was performed.
The test subject
This may include: Web pages, tools (e.g. accessibility checkers, validators), and user agents
The result
Did the test subject pass or fail the test? How certain can we be?
Test criteria
What are we evaluating the test subject against? This could be a specification, a set of guidelines, a test from a test suite, or some other test case.

Prose examples that demonstrate the above structure:

  1. Context
    Mary Thompson claims on the 17th December
    Test Subect
    A Web page at http://www.example.org/mypage
    Test Result
    Passed
    Test performed
    Checkpoint 1.1 of the Web Content Accessibility Guidelines 1.0
  2. Context
    The W3C Markup Validator claims as of 2004-04-14T14:00:04+1000
    Test Subject
    The XHTML returned from a GET request to the URI http://www.example.org/yourpage
    Test Result
    Failed
    Test Performed
    XHTML conformance
  3. Bobby Smith (context) asserts that his browser, CoolBrowser v 1.0 revision date 2001-05-17 (test subject) passed (test result) the CSS 1.0 test suite (test criteria).

1.2. An RDF Vocabulary

EARL is defined as an RDF vocabulary. The Resource Description Framework (RDF) [RDF] is a general-purpose language for describing information in a way that is machine-understandable.

EARL is an RDF vocabulary used to make statements about how a resource performed against a test. In common with other RDF it assumes that other voacbularies will be used as appropriate.

For more information on RDF, please refer to the following references:

2. Core Vocabulary

This chapter is normative.

Namespace

The namespace for EARL as specified in this draft is http://www.w3.org/WAI/ER/EARL/nmg-strawman#

[Editor's note: Versioning terms during the process of developing the vocabulary is an issue the group is working on. It is possible that a new namespace will be used for a final version of the vocabulary]

2.1. Assertion

An assertion is a statement about the results of performing a test. This is the fundamental part of an EARL statement.

Excerpt 1: definition of the assertion class in RDF/XML


<rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion">
  <rdfs:label xml:lang="en">An assertion</rdfs:label>
  <rdfs:comment xml:lang="en">Parent node that contains all parts of an assertion</rdfs:comment>
  <rdfs:subClassOf>
    <owl:Restriction>
      <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#assertedBy"/>
      <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1
        </owl:minCardinality>
    </owl:Restriction>
    <owl:Restriction>
      <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#mode"/>
      <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1
        </owl:minCardinality>
    </owl:Restriction>
    <owl:Restriction>
      <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#result"/>
      <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1
        </owl:minCardinality>
    </owl:Restriction>
    <owl:Restriction>
      <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#subject"/>
      <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1
        </owl:minCardinality>
    </owl:Restriction>
    <owl:Restriction>
      <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#testcase"/>
      <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1
        </owl:minCardinality>
    </owl:Restriction>
  </rdfs:subClassOf>
</rdfs:Class>

An assertion must have at least the following properties:

Asserted By
The assertion must be asserted by an assertor. The property &earl;assertedBy is defined by this specification.
Subject
The thing that is being tested for conformance to some requirement. The property &earl;subject is defined by this specification.
Test Case
The requirement that is being tested. The property &earl;testCase is defined by this specification.
Result
The result of the test - whether the subject passes or fails the test case (or there is some other result). The property &earl;result is defined by this specification.
Mode
How the test was performed - as an automated computer process, by a human making a subjective judgement, or otherwise. The property &earl;mode is defined by this specification.

Example 1: instance of an assertion expressed in RDF/XML


<earl:Assertion rdf:about="http://example.org/#assertion-1">
  <earl:subject rdf:resource="http://example.org/#someID02495"/>
  <earl:result rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#pass"/> 
  <earl:mode rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#manual"/> 
  <earl:testcase rdf:resource="http://example.org/#tc-1"/>   
  <earl:assertedBy rdf:resource="http://example.org/#assertor123" />
</earl:Assertion>

2.2. Assertor

An assertor states the results of a test (i.e. an assertor asserts and assertion). An assertor must be either a person or a tool of class &earl;Assertor which is defined by this specification.

Assertors

Person
The Assertor is a human being. This uses the FOAF vocabulary term &foaf;Person for a person. There should be identifying information including a name, and a uniquely identifying property such as email address or an encrypted email address. Again, the properties &foaf;name, &foaf;mbox and &foaf;mbox_sha1sum are defined by FOAF [FOAF].
[Editor's note: the use of FOAF is subject to review of the stability of these terms.]
[Editor's note: the current requirements on properties to identify the tester are subject to revision.]
A person may have made their evaluation with the help of a tool. In this case EARL provides the &earl;usingTool property. [Editor's note: there may be a problem with the way this is modelled, and it may need to change.]
Tool
The Assertor is a tool, such as a black box testing tool of some sort or an evaluation and repair tool. A Tool must have a title (using the Dublin Core property title) and may have version information (using Dublin Core terms)
[Editor's note: the current requirements on properties to identify a tool are subject to revision.]
[Editor's note: Tool used to be a sub class of Assertor. This restriction has been removed, so a Tool may now also be a Test Subject.]

The assertor in the following example is a person. Their personal email address is used to uniquely identify them, in both unencrypted and encrypted forms (it is not necessary to use both of these methods, but it is permitted). The test was done using a tool called "My Favourite Tool".

<earl:Assertor rdf:about="http://example.org/#assertor123">
<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/Person">
  <foaf:name>Bob B. Bobbington</earl:name>
  <foaf:mbox rdf:resource="mailto:bob@example.org"/>
  <foaf:mbox_sha1sum>1a9daad476f0158b81bc66b7b27b438b4b4c19c0</foaf:mbox_sha1sum>
  <earl:usingTool>
    <earl:Tool>
      <dc:title xml:lang="en">My Favourite Tool</dc:title>
    </earl:Tool>
  </earl:usingTool>
</earl:Assertor>

Test Subject [Editors note: this section is still under discusssion and is expected to be substantially revised]

The class of things that have been evaluated. It needs to be qualified with some type of information in order to make it unambiguous. You may use an unambiguous property, or unambiguous constellation of properties.

Different Test Subjects

Tool
A tool. Most likely a piece of software such as an authoring tool, or evaluation and repair tool.
Web Content
Information on the World Wide Web. This should include enough information to identify the content actually tested, taking account of content type and language negotiation and similar factors that can change the content actually served.

Test Result

The result of the test. This must be one of the Validity Levels

or a customised subClass of these.

It may also include a description, using the Dublin Core description property. This is meant to be human-readable text or markup (for example HTML included as an XML Literal). This can be inserted by a tool or by a human evaluator.

There is a confidence property which allows an evaluator to assert their confidence in the result. This may be used where a tool wants to assert that it has difference levels of confidence about two possible results (for example low confidence that a test has been passed, but also high confidence that it is not applicable.

[Editor's note: there are currently value specified as confidence values, of high, medium, and low, but these are under discussion and may be removed or significantly revised since it is not yet clear how to ensure that they can be used interoperably]

The following example shows a result with a validity of fail and a description of the problem in XHTML:

<earl:result rdf:parseType="Resource">
  <earl:validity rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#fail"/>
  <dc:description rdf:parseType="Literal">
    <div xml:lang="en" xmlns="http://www.w3.org/1999/xhtml">
      <p>The <code>table</code> element is not allowed to appear
        inside a <code>p</code> element</p>
    </div>
</earl:result>

Test Case

A Test Case is a test - usually one that can either be passed or failed. This may include many things such as validation requirements, code test cases, checkpoints from guidelines such as WCAG 1.0 [WCAG10], etc. These should be identified with a URI.

A Test Case may be a compound test, or may be a part of a larger compound test. These relations can be described using Dublin Core's hasPart or isPartOf properties.

The following example uses the Test Case class to identify a test case for an Assertion.

<earl:testCase>
  <earl:Testcase rdf:about="http://example.org/#tc-1" />    
</earl:testcase>

The value of the testCase property is by definition a Test Case, so the above example can be shortened to:

<earl:testCase rdf:resource="http://example.org/#tc-1" />

Test Mode

The value of the mode property must be exactly one test mode (or subclass of a test mode - see extensibility for more explanation). The modes defined are

Manual (earl:manual)
Where the test was performed based on a person's judgement. This includes the case where that judgement was aided through the use of a tool, although this should be noted with the usingTool property.
Automatic (earl:automatic)
Where a computer program or similar has done an automated test and generated a result without human assistance.
Heuristic (earl:heuristic) [Editor's note: this property is under discussion and may be changed]
This property was designed to cover assertions which are made by inference, for example based on several existing test results.

4. Extensibility

Because it is written as an RDF vocabulary EARL is extensible; that is, it is simple to add new terms or otherwise modify them to fit your own specific application demands more closely. EARL was designed to be extended. You may think of it as a core set of structures and terms. In addition, the working group expects to work on at least a couple of areas and extend the specification before publishing it as a Recommendation.

[Editor's note: there will be examples of extending EARL provided in a later draft]

5. Conformance

The EARL vocabulary uses OWL [OWL] to provide formal constraints on what is valid EARL.

[Editor's note: the topic of conformance requirements beyond those implicit in the vocabulary definition will be discussed, and results will be incorporated into a future draft.]

6. Contributors and History

EARL is the result of the work of a great many people. In particular important contributions to the specification have been made by Shadi Abou-Zahra, Chrisoula Alexandraki, Myriam Arrue, Gabriele Bartolini, Giorgio Brajnik, Dan Brickley, Daniel Dardailler, Karl Dubost, Nick Gibbins, Al Gilman, Dominique Hazael-Massieux, Nadia Heninger, Ian Hickson, Carlos Iglesias, Leonard Kasday, Nick Kew, Johannes Koch, Jim Ley, William Loughborough, John Lutts, Charles McCathieNevile, Libby Miller, Tom Martin, Sean B. Palmer, Dave Pawson, Eric Prud'hommeaux, Pierre Queinnec, Chris Ridpath, Romain Roure, Aaron Swartz, Olivier Thoreaux, Paul Walsh and Rob Yonaitis.

The editors apologise for any names left out of this list, and will endeavour to rectify any errors noted in comments.

7. References

[DC]
Dublin Core terms - DCMI. Available at ...
[EARL-Background]
EARL Background Material - Sean B. Palmer (2001)
[EARL-Imps]
EARL Implementations
[EVOLVE]
Evolvability - Tim Berners-Lee (1998)
[FOAF]
FOAF vocabulary definition - Dan Brickley et al. Available at http://xmlns.com/foaf/0.1/
[OWL]
Web Ontology Language -
[RDF]
Resource Description Framework (RDF) Model and Syntax Specification - Ora Lassila and Ralph R. Swick. (1999) W3C Recommendation.
[RDF-PRIMER]
RDF Primer - Frank Manola and Eric Miller (2002) W3C Working Draft.
[RDF-Schema]
RDF Vocabulary Description Language 1.0: RDF Schema - Dan Brickley, R.V. Guha. (2002) W3C Working Draft.
[RDF-XML-DIFFS]
Why RDF model is different from the XML model - Tim Berners-Lee (1998)
[WCAG10]
Web Content Accessibility Guidelines 1.0 - Wendy Chisholm, Gregg Vanderheiden, Ian Jacobs. (1999) W3C Recommendation.

Appendix A: EARL 1.0 Schema

<?xml version="1.0"?>
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
         xmlns:earl="http://www.w3.org/WAI/ER/EARL/nmg-strawman#"
         xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"
         xmlns:dc="http://purl.org/dc/elements/1.1/"
         xmlns:foaf="http://xmlns.com/foaf/0.1/"
         xmlns:owl="http://www.w3.org/2002/07/owl#">
  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion">
    <rdfs:label xml:lang="en">An assertion</rdfs:label>
    <rdfs:comment xml:lang="en">Parent node that contains all parts of an assertion</rdfs:comment>
    <rdfs:subClassOf>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#assertedBy"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#mode"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#result"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#subject"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#testcase"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
    </rdfs:subClassOf>
  </rdfs:Class>

  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#assertedBy">
    <rdfs:label xml:lang="en">asserted by</rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion"/>
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertor"/>
  </rdf:Property>
  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#result">
    <rdfs:label xml:lang="en">result</rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion"/>
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestResult"/>
  </rdf:Property>
    <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#subject">
    <rdfs:label xml:lang="en">subject</rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion"/>
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestSubject"/>
  </rdf:Property>
  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#testcase">
    <rdfs:label xml:lang="en">testcase</rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion"/>
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestCase"/>
  </rdf:Property>
  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#mode">
    <rdfs:label xml:lang="en">mode</rdfs:label>
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestMode"/>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertion"/>
  </rdf:Property>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Assertor">
    <rdfs:label xml:lang="en">Assertor Class</rdfs:label>
    <rdfs:comment xml:lang="en">Person or evaluation tool that claims assertions</rdfs:comment>
    <owl:oneOf rdf:parseType="Collection">
      <owl:Thing rdf:type="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Tool"/>
      <owl:Thing rdf:type="http://xmlns.com/foaf/0.1/Person">
        <rdfs:subClassOf>
          <owl:Restriction>
            <owl:onProperty rdf:resource="http://xmlns.com/foaf/0.1/name"/>
            <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
          </owl:Restriction>
          <owl:Restriction>
            <owl:onProperty rdf:resource="http://xmlns.com/foaf/0.1/mbox"/>
            <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
          </owl:Restriction>
          <owl:Restriction>
            <owl:onProperty rdf:resource="http://xmlns.com/foaf/0.1/mbox_sha1sum"/>
            <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
          </owl:Restriction>
        </rdfs:subClassOf>
      </owl:Thing>
    </owl:oneOf>
  </rdfs:Class> 

  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#usingTool">
    <rdfs:label xml:lang="en">Using the tool </rdfs:label> 
    <rdfs:domain rdf:resource="http://xmlns.com/foaf/0.1/Person"/> 
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Tool"/> 
  </rdf:Property> 

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#Tool">
    <rdfs:label xml:lang="en">Evaluation Tool</rdfs:label>
    <rdfs:comment xml:lang="en">Tool that is used to perform tests</rdfs:comment>
    <rdfs:subClassOf>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/title"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/hasVersion"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
    </rdfs:subClassOf>
  </rdfs:Class>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestCase">
    <rdfs:label xml:lang="en">Test Case</rdfs:label>
    <rdfs:comment xml:lang="en">Test case against which subjects are tested</rdfs:comment>
    <rdfs:subClassOf>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/hasPart"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/isPartOf"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
    </rdfs:subClassOf>
  </rdfs:Class>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestMode">
    <rdfs:label xml:lang="en">Test Mode</rdfs:label>
    <rdfs:comment xml:lang="en">Mode in which tests were conducted</rdfs:comment>
    <owl:oneOf rdf:parseType="Collection">
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#manual">
        <rdfs:label xml:lang="en">Manual Testing Mode</rdfs:label>
        <rdfs:comment xml:lang="en">Test was performed by a human</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#automatic">
        <rdfs:label xml:lang="en">Automatic Testing Mode</rdfs:label>
        <rdfs:comment xml:lang="en">Test was performed by a tool</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#heuristic">
        <rdfs:label xml:lang="en">Heuristic Testing Mode</rdfs:label>
        <rdfs:comment xml:lang="en">Result was derived from other results</rdfs:comment>
      </owl:Thing>
    </owl:oneOf>
  </rdfs:Class>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestResult">
    <rdfs:label xml:lang="en">Test Result</rdfs:label>
    <rdfs:comment xml:lang="en">Result from conducting test cases on subjects</rdfs:comment>
    <rdfs:subClassOf>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/description"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#confidence"/>
        <owl:maxCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:maxCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#validity"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
        <owl:maxCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:maxCardinality>
      </owl:Restriction>
    </rdfs:subClassOf>
  </rdfs:Class>

  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#confidence">
    <rdfs:label xml:lang="en">Confidence Level Property</rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestResult"/> 
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#ConfidenceLevel"/> 
  </rdf:Property>
  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#validity">   
    <rdfs:label xml:lang="en">Validity Level Property</rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestResult"/> 
    <rdfs:range rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#ValidityLevel"/> 
  </rdf:Property>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#ValidityLevel">
    <rdfs:label xml:lang="en">Validity Level</rdfs:label>
    <rdfs:comment xml:lang="en">Nominal value of the result</rdfs:comment>
    <owl:oneOf rdf:parseType="Collection">
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#pass">
        <rdfs:label xml:lang="en">Pass</rdfs:label>
        <rdfs:comment xml:lang="en">Test passed</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#fail">
        <rdfs:label xml:lang="en">Fail</rdfs:label>
        <rdfs:comment xml:lang="en">Test failed</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#cannotTell">
        <rdfs:label xml:lang="en">Can Not Tell</rdfs:label>
        <rdfs:comment xml:lang="en">Outcome of the test is uncertain</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#notApplicable">
        <rdfs:label xml:lang="en">Not Applicable</rdfs:label>
        <rdfs:comment xml:lang="en">Test is not applicable to the subject</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#notTested">
        <rdfs:label xml:lang="en">Not Tested</rdfs:label>
        <rdfs:comment xml:lang="en">Test has not been carried out</rdfs:comment>
      </owl:Thing>
    </owl:oneOf>
  </rdfs:Class>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#ConfidenceLevel">
    <rdfs:label xml:lang="en">Confidence Level</rdfs:label>
    <rdfs:comment xml:lang="en">Level of confidence in the given result</rdfs:comment>
    <owl:oneOf rdf:parseType="Collection">
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#high">
        <rdfs:label xml:lang="en">High Confidence</rdfs:label>
        <rdfs:comment xml:lang="en">Validity of the result is certain</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#medium">
        <rdfs:label xml:lang="en">Medium Confidence</rdfs:label>
        <rdfs:comment xml:lang="en">Validity of the result is not sure</rdfs:comment>
      </owl:Thing>
      <owl:Thing rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#low">
        <rdfs:label xml:lang="en">Low Confidence</rdfs:label>
        <rdfs:comment xml:lang="en">Validity of the result is questionable</rdfs:comment>
      </owl:Thing>
    </owl:oneOf>
  </rdfs:Class>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#TestSubject">
    <rdfs:label xml:lang="en">Test Subject</rdfs:label>
    <rdfs:comment xml:lang="en">Subject of the assertion</rdfs:comment>
    <rdfs:subClassOf>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/hasPart"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/isPartOf"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/date"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
        <owl:maxCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:maxCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/location"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
      </owl:Restriction>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://purl.org/dc/elements/1.1/format"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:minCardinality>
        <owl:maxCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">0</owl:maxCardinality>
      </owl:Restriction>
    </rdfs:subClassOf>
  </rdfs:Class>

  <rdfs:Class rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#WebContent">
    <rdfs:label xml:lang="en">Web Content</rdfs:label>
    <rdfs:comment xml:lang="en">Subjects that are available on the Web</rdfs:comment>
    <rdfs:subClassOf>
      <owl:Restriction>
        <owl:onProperty rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#http-header"/>
        <owl:minCardinality rdf:datatype="http://www.w3.org/2001/XMLSchema#nonNegativeInteger">1</owl:minCardinality>
      </owl:Restriction>
    </rdfs:subClassOf>
  </rdfs:Class>

  <rdf:Property rdf:about="http://www.w3.org/WAI/ER/EARL/nmg-strawman#http-header">
    <rdfs:label xml:lang="en">http-header<rdfs:label>
    <rdfs:domain rdf:resource="http://www.w3.org/WAI/ER/EARL/nmg-strawman#WebContent"/> 
    <rdfs:range rdf:resource="http://www.w3.org/2000/01/rdf-schema#Literal"/> 
  </rdf:Property>
</rdf:RDF>

Appendix D: Document History

(see also section 4 Vocabulary Changes, which describes semantic changes to the terms in the vocabulary.

Differences between this draft and EARL 1.0 draft of 12 December 2002

Differences between 0.95 and 1.0 draft of 12 December 2002

[Editor's note: need to complete this section.]

3. Vocabulary Changes

[Editor's note: In a final version of the specification this chapter would be moved to an Appendix C. However in the development process this information is useful to reviewers, so it is given more prominence in working drafts]

New terms

New terms have been introduced to the vocabulary, sometimes as replacements for deprecated terms that existed in earlier drafts, sometime to introduce new funtionality

This draft

Tool
The new version of this term is no longer a subclass of Assertor, so can be used to describe any type of tool.
usingTool
This property is designed to describe the fact that a person made a decision with the aid of a particular tool.

Deprecated terms

A number of terms have been deprecated, either in favour of terms from existing widely-used vocabularies, or because their use is somehow problematic. While this deprecation is provisional, no RDF has been published formally noting them as deprecated (for example through OWL). A quick guide to terms that have been provisionally deprecated:

This draft

format, reprOf
Both of these terms are deprecated in favour of a more comprehensive approach to describing Web content.
UserAgent, platform
These terms were deprecated as they did not seem to be useful except in a very particular use case.
message
This term was deprecated in favour of the Dublin Core term description.
Person, name, email, contactInfo
These terms are currently deprecated in favour of equivalent terms from the FOAF vocabulary.

Working group change plans

The working group is considering several open issues which would lead to extending the current vocabulary before it reaches recommendation.

Three areas in particular are under active consideration:

Evidence

A mechanism to provide further evidence used to make a claim. This could be a copy of the web content analysed for a particular test, or a rule describing how may tests are required to pass some compund test, and pointers to the individual results that together satisfy the rule.

Location

Within Web content, for the use case of testing accessibility, it is very valuable to point to the location(s) that cause the test to pass or fail. This is also true of software interfaces and various other kinds of subject. THe working group has agreed in principle to include a mechanism for recording this information in an EARL report, but has not yet developed or found the necessary terms.

HTTP transaction information

There is currently a placeholder property for HTTP transaction information. The group expects to develop this further, either themselves or with an existing vocabulary.