Warning:
This wiki has been archived and is now read-only.

Test Result Format

From OWL
Jump to: navigation, search

Result Reporting Format

Results Ontology

The ontology is described below using the OWL 2 Functional Style Syntax. It is available in RDF/XML as results-ontology.owl 

Namespace( = <http://www.w3.org/2007/OWL/testResultOntology> )
Namespace( test = <http://www.w3.org/2007/OWL/testOntology#> )
Namespace( owl = <http://www.w3.org/2002/07/owl#> )
Namespace( rdfs = <http://www.w3.org/2000/01/rdf-schema#> )
Namespace( xsd = <http://www.w3.org/2001/XMLSchema#> )

Ontology( <http://www.w3.org/2007/OWL/testResultOntology>
    Import( <http://www.w3.org/2007/OWL/testOntology> )
    Annotation( rdfs:label "The OWL 2 Test Result Ontology" )
    Annotation(
        rdfs:comment
        "Adapted from http://www.w3.org/2002/03owlt/resultsOntology"
        )

    Declaration( Class( :TestRun ) )

    Declaration( ObjectProperty( :runner ) )
    Declaration( ObjectProperty( :test ) )

    FunctionalProperty( :runner )
    FunctionalProperty( :test )
    SubClassOf( :TestRun SomeValuesFrom( :runner owl:Thing ) )
    SubClassOf( :TestRun SomeValuesFrom( :test test:TestCase ) )

    Declaration( Class( :PassingRun ) )
    Declaration( Class( :FailingRun ) )
    Declaration( Class( :IncompleteRun ) )

    SubClassOf( :PassingRun :TestRun )
    SubClassOf( :FailingRun :TestRun )
    SubClassOf( :IncompleteRun :TestRun )
    DisjointClasses( :PassingRun :FailingRun :IncompleteRun )

    Declaration( Class( :ProfileIdentificationRun ) )
    Declaration( Class( :SyntaxTranslationRun ) )
    Declaration( Class( :ConsistencyRun ) )
    Declaration( Class( :InconsistencyRun ) )
    Declaration( Class( :PositiveEntailmentRun ) )
    Declaration( Class( :NegativeEntailmentRun ) )

    SubClassOf( :ProfileIdentificationRun :TestRun )
    SubClassOf( :SyntaxTranslationRun :TestRun )
    SubClassOf( :ConsistencyRun :TestRun )
    SubClassOf( :InconsistencyRun :TestRun )
    SubClassOf( :PositiveEntailmentRun :TestRun )
    SubClassOf( :NegativeEntailmentRun :TestRun )
    DisjointClasses(
        :ProfileIdentificationRun
        :SyntaxTranslationRun
        :ConsistencyRun
        :InconsistencyRun
        :PositiveEntailmentRun
        :NegativeEntailmentRun
        )

    Declaration( ObjectProperty( :profile ) )
    FunctionalProperty( :profile )
    SubClassOf( :ProfileIdentificationRun
        SomeValuesFrom(
            :profile 
            OneOf( test:DL test:EL test:QL test:RL )
        ) )

    Declaration( AnnotationProperty( :details ) )

    Declaration( DataProperty( :runtimeMillisecs ) )
    PropertyRange(
        :runtimeMillisecs
        DatatypeRestriction( owl:real xsd:minExclusive "0"^^xsd:integer )
        )
    FunctionalProperty( :runtimeMillisecs )
)

Example in Turtle

In this example, the tool ex:my-reasoner is reporting several results.

  1. The test with identifier WebOnt-description-logic-001 was run as an inconsistency test, and the tool correctly identified the ontology as inconsistent.
  2. The test with identifier WebOnt-description-logic-202 was run as an consistency test, and the tool correctly identified the ontology as consistent.
  3. The test with identifier WebOnt-description-logic-202 was run as a positive entailment test, and the tool timed out before completing (thereby making the run an :IncompleteRun).
  4. The test with identifier WebOnt-I5.8-012 was run as a consistency test, but the tool failed to identify the premise ontology as consistent.

Note that a single test case may be used in multiple runs. E.g., the premise ontology present in positive and negative entailment tests cases can also be used in consistency runs. 


@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix owl:  <http://www.w3.org/2002/07/owl#> .
@prefix xsd:  <http://www.w3.org/2001/XMLSchema#> .
@prefix ex:   <http://example.org/> .
@prefix test: <http://www.w3.org/2007/OWL/testOntology#> .
@prefix :     <http://www.w3.org/2007/OWL/testResultOntology> .

ex:my-reasoner
    a owl:Thing ;
    rdfs:label "My Reasoner (Version 0.1)" .

[]
    a :InconsistencyRun , :PassingRun , :TestRun ;
    :test [ test:identifier "WebOnt-description-logic-001"^^xsd:string ] ;
    :runner ex:my-reasoner ;
    :runtimeMillisecs "314"^^xsd:integer .
    
[]
    a :ConsistencyRun , :PassingRun , :TestRun ;
    :test [ test:identifier "WebOnt-description-logic-202"^^xsd:string ] ;
    :runner ex:my-reasoner .

[]
    a :PositiveEntailmentRun , :IncompleteRun , :TestRun ;
    :test [ test:identifier "WebOnt-description-logic-202"^^xsd:string ] ;
    :runner ex:my-reasoner ;
    :details "Time out after 5 minutes" .

[]
    a :ConsistencyRun , :FailingRun , :TestRun ;
    :test [ test:identifier "WebOnt-I5.8-012"^^xsd:string ] ;
    :runner ex:my-reasoner .

Latest Results

http://www.w3.org/2007/OWL/wiki/Test_Suite_Status

Retrieved from "https://www.w3.org/2007/OWL/wiki/index.php?title=Test_Result_Format&oldid=25045"