Open Issues for EARL 1.0 Schema, 10 May 2011 Draft
- Editor:
- Shadi Abou-Zahra, World Wide Web Consortium <shadi@w3.org>
Copyright © 2011 W3C ® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark, document use rules apply.
[contents]
Copyright © 2011 W3C ® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark, document use rules apply.
This document captures outstanding issues in the Evaluation and Report Language (EARL) 1.0 Schema, Working Draft of 10 May, 2011. The Evaluation and Repair Tools Working Group (ERT WG) intends to address these issues in future working drafts. Comments and feedback welcome to public-earl10-comments@w3.org.
Previous lists: 29 October 2009, 23 March 2007, 27 September 2006.
[Open] - Drop rdfs:Domain and rdfs:Range for OWL constraints to increase reusability of the terms (from Sean B. Palmer [009] on 10 May 2011, Sean B. Palmer [026] on 11 May 2011, and Andrew Houghton on 20 September 2011).
Resolution: Needs more discussion (see also corresponding group resolution in minutes of 29 June 2011, group resolution in minutes of 7 September 2011, and group resolution in minutes of 12 October 2011).
[Open] - Use OWL constraints to express conformance requirements (from Sean B. Palmer [003] on 10 May 2011).
Resolution: Group has previously decided against the use of OWL but will revisit dependong on outcome of comment 004 (see also corresponding group resolution in minutes of 22 June 2011).
[Open] - Use of prefix "dc" vs "dct" (conflicting comments from Sean B. Palmer [028] on 11 May 2011 and Thomas Steiner on 18 June 2011).
Resolution: Confirm with DC folks (see also corresponding group resolution in minutes of 7 September 2011, group resolution in minutes of 12 October 2011, and group resolution in minutes of 19 October 2011).
[Drafted] - Move conformance section from EARL 1.0 Guide to EARL 1.0 Schema to make it normative (from Sean B. Palmer [002] on 10 May 2011).
Resolution: Accept (see also related comment 004 about profiles and group resolution in minutes of 22 June 2011).
[Drafted] - Consider use of profiles for conformance (from Sean B. Palmer [004] on 10 May 2011).
Resolution: Needs further investigation (see also corresponding group resolution in minutes of 29 June 2011).
[Drafted] - Move conformance section to the top of the document (from Sean B. Palmer [002] on 10 May 2011).
Resolution: Needs more discussion (after conformance section is edited back into this document; see also corresponding group resolution in minutes of 22 June 2011).
[Pending] - Explain extensibility policy (from Sean B. Palmer [006] on 10 May 2011).
Resolution: Accept to add more explanation in the EARL 1.0 Guide and more cross-references in EARL 1.0 Schema (see also corresponding group resolution in minutes of 29 June 2011).
[Pending] - Provide information about the spec maturity in the RDF schema file (from Sean B. Palmer [007] on 10 May 2011 and Sean B. Palmer [027] on 11 May 2011).
Resolution: Accept to add corresponding information in the schema header and by using rdfs:DefinedBy property for terms (see also corresponding group resolution in minutes of 29 June 2011 and group resolution in minutes of 7 September 2011).
[Pending] - reference EARL 1.0 Requirements from this document (from Sean B. Palmer [035] on 12 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 14 September 2011).
[Pending] - OWL namespace is missing a hash (#) in the schema document (from Timothy Lebo on 25 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 14 September 2011).
[Pending] - TestResult is missing a hash (#) in the schema document (from Timothy Lebo on 25 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 14 September 2011).
[Pending] - use correct FOAF namespace in the schema document (from Timothy Lebo on 26 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 14 September 2011).
[Pending] - use "ht" as the prefix for HTTP-in-RDF namespace (from Thomas Steiner on 18 June 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 12 October 2011).
[Closed] - Providing additional descriptions and background, potentially using diagrams and illustrations (from Sean B. Palmer [001] on 10 May 2011).
Resolution: Reject adding more background in this document; that is the objective of the EARL 1.0 Guide (see also corresponding group resolution in minutes of 22 June 2011).
[Closed] - Revise terms to support "reification trick" (from Sean B. Palmer [005] on 10 May 2011).
Resolution: Reject changing the terms given the maturity and stability of this spec; previous discussions with SemWeb experts have not provided clear arguments in support of this approach (see also corresponding group resolution in minutes of 29 June 2011).
[Closed] - Introduce "earl:tool" as a simple way for referencing tools used (from Sean B. Palmer [008] on 10 May 2011).
Resolution: Reject as this has severe reprecutions on ambiguity (see also corresponding group resolution in minutes of 29 June 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Consider more listing the terms in alphabetical order (from Sean B. Palmer [012] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 13 July 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Explain more clearly the relationship between the generic class and the refined classes (from Sean B. Palmer [015] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 27 July 2011).
[Pending] - Define the classes and refined classes more clearly (from Sean B. Palmer [017] on 10 May 2011).
Resolution: Accept as editorial changes (consider more examples in the EARL 1.0 Guide too; see also corresponding group resolution in minutes of 24 August 2011).
[Pending] - Grouping of tests such as "test suites" is not clear from the description (from Sean B. Palmer [024] on 10 May 2011).
Resolution: Introduce a new earl:TestSuite sub-class to denote a series of (related or unrelated) tests (see also corresponding group resolution in minutes of 31 August 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Closed] - Remove TestResult intermediary (from Sean B. Palmer [018] on 10 May 2011).
Resolution: Reject as this would break important aspects of the EARL model (see also corresponding group resolution in minutes of 24 August 2011).
[Pending] - Move earl:pointer to TestCriterion rather than TestSubject (from Sean B. Palmer [021] on 10 May 2011).
Resolution: Improve the description to explain that the pointer is more relevant to the test result rather than to the test subject (see also corresponding group resolution in minutes of 24 August 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Explain more clearly the relationship between the generic class and the refined classes (from Sean B. Palmer [015] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 27 July 2011).
[Closed] - Use same subclassing approach as used in earl:OutcomeValue class (from Sean B. Palmer [025] on 10 May 2011).
Resolution: Reject as there are no known use-cases to support this approach (see also corresponding group resolution in minutes of 31 August 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Explain more clearly the relationship between the generic class and the refined classes (from Sean B. Palmer [015] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 27 July 2011).
[Closed] - Replace OutcomeValue instances with literal values (from Sean B. Palmer [020] on 10 May 2011).
Resolution: Reject as this would make querying much more difficult (and resource intensive in most implementations; see also corresponding group resolution in minutes of 24 August 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Consider more examples to illustrate the different uses of earl:Software (from Sean B. Palmer [014] on 10 May 2011).
Resolution: Accept as editorial changes (potentially add examples to the EARL 1.0 Guide instead; see also corresponding group resolution in minutes of 27 July 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Consider more listing the terms in alphabetical order (from Sean B. Palmer [012] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 13 July 2011).
[Closed] - Rename this term to "assertor" for consistency (from Sean B. Palmer [013] on 10 May 2011).
Resolution: Reject as it would be only differ from the corresponding class through character casing, which frequently leads to parser conflicts (see also corresponding group resolution in minutes of 27 July 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Open] - The design of this property essentially allows recurrsions (from Sean B. Palmer [010] on 10 May 2011).
Resolution: Needs more discussion (see also corresponding group resolution in minutes of 13 July 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Pending] - Consider more (1) descriptive labels, (2) putting these descriptions in the corresponding sections and not only in this listing, and (3) provding more cross-reference between the sections and with the EARL 1.0 Guide (from Sean B. Palmer [011] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 13 July 2011).
[Pending] - Consider more listing the terms in alphabetical order (from Sean B. Palmer [012] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 13 July 2011).
[Pending] - Double-check terms casing and naming (from Sean B. Palmer [022] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 24 August 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Drafted] - Change "Title" column to "Label" (from Sean B. Palmer [022] on 10 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 24 August 2011).
The are currently no open issues for this section of the document.
The are currently no open issues for this section of the document.
[Drafted] - Change "Olivier Thoreaux" --> "Olivier Thereaux" and "Sean B Palmer" --> "Sean B. Palmer" (from Sean B. Palmer [029] on 11 May 2011).
Resolution: Accept as editorial changes (see also corresponding group resolution in minutes of 7 September 2011).