ISSUE-61: Support external testing/certification organizations

Support external testing/certification organizations

State:
CLOSED
Product:
testing
Raised by:
Mark Vickers
Opened on:
2013-03-27
Description:
Build a single, consistent web site to run all W3C specification tests.
- Central: Provide one home for all W3C tests.
- Interactive or scripted: Must be able to run tests either interactively or completely scripted.
- Configurable: Enable choice of which specs and/or individual tests to run.
- One click/script: Any mix of specification tests should all be runnable from one click or a single script.
- Automated: All tests must be as fully automated as possible.
- Results: Test runs must create a detailed pass/fail report.

Motivation:
- HTML5 being built into external specs: DLNA, OIPF, DTG, HbbTV, etc.
- Many of these organizations provide testing and/or certification. A consistent W3C test suite ensures all organizations measure W3C specs consistently.
- Current W3C tests difficult to use by external organizations due to inconsistencies of test frameworks, test locations, coverage and lack of maintenance.

Dependencies:
- Involves changes and additions to test suites and frameworks across W3C.

What needs to be standardized:
Two external HTML5-related test suites meet the goals above and can be used as examples and/or to leverage technology:
1. Khronos WebGL Conformance Test Suite http://www.khronos.org/webgl/wiki/Testing/Conformance
2. ECMA Test262 http://test262.ecmascript.org
Related Actions Items:
No related actions
Related emails:
  1. [testing] minutes - 14 August 2013 (from ddavis@w3.org on 2013-08-14)
  2. webtv-ISSUE-61: Support external testing/certification organizations [testing] (from sysbot+tracker@w3.org on 2013-03-27)

Related notes:

No additional notes.

Display change log ATOM feed


Tatsuya Igarashi <Tatsuya.Igarashi@sony.com>, Mark Vickers <mav@mavkt.com>, Chris Needham <chris.needham@bbc.co.uk>, Chairs, Kazuyuki Ashimura <ashimura@w3.org>, Staff Contact
Tracker: documentation, (configuration for this group), originally developed by Dean Jackson, is developed and maintained by the Systems Team <w3t-sys@w3.org>.
$Id: 61.html,v 1.1 2019/10/18 08:12:49 carcone Exp $