Testing/Web & TV Testing Discussions/Support external testing & certification organizations

From Web and TV IG

Use Case: Support external testing/certification organizations

Submitter(s): Comcast (Mark Vickers)

Tracker Issue ID: ISSUE-61

Build a single, consistent web site to run all W3C specification tests.

  • Central: Provide one home for all W3C tests.
  • Interactive or scripted: Must be able to run tests either interactively or completely scripted.
  • Configurable: Enable choice of which specs and/or individual tests to run.
  • One click/script: Any mix of specification tests should all be runnable from one click or a single script.
  • Automated: All tests must be as fully automated as possible.
  • Results: Test runs must create a detailed pass/fail report.


Motivation:

  • HTML5 being built into external specs: DLNA, OIPF, DTG, HbbTV, etc.
  • Many of these organizations provide testing and/or certification. A consistent W3C test suite ensures all organizations measure W3C specs consistently.
  • Current W3C tests difficult to use by external organizations due to inconsistencies of test frameworks, test locations, coverage and lack of maintenance.

Dependencies:

  • Involves changes and additions to test suites and frameworks across W3C.


What needs to be standardized:

Retrieved from "https://www.w3.org/2011/webtv/wiki/index.php?title=Testing/Web_%26_TV_Testing_Discussions/Support_external_testing_%26_certification_organizations&oldid=2414"