|
Guideline 1. In charters, describe QA goals,
criteria, deliverables and resources
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 1.1 |
In the Working Group charter include
conformance test materials plans. Plan to have at least a commitment
to "QA level three".
|
[Priority 1] |
|
|
|
| 1.2 |
In the Working Group charter, specify
completion and publication of test materials to be a criterion for
CR-exit and PR-entrance.
|
[Priority 2] |
|
|
|
| 1.3 |
In the Working Group charter, address QA
staffing commitments.
|
[Priority 2] |
|
|
|
|
Guideline 2. In the Working Group charter,
address where and how conformance test materials will be produced.
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 2.1 |
In the Working Group charter, specify the
WG's level of involvement in the ongoing evolution of test
materials.
|
[Priority 1] |
|
|
|
| 2.2 |
Ensure a secure and reliable repository
location for future test materials.
|
[Priority 2] |
|
|
|
|
Guideline 3. Ensure that the goals and scope of
QA development are clear
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 3.1 |
Ensure that test materials are documented,
self contained and reusable by accredited third parties for testing
purposes.
|
[Priority 2] |
|
|
|
| 3.2 |
Specify a policy for branding materials if
applicable.
|
[Priority 3] |
|
|
|
| 3.3 |
Provide disclaimer regarding use of the test
materials for compliance verification.
|
[Priority 2] |
|
|
|
|
Guideline 4. Allocate staff for the QA
process.
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 4.1 |
Appoint a test QA moderator.
|
[Priority 2] |
|
|
|
| 4.2 |
Designate a task force or another entity to
maintain the test suite, as well as maintenance procedures.
|
[Priority 2] |
|
|
|
|
Guideline 5. Synchronize specification and test
materials development
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 5.1 |
Introduce intermediate milestones for test
materials completion.
|
[Priority 3] |
|
|
|
| 5.2 |
Synchronize the latest published version of
the specification and the latest published version of the test
materials.
|
[Priority 3] |
|
|
|
| 5.3 |
Support specification versioning/errata in
the test materials.
|
[Priority 2] |
|
|
|
|
Guideline 6. Produce QA process document.
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 6.1 |
Review Test Materials Guidelines before
writing the QA Process document and starting test materials
development.
|
[Priority 2] |
|
|
|
| 6.2 |
In the QA Process document, define a
contribution process.
|
[Priority 2] |
|
|
|
| 6.3 |
In the QA Process document, define the
licenses applicable to submitted and published test materials.
|
[Priority 2] |
|
|
|
| 6.4 |
In the QA Process document, define a means
for communication regarding test suites.
|
[Priority 2] |
|
|
|
| 6.5 |
In the QA Process document, define review
procedures for submitted test materials.
|
[Priority 2] |
|
|
|
| 6.6 |
In the QA Process document, describe the way
test materials will be published and point to the corresponding web
page.
|
[Priority 2] |
|
|
|
| 6.7 |
In the QA Process document, describe how
vendors can publish test results for their products, if
applicable.
|
[Priority 3] |
|
|
|
|
Guideline 7. Plan the transfer of test materials
to W3C if needed
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 7.1 |
If transfer of the test materials to W3C is
planned, perform assessment of their quality.
|
[Priority 2] |
|
|
|
| 7.2 |
If transfer of the test materials to W3C is
planned, identify staff resources to meet requirements.
|
[Priority 2] |
|
|
|
| 7.3 |
If transfer of the test materials to W3C is
planned, resolve IPR questions and reach agreement with external
party that produced test materials.
|
[Priority 1] |
|
|
|
| 7.4 |
If transfer of the test materials to W3C is
planned, update QA commitments in the Working Group charter if
necessary.
|
[Priority 2] |
|
|
|
|
Guideline 8. Plan for test materials
maintenance
|
| Nbr |
Checkpoint |
Priority |
Yes |
No |
N/A |
| 8.1 |
Maintain contribution and review procedures
throughout test materials' and standard's entire life cycles.
|
[Priority 3] |
|
|
|
| 8.2 |
In the Working Group's QA process document,
specify a procedure for updates of the test materials to track new
errata/specification versions.
|
[Priority 2] |
|
|
|
| 8.3 |
In the Working Group's QA process document,
identify the communication channel and procedure for appeals of tests
validity.
|
[Priority 2] |
|
|
|