QA Framework: Operational Guidelines

Checklist Table (2002-03-11)

Guideline 1. Integrate Quality Assurance into Working Group activities.
Nbr Checkpoint Priority Yes No N/A
1.1

In the Charter, specify the level of commitment to QA. Plan to have at least a commitment to "QA level three".

 [Priority 1]      
1.2

In the Charter, enumerate QA deliverables and expected milestones.

 [Priority 1]      
1.3

In the Charter, associate QA criteria with WG milestones.

 [Priority 2]      

Guideline 2. Define resources for Working Group QA activities.
Nbr Checkpoint Priority Yes No N/A
2.1

In the Charter, address where and how conformance test materials will be produced.

 [Priority 1]      
2.2

In the Charter, address QA staffing commitments.

 [Priority 1]      
2.3

In the Call For Participation, request allocation of QA resources to the Working Group.

 [Priority 1]      

Guideline 3. Synchronize QA activities with the milestones for WG deliverables.
Nbr Checkpoint Priority Yes No N/A
3.1

Synchronize the publication of QA deliverables and the specification's drafts.

 [Priority 2]      
3.2

Support specification versioning/errata in the QA deliverables.

 [Priority 3]      

Guideline 4. Define the QA process.
Nbr Checkpoint Priority Yes No N/A
4.1

Appoint a QA moderator and a QA task force.

 [Priority 2]      
4.2

Produce the QA Process document.

 [Priority 1]      
4.3

In the QA Process document, define means for QA-related communication.

 [Priority 2]      
4.4

In the QA Process document, specify the framework for test materials development.

 [Priority 2]      
4.5

Specify a policy for branding materials if applicable.

 [Priority 3]      

Guideline 5. QA Process: Plan test materials development.
Nbr Checkpoint Priority Yes No N/A
5.1

In the test framework, ensure test materials are documented and reusable by accredited third parties for testing purposes.

 [Priority 2]      
5.2

In the QA Process document, define a contribution process.

 [Priority 2]      
5.3

In the QA Process document, define the licenses applicable to submitted test materials.

 [Priority 2]      
5.4

In QA Process document, define review procedures for submitted test materials.

 [Priority 2]      

Guideline 6. QA Process: Plan test materials publication.
Nbr Checkpoint Priority Yes No N/A
6.1

Ensure a secure and reliable repository location for future test materials.

 [Priority 2]      
6.2

In the QA Process document, define the licenses applicable to published test materials.

 [Priority 2]      
6.3

In the QA Process document, describe how the test materials will be published and point to the corresponding web page.

 [Priority 2]      
6.4

Provide a disclaimer regarding the use of the test materials for compliance verification.

 [Priority 2]      
6.5

In the QA Process document, describe how vendors can publish test results for their products, if applicable.

 [Priority 3]      

Guideline 7. Plan the transfer of test materials to W3C if needed.
Nbr Checkpoint Priority Yes No N/A
7.1

If transfer of the test materials to W3C is planned, perform an assessment of their quality.

 [Priority 2]      
7.2

If transfer of the test materials to W3C is planned, identify sufficient staff resources to meet the requirements.

 [Priority 2]      
7.3

If transfer of the test materials to W3C is planned, resolve IPR questions and reach agreement with the external party that produced test materials.

 [Priority 1]      
7.4

If transfer of the test materials to W3C is planned, update the QA commitments in the Working Group charter if necessary.

 [Priority 2]      

Guideline 8. Plan for test materials maintenance.
Nbr Checkpoint Priority Yes No N/A
8.1

Maintain contribution and review procedures throughout test materials' and standard's entire life cycles.

 [Priority 3]      
8.2

In the Working Group's QA process document, specify a procedure for updates of the test materials to track new errata/specification versions.

 [Priority 2]      
8.3

In the Working Group's QA process document, identify the communication channel and procedure for appeals of tests validity.

 [Priority 2]