QA Framework: Process & Operational Guidelines

Checklist Table (2002-03-07)


Guideline 1. Integrate Quality Assurance into Working Group activities.

Nbr Checkpoint Priority Yes No N/A
1.1

In Charter, determine level of commitment to QA. Plan to have at least a commitment to "QA level three".

[Priority 1]      
1.2

In Charter, identify QA deliverables, expected milestones

[Priority 2]      
1.3

In Charter, identify QA criteria for WG deliverables milestones.

[Priority 2]      

Guideline 2. Define resources for Working Group QA activities.

Nbr Checkpoint Priority Yes No N/A
2.1

In Charter, address where and how conformance test materials will be produced.

[Priority 1]      
2.2

In charter, address QA staffing commitments.

[Priority 2]      

Guideline 3. Synchronize QA activities with the milestones for WG deliverables.

Nbr Checkpoint Priority Yes No N/A
3.1

Align intermediate milestones for QA deliverables with WG deliverables milestones

[Priority 2]      
3.2

Synchronize publication of QA deliverables and specification's drafts.

[Priority 2]      
3.3

Support specification versioning/errata in the QA deliverables.

[Priority 3]      

Guideline 4. Define the QA process.

Nbr Checkpoint Priority Yes No N/A
4.1

Define the goals and scope of QA development

[Priority 1]      
4.2

Produce the QA Process document.

[Priority 1]      
4.3

Appoint QA moderator and QA taskforce.

[Priority 2]      
4.4

In QA Process document, define means for QA-related communication.

[Priority 2]      
4.5

In QA Process document, specify the framework for test materials development.

[Priority 2]      
4.6

Specify a policy for branding materials if applicable.

[Priority 3]      

Guideline 5. QA Process: Plan test meterials development.

Nbr Checkpoint Priority Yes No N/A
5.1

Review the Test Materials Guidelines.

[Priority 2]      
5.2

In the test framework, ensure test materials are documented and reusable by accredited third parties for testing purposes.

[Priority 2]      
5.3

In QA Process document, define a contribution process.

[Priority 2]      
5.4

In QA Process document, define the licenses applicable to submitted test materials.

[Priority 2]      
5.5

In the QA Process document, define review procedures for submitted test materials.

[Priority 2]      

Guideline 6. QA Process: Plan test meterials publication.

Nbr Checkpoint Priority Yes No N/A
6.1

Ensure a secure and reliable repository location for future test materials.

[Priority 2]      
6.2

In QA Process document, define the licenses applicable to published test materials.

[Priority 2]      
6.3

In the QA Process document, describe the way test materials will be published and point to the corresponding web page.

[Priority 2]      
6.4

Provide disclaimer regarding use of the test materials for compliance verification.

[Priority 2]      
6.5

In the QA Process document, describe how vendors can publish test results for their products, if applicable.

[Priority 3]      

Guideline 7. Plan the transfer of test materials to W3C if needed

Nbr Checkpoint Priority Yes No N/A
7.1

If transfer of the test materials to W3C is planned, perform assessment of their quality.

[Priority 2]      
7.2

If transfer of the test materials to W3C is planned, identify staff resources to meet requirements.

[Priority 2]      
7.3

If transfer of the test materials to W3C is planned, resolve IPR questions and reach agreement with external party that produced test materials.

[Priority 1]      
7.4

If transfer of the test materials to W3C is planned, update QA commitments in the Working Group charter if necessary.

[Priority 2]      

Guideline 8. Plan for test materials maintenance

Nbr Checkpoint Priority Yes No N/A
8.1

Maintain contribution and review procedures throughout test materials' and standard's entire life cycles.

[Priority 3]      
8.2

In the Working Group's QA process document, specify a procedure for updates of the test materials to track new errata/specification versions.

[Priority 2]      
8.3

In the Working Group's QA process document, identify the communication channel and procedure for appeals of tests validity.

[Priority 2]