W3C

Checklist of Checkpoints for "QA Framework: Operational Guidelines"

This version:
http://www.w3.org/TR/2002/WD-qaframe-ops-20020515/qaframe-ops-checklist
This document is an appendix to:
http://www.w3.org/TR/2002/WD-qaframe-ops-20020515/
Latest version of "QA Framework: Operational Guidelines":
http://www.w3.org/TR/qaframe-ops/
Editors:
Dominique HazaŽl-Massieux (dom@w3.org)
Lofton Henderson (lofton@rockynet.com)
Contributors:
See Acknowledgments in Operational Guidelines.

Abstract

This document is an appendix QA Framework: Operational Guidelines [QAF-OPS]. It provides a tabular checklist of all checkpoints from the specification guidelines, complete with their priorities. Please refer to QA Framework: Operational Guidelines [QAF-OPS] for the full statement and description of the operational guidelines and checkpoints, as well as references to related documents and full credits and acknowledgements of contributors to the operational guidelines work.

Status of this document

This section describes the status of this document at the time of its publication. Other documents may supersede this document. The latest status of this document series is maintained at the W3C.

This document is derived from and is an appendix to QA Framework: Operational Guidelines [QAF-OPS], which document is a W3C Working Draft (WD), made available by the W3C Quality Assurance (QA) Activity for discussion by W3C members and other interested parties. For more information about the QA Activity, please see the QA Activity statement. Please see the "Status of this document" section of the corresponding specification guidelines [QAF-OPS], for complete details about the status of the specification guidelines version from which this is extracted and which it accompanies.

Please send comments to www-qa@w3.org, the publicly archived list of the QA Interest Group [QAIG]. Please note that any mail sent to this list will be publicly archived and available. Do not send information you wouldn't want to see distributed, such as private data.

Publication of this document does not imply endorsement by the W3C, its membership or its staff. This is a draft document and may be updated, replaced, or made obsolete by other documents at any time. It is inappropriate to use W3C Working Drafts as reference material or to cite them as other than "work in progress".

A list of current W3C Recommendations and other technical documents can be found at http://www.w3.org/TR.


Introduction

This checklist includes all checkpoints from the QA Framework: Operational Guidelines [QAF-OPS] presented in a tabular format. The checkpoint priorities are included, and the order of the operational guidelines document is maintained.

The presentation is intended to be convenient for organizers and evaluators of QA projects in W3C Working Groups, to facilitate assessing operational aspects against the checkpoints. The table includes spaces for scoring each checkpoint, "yes" (satisfied), "no" (not satisfied), "n/a" (not applicable).

Priorities

For a description of the meaning of the priorities in the following table, please consult the conformance clause and the priorities definition section of the operational guidelines ([QAF-OPS], chapter 4 and section 1.4).

Checklist table

Guideline 1. Integrate Quality Assurance into Working Group activities.

Nbr Checkpoint Priority Yes No N/A
1.1

In the Charter, specify the level of commitment to QA. Plan to have at least a commitment to "QA level three".

[Priority 1]      
1.2

In the Charter, plan at least for the"QA level five".

[Priority 2]      
1.3

In the Charter, plan for the"QA level seven".

[Priority 3]      
1.4

In the Charter, enumerate QA deliverables and expected milestones.

[Priority 1]      
1.5

In the Charter, associate QA criteria with WG milestones.

[Priority 2]      

Guideline 2. Define resources for Working Group QA activities.

Nbr Checkpoint Priority Yes No N/A
2.1

In the Charter, address where and how conformance test materials will be produced.

[Priority 1]      
2.2

In the Charter, address QA staffing commitments.

[Priority 1]      
2.3

In the Call for Participation, request allocation of QA resources to the Working Group.

[Priority 1]      

Guideline 3. Synchronize QA activities with the milestones for WG deliverables.

Nbr Checkpoint Priority Yes No N/A
3.1

Synchronize the publication of QA deliverables and the specification's drafts.

[Priority 2]      
3.2

Support specification versioning/errata in the QA deliverables.

[Priority 3]      

Guideline 4. Define the QA process.

Nbr Checkpoint Priority Yes No N/A
4.1

Appoint a QA moderator.

[Priority 1]      
4.2

Appoint a QA task force.

[Priority 2]      
4.3

Produce the QA Process document.

[Priority 1]      
4.4

In the QA Process document, define means for QA-related communication.

[Priority 2]      
4.5

In the QA Process document, specify the framework for test materials development.

[Priority 1]      
4.6

Specify a policy for branding materials.

[Priority 3]      

Guideline 5. QA Process: Plan test materials development.

Nbr Checkpoint Priority Yes No N/A
5.1

In the test framework, ensure test materials are documented and usable for the intended purpose.

[Priority 1]      
5.2

In the QA Process document, define a contribution process.

[Priority 2]      
5.3

In the QA Process document, define the licenses applicable to submitted test materials.

[Priority 1]      
5.4

In QA Process document, define review procedures for submitted test materials.

[Priority 2]      
5.5

Test materials review process includes but not limited to checking for accuracy, scope and clarity of the tests.

[Priority 1]      

Guideline 6. QA Process: Plan test materials publication.

Nbr Checkpoint Priority Yes No N/A
6.1

Ensure a secure, reliable, freely accessible repository location for test materials.

[Priority 1]      
6.2

In the QA Process document, define the licenses applicable to published test materials.

[Priority 1]      
6.3

In the QA Process document, describe how the test materials will be published and point to the corresponding web page.

[Priority 2]      
6.4

Provide a disclaimer regarding the use of the test materials for compliance verification.

[Priority 1]      
6.5

In the QA Process document, describe how the test results for the products can be published.

[Priority 2]      

Guideline 7. Plan the transfer of test materials to W3C if needed.

Nbr Checkpoint Priority Yes No N/A
7.1

If transfer of the test materials to W3C is planned, perform an assessment of their quality.

[Priority 2]      
7.2

If transfer of the test materials to W3C is planned, identify sufficient staff resources to meet the requirements.

[Priority 1]      
7.3

If transfer of the test materials to W3C is planned, resolve IPR questions and reach agreement with the external party that produced test materials.

[Priority 1]      

Guideline 8. Plan for test materials maintenance.

Nbr Checkpoint Priority Yes No N/A
8.1

Maintain the contribution and review procedures throughout the entire life cycle of the test materials and the standard itself.

[Priority 3]      
8.2

In the Working Group's QA process document, specify a procedure for updates of the test materials to track new errata/specification versions.

[Priority 2]      
8.3

In the Working Group's QA process document, identify the communication channel and procedure for appeals of tests validity.

[Priority 2]      

References

QAF-OPS
QA Framework: Operational Guidelines, K. Gavrylyuk, D. Dimitriadis, L. Henderson, L. Rosenthal, Eds., W3C Working Draft, May 2002, available at http://www.w3.org/TR/qaframe-ops/.