W3C

Checklist of Checkpoints for "QA Framework: Operational Guidelines"

This version:
http://www.w3.org/TR/2003/CR-qaframe-ops-20030922/qaframe-ops-ics
This document is an appendix to:
http://www.w3.org/TR/2003/CR-qaframe-ops-20030922/
Latest version of "QA Framework: Operational Guidelines":
http://www.w3.org/TR/qaframe-ops/
Editors:
Dominique Hazaël-Massieux (dom@w3.org)
Lofton Henderson (lofton@rockynet.com)
Contributors:
See Acknowledgments in QA Framework: Operational Guidelines.

Abstract

This document is an appendix QA Framework: Operational Guidelines [QAF-OPS] . It provides a tabular checklist of all checkpoints from the specification guidelines, sorted by their priorities. Please refer to QA Framework: Operational Guidelines [QAF-OPS] for the full statement and description of the operational guidelines and checkpoints, as well as references to related documents and full credits and acknowledgements of contributors to the operational guidelines work.

Status of this document

This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the W3C technical reports index at http://www.w3.org/TR/.

This document is derived from and is an appendix to QA Framework: Operational Guidelines [QAF-OPS] , which document is a W3C Candidate Recommendation (CR), made available by the W3C Quality Assurance (QA) Activity for discussion by W3C members and other interested parties. For more information about the QA Activity, please see the QA Activity statement. Please see the "Status of this document" section of the corresponding specification guidelines [QAF-OPS] , for complete details about the status of the specification guidelines version from which this is extracted and which it accompanies.

Please send comments to www-qa@w3.org, the publicly archived list of the QA Interest Group [QAIG]. Please note that any mail sent to this list will be publicly archived and available. Do not send information you wouldn't want to see distributed, such as private data.

Publication of this document does not imply endorsement by the W3C, its membership or its staff. This is a draft document and may be updated, replaced, or made obsolete by other documents at any time. It is inappropriate to use W3C Working Drafts as reference material or to cite them as other than "work in progress".


Introduction

This checklist includes all checkpoints from the QA Framework: Operational Guidelines [QAF-OPS] presented in a tabular format. The checkpoints are presented by order of their priorities, which makes it an appropriate Implementation Conformance Statement for the guidelines.

The presentation is intended to be convenient for organizers and evaluators of QA projects in W3C Working Groups, to facilitate assessing operational aspects against the checkpoints. The table includes spaces for scoring each checkpoint, "yes" (satisfied), "no" (not satisfied), "n/a" (not applicable).

Priorities

For a description of the meaning of the priorities in the following table, please consult the conformance clause and the priorities definition section of the operational guidelines ([QAF-OPS], chapter 4 and section 1.8) .

Checklist table

Degree A Conformance

To be A-conformant with the guidelines, the following Priority 1 checkpoints must be fulfilled:

Nbr Checkpoint Yes No N/A

Guideline 1. Commit to Quality Assurance in Working Group activities.

1.1

Define QA commitment levels for operations, specifications, and test materials.

     
1.4

Enumerate QA deliverables and expected milestones.

     

Guideline 2. Commit to resource level for Working Group QA activities.

2.1

Address where and how conformance test materials will be produced.

     
2.2

Address QA staffing commitments.

     
2.3

Request allocation of QA resources to the Working Group.

     

Guideline 3. Synchronize QA activities with the specification milestones.

3.2

Support specification versioning/errata in QA deliverables.

     

Guideline 4. Define the QA process.

4.1

Appoint a QA moderator.

     
4.3

Produce the QA Process Document.

     

Guideline 5. Plan test materials development.

5.2

Ensure test materials are documented and usable for their intended purposes.

     
5.4

Address license terms for submitted test materials.

     

Guideline 6. Plan test materials publication.

6.1

Ensure a suitable repository location for test materials.

     
6.2

Define the licenses applicable to published test materials.

     
6.4

Provide a conformance verification disclaimer with the test materials.

     

Guideline 7. Plan the transfer of test materials to W3C if needed.

7.2

Identify sufficient staff resources to meet the needs of any transferred test materials.

     
7.3

For any transferred test materials, resolve all IPR issues with the external party that produced the test materials.

     

Guideline 8. Plan for test materials maintenance.

8.2

Specify a test materials update procedure to track new specification versions/errata.

     

Degree AA Conformance

To be AA-conformant with the guidelines, the following Priority 2 checkpoints must be fulfilled (in addition to the above Priority 1 checkpoints):

Nbr Checkpoint Yes No N/A

Guideline 1. Commit to Quality Assurance in Working Group activities.

1.2

Commit to test materials.

     
1.5

Define QA criteria for Recommendation-track advancement.

     

Guideline 3. Synchronize QA activities with the specification milestones.

3.1

Synchronize the publication of QA deliverables and the specification's drafts.

     

Guideline 4. Define the QA process.

4.2

Appoint a QA task force.

     
4.4

Specify means for QA-related communication.

     

Guideline 5. Plan test materials development.

5.1

Define a framework for test materials development.

     
5.3

Define a contribution process.

     
5.5

Define review procedures for submitted test materials.

     

Guideline 6. Plan test materials publication.

6.3

Describe how and where the test materials will be published.

     
6.5

Promote testing and the publication of test results.

     

Guideline 7. Plan the transfer of test materials to W3C if needed.

7.1

Perform a quality assessment of any test materials that are candidates for transfer.

     

Guideline 8. Plan for test materials maintenance.

8.3

Identify a procedure for test validity appeals.

     

Degree AAA Conformance

To be AAA-conformant with the guidelines, the following Priority 3 checkpoints must be fulfilled (in addition to the above Priority 1 and Priority 2 checkpoints):

Nbr Checkpoint Yes No N/A

Guideline 1. Commit to Quality Assurance in Working Group activities.

1.3

Commit to complete test materials.

     

Guideline 4. Define the QA process.

4.5

Define branding policy details.

     

Guideline 8. Plan for test materials maintenance.

8.1

Provide for the long-term maintenance of the contribution and review procedures.

     

References

QAF-OPS
QA Framework: Operational Guidelines, L. Henderson, D. Hazaël-Massieux, L. Rosenthal, Eds., W3C Candidate Recommendation, September 2003, available at http://www.w3.org/TR/2003/CR-qaframe-ops-20030922/.