7. Change history

2003-09-12, Candidate Recommendation version

Clarifications and improvements in response to Last Call comments. Checkpoint numbers, CPx.y, refer to the checkpoint numbers in the Last Call WD of Operational Guidelines. Similarly, "GLz" refers to Guideline "z" in the Last Call version.

• New Introduction section -- a table (for now) -- about correlation of guidelines to stages in WG's life and deliverables.
• Rewrote CP1.1, 1.2, 1.3 to preserve all of LC-version normative requirements, but eliminate the table and (implied) conflicting conformance scale, and integrate the commitment definition with other GL documents.
• Added clarifications to GL1/2 verbiage, to emphasize (ideally) that these are Charter-phase activities.
• Wording of GL1 and GL2 improved to emphasize that they are about deciding and recording commitment to QA and its staffing.
• To CP1.5 and CP3.1, added reciprocal clarifications to disambiguate the similarity between the two.
• To CP2.2, CP4.1 and CP4.2, added reciprocal clarifications to disambiguate the similarity between them.
• Revised CP4.3 verbiage for clarification (per LC-58), to allow a "TOC" to satisfy the QAPD.
• Cross-reference and clarify relationship of CP5.3 (new5.4) and CP6.2, revise verbiage per consensus with W3C Legal and TM-license task team.
• Clarified CP4.5 (esp. the ambiguous use of "the QA framework"), and its motivation/rationale; changed its priority from P1 to P2; moved it to become first checkpoint of GL5 (so that it becomes new5.1).
• Moved some verbiage out of CP6.1 into GL6, clarified about maintenance & publication.
• Added some clarification and rationale to verbiage of GL7.
• Improved testability of the language in CP3.1, CP3.2, CP6.1, CP4.2, CP2.2, CP6.3, CP7.1, CP7.2, CP7.3.
• Change CP8.2 from P2 to P1, CP3.2 from P3 to P1, and clarify the requirements and relationship between the two checkpoints, and clarify "versioning".
• Better explanation of Checklists and their usage, in Introduction.
• Better exposure of the Examples & Techniques documents, in Introduction, by reference to "QA Framework: Introduction".
• Editorial clarification of wording in GL3, CP5.4 (new5.5), CP6.3, CP6.5.
• Applied new styling throughout, for clearer presentation of Checkpoints and their subsections.
• Complete re-write of (informative) Introductory chapter, for brevity, clarity, and readability.
• Clarification of minimal recommended conformance level (A) in Conformance clause.
• Clarification of rationale/justification for 3-level (A, AA, AAA) conformance scheme in Conformance clause.
• Short section of Use Cases added to end of Introduction.
• Added "promote conformance testing" refinement to the "publish test results" of CP6.5.
• Added new "Document overview" subsection to the beginning of the Introduction.

2003-02-10, Last Call Working Draft

Revised Introduction, Conformance chapters for better conformance to SpecGL. Restructure all checkpoints for better verifiability. Add rationale to many checkpoints. Implement resolution of all closed OpsGL issues. Editorial improvements.

• Finish "add Rationale" (below) for those CP which need one
• extensive editorial improvements to wording.
• In all checkpoints, changed "To fulfill..," verbiage to "Conformance requirements:"
• Changed "Test assertions" subsection of Conformance chapter to "Conformance requirements & test assertions", revised its wording (no test assertions).
• Replace most of Ch.3, " WG relationship to QA Activity", with a reference to the QAWG Process Document.
• Removed Sec 1.3 (Goals of QA Development), revised 1.1, 1.2, 1.4.
• Add to CP5.3 (submission license policy) "Discussion" a reference to W3C-wide submission policies.
• Modified CP6.2 (TM License) to subsume a special TM License under "W3C-approved custom license", while discussion with W3C legal is still pending.
• Clarified wording of CP3.2 (spec versioning/errata support in TM).
• Added "Rationale" to all checkpoints for which it was missing.
• Revised "commitment table" of CP1.1 to clarify levels and add conformance criteria.
• Clarified fulfillment criteria of CP3.2.
• Remove 2nd part ("sufficient" clause) of Conformance Disclaimer.
• Revised checkpoint wording and fulfillment criteria of CP8.1
• edited Discussion of several checkpoints, added Rationale to a couple (CP4.3, 7.3).
• revised Conformance Section to comply w/ SpecGL (extensibility, normativeness, conformance claims, etc).
• revised Introduction to comply w/ SpecGL -- added scope, class of product, etc.
• CP5.3, replace requirement for license with requirement for license policy.
• CP5.3, add links to a couple of sample submission licenses.
• separate the normative references from the informative references (and label them).
• add links to sample QA (TS) process documents to GL4 verbiage.
• CP2.3, change requirement on existing WGs.
• CP6.4, the disclaimer must prominent.
• CP6.5, adjust the "may" usage in the fulfillment criteria and discussion.
• clean up discussion in CP5.1
• qualify "public, archived" for mailing list and "public" for /Test/ Web page.
• revise GL3 and CP3.1 to explicitly link QA deliverables to specification versions.
• change post- WG "maintenance" comments in CP6.1 to repository.
• include post- WG maintenance comments in CP8.1.
• clarify CP4.6 (branding) (new4.5), and stipulate "not applicable" if branding is not supported.
• remove "discussion" from list requirements in CP4.4, clarify requirements.
• clarify minimal QAPD contents in CP4.3 and enumerate them in the discussion.
• move content from CP4.1 to Ops Extech, leave brief summary in its place.
• changes to wording in QA commitment table of GL1

2002-11-08, third published WD

Revised Introduction, Conformance for better conformance to SpecGL. Implemented other minor editorial and resolved-issue changes. Make over all checkpoints for better verifiability.

• (since 11/03) Moved a handful of examples to Ops Extech.
• (since 10/31)
  • Make over of GL3-GL8, to isolate the "to fulfill" criterion and apply TA markup;
  • Numerous minor editorial (wording & grammar) improvements.
• Miscellaneous editorial corrections, fix missing anchors, etc.
• Combine CK5.5 into CK5.4 as new MUST requirement.
• In GL1 and GL2, apply test assertion markup, to identify fulfillment criteria.
• In GL2, remove the "In the charter" bits of all checkpoints, and embed old/new requirements in the fulfillment criteria.
• In GL1, remove the "In the charter" bits of all checkpoints, and embed old/new requirements in the fulfillment criteria.
• Identify the checklist as the ICS pro forma for OpsGL.
• Revise "Conformance" chapter per SpecGL (level/degree, test assertions, etc)
• Rewrite descriptions of priority 1, 2, 3 (subsection of Intro)
• Clarify RFC2119 usage ("Terminology" subsection of Intro)
• Reorganize and augment Introduction, w/ subsections for: scope&goals, motivation, understanding&using, priorities, etc.

2002-05-15, second published WD

Checkpoints numbering is changed, changes list refers to the numbering from the previous WD [1].

• Ck 4.1 - split into 2 having QA moderator as priority 1 and the task force as priority 2
• Ck 4.4 - advanced to priority 1
• Ck 4.5 - removed "if applicable"
• Ck 5.1 - advanced to priority 1, remove accredited, changed to "usable for intended purpose"
• Ck 5.3 - advanced to priority 1
• Advanced Ck 6.1 to priority 1, removed "future", add "freely available"
• Ck 6.2 - advanced to priority 1
• Ck 6.4 - advanced to priority 1.
• Ck 6.5 reworded checkpoint and explanation text. advanced to priority 2
• Ck. 7.1. Added a note on how this checkpoint is related to 5.4 "review process". Clarified what is the assessment quality by referring to the criteria for the review process.
• Added Ck 5.5 with priority 1 as a criteria for the review process - needed for a reference from other places where we talk about "tests quality assessment criteria". priority 1 is needed to match the minimum requirement in the WG QA commitment.
• Ck 7.2 - added note on how this relates to the Ck 2.2 and moved it to priority 1
• Ck 7.4 - removed
• Ck 8.1 - reworded.
• Ck 1.1 - changed the commitment table based on Mark's suggestions: added requirement for some test assertions to the level 2, added requirement for tests review to the Level 3, swapped level 5 and level 6.
• Added 2 more checkpoints in advancement of Ck 1.1: with priority 2 to commit to the level 5 and with pri3 to commit to the level 7. Explanation notes are there
• Added first draft for Definitions of the Ck Priorities to the Introduction section.
• Added Conformance disclaimer subsection drafted by Lofton, per WG decision.
• Other rewrites and small editorial changes.

[1] http://www.w3.org/QA/WG/2002/framework-20020311/qaframe-ops

03-11-2002

Checkpoints numbering is changed, changes list refers to the numbering from the previous WD [1].

• Incorporated Lynne's contribution - Ch3 rewrite
• add checkpoint for soliciting QA resources in Call for Participation with P2
• minor rephrasing of statements of chkpt 1.1, 1.2, and 1.3
• rephrase "CR-exit" discussion
• Changed chkpt 2.2 from [1] to have P1
• Changed chkpt 1.2 from [1] to have P1
• Removed 3.1, added more explanation notes to 3.2 (P2) and 3.3 (P3)
• Removed the checkpoint 4.1 from [1] and add it to the Intro section
• Removed the checkpoint 5.1
• Added more explanation, clarified the difference between chckpt 6.3 and 6.5 from [1]
• Added more explanation, clarified the difference between 5.3 and 5.5 from [1]
• Added text to explain why the WG SHOULD NOT publish test materials in TR space
• Added text to explain why the Document License is recommended
• Added mild disclaimer on the use of the "SHOULD", "MUST", etc keywords to the Terminology section
• Other rewrites and small editorial changes

[1] http://www.w3.org/QA/WG/2002/02/qaframe-ops-0225.html

02-28-2002

Major rewrite of the previous draft. Incorporated Lynne's comments about Gd1 and Gd4, split Gd regarding QA process, added bunch of new checkpoints.