QAWG Last Call Disposition of Comments for IntroGuide

This document records the QA Working Group's (QAWG) response to comments on the Last Call Working Draft of QA Framework: Introduction. Please note that the table below is for "Introduction" only. We will generate separate tables for the Operational Guidelines and Specification Guidelines specifications.

Please note, as you review these dispositions, that "QA Framework: Introduction" will not continue processing on the Recommendation track. Because it is a purely informative companion document to the (normative) Guidelines specifications -- Operational, Specification, and Test -- QAWG has resolved to publish it henceforth as a "W3C Working Group Note" companion to those specifications.

In the below table, the full statement of each issue and its processing history can be found in QAWG's Last Call Issues List. The issue number in the first column of the table links to that. In some cases, the Resolution column has links to an Introduction editor's draft, whose purpose is to illustrate the Disposition.

The last column indicates QAWG's disposition of the issue:

No replies to this DoC document are required, because "QA Framework: Introduction" will not continue advancement on the Recommendation track. Nevertheless, QAWG welcomes your comments and suggestions, on both our responses to your comments and on the new draft text of "QA Framework: Introduction" .

Last update: $Date: 2005/06/22 21:01:55 $

Issue # Originator Description Resolution Status
LC-69.1 Colleen Evans Several comments on various parts of Introduction: In general it provides useful guidance on how to use the Framework, defining audience and WG activity applicability for each document.

[No action required.] Thank you for the positive feedback -- it is useful to know that it is fulfilling its purpose.

accepted
LC-69.2 Colleen Evans Several comments on various parts of Introduction: Is this a Working Draft or Last Call Working Draft? Title indicates the former.

W3C process and pubrules do not distinguish between WD and Last Call WD in the dated subtitle. The distinction is required in the "Status of this document" section.

accepted with modification
LC-69.3 Colleen Evans Several comments on various parts of Introduction: Interspersed usage of the terms 'document', 'guideline', and 'specification' to describe the QA Framework documents could be confusing. E.g., paragraph 4 of Status: "... It is anticipated that this specification will eventually progress, along with its Operational Guidelines and Specification Guidelines companions, to Candidate Recommendation (CR) and beyond. The timing of progression of this specification will be determined by the progression of the companion guidelines documents." Similarly, 'TR', 'standard', 'specification', and 'recommendation' are used interchangeably to describe the output of WGs.

This has been fixed as suggested -- document is used uniformly when "Introduction" refers to itself.

accepted
LC-69.4 Colleen Evans Several comments on various parts of Introduction: Section 1.3, first sentence: "The last underscores a key reality of improved quality practices associated with W3C technical reports". Not clear what 'the last' is (previous section?).

This has been fixed as a result of the substantial rewrite of "QA Framework: Introduction" from issue #68 -- as a result of consolidation, that text is gone.

accepted
LC-69.5 Colleen Evans Several comments on various parts of Introduction: Section 1.4, paragraph 3, first sentence incomplete? "While some might perceive QA projects as a regrettable drain on WG resources, there is ample experience, both within W3C as well as other standards venues, that shows significant improvement to the products of the WGs."

This has been fixed as a result the substantial rewrite of "QA Framework: Introduction" from issue #68 -- as a result of consolidation, that text is gone.

accepted
LC-69.6 Colleen Evans Several comments on various parts of Introduction: Sections 1.3 (paragraph 1) and 1.4 (paragraphs 2 and 3) contain general justification arguments for QA efforts in WGs - may be more appropriate content for Section 1.2.

This has changed as a result of the substantial rewrite of "QA Framework: Introduction" from issue #68.

accepted
LC-69.7 Colleen Evans Several comments on various parts of Introduction: Section 3.1 Application Domain - does this belong in Section 3 (Structure and content of Framework documents)? Seems more like Section 1 (Overview) content where target audience is covered.

This has changed as a result of the substantial rewrite of "QA Framework: Introduction" from issue #68.

accepted
LC-69.8 Colleen Evans Several comments on various parts of Introduction: Sections 3.5.2 - 3.5.5 describe each document - information on content, audience, and objective. It may help readability to use a consistent order for presenting this information across sections.

It is our intent that the order be uniform where the framework family is discussed, unless driven by another criterion such as roles or scenarios. We are not aware of any non-uniformities in the revised text.

accepted
LC-69.9 Colleen Evans Several comments on various parts of Introduction: Section 3.5.4 Single item bullet list?

This has changed as a result of the substantial rewrite of "QA Framework: Introduction" from issue #68.

accepted
LC-69.10 Colleen Evans Several comments on various parts of Introduction: Section 4.1.3 Useful breakout of document relevance by role within a WG.

[No action required.] Thank you for the positive feedback.

accepted
LC-69.11 Colleen Evans Several comments on various parts of Introduction: Section 4.2 Provides a good life cycle view of the relationship between Framework documents and WG activities. A table summary might be useful as well.

We will consider this for a future version of "QA Framework: Introduction" (which is now being published as a "Note"). We have put a "chronology diagram" into "QA Framework: Specification Guidelines." One lesson from there is that the chronology is only approximate, and there can be wide variation without substantially diluting the benefits. A submission of a draft table would be welcomed and considered for inclusion.

accepted with modification
LC-69.12 Colleen Evans Several comments on various parts of Introduction: Section 4.1.3 "WG-TS moderator" - Section 4.2.2 "test materials (QA) moderator". Same role?

Yes. The 4.2.2 wording has been changed to simply, "QA moderator".

accepted
LC-69.13 Colleen Evans Several comments on various parts of Introduction: Section 4.2.3, paragraph 4, second sentence is unclear: "Normally, this should not be considered as a good time to bring a specification for 'Specification Guidelines' conformance, as the latter could significantly disrupt and restructure the specification.". Is 'the latter' referring to bringing a spec to specification guidelines conformance, or something in a previous sentence?

The first choice (bringing spec to conformance). The sentence has been revised to remove the ambiguity.

accepted
LC-69.14 Colleen Evans Several comments on various parts of Introduction: Section 4.2.5. Intra-WG build of test materials calls for an acceptance procedure for the individual bits. Import and assemble only call for quality assessment and assessment criteria - is an acceptance procedure required / implied?

This has been revised to clarify.

accepted
LC-69.15 Colleen Evans Several comments on various parts of Introduction: (Editorial) Usage of Working Group vs. WG inconsistent throughout

As a general rule, we have used "WG" a lot for brevity. We have tried to have a full "Working Group" spelled out nearby, e.g., somewhere early in the same section. We have used markup extensively to define the WG acronym.

accepted with modification
LC-69.16 Colleen Evans Several comments on various parts of Introduction: Inconsistent bullet list punctuation (';' vs. ',' vs. nothing at line end, etc.)

This has been made consistent (";").

accepted
LC-69.17 Colleen Evans Several comments on various parts of Introduction: Section 1.2, paragraph 1 "...." at end of first sentence

Fixed.

accepted
LC-69.18 Colleen Evans Several comments on various parts of Introduction: Section 4.2.5, paragraph 2 "? -- as " in middle of second sentence

Fixed.

accepted
LC-71.1 Leonid Arbouzov Collected substantive & editorial comments: [IN-1]: Define "conformance" and "interoperability".

Agreed, the terms should be defined. Note that "conformance" is defined in the "QA Glossary", but "interoperability" is not. An action item has been given to the glossary owners to add this. A note has been added to "Terminology", to refer to "QA Glossary" for definitions.

accepted
LC-71.2 Leonid Arbouzov Collected substantive & editorial comments: [IN-2]: Add "coverage measurement tools" to list in "Technical Assets".

Agreed, this has been added.

accepted
LC-71.3 Leonid Arbouzov Collected substantive & editorial comments: [IN-3]: [editorial] Define the "WAI" acronym in section 2.

Agreed, the first occurrence of WAI is defined (in the text substantially revised per LC-68.)

accepted
LC-71.4 Leonid Arbouzov Collected substantive & editorial comments: [IN-4]: [editorial] Fix last bullet ("assets") in the resource list in section 2.

Done, "assets" is now "technical assets" (per the 2nd following subsection).

accepted
LC-71.5 Leonid Arbouzov Collected substantive & editorial comments: [IN-5]: Since Intro is entirely non-normative, consistently refer to it as "document" instead of "specification".

Agreed, "Introduction" is uniformly referred to as "document" now.

accepted
LC-71.6 Leonid Arbouzov Collected substantive & editorial comments: [IN-6]: Clarify what are the items in the bullet list of 4.2.3.

This has been clarified by identifying them as SpecGL topics, and adding a Guideline # reference to each list item.)

accepted
LC-111.1 Roger Gimson Collected substantive & editorial comments: [FR-1] (Affects SpecGL and other GLs) Can ISO9000 be applied?

After preliminary discussion, QAWG does not think that ISO9000 could replace QA Framework. However an action item to generate a comparison has been assigned and is in progress. It will be circulated to QA distribution when finished. A future version of the "Introduction" part of the QA Framework (now a W3C Working Group Note) could mention or point to the results.

accepted with modification
LC-111.2 Roger Gimson Collected substantive & editorial comments: [FR-2] (Affects Intro, and maybe all GLs). Give a cost/benefit analysis for conforming to the GLs.

An action item has been assigned and is in progress, to generate a some cost-benefit data. It will be circulated to QA distribution when finished. A future version of the "Introduction" part of the QA Framework (now a W3C Working Group Note) could mention or point to the results. Some preliminary results have been incorporated into the new (for renewal) QA Activity statements and charters.

accepted with modification
LC-111.3 Roger Gimson Collected substantive & editorial comments: [FR-3] (Affects Intro, and maybe all GLs). Explain/highlight the relationship of QA Framework to W3C processes.

QA Framework: Introduction has been substantially revised, and in the process the motivational material and discussion of QA within W3C has been substantially condensed and focused. Regarding any formal relationship of QA to W3C processes as described in "W3C Process" document itself -- there is no defined relationship now. As the status of any such relationship is likely to be changeable and volatile, QAWG considers it inadvisable to address that in any of the Framework documents.

accepted with modification
LC-112.1 Roger Gimson Collected substantive & editorial comments: [GC-1]: QA work appreciated, but please "author good tools" to minimize cost to WGs.

Resolution. It is QAWG's intention to shift its resources to tools now, as well as finishing Test Guidelines. How much we can achieve is ultimately limited QAWG resources (number of active participants). Tool suggestions are welcome.

accepted
LC-112.2 Roger Gimson Collected substantive & editorial comments: [GC-2]: A DIFF application for subsequent (WG) spec versions would be useful.

Resolution. A tool like this might be considered outside of the scope of QAWG/IG charters (more in-scope for Comm, for example). That notwithstanding, a number of such tools exist. A summary of diff tools was a topic on the W3C spec-prod list.

accepted with modification
LC-112.3 Roger Gimson Collected substantive & editorial comments: [GC-3]: A set of standard universal templates to help WGs write their specs.

Resolution. Templates to facilitate the QA-related aspects of operations, specifications, and test materials is definitely within the QAWG/IG scope and future agenda. The suggested "universal template" might actually fall in the domain of the Comm team, or possible joint Comm-QAWG project. In recent Chairs email, a new homepage for editors was announced. This suggestion will be forwarded to Comm for further discussion.

accepted with modification
LC-112.4 Roger Gimson Collected substantive & editorial comments: [GC-4]: Can QA suggest review procedures/guidelines that will ensure early involvement of non-WG reviewers?

QAWG recognizes the value of early involvement of non-WG members in QA deliverables. It will be added to QAWG's agenda, to consider where and how this might best be addressed. It is unclear whether it should be addressed in one of the QA Framework documents (which one?), in a QA Note, or some other way.

accepted with modification
LC-112.5 Roger Gimson Collected substantive & editorial comments: [GC-5]: [This is a comment with no apparent action needed -- it is a forward (now-current) reference to their CC/PP work.]

Resolution. Subsequent to this comment, QAWG did a review of CC/PP according to Last Call WD of Specification Guidelines, and a discussion followed. Thanks for your consideration of QAWG's review comments in your CC/PP progression.

accepted with modification
LC-112.6 Roger Gimson Collected substantive & editorial comments: [GC-6]: Questions about how to manage multiple glossaries and what's happening with the Glossary Project (3/2003 Technical Plenary).

The glossary project have been through 5 months of development and is being tested at the moment, It can scrape, manipulate and index glossaries from various sources (including multiple, dated versions of a document), as well as translations. We are planning to send some news to the public list public-glossary@w3.org (to which the commenter could subscribe to get updates on the project, by the way) very soon now.

accepted with modification
LC-76.1 Roger Gimson Collected substantive & editorial comments: [IN-1]: Rephrase "ultimate mission of W3C".

Accepted, "ultimate" is replaced with "ongoing".

accepted
LC-76.2 Roger Gimson Collected substantive & editorial comments: [IN-2]: Meaningless phrase, "unimplementable language".

Agreed, the phrase has been changed to read, "early detection and correction of unintentionally vague or contradictory language".

accepted
LC-76.3 Roger Gimson Collected substantive & editorial comments: [IN-3]: More detail in 3.5.2 audience list than in "Audience" section.

This has been fixed during the substantial rewrite of QA Framework: Introduction that resulted from issue #68. As a result of consolidation of similar parts, the 3.5.2 list is gone.

accepted
LC-76.4 Roger Gimson Collected substantive & editorial comments: [IN-4]: Combine target audience sections -- 4.1 and 1.3.

Agreed, the disparate sections been consolidated during the substantial rewrite of QA Framework: Introduction that resulted from issue #68.

accepted
LC-68 Susan Lesch Intro draft Accepted. Thank you for the excellent contribution. It has been reviewed and adopted as submitted. See draft revised text. accepted