14446 2011-10-13 10:46:01 +0000 Conflicting statements on pre-override schema documents 2012-01-06 23:44:25 +0000 1 1 1 Unclassified XML Schema Structures: XSD Part 1 1.1 only PC All CLOSED FIXED resolved P2 normal --- 1 mike David_E3 cmsmcq www-xml-schema-comments oldest_to_newest 58182 0 mike 2011-10-13 10:46:01 +0000 There appear to be conflicting statements on whether or not a schema document, prior to any transformation applied by the chameleon and/or override transformations, has to conform to the schema for schema documents and to the XML representation constraints. The fact that the transformations are schema-aware implies that the input to the transformation must be valid against the S4SD, A Note in 4.2.5 (under the Schema Representation Constraint) says: "Note: It is Dold′ and not Dold, which is required to correspond to a conforming schema. In particular, it is not an error for Dold to fail to satisfy all of the constraints governing schema documents, while it is an error if Dold′ fails to satisfy them." Section 5.1 says: "two additional conditions hold; both apply to the schema document after the conditional-inclusion pre-processing described in Conditional inclusion ( 58637 1 David_E3 2011-10-21 15:37:42 +0000 The WG agrees with points a, b, and c below, but awaits the editor's input. 62082 2 cmsmcq 2011-12-28 00:46:37 +0000 I think the conflict is a consequence of inattention rather than two conscious decisions that conflict with each other. The XSLT form of the chameleon transformation was introduced in a proposal primarily aimed at bug 4767 (https://www.w3.org/XML/Group/2004/06/xmlschema-1/structures.b4767.html#chameleon-xslt); there was no discussion that I can remember or that I have found concerning its schema-awareness. So it may be worth discussing the schema awareness of the transforms (both chameleon and override). The current formulation of the chameleon transform uses schema awareness to identify attributes of type QName, but I think it could in principle be rewritten to act on the specific attributes we know are typed as QNames instead, without schema awareness and thus without any requirement that the input be schema-valid. That would allow us to avoid heading back into the problem of schema-validity for schema documents, which we have not found an easy one to deal with. The current formulation of the override transform is also schema-aware, but there is clearly no problem writing a schema-agnostic version. 62223 3 1059 cmsmcq 2012-01-03 01:05:15 +0000 Created attachment 1059 Proposed schema-agnostic override transformation As an alternative to modifying our rules about schema-validity of the input to pre-processing steps, we could replace the current schema-aware transformations with non-schema-aware transformations. The attached version of the override transformation is such a non-schema-aware transform; the versions of the chameleon-include transform attached to bug 14448 are also non-schema-aware. I do not have a principled objection to changing the text in the way suggested in the bug description (not legible here at the moment, but recorded in http://lists.w3.org/Archives/Public/www-xml-schema-comments/2011OctDec/0004.html). It may well be that the transforms are defined in such a way that only schema-valid input is in fact guaranteed to produce schema-valid output; that seems a possible, even plausible, consequence of the simplicity of the transformations. If I hesitate to make the change, and offer this counter-proposal instead of drafting what the WG agreed upon, it is for two reasons: (1) the constraints on the input are a sore subject for some WG members and I'd rather not reopen it if we can avoid it, and (2) although it seems possible, even plausible, to believe that only schema-valid input to the transforms can produce schema-valid output, only something resembling a proof of that proposition could really carry conviction. Such a proof would really have to go almost line by line through the schema for schema documents arguing that nothing in the chameleon or override transformations could render an invalid document valid. I haven't the time to attempt such a proof, and I don't like to ask it of anyone else either. (An ideal schema language ought to lend itself precisely to proofs of this kind, but I fear the world may not yet contain any ideal schema languages.) So I make the counter-proposal of replacing the currently specified transformations with non-schema-aware equivalents. If the WG agrees, we could close this bug by adopting these non-schema-aware transforms and leaving the prose text of the spec alone. 62224 4 1060 cmsmcq 2012-01-03 01:09:07 +0000 Created attachment 1060 scaffolding for running override.xsl As a convenience to anyone seeking to test the proposed change to the override transform, I attach a scaffolding stylesheet which imports the actual override.xsl. The expected usage is explained in a comment: run the transformation with the overriding schema document (D1 in the spec) as the main input document. Optionally specify an integer parameter 'nth' to select the nth xs:override element in the main input; default value of 'nth' is 1. The output is the transformed version (D2') of the schema document pointed at by the nth override element (D2). Sample test input has already been described in an earlier comment. 62362 5 cmsmcq 2012-01-06 23:34:56 +0000 At its call this morning, the XML Schema WG agreed to replace both the chameleon-include and the override transformations with non-schema-aware versions as a way of resolving the conflicts identified in the bug description. The new transforms have been integrated into the status-quo documents, so I'm marking this issue resolved. Michael, would you please check that the correct transformations have in fact been integrated into the status-quo documents and then close this issue? Thank you. 1059 2012-01-03 01:05:15 +0000 2012-01-03 01:05:15 +0000 Proposed schema-agnostic override transformation override.xsl text/xml 4210 cmsmcq PHhzbDp0cmFuc2Zvcm0gdmVyc2lvbj0iMi4wIiAKICB4bWxuczp4c2w9Imh0dHA6Ly93d3cudzMu b3JnLzE5OTkvWFNML1RyYW5zZm9ybSIKICB4bWxuczp4cz0iaHR0cDovL3d3dy53My5vcmcvMjAw MS9YTUxTY2hlbWEiCiAgeG1sbnM6Zj0iaHR0cDovL3d3dy53My5vcmcvMjAwOC8wNS9YTUxTY2hl bWEtbWlzYyIKICBleGNsdWRlLXJlc3VsdC1wcmVmaXhlcz0iZiI+CiAgCiAgPHhzbDp0ZW1wbGF0 ZSBuYW1lPSJwZXJmb3JtLW92ZXJyaWRlIj4KICAgIDx4c2w6cGFyYW0gbmFtZT0ib3ZlcnJpZGVF bGVtZW50IiBhcz0iZWxlbWVudCh4czpvdmVycmlkZSkiLz4gICAgICAgCiAgICA8eHNsOnBhcmFt IG5hbWU9Im92ZXJyaWRkZW5TY2hlbWEiIGFzPSJlbGVtZW50KHhzOnNjaGVtYSkiLz4KICAgIDx4 c2w6cmVzdWx0LWRvY3VtZW50PgogICAgICA8eHNsOmFwcGx5LXRlbXBsYXRlcyBzZWxlY3Q9IiRv dmVycmlkZGVuU2NoZW1hIj4KICAgICAgICA8eHNsOndpdGgtcGFyYW0gbmFtZT0ib3ZlcnJpZGVF bGVtZW50IiBzZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQiLz4KICAgICAgPC94c2w6YXBwbHktdGVt cGxhdGVzPgogICAgPC94c2w6cmVzdWx0LWRvY3VtZW50PgogIDwveHNsOnRlbXBsYXRlPiAgCiAg CiAgPHhzbDp0ZW1wbGF0ZSBtYXRjaD0ieHM6c2NoZW1hIHwgeHM6cmVkZWZpbmUiCiAgICAgICAg ICAgICAgICBwcmlvcml0eT0iNSI+CiAgICA8eHNsOnBhcmFtIG5hbWU9Im92ZXJyaWRlRWxlbWVu dCIvPgogICAgPHhzbDpjb3B5PgogICAgICA8eHNsOmNvcHktb2Ygc2VsZWN0PSJAKiIvPgogICAg ICA8eHNsOmFwcGx5LXRlbXBsYXRlcz4KICAgICAgICA8eHNsOndpdGgtcGFyYW0gbmFtZT0ib3Zl cnJpZGVFbGVtZW50IiBzZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQiLz4KICAgICAgPC94c2w6YXBw bHktdGVtcGxhdGVzPgogICAgPC94c2w6Y29weT4KICA8L3hzbDp0ZW1wbGF0ZT4KICAKICA8eHNs OnRlbXBsYXRlIG1hdGNoPSJ4czppbXBvcnQiIHByaW9yaXR5PSI1Ij4KICAgIDx4c2w6Y29weS1v ZiBzZWxlY3Q9Ii4iLz4KICA8L3hzbDp0ZW1wbGF0ZT4KCiAgPCEtLSogcmVwbGFjZSBjaGlsZHJl biBvZiB4czpzY2hlbWEsIHhzOnJlZGVmaW5lLCAKICAgICAgKiBhbmQgeHM6b3ZlcnJpZGUgd2hp Y2ggbWF0Y2ggY2hpbGRyZW4gb2YgCiAgICAgICogJG92ZXJyaWRlRWxlbWVudC4gIFJldGFpbiBv dGhlcnMuCiAgICAgICotLT4KICA8eHNsOnRlbXBsYXRlIG1hdGNoPSJ4czpzY2hlbWEvKiAKICAg ICAgICAgICAgICAgICAgICAgICB8IHhzOnJlZGVmaW5lLyoKICAgICAgICAgICAgICAgICAgICAg ICB8IHhzOm92ZXJyaWRlLyoiIAogICAgICAgICAgICAgICAgICAgICAgIHByaW9yaXR5PSIzIj4K ICAgIDx4c2w6cGFyYW0gbmFtZT0ib3ZlcnJpZGVFbGVtZW50Ii8+CiAgICA8eHNsOnZhcmlhYmxl IG5hbWU9Im9yaWdpbmFsIiBzZWxlY3Q9Ii4iLz4KICAgIDx4c2w6dmFyaWFibGUgbmFtZT0icmVw bGFjZW1lbnQiCiAgICAgICAgICAgICAgICAgIHNlbGVjdD0iJG92ZXJyaWRlRWxlbWVudC8qCiAg ICAgICAgICAgICAgICAgICAgICAgICAgW25vZGUtbmFtZSguKSAKICAgICAgICAgICAgICAgICAg ICAgICAgICAgID0gbm9kZS1uYW1lKCRvcmlnaW5hbCkgCiAgICAgICAgICAgICAgICAgICAgICAg ICAgYW5kIAogICAgICAgICAgICAgICAgICAgICAgICAgIGY6Y29tcG9uZW50TmFtZSguKSAKICAg ICAgICAgICAgICAgICAgICAgICAgICAgID0gZjpjb21wb25lbnROYW1lKCRvcmlnaW5hbCldIi8+ CiAgICA8eHNsOmNvcHktb2Ygc2VsZWN0PSIoJHJlcGxhY2VtZW50LCAkb3JpZ2luYWwpWzFdIi8+ CiAgPC94c2w6dGVtcGxhdGU+CgogIDwhLS0qIHJlcGxhY2UgeHM6aW5jbHVkZSBlbGVtZW50cyB3 aXRoIG92ZXJyaWRlcwogICAgICAqLS0+CiAgPHhzbDp0ZW1wbGF0ZSBtYXRjaD0ieHM6aW5jbHVk ZSIgcHJpb3JpdHk9IjUiPgogICAgPHhzbDpwYXJhbSBuYW1lPSJvdmVycmlkZUVsZW1lbnQiLz4K ICAgIDx4c2w6ZWxlbWVudCBuYW1lPSJ4czpvdmVycmlkZSI+CiAgICAgIDx4c2w6Y29weS1vZiAK ICAgICAgICAgIHNlbGVjdD0iQHNjaGVtYUxvY2F0aW9uLCAkb3ZlcnJpZGVFbGVtZW50LyoiLz4K ICAgIDwveHNsOmVsZW1lbnQ+CiAgPC94c2w6dGVtcGxhdGU+CiAgCiAgPCEtLSogY2hhbmdlIHhz Om92ZXJyaWRlIGVsZW1lbnRzOiAgY2hpbGRyZW4gd2hpY2ggbWF0Y2ggCiAgICAgICogY2hpbGRy ZW4gb2YgJG92ZXJyaWRlRWxlbWVudCBhcmUgcmVwbGFjZWQsIG90aGVycyAKICAgICAgKiBhcmUg a2VwdCwgYW5kIGF0IHRoZSBlbmQgYWxsIGNoaWxkcmVuIG9mIAogICAgICAqICRvdmVycmlkZUVs ZW1lbnQgbm90IGFscmVhZHkgaW5zZXJ0ZWQgYXJlIGFkZGVkLgogICAgICAqLS0+CiAgPHhzbDp0 ZW1wbGF0ZSBtYXRjaD0ieHM6b3ZlcnJpZGUiCiAgICBwcmlvcml0eT0iNSI+CiAgICA8eHNsOnBh cmFtIG5hbWU9Im92ZXJyaWRlRWxlbWVudCIvPgogICAgPHhzbDplbGVtZW50IG5hbWU9InhzOm92 ZXJyaWRlIj4KICAgICAgPHhzbDphdHRyaWJ1dGUgbmFtZT0ic2NoZW1hTG9jYXRpb24iPgogICAg ICAgIDx4c2w6dmFsdWUtb2Ygc2VsZWN0PSJAc2NoZW1hTG9jYXRpb24iLz4KICAgICAgPC94c2w6 YXR0cmlidXRlPgogICAgICA8eHNsOmFwcGx5LXRlbXBsYXRlcz4KICAgICAgICA8eHNsOndpdGgt cGFyYW0gbmFtZT0ib3ZlcnJpZGVFbGVtZW50IiBzZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQiLz4K ICAgICAgPC94c2w6YXBwbHktdGVtcGxhdGVzPgogICAgICA8eHNsOmFwcGx5LXRlbXBsYXRlcyBz ZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQvKiIgCiAgICAgICAgbW9kZT0iY29weS11bm1hdGNoZWQi PgogICAgICAgIDx4c2w6d2l0aC1wYXJhbSBuYW1lPSJvdmVycmlkZUVsZW1lbnQiIAogICAgICAg ICAgICAgICAgICAgICAgICBzZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQiLz4KICAgICAgICA8eHNs OndpdGgtcGFyYW0gbmFtZT0ib3ZlcnJpZGRlbk92ZXJyaWRlIiAKICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgc2VsZWN0PSIuIi8+CiAgICAgIDwveHNsOmFwcGx5LXRl bXBsYXRlcz4KICAgIDwveHNsOmVsZW1lbnQ+CiAgPC94c2w6dGVtcGxhdGU+CgogIDx4c2w6dGVt cGxhdGUgbWF0Y2g9IioiIG1vZGU9ImNvcHktdW5tYXRjaGVkIj4KICAgIDx4c2w6cGFyYW0gbmFt ZT0ib3ZlcnJpZGRlbk92ZXJyaWRlIi8+CiAgICA8eHNsOnZhcmlhYmxlIG5hbWU9Im92ZXJyaWRp bmciIHNlbGVjdD0iLiIvPgogICAgPHhzbDp2YXJpYWJsZSBuYW1lPSJvdmVycmlkZGVuIiAKICAg ICAgICAgICAgICAgICAgc2VsZWN0PSIkb3ZlcnJpZGRlbk92ZXJyaWRlLypbCiAgICAgICAgICAg ICAgICAgICAgICAgICAgbm9kZS1uYW1lKC4pIAogICAgICAgICAgICAgICAgICAgICAgICAgICAg PSBub2RlLW5hbWUoJG92ZXJyaWRpbmcpIAogICAgICAgICAgICAgICAgICAgICAgICAgIGFuZCAK ICAgICAgICAgICAgICAgICAgICAgICAgICBmOmNvbXBvbmVudE5hbWUoLikgCiAgICAgICAgICAg ICAgICAgICAgICAgICAgICA9IGY6Y29tcG9uZW50TmFtZSgkb3ZlcnJpZGluZykKICAgICAgICAg ICAgICAgICAgICAgICAgICBdIi8+CiAgICA8eHNsOmNob29zZT4KICAgICAgPHhzbDp3aGVuIHRl c3Q9ImNvdW50KCRvdmVycmlkZGVuKSA+IDAiPgogICAgICAgIDwhLS0qIGRvIG5vdGhpbmc7IHRo aXMgZWxlbWVudCBhbHJlYWR5IGNvcGllZCAqLS0+CiAgICAgIDwveHNsOndoZW4+CiAgICAgIDx4 c2w6d2hlbiB0ZXN0PSJjb3VudCgkb3ZlcnJpZGRlbikgPSAwIj4KICAgICAgICA8IS0tKiBjb3B5 IHRoaXMgZWxlbWVudCwgaXQgaXNuJ3QgYWxyZWFkeSB0aGVyZSAqLS0+CiAgICAgICAgPHhzbDpj b3B5LW9mIHNlbGVjdD0iLiIvPgogICAgICA8L3hzbDp3aGVuPgogICAgPC94c2w6Y2hvb3NlPgog IDwveHNsOnRlbXBsYXRlPgoKICA8eHNsOmZ1bmN0aW9uIG5hbWU9ImY6Y29tcG9uZW50TmFtZSIg YXM9InhzOlFOYW1lIj4KICAgIDx4c2w6cGFyYW0gbmFtZT0iY29tcG9uZW50IiBhcz0iZWxlbWVu dCgpIi8+CiAgICA8eHNsOnNlcXVlbmNlIHNlbGVjdD0iCiAgICAgIFFOYW1lKCRjb21wb25lbnQv YW5jZXN0b3I6OnhzOnNjaGVtYS9AdGFyZ2V0TmFtZXNwYWNlLAogICAgICAgICAgICAkY29tcG9u ZW50L0BuYW1lKSIvPgogIDwveHNsOmZ1bmN0aW9uPgoKPC94c2w6dHJhbnNmb3JtPg== 1060 2012-01-03 01:09:07 +0000 2012-01-03 01:09:07 +0000 scaffolding for running override.xsl run_override.xsl text/xml 1934 cmsmcq PHhzbDp0cmFuc2Zvcm0gdmVyc2lvbj0iMi4wIiAKICAgICAgICAgICAgICAgeG1sbnM6eHNsPSJo dHRwOi8vd3d3LnczLm9yZy8xOTk5L1hTTC9UcmFuc2Zvcm0iCiAgICAgICAgICAgICAgIHhtbG5z OnhzPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYSI+CgogIDwhLS0qIFRoaXMganVz dCByZWFkcyBpbiB0aGUgYXBwcm9wcmlhdGUgaW5wdXQgZG9jdW1lbnRzCiAgICAgICogYW5kIHNl bGVjdHMgdGhlIGVsZW1lbnRzIHRvIGJlIHByb2Nlc3NlZCBieSB0aGUKICAgICAgKiBvdmVycmlk ZS54c2wgc3R5bGVzaGVldC4gCiAgICAgICoKICAgICAgKiBNYWtlIHRoZSBvdmVycmlkaW5nIHNj aGVtYSBkb2N1bWVudCAoRG5ldywgdGhlCiAgICAgICogb25lIGNvbnRhaW5pbmcgdGhlIHhzZDpv dmVycmlkZSBlbGVtZW50KSB0aGUKICAgICAgKiBtYWluIGlucHV0LgogICAgICAqCiAgICAgICog TWFrZSBzdXJlIHRoZSBvdmVycmlkZSBlbGVtZW50IGluIERuZXcgcG9pbnRzCiAgICAgICogY29y cmVjdGx5IHRvIHRoZSBkb2N1bWVudCB0byBiZSBvdmVycmlkZGVuLgogICAgICAqLS0+CiAgPCEt LSogSW52b2NhdGlvbiB3aXRoIFNheG9uOgogICAgICAqCiAgICAgICogc2F4b24gLXhzbDpydW5f b3ZlcnJpZGUueHNsCiAgICAgICogICAgICAgLXM6RDEueHNkCiAgICAgICotLT4KICAKICA8eHNs OmltcG9ydCBocmVmPSJvdmVycmlkZS54c2wiLz4KICAKICA8eHNsOnBhcmFtIG5hbWU9Im50aCIg YXM9InhzOmludGVnZXIiIHNlbGVjdD0iMSIvPgogIAogIDx4c2w6b3V0cHV0IGluZGVudD0ieWVz Ii8+CiAgCiAgPHhzbDp0ZW1wbGF0ZSBtYXRjaD0iLyI+IAogICAgICA8IS0tKgogICAgPHhzbDpt ZXNzYWdlPkhpLCBtb20sIGxvb2tpbmcgZm9yIDx4c2w6dmFsdWUtb2Ygc2VsZWN0PSIkbnRoIi8+ IG92ZXJyaWRlIGVsZW1lbnQuPC94c2w6bWVzc2FnZT4KICAgICotLT4KICAgIDx4c2w6dmFyaWFi bGUgbmFtZT0ib3ZlcnJpZGVFbGVtZW50IiAKICAgICAgICAgICAgICAgICAgYXM9ImVsZW1lbnQo eHM6b3ZlcnJpZGUpIgogICAgICAgICAgICAgICAgICBzZWxlY3Q9Ii94czpzY2hlbWEveHM6b3Zl cnJpZGVbJG50aF0iLz4KICAgICAgPCEtLSoKICAgIDx4c2w6bWVzc2FnZT5PdmVycmlkZSBlbGVt ZW50IGlzIDx4c2w6Y29weS1vZiBzZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQiLz48L3hzbDptZXNz YWdlPgogICAgKi0tPgogICAgPHhzbDp2YXJpYWJsZSBuYW1lPSJvdmVycmlkZGVuU2NoZW1hIiAK ICAgICAgICAgICAgICAgICAgYXM9ImVsZW1lbnQoeHM6c2NoZW1hKSIKICAgICAgICAgICAgICAg ICAgc2VsZWN0PSJkb2N1bWVudCgveHM6c2NoZW1hCiAgICAgICAgICAgICAgICAgICAgICAgICAg L3hzOm92ZXJyaWRlWyRudGhdCiAgICAgICAgICAgICAgICAgICAgICAgICAgL0BzY2hlbWFMb2Nh dGlvbikKICAgICAgICAgICAgICAgICAgICAgICAgICAveHM6c2NoZW1hIi8+CiAgICAgIDwhLS0q CiAgICA8eHNsOm1lc3NhZ2U+T3ZlcnJpZGRlbiBzY2hlbWEgZG9jdW1lbnQgaXMgPC94c2w6bWVz c2FnZT4KICAgIDx4c2w6bWVzc2FnZT48eHNsOmNvcHktb2Ygc2VsZWN0PSIkb3ZlcnJpZGRlblNj aGVtYSIvPjwveHNsOm1lc3NhZ2U+CiAgICAqLS0+CiAgICAKICAgIDx4c2w6Y2FsbC10ZW1wbGF0 ZSBuYW1lPSJwZXJmb3JtLW92ZXJyaWRlIj4KICAgICAgPHhzbDp3aXRoLXBhcmFtIG5hbWU9Im92 ZXJyaWRkZW5TY2hlbWEiCiAgICAgICAgICAgICAgICAgICAgICBzZWxlY3Q9IiRvdmVycmlkZGVu U2NoZW1hIi8+CiAgICAgIDx4c2w6d2l0aC1wYXJhbSBuYW1lPSJvdmVycmlkZUVsZW1lbnQiCiAg ICAgICAgICAgICAgICAgICAgICBzZWxlY3Q9IiRvdmVycmlkZUVsZW1lbnQiLz4KICAgIDwveHNs OmNhbGwtdGVtcGxhdGU+CiAgPC94c2w6dGVtcGxhdGU+CiAgCjwveHNsOnRyYW5zZm9ybT4=