The XML Query Test Suite (XQTS) provides a set of metrics for determining whether the W3C XML Query Language can be implemented interoperably as published. XQTS will help implementers identify possible problems both with the Specification and with their software.. The test suite is occasionally updated to reflect the current work of the W3C XML Query Working Group and the W3C XSL Working Group; all releases of the XQTS will be available from this page.
The XQTS contains over 7000 test cases. It contains a catalog that contains general information on the test suite as well as test descriptions for each of the test cases included in this release. Test queries and expected results are contained in individual files. All interpretations of this Recommendation are subject to confirmation by the XML Query Working Group and the XSL Working Group.
Implementors are encouraged 1) to write a harness for this test suite and to test their implementations, 2) to report their results to the XML Query Working Group, and 3) to submit test cases to the XML Query Working Group to help us complete our coverage of XML Query 1.0. All of these areas are discussed in greater detail below.
This document serves as a first point of information for all interested parties. A general account of current activities, finalized work, and pointers to further information is given. In the sections below, you will be able to get a good view of the status of the XQTS, and if you are interested in something in particular you are invited to follow the appropriate link given below.
All but one of the XML Query specifications began Last Call WD review on April 4, 2005. The last specification began Last Call WD on June 3, 2005. Some changes to both the XQuery 1.0 grammar and semantics will likely be made before XQuery 1.0 is published as a Candidate Recommendation.
XQTS 0.6 provides an early look at this test suite. It contains about 60% of the tests that will exist when the test suite has been completed. We encourage implementors to build their test harnesses and to provide feedback to the XML Query Working Group.
It will take us some time to complete this test suite. We encourage members of the public to contribute tests in some specific areas. The submission of test cases is discussed below.
| Version | Date | File |
| XQTS 0.6.0 | August 2, 2005 | XQTS_0_6_0.zip |
This zip file contain a large number of files, including XQTSCatalog.xml, a catalog file contain the metadata for the test suite, files that contain source documents, files that contain queries, and files the contain expected query results. These files also contain a description of the XML document that implementors should produce, if they wish to submit their results to us.
We have associated a stylesheet with XQTSCatalog.xml to make the test suite metadata more readable.
We encourage you, then implementors of XQuery, to run these tests and send us your results. These results will help us exit Candidate Recommendation (described in the W3C Process).
As there is no de jure or de facto API for implementations of XQuery 1.0, we are not able to provide a test harness to execute these tests. You will have to write your own test harnesses.
We have provided Guidelines for Running the XML Query Test Suite to assist you in running these tests. These guidelines will tell you how the queries may be modified before they are executed and how to compare your actual results with the expected results that we have provided.
If you believe that some of the queries or their expected results are incorrect, then we encourage you to enter bug reports in the public instance of Bugzilla at W3C, http://www.w3.org/Bugs/Public/. To enter a bug report you will need a Bugzilla signon (email address and password). You can create this singon by following the Open a new Bugzilla account link on the Bugzilla Main Page.
General information on Bugzilla, an open-source bug tracking system, is available at http://www.bugzilla.org/. The standard documentation for the version currently being run on the W3C server is available at http://www.bugzilla.org/docs/2.18/html/index.html.
To enter a bug report in Bugzilla you will need to log in, choose the action "New", and then choose the "XML Query Test Suite" product. Please be specific about the problem that you are reporting. Clearly identify the test case or test cases that are problematic. If you believe that the expected result is wrong, then tell us what result you believe is correct. If you believe that another result for a test case is justified, then please tell us what it is. In both cases, please cite portions of one or more of the XQuery specifications that support your position.
When you are ready to submit your results to us, we ask that you follow the guidelines provided in Guidelines for Submitting XML Query Test Suite Results. These guidelines will tell you how to generate an XML result document that we can use to generate our reports. They will also tell you how to generate your own report from the XML result file.
If you have indicated that you wish your results to be displayed as “Anonymous”, then please send them to the XML Query WG Team Contact, Liam Quin, cc'ing w3t-archive@w3.org. Otherwise, please send them to the XML Query WG co-chair, Andrew Eisenberg, cc'ing www-archive@w3.org.
We encourage you to send us results early, and then to send us updates as the XQTS progresses and as your implementation progresses.
We welcome submissions of test cases from individuals and organizations that are not already participating in the XML Query Working Group. We encourage you to look at Guidelines for XML Query Test Suite Submissions so that the test cases that you submit can be added easily to our test suite.
If you would like to submit test cases, then you must:
The XML Query Working Group and XSL Working Group will, at their sole discretion, determine what tests are incorporated in the test suite.
Questions about the XQTS can be sent to the XQTS public mailing list. Messages sent to this list can be seen in public-xqts-comments@w3.org Mail Archives.
The following members of the XML Query Working Group participated in the development of this test suite:
Michael Rorke (Microsoft), Karuna Muthiah (Oracle), Ravindranath Chennoju (Oracle), Andreas Behm (IBM), Carmelo Montanez (NIST), and Gauri Sharma (Sun Microsystems, Inc.)
The following members of the XSL Working Group participated in the development of this test suite:
Joanne Tong (IBM)
We would also like to acknowledge an initial test suite submission to the XML Query Working Group by:
David Marston (IBM), Asad Jawahar (Microsoft), Jinghao Liu (Microsoft), Mike Rorke (Microsoft), Ana Elisa Schmidt (Microsoft), and Kuen Siew (Microsoft)
Copyright © 1994-2005 W3C® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark, document use and software licensing rules apply. Your interactions with this site are in accordance with our public and Member privacy statements.