The XML Query Test Suite (XQTS) provides a set of metrics for determining whether the W3C XML Query Language can be implemented interoperably as published. XQTS will help implementers identify possible problems both with the Specification and with their software.. The test suite is occasionally updated to reflect the current work of the W3C XML Query Working Group and the W3C XSL Working Group; all releases of the XQTS will be available from this page.
XQuery 1.0 is a superset of XPath 2.0, with the exception of the namespace axis. As such, this test suite tests all of XPath 2.0, with the exception of the namespace axis (which is tested in the XSLT 2.0 test suite). These XPath 2.0 test cases are identified in the test suite catalog.
XQTS 1.0.2 contains over 15,000 test cases. It contains a catalog that contains general information on the test suite as well as test descriptions for each of the test cases included in this release. Test queries and expected results are contained in individual files. All interpretations of this Recommendation are subject to confirmation by the XML Query Working Group and the XSL Working Group.
Implementors are encouraged 1) to write a harness for this test suite and to test their implementations and 2) to report their results to the XML Query Working Group. All of these areas are discussed in greater detail below.
This document serves as a first point of information for all interested parties. A general account of current activities, finalized work, and pointers to further information is given. In the sections below, you will be able to get a good view of the status of the XQTS, and if you are interested in something in particular you are invited to follow the appropriate link given below.
XQTS 1.0.2 fixes a small number of bugs reported against XQTS 1.0.1 and it reflects a small number of CR issues that have been resolved by the WGs.
It is possible that we will enhance the test suite further after we have made the transition to PR.
The number of XQueryX test cases in XQTS 1.0.2 has fallen about 28 short of our goal of having an XQueryX version of each XQuery (considering only those XQuery expressions that are not expected to produce a parse error). It is possible that this will be remedied in the future.
These tests have been written using the XML Query specifications were published as Candidate Recommendations on Nov. 3, 2005. Updated versions of these documents were published on June 8, 2006. Some of the changes that have been made to the documents based on the resolution of CR issues are reflected in the tests. These issues are listed in our release notes. The largest of these changes effects a number of our test cases. We have changed the namespace of xdt:anyAtomicType, xdt:yearMonthDuration, xdt:dayTimeDuration, xdt:untyped, and xdt:untypedAtomic to the XML Schema namespace "http://www.w3.org/2001/XMLSchema" (see the CR issue resolved in Bugzilla 2548, Change namespace binding for anyAtomicType, yearMonthDuration and dayTimeDuration).
We have received results for a number of XQuery implementations. The reports that we have generated from these results are found below.
| Version | Date | File |
| XQTS 1.0.2 | Nov. 20, 2006 | XQTS_1_0_2.zip |
| XQTS 1.0.1 | Oct. 2, 2006 | XQTS_1_0_1.zip |
| XQTS 1.0 | Aug. 18, 2006 | XQTS_1_0.zip |
| XQTS 0.9.4 | June 9, 2006 | XQTS_0_9_4.zip |
| XQTS 0.9.0 | April 19, 2006 | XQTS_0_9_0.zip |
| XQTS 0.8.6 | Feb. 15, 2006 | XQTS_0_8_6.zip |
| XQTS 0.8.4 | Jan. 4, 2006 | XQTS_0_8_4.zip |
| XQTS 0.8.2 | Dec. 7, 2005 | XQTS_0_8_2.zip |
| XQTS 0.8.0 | Nov. 3, 2005 | XQTS_0_8_0.zip |
| XQTS 0.7.0 | Oct. 16, 2005 | XQTS_0_7_0.zip |
| XQTS 0.6.0 | Aug. 2, 2005 | XQTS_0_6_0.zip |
This zip file contain a large number of files, including XQTSCatalog.xml, a catalog file contain the metadata for the test suite, files that contain source documents, files that contain queries, and files the contain expected query results. These files also contain a description of the XML document that implementors should produce, if they wish to submit their results to us. A release_notes.html file has been added in this release.
We have associated a stylesheet with XQTSCatalog.xml to make the test suite metadata more readable.
Our source files are available at http://dev.w3.org/cvsweb/2006/xquery-test-suite/. This page provides direct access to the files and it contains instructions on how to use CVS to access these files.
The zip files above each contain:
A combined zip file can be produced using the Ant script contained in the Tools/ZipXQTS directory.
We encourage you, the implementors of XQuery and XQueryX, to run these tests and send us your results. These results will help us exit Candidate Recommendation (described in the W3C Process).
As there is no de jure or de facto API for implementations of XQuery 1.0, we are not able to provide a test harness to execute these tests. You will have to write your own test harnesses.
We have provided Guidelines for Running the XML Query Test Suite to assist you in running these tests. These guidelines will tell you how the queries may be modified before they are executed and how to compare your actual results with the expected results that we have provided. At one time we solicited submissions of test cases from individuals and organizations that were not already participating in the XML Query Working Group. You may find a document that we prepared, Guidelines for XML Query Test Suite Submissions, useful.
If you believe that some of the queries or their expected results are incorrect, then we encourage you to enter bug reports in the public instance of Bugzilla at W3C, http://www.w3.org/Bugs/Public/. To enter a bug report you will need a Bugzilla signon (email address and password). You can create this singon by following the Open a new Bugzilla account link on the Bugzilla Main Page.
General information on Bugzilla, an open-source bug tracking system, is available at http://www.bugzilla.org/. The standard documentation for the version currently being run on the W3C server is available at http://www.bugzilla.org/docs/2.20/html/.
To enter a bug report in Bugzilla you will need to log in, choose the action "New", and then choose the "XML Query Test Suite" product. Please be specific about the problem that you are reporting. Clearly identify the test case or test cases that are problematic. If you believe that the expected result is wrong, then tell us what result you believe is correct. If you believe that another result for a test case is justified, then please tell us what it is. In both cases, please cite portions of one or more of the XQuery specifications that support your position.
When you are ready to submit your results to us, we ask that you follow the guidelines provided in Guidelines for Submitting XML Query Test Suite Results. These guidelines will tell you how to generate an XML result document that we can use to generate our reports. They will also tell you how to generate your own report from the XML result file.
If you have indicated that you wish your results to be displayed as “Anonymous”, then please send them to the XML Query WG Team Contact, Liam Quin, cc'ing w3t-archive@w3.org. Otherwise, please send them to the XML Query WG co-chair, Andrew Eisenberg, cc'ing www-archive@w3.org.
We encourage you to send us results early, and then to send us updates as the XQTS progresses and as your implementation progresses.
We have received results for the following XQuery implementations:
We have generated both summary and detail reports from these results.
Questions about the XQTS can be sent to the XQTS public mailing list. Messages sent to this list can be seen in public-xqts-comments@w3.org Mail Archives.
The following members of the XML Query Working Group participated in the development of this test suite:
Michael Rorke (Microsoft), Karuna Muthiah (Oracle), Ravindranath Chennoju (Oracle), Ying Lu (Oracle), Andreas Behm (IBM), Carmelo Montanez (NIST), Gauri Sharma (Sun Microsystems, Inc.), and Frans Englich (invited expert).
The following members of the XSL Working Group participated in the development of this test suite:
Joanne Tong (IBM)
We would also like to acknowledge an initial test suite submission to the XML Query Working Group by:
David Marston (IBM), Asad Jawahar (Microsoft), Jinghao Liu (Microsoft), Mike Rorke (Microsoft), Ana Elisa Schmidt (Microsoft), and Kuen Siew (Microsoft)
Copyright © 1994-2006 W3C® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark, document use and software licensing rules apply. Your interactions with this site are in accordance with our public and Member privacy statements.