This test suite is no longer maintained. See the Version 3 Test Suite instead.
The XML Query Test Suite 1.0 (XQTS) provides a set of metrics for determining whether the W3C XML Query Language can be implemented interoperably as published. XQTS will help implementers identify possible problems both with the Specification and with their software. The test suite is occasionally updated to reflect the current work of the W3C XML Query Working Group and the W3C XSL Working Group; all releases of the XQTS will be available from this page.
The XQuery/XPath/XSLT 3.* Test Suite will help us determine whether XPath 3.0, XQuery 3.0, and XSLT 3.0 can be implemented interoperably as published.
XQuery 1.0 is a superset of XPath 2.0, with the exception of the namespace axis. As such, this test suite tests all of XPath 2.0, with the exception of the namespace axis (which is tested in the XSLT 2.0 test suite). These XPath 2.0 test cases are identified in the test suite catalog.
XQTS 1.0.3 contains over 19,000 test cases. It contains a catalog that contains general information on the test suite as well as test descriptions for each of the test cases included in this release. Test queries and expected results are contained in individual files. All interpretations of this Recommendation are subject to confirmation by the XML Query Working Group and the XSL Working Group.
Implementors are encouraged 1) to write a harness for this test suite and to test their implementations and 2) to report their results to the XML Query Working Group. All of these areas are discussed in greater detail below.
This document serves as a first point of information for all interested parties. A general account of current activities, finalized work, and pointers to further information is given. In the sections below, you will be able to get a good view of the status of the XQTS, and if you are interested in something in particular you are invited to follow the appropriate link given below.
These tests have been written using the XML Query (Second Edition) specifications were published as Proposed Edited Recommendations on April 21, 2009.
XQTS 1.0.3 has about 4000 more test cases than did XQTS 1.0.2. 322 of these were added specifically to test the errata that were incorporated into the Second Edition specifications. A new catalog file, XQTSCatalogSecondEdition.xml, contains a subset of the complete test suite that includes only these Second Edition test cases.
The WGs have started to add test cases for XQuery 1.1 to the test suite. These test cases are currently found in the "XQuery 1.1 test cases" group. These test cases contain output-file and expected-error elements that specify spec-version="1.1".
We have received results for a number of XQuery implementations. The reports that we have generated from these results are found below.
| Version | Date | File |
| XQTS 1.0.3 | Sept. 17, 2010 | XQTS_1_0_3.zip |
| XQTS 1.0.2 | Nov. 20, 2006 | XQTS_1_0_2.zip |
| XQTS 1.0.1 | Oct. 2, 2006 | XQTS_1_0_1.zip |
| XQTS 1.0 | Aug. 18, 2006 | XQTS_1_0.zip |
| XQTS 0.9.4 | June 9, 2006 | XQTS_0_9_4.zip |
| XQTS 0.9.0 | April 19, 2006 | XQTS_0_9_0.zip |
| XQTS 0.8.6 | Feb. 15, 2006 | XQTS_0_8_6.zip |
| XQTS 0.8.4 | Jan. 4, 2006 | XQTS_0_8_4.zip |
| XQTS 0.8.2 | Dec. 7, 2005 | XQTS_0_8_2.zip |
| XQTS 0.8.0 | Nov. 3, 2005 | XQTS_0_8_0.zip |
| XQTS 0.7.0 | Oct. 16, 2005 | XQTS_0_7_0.zip |
| XQTS 0.6.0 | Aug. 2, 2005 | XQTS_0_6_0.zip |
This zip file contain a large number of files, including XQTSCatalog.xml, a catalog file contain the metadata for the test suite, files that contain source documents, files that contain queries, and files the contain expected query results. These files also contain a description of the XML document that implementors should produce, if they wish to submit their results to us. A release_notes.html file has been added in this release.
We have associated a stylesheet with XQTSCatalog.xml to make the test suite metadata more readable.
Our source files are available at http://dev.w3.org/cvsweb/2006/xquery-test-suite/. This page provides direct access to the files and it contains instructions on how to use CVS to access these files.
The zip files above each contain the files contained in the TestSuiteStagingArea directory.
We encourage you, the implementors of XQuery and XQueryX, to run these tests and send us your results. These results will help us exit Candidate Recommendation (described in the W3C Process).
As there is no de jure or de facto API for implementations of XQuery 1.0, we are not able to provide a test harness to execute these tests. You will have to write your own test harnesses.
We have provided Guidelines for Running the XML Query Test Suite to assist you in running these tests. These guidelines will tell you how the queries may be modified before they are executed and how to compare your actual results with the expected results that we have provided. At one time we solicited submissions of test cases from individuals and organizations that were not already participating in the XML Query Working Group. You may find a document that we prepared, Guidelines for XML Query Test Suite Submissions, useful.
If you believe that some of the queries or their expected results are incorrect, then we encourage you to enter bug reports in the public instance of Bugzilla at W3C, http://www.w3.org/Bugs/Public/. To enter a bug report you will need a Bugzilla signon (email address and password). You can create this singon by following the Open a new Bugzilla account link on the Bugzilla Main Page.
General information on Bugzilla, an open-source bug tracking system, is available at http://www.bugzilla.org/. The standard documentation for the version currently being run on the W3C server is available at http://www.bugzilla.org/docs/2.20/html/.
To enter a bug report in Bugzilla you will need to log in, choose the action "New", and then choose the "XML Query Test Suite" product. Please be specific about the problem that you are reporting. Clearly identify the test case or test cases that are problematic. If you believe that the expected result is wrong, then tell us what result you believe is correct. If you believe that another result for a test case is justified, then please tell us what it is. In both cases, please cite portions of one or more of the XQuery specifications that support your position.
When you are ready to submit your results to us, we ask that you follow the guidelines provided in Guidelines for Submitting XML Query Test Suite Results. These guidelines will tell you how to generate an XML result document that we can use to generate our reports. They will also tell you how to generate your own report from the XML result file.
If you have indicated that you wish your results to be displayed as “Anonymous”, then please send them to the XML Query WG Team Contact, Liam Quin, cc'ing w3t-archive@w3.org. Otherwise, please send them to the XML Query WG co-chair, Andrew Eisenberg, cc'ing www-archive@w3.org.
We encourage you to send us results early, and then to send us updates as the XQTS progresses and as your implementation progresses.
We have received results for the following XQuery 1.0 implementations:
We have generated both summary and detail reports from these results. You can also see summary and detail reports reflecting the previous version of our test suite, XQTS 1.0.2.
We have generated both summary and detail reports for XQuery 1.0 Second Edition from the more recently submitted results.
Questions about the XQTS can be sent to the XQTS public mailing list. Messages sent to this list can be seen in public-xqts-comments@w3.org Mail Archives.
The following members of the XML Query Working Group and XSL Working Group participated in early versions of this test suite:
Michael Rorke (Microsoft), Karuna Muthiah (Oracle), Ravindranath Chennoju (Oracle), Ying Lu (Oracle), Andreas Behm (IBM), Carmelo Montanez (NIST), Gauri Sharma (Sun Microsystems, Inc.), Joanne Tong (IBM), and Frans Englich (invited expert).
We would also like to acknowledge an initial test suite submission to the XML Query Working Group by:
David Marston (IBM), Asad Jawahar (Microsoft), Jinghao Liu (Microsoft), Mike Rorke (Microsoft), Ana Elisa Schmidt (Microsoft), and Kuen Siew (Microsoft)
Copyright © 1994-2006 W3C® (MIT, ERCIM, Keio), All Rights Reserved. W3C liability, trademark, document use and software licensing rules apply. Your interactions with this site are in accordance with our public and Member privacy statements.