This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.
The type "void()" is used which is obsolete, replaced by empty-sequence(). Looks like the EBNF needs to be updated/re-generated. It's also in the ITEMTYPE state table. Frans
The document "Building a Tokenizer for XPath or XQuery" is obsolete. If you do want to know what states we use to build our current test parser, the states are specified in the XML definition of the joint grammar, http://www.w3.org/XML/Group/xsl-query-specs/grammar/parser/applets/xpath-grammar.xml. Note that the current test parser uses selective LL(2) or LL(3) lookahead, and the number of tokenizer states has been greatly decreased.
You should know that the link to that document is accessible only for W3C members. I'm ok with it, but if the intent is to provide information about the grammar for non-members, it doesn't. Regards, Frans
Oops, sorry, the link should have been http://www.w3.org/2004/08/applets/xpath-grammar.xml.