5414 2008-01-24 15:31:49 +0000 Remove consecutive from explanation of tokenization 2008-01-24 16:55:03 +0000 1 1 1 Unclassified XPath / XQuery / XSLT Full Text 1.0 Last Call drafts PC Windows XP CLOSED FIXED P2 normal --- 1 pcase pcase public-qt-comments oldest_to_newest 18502 0 pcase 2008-01-24 15:31:49 +0000 In 4.1 Tokenization bullet 1 Each token MUST consist of one or more consecutive characters. Changing to: Each token MUST consist of one or more characters. Removing consecutive to allow implementations to return "vorstellen" in the following sentence "Er stellte sic vor." 18503 1 pcase 2008-01-24 15:36:01 +0000 The correct sentence is "Er stellte sie vor" Fixed as stated in the bug. 18504 2 pcase 2008-01-24 15:36:45 +0000 Closed 18509 3 mike 2008-01-24 16:11:42 +0000 There are many words that could appear as the third word of that sentence: mich, dich, sich, jemand, euch, uns, Ihnen. But not sic or sie. I assumed "sich" was intended. 18511 4 mike 2008-01-24 16:55:03 +0000 I talk nonsense. Of course it can be "sie" - "He introduced her". I just had "Er stellte sich vor" - "He imagined" in my head.