2485 2005-11-08 18:08:14 +0000 tokenization parameters: for data for query or for both ? 2006-02-20 19:29:19 +0000 1 1 1 Unclassified XPath / XQuery / XSLT Full Text 1.0 Working drafts Macintosh All CLOSED FIXED P2 normal --- 1 dflorescu sihem public-qt-comments oldest_to_newest 7096 0 dflorescu 2005-11-08 18:08:14 +0000 This issue concerns the options that effect the tokenization process. The question is: are they influencing only the tokenization of the query string or of both the query string and the data string ? 7097 1 mrys 2005-11-08 18:16:52 +0000 Note that in order to have systems that perform a priori tokenization of the search corpus using FT indices (like all the ones we have), the tokenization parameters of ftcontains should only apply to the search strings and not the input data. 8043 2 sihem 2006-01-30 16:54:29 +0000 Added a note in Section 4: Because tokenization is implementation-defined, the tokenization of each item in $searchContext does not necessarily take into account the match options in $matchOptions. This allows implementations to tokenize and index input data without the knowledge of particular match options used in full-text queries.