This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.
Jochen has introduced the requirement of separating query tokeninfos and regular tokeninfos. Specifically he introduces a new type in message http://lists.w3.org/Archives/Member/member-query-fttf/2006Mar/0036.html Namely: 1. Types: I introduce a type fts:SearchItem to model the sequence of search tokens of a single search string. I assume fts:SearchTokenInfo to be provided by the implementation.
This is directly related to the proposal that Mary sent about eliminating getTokenInfo and the fact that in the current schema for the search string (xml) the query is already tokenized. Jochen sent a proposal (http://lists.w3.org/Archives/Member/member-query-fttf/2006Feb/0013.html) to solve this isuue.
TokenInfos representing interval are no longer an adequate representation for search tokens. The complete proposal of the change is contained here: (W3C-internal) http://lists.w3.org/Archives/Member/member-query-fttf/2006Apr/0002.html