This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.

Bug 3919 - [FT] Section 3.1.8 tokens vs words
Summary: [FT] Section 3.1.8 tokens vs words
Status: CLOSED WONTFIX
Alias: None
Product: XPath / XQuery / XSLT
Classification: Unclassified
Component: Full Text 1.0 (show other bugs)
Version: Working drafts
Hardware: PC Windows XP
: P2 normal
Target Milestone: ---
Assignee: Jim Melton
QA Contact: Mailing list for public feedback on specs from XSL and XML Query WGs
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2006-10-31 23:41 UTC by Michael Rys
Modified: 2007-02-01 21:10 UTC (History)
0 users

See Also:

Attachments

Description Michael Rys 2006-10-31 23:41:35 UTC 
use the term token and not words in grammar. There is a difference such as the word "Donaudampfschiffartskapitaensmuetzen" can be tokenized and be searched with

Dampf && muetze distance at most 5 tokens

It would read strange with word.
Comment 1 Pat Case 2007-02-01 21:09:20 UTC 
I18N asked us specifically to use "words", not "tokens". There was no support within the TF other then Michael to support this change. So there will be no change.
Comment 2 Pat Case 2007-02-01 21:10:09 UTC 
Closed by Pat with Michael's knowledge.