<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://www.w3.org/Bugs/Public/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4"
          urlbase="https://www.w3.org/Bugs/Public/"
          
          maintainer="sysbot+bugzilla@w3.org"
>

    <bug>
          <bug_id>3919</bug_id>
          
          <creation_ts>2006-10-31 23:41:35 +0000</creation_ts>
          <short_desc>[FT] Section 3.1.8 tokens vs words</short_desc>
          <delta_ts>2007-02-01 21:10:09 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>XPath / XQuery / XSLT</product>
          <component>Full Text 1.0</component>
          <version>Working drafts</version>
          <rep_platform>PC</rep_platform>
          <op_sys>Windows XP</op_sys>
          <bug_status>CLOSED</bug_status>
          <resolution>WONTFIX</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P2</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Michael Rys">mrys</reporter>
          <assigned_to name="Jim Melton">jim.melton</assigned_to>
          
          
          <qa_contact name="Mailing list for public feedback on specs from XSL and XML Query WGs">public-qt-comments</qa_contact>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>12712</commentid>
    <comment_count>0</comment_count>
    <who name="Michael Rys">mrys</who>
    <bug_when>2006-10-31 23:41:35 +0000</bug_when>
    <thetext>use the term token and not words in grammar. There is a difference such as the word &quot;Donaudampfschiffartskapitaensmuetzen&quot; can be tokenized and be searched with

Dampf &amp;&amp; muetze distance at most 5 tokens

It would read strange with word.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>13867</commentid>
    <comment_count>1</comment_count>
    <who name="Pat Case">pcase</who>
    <bug_when>2007-02-01 21:09:20 +0000</bug_when>
    <thetext>I18N asked us specifically to use &quot;words&quot;, not &quot;tokens&quot;. There was no support within the TF other then Michael to support this change. So there will be no change.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>13868</commentid>
    <comment_count>2</comment_count>
    <who name="Pat Case">pcase</who>
    <bug_when>2007-02-01 21:10:09 +0000</bug_when>
    <thetext>Closed by Pat with Michael&apos;s knowledge.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>