<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://www.w3.org/Bugs/Public/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4"
          urlbase="https://www.w3.org/Bugs/Public/"
          
          maintainer="sysbot+bugzilla@w3.org"
>

    <bug>
          <bug_id>16106</bug_id>
          
          <creation_ts>2012-02-24 11:37:49 +0000</creation_ts>
          <short_desc>Clarify paragraph about character references in tokenization.html</short_desc>
          <delta_ts>2012-09-28 05:17:35 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>HTML WG</product>
          <component>HTML5 spec</component>
          <version>unspecified</version>
          <rep_platform>PC</rep_platform>
          <op_sys>Linux</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P2</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Ezio Melotti">ezio.melotti</reporter>
          <assigned_to name="Silvia Pfeiffer">silviapfeiffer1</assigned_to>
          <cc>ezio.melotti</cc>
    
    <cc>ian</cc>
    
    <cc>kennyluck</cc>
    
    <cc>mike</cc>
    
    <cc>public-html-admin</cc>
    
    <cc>public-html-wg-issue-tracking</cc>
    
    <cc>robin</cc>
          
          <qa_contact name="HTML WG Bugzilla archive list">public-html-bugzilla</qa_contact>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>64533</commentid>
    <comment_count>0</comment_count>
    <who name="Ezio Melotti">ezio.melotti</who>
    <bug_when>2012-02-24 11:37:49 +0000</bug_when>
    <thetext>In the tokenization.html page, in the section &quot;8.2.4.69 Tokenizing character references&quot;, after the table, it says:

&quot;&quot;&quot;
Otherwise, return a character token for the Unicode character whose code point is that number. If the number is in the range 0x0001 to 0x0008, 0x000E to 0x001F, 0x007F to 0x009F, 0xFDD0 to 0xFDEF, or is one of 0x000B, 0xFFFE, 0xFFFF, 0x1FFFE, 0x1FFFF, 0x2FFFE, 0x2FFFF, 0x3FFFE, 0x3FFFF, 0x4FFFE, 0x4FFFF, 0x5FFFE, 0x5FFFF, 0x6FFFE, 0x6FFFF, 0x7FFFE, 0x7FFFF, 0x8FFFE, 0x8FFFF, 0x9FFFE, 0x9FFFF, 0xAFFFE, 0xAFFFF, 0xBFFFE, 0xBFFFF, 0xCFFFE, 0xCFFFF, 0xDFFFE, 0xDFFFF, 0xEFFFE, 0xEFFFF, 0xFFFFE, 0xFFFFF, 0x10FFFE, or 0x10FFFF, then this is a parse error.
&quot;&quot;&quot;

As far as I understand, the character is still returned even if it&apos;s a parse error, but this is not clear.  The current wording might suggest that the character is returned, /but/ if the number is in those ranges, then it&apos;s a parse error (and it doesn&apos;t say what should be returned).
I suggest rephrasing it a bit to state explicitly that the character corresponding to that value is returned in both the cases.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>64535</commentid>
    <comment_count>1</comment_count>
    <who name="Kang-Hao (Kenny) Lu">kennyluck</who>
    <bug_when>2012-02-24 12:47:08 +0000</bug_when>
    <thetext>(In reply to comment #0)
&gt; As far as I understand, the character is still returned even if it&apos;s a parse
&gt; error, but this is not clear.  

It&apos;s pretty clear to me that the first sentence already covers all cases. Otherwise, the first sentence and the second long long sentence would have been switched.

Having said that, I am not the editor and he might agree with you. 

&gt; I suggest rephrasing it a bit to state explicitly that the character
&gt; corresponding to that value is returned in both the cases.

Why don&apos;t you propose some text by the way?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>64553</commentid>
    <comment_count>2</comment_count>
    <who name="Ian &apos;Hixie&apos; Hickson">ian</who>
    <bug_when>2012-02-24 17:16:38 +0000</bug_when>
    <thetext>I&apos;m with Kenny on this. I don&apos;t really see how to make it clearer. If you have any proposals though I&apos;m happy to entertain them.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>64673</commentid>
    <comment_count>3</comment_count>
    <who name="Ezio Melotti">ezio.melotti</who>
    <bug_when>2012-02-28 10:59:04 +0000</bug_when>
    <thetext>One solution would be to use a list like the in the rest of the page, so something like:
...
→ 0xD800 to 0xDFFF
→ greater than 0x10FFFF
    Parse error.  Return U+FFFD.
→ 0x0001 to 0x0008
→ 0x000E to 0x001F
→ ...
    Parse error. Treat it as per the &quot;anything else&quot; entry below.
→ Anything else
    Return a character token for the Unicode character whose code point is that number.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>70511</commentid>
    <comment_count>4</comment_count>
    <who name="">contributor</who>
    <bug_when>2012-07-18 15:06:18 +0000</bug_when>
    <thetext>This bug was cloned to create bug 18021 as part of operation convergence.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>74734</commentid>
    <comment_count>5</comment_count>
    <who name="Silvia Pfeiffer">silviapfeiffer1</who>
    <bug_when>2012-09-28 05:17:35 +0000</bug_when>
    <thetext>EDITOR&apos;S RESPONSE: This is an Editor&apos;s Response to your comment. If
you are satisfied with this response, please change the state of
this bug to CLOSED. If you have additional information and would
like the Editor to reconsider, please reopen this bug. If you would
like to escalate the issue to the full HTML Working Group, please
add the TrackerRequest keyword to this bug, and suggest title and
text for the Tracker Issue; or you may create a Tracker Issue
yourself, if you are able to do so. For more details, see this
document:   http://dev.w3.org/html5/decision-policy/decision-policy.html

Status: Accepted
Change Description: applied patch
https://github.com/w3c/html/commit/6ce78faff3937f156ea217bba6d290de3f456de0
Rationale: adopted resolution by WHATWG</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>