<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://www.w3.org/Bugs/Public/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.4"
          urlbase="https://www.w3.org/Bugs/Public/"
          
          maintainer="sysbot+bugzilla@w3.org"
>

    <bug>
          <bug_id>802</bug_id>
          
          <creation_ts>2004-06-16 13:54:38 +0000</creation_ts>
          <short_desc>double utf-8 bom yields in encoding errors in Validation result</short_desc>
          <delta_ts>2005-08-18 03:19:59 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>1</classification_id>
          <classification>Unclassified</classification>
          <product>Validator</product>
          <component>check</component>
          <version>0.6.7</version>
          <rep_platform>Other</rep_platform>
          <op_sys>other</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc>http://validator.w3.org/check?uri=http%3A%2F%2Fwww.websitedev.de%2Fmarkup%2Fvalidator%2Ftests%2Fdouble-utf-8-bom.html</bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>P2</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Bj">bjoern</reporter>
          <assigned_to name="Terje Bless">link</assigned_to>
          
          
          <qa_contact name="qa-dev tracking">www-validator-cvs</qa_contact>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>2023</commentid>
    <comment_count>0</comment_count>
    <who name="Bj">bjoern</who>
    <bug_when>2004-06-16 13:54:38 +0000</bug_when>
    <thetext>http://validator.w3.org/check?uri=http%3A%2F%2Fwww.websitedev.de%2Fmarkup%
2Fvalidator%2Ftests%2Fdouble-utf-8-bom.html

Is invalid,

http://validator.w3.org/check?uri=http%3A%2F%2Fvalidator.w3.org%2Fcheck%3Furi%
3Dhttp%253A%252F%252Fwww.websitedev.de%252Fmarkup%252Fvalidator%252Ftests%
252Fdouble-utf-8-bom.html

  Sorry, I am unable to validate this document because on line 172 it
  contained one or more bytes that I cannot interpret as utf-8 (in other
  words, the bytes found are not valid values in the specified Character 
  Encoding). Please check both the content of the file and the character
  encoding indication.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2250</commentid>
    <comment_count>1</comment_count>
    <who name="Bj">bjoern</who>
    <bug_when>2004-09-06 21:13:12 +0000</bug_when>
    <thetext>This is probably a duplicate of the bug that deals with using the UTF-8 flag 
for truncate_line() etc.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2255</commentid>
    <comment_count>2</comment_count>
    <who name="Ville Skyttä">ville.skytta</who>
    <bug_when>2004-09-06 21:33:14 +0000</bug_when>
    <thetext>Offtopic, but BOM related: this might be interesting sometime:
http://search.cpan.org/dist/File-BOM/</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2328</commentid>
    <comment_count>3</comment_count>
    <who name="Terje Bless">link</who>
    <bug_when>2004-09-11 13:15:29 +0000</bug_when>
    <thetext>One way to deal with this is to pass our complete output data through the UTF-8 checker (charlint),
possibly modified to tag illegal byte sequences and continue instead of croaking.

BTW, cf. Comment #1, I can&apos;t seem to find this bug you&apos;re refering to; care to provide a bug number?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>2334</commentid>
    <comment_count>4</comment_count>
    <who name="Bj">bjoern</who>
    <bug_when>2004-09-11 23:08:39 +0000</bug_when>
    <thetext>See the relevant comment in the source about Perl 5.8.x --- and I am not sure 
how your suggestion would help. The problem here is that the string is 
considered a byte string and thus substr etc. do not work as expected.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>5432</commentid>
    <comment_count>5</comment_count>
    <who name="Bj">bjoern</who>
    <bug_when>2005-08-18 03:19:59 +0000</bug_when>
    <thetext>Fixed in HEAD.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>