bugGNU gettext - Bugs: bug #37857, libiconv allows encoding...

 
 

bug #37857: libiconv allows encoding characters above U+10FFFF in UTF-8

Submitted by:  Vlad R <vladr>
Submitted on:  Mon 03 Dec 2012 08:14:02 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: None
Privacy: PublicAssigned to: None
Open/Closed: Open

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 03 Dec 2012 08:14:02 PM UTC, original submission:

In lib/utf-8.h we imply adherence to RFC 3629, but RFC 3629 explicitly restricts the range of characters to 0000-10FFFF (the UTF-16 accessible range.) In this respect, lib/utf-8.h follows RFC 2279.

As a result, such non-RFC 3629 sequences (in excess of U+10ffff) are deemed "valid" by libiconv (`printf '\xf4\x90\x80\x80' | iconv -f utf8 -t utf8` succeeds) but are not convertible to any other encoding (including utf32: `printf '\xf4\x90\x80\x80' | iconv -f utf8 -t utf32` fails.)

Sequences deemed valid by libiconv are also not interoperable with misc. XML parsers (e.g. Java-based.)

This is similar to the glibc bug 2373.

Vlad R <vladr>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by vladr (Submitted the item)
  • -unavailable- added by vladr
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follows 1 latest change.

    Date Changed By Updated Field Previous Value => Replaced By
    Mon 03 Dec 2012 08:14:02 PM UTCvladrCarbon-Copy-=>Added -unavailable-

    Back to the top


    Powered by Savane 3.1-cleanup