helpSavannah Administration - Support: sr #109423, Non-BMP characters truncate...

 
 

sr #109423: Non-BMP characters truncate comments

Submitted by:  David Corbett <dscorbett>
Submitted on:  Mon 27 Nov 2017 09:09:10 PM UTC  
 
Category:  Savannah trackers - bugs, tasks, etc. Priority:  5 - Normal
Severity:  3 - Normal Status:  Done
Assigned to:  Ineiev <ineiev> Operating System:  None
Open/Closed:  Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

( Jump to the original submission)

Sat 28 Jul 2018 12:29:18 PM UTC, comment #7:

It turns out, my terminal wasn't capable to display it; mutt with gnome-terminal shows that character in notifications correctly.

Closing the request.

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Sat 03 Mar 2018 04:59:37 PM UTC, comment #6:

The notifications still come broken

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Sat 03 Mar 2018 04:55:05 PM UTC, comment #5:

I've just pushed and installed a workaround: whenever a new comment is written, it reads back what it actually inserted in the database, and if it differs from the original text, it base64encodes it and inserts with a magic prefix.

When extracting comments from the database, it checks for that prefix and base64decodes when needed:

test: 😀

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Fri 08 Dec 2017 10:15:33 AM UTC, comment #4:

This looks like a MySQL bug: the string breaks when inserted. FYI: Savannah runs on top of 'mysql Ver 14.14 Distrib 5.5.58, for debian-linux-gnu (x86_64) using readline 6.3'.

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Tue 28 Nov 2017 05:52:43 PM UTC, comment #3:

Thanks for the sample; curiously, preview seems to be unaffected.

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Tue 28 Nov 2017 05:45:56 PM UTC, comment #2:

Does it reproduce?

begin

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Tue 28 Nov 2017 01:02:39 PM UTC, comment #1:

Could you attach a sample text in a file?

Ineiev <ineiev>
Site AdministratorIn charge of this item.
Mon 27 Nov 2017 09:09:10 PM UTC, original submission:

When a comment containing a non-BMP Unicode character is submitted, it will be truncated before that character. See, for example, the original submissions of bug #51672 and bug #52538.

David Corbett <dscorbett>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #42509:  1f600.txt added by dscorbett (4B - text/plain)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by ineiev (Posted a comment)
  • -email is unavailable- added by dscorbett (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

     

     

    Follow 6 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2018-07-28 ineiev StatusIn Progress => Done
        Open/ClosedOpen => Closed
    2018-03-03 ineiev StatusWorks For Me => In Progress
    2018-03-03 ineiev StatusNone => Works For Me
    2017-11-28 dscorbett Attached File- => Added 1f600.txt, #42509
    2017-11-28 ineiev Assigned toNone => ineiev

    Back to the top


    Powered by Savane 3.3