bugGNU Screen - Bugs: bug #27586, broken support for unicode plane 1

 
 

bug #27586: broken support for unicode plane 1

Submitter:  Arc Riley <arcx>
Submitted:  Sat 03 Oct 2009 05:12:52 AM UTC
   
 
Category:  Program Logic Severity:  3 - Normal
Priority:  * 5 - Normal Status:  None
Privacy:  Public Assigned to:  None
Open/Closed:  Open Release:  4.0.3
Fixed Release:  None Planned Release:  None
Work Required:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Fri 22 Oct 2010 08:52:18 PM UTC, comment #3: 

Awesome.  Not only is screen broken in this regard, but so is Savannah (it truncated my earlier comment).

Here it is again, reproduced entirely in ASCII.

I just ran into this issue, so I tried out the unicode++ branch.

Sure enough, code points such as <U+26ED9> come out correctly, and they seem to work in copy+paste, scrollback, writebuf, etc.

However, there are problems with the language tag characters (U+E0000 through U+E007F, as they get mangled by screen.  For example, if I output the text,

  <U+E0001><U+E007A><U+E0068><U+9089><U+E007F>,

screen turns it into a bunch of garbage that mutates as you scroll or move the copy cursor around.  The results differ every time the text is output, too.  This text disrupts screen's notion of where lines start and end: after printing this text, the copy mode cursor does not appear on the line that is actually being copied.

Nick Bowler <draconx>
Fri 22 Oct 2010 08:49:05 PM UTC, comment #2: 

I just ran into this issue, so I tried out the unicode++ branch.

Sure enough, code points such as <U+26ED9> (

Nick Bowler <draconx>
Fri 05 Mar 2010 10:34:32 AM UTC, comment #1: 

The 'unicode++' branch in the official repository [1] should now support plane-1 unicode stuff. Using this branch, I can visit, for example, http://www.code2000.net/oneplane.htm, and the characters do not show up as '?' any more.

If you (or anyone) could try it out, that'd be great. If someone's testing, please also test copy/paste from the scrollback, writebuf, hardcopy etc. commands.

[1] http://git.savannah.gnu.org/gitweb/?p=screen.git;a=shortlog;h=refs/heads/unicode%2B%2B

Sadrul Habib Chowdhury <sadrul>
Group administrator
Sat 03 Oct 2009 05:12:52 AM UTC, original submission:  

I have my locale and screen setup properly for en_US.UTF-8

Unicode characters below uffff appear fine, while unicode characters above u10000 appear as a ?.

The same unicode characters work fine outside of screen in the same terminal.

Arc Riley <arcx>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by inimino
  • -email is unavailable- added by draconx (Posted a comment)
  • -email is unavailable- added by sadrul (Posted a comment)
  • -email is unavailable- added by arcx (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 3 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2011-06-23 inimino Carbon-Copy- Added inimino
    2010-10-22 draconx Carbon-CopyRemoved -email is unavailable- -
    2010-10-22 draconx Carbon-Copy- Added -email is unavailable-

    Back to the top

    Powered by Savane 3.14-f13d.
    Corresponding source code