bugPSPP - Bugs: bug #35688, encoding-guesser could detect bad...

 
 

bug #35688: encoding-guesser could detect bad fallback encoding more generally

Submitter:  Ben Pfaff <blp>
Submitted:  Fri 02 Mar 2012 05:28:58 AM UTC
   
 
Category:  Internationalization/Localization Severity:  5 - Average
Status:  Wont Fix Assigned to:  None
Open/Closed:  Closed Release:  None
Effort:  0.00
* Mandatory Fields

Add a New Comment Rich Markup
   

Wed 02 Sep 2020 01:59:37 AM UTC, comment #1: 

I think that this feature is likely not to be implementable for most multibyte encodings other than UTF-8 itself, so I am closing it.

Ben Pfaff <blp>
Group administrator
Fri 02 Mar 2012 05:28:58 AM UTC, original submission:  

See http://lists.gnu.org/archive/html/pspp-dev/2012-03/msg00008.html for full context.

John Darrington <john@darrington.wattle.id.au> writes:

> Would it be possible to generalize it?  That is to say, could we make
> sure, that when the fallback encoding is X, where X is multi-byte encoding,
> but we know that the input is not X, that it also falls back to windows-1252?
>
> On Wed, Feb 29, 2012 at 10:44:30PM -0800, Ben Pfaff wrote:
>      Until now the encoding-guesser code has used UTF-8 as a fallback in
>      situations where we can tell that the file is not valid UTF-8.  In
>      this kind of situation having a single-byte character set as a
>      fallback makes more sense.  This commit hard-codes windows-1252 as
>      that fallback, since it is a widely encountered encoding (and
>      compatible with ISO-8859-1 as well).


Ben Pfaff <blp>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by blp (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 2 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2020-09-02 blp StatusNone Wont Fix
        Open/ClosedOpen Closed

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code