bugGNU Wget - Bugs: bug #48281, iri tests fails after...

 
 

bug #48281: iri tests fails after 59b920874daa565a1323ffa1e756e80493190686 (Support non-ASCII URLs) on illumos

Submitter:  None
Submitted:  Tue 21 Jun 2016 06:15:13 AM UTC
   
 
Category:  Testing Severity:  3 - Normal
Priority:  5 - Normal Status:  Confirmed
Privacy:  Public Assigned to:  None
Originator Name:  Alexander Pyhalov Originator Email:  -email is unavailable-
Open/Closed:  Open Release:  1.18
Operating System:  None Reproducibility:  Every Time
Fixed Release:  None Planned Release:  None
Regression:  Yes Work Required:  None
Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Tue 21 Jun 2016 11:15:07 AM UTC, comment #2: 

Test-iri.px works with C and UTF-8 locale (that is what we normally test). But it doesn't work with e.g. iso-8859-15.

On Illumos the C locale is a '646' code page with non-ASCII characters >=128 (containing ccedilla). That is why the test did not survive.

We have two problems here:
1. wget converts 2x when extracting URLs from HTML. from the logs:
Loaded index.html (size 279).
URI encoding = 'ISO-8859-15'
index.html: merge('http://localhost:46449/', 'http://localhost:46449/p1_français.html') -> http://localhost:46449/p1_français.html
converted 'http://localhost:46449/p1_français.html' (ISO-8859-15) -> 'http://localhost:46449/p1_français.html' (UTF-8)
Here we see the UTF-8 URL being treated as ISO-8859-15 and convert (again) to UTF-8.

2. the test checks for UTF-8 filenames (see %expected_downloaded_files) regardless of the local encoding.
I already have perl code here to fix this.

Tim Ruehsen <rockdaboot>
Group administrator
Tue 21 Jun 2016 07:35:40 AM UTC, comment #1: 

Are you sure, you have Wget 1.18 ?

The trace contains
DEBUG output created by Wget 1.17.1.9-9a6e on solaris2.11.

Tim Ruehsen <rockdaboot>
Group administrator
Tue 21 Jun 2016 06:15:13 AM UTC, original submission:  

After updating wget to the latest 1.18 version I see that
Test-iri.px
Test-iri-percent.px
Test-iri-list.px
now fail on illumos (OpenIndiana illumos-7dc9a16, 2016-05-20).

It seems to have something with encoding conversions. For example, debug output from Test-iri.px is attached

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #37534:  Test-iri.log added by None (11KiB - text/x-log)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rockdaboot (Posted a comment)
  • -email is unavailable- added by None (Submitted the item)
  •  

    Follow 2 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2016-06-21 rockdaboot StatusNone Confirmed
    2016-06-21 None Attached File- Added Test-iri.log, #37534

    Back to the top

    Powered by Savane 3.13-758e.
    Corresponding source code