bugGNU Wget - Bugs: bug #50556, When using international TLD,...

 
 

bug #50556: When using international TLD, instead of encoding domain part using puny code, wget encodes it as precent encoding.

Submitted by:  None
Submitted on:  Thu 16 Mar 2017 06:58:14 AM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: Wont Fix
Privacy: PublicAssigned to: Tim Ruehsen <rockdaboot>
Originator Name: zaxdoOriginator Email: -unavailable-
Open/Closed: ClosedRelease: 1.19.1
Operating System: NoneReproducibility: Every Time
Fixed Release: NonePlanned Release: None
Regression: NoneWork Required: None
Patch Included: No

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu 16 Mar 2017 11:24:41 AM UTC, comment #3:

That is not quite correct:

$ wget президент.рф
--2017-03-16 12:19:02-- http://xn--d1abbgf6aiiy.xn--p1ai/
Resolving xn--d1abbgf6aiiy.xn--p1ai (xn--d1abbgf6aiiy.xn--p1ai)... 95.173.136.80
...
2017-03-16 12:19:03 (362 KB/s) - ‘index.html.1’ saved [46752/46752]

Wget 1.19+ uses the underlying libidn2, which you can test with
$ idn2 президент.рф

Maybe your version of Wget isn't compiled with IRI support ?
Check
$ wget --version|grep iri
and
$ ldd /usr/bin/wget|grep libidn2

Tim Ruehsen <rockdaboot>
Project AdministratorIn charge of this item.
Thu 16 Mar 2017 11:09:29 AM UTC, comment #2:

That answer kind of misses the problem. The incorrect behavior happens on all domain names that contains unicode names. (I. E. "wget президент.рф" also fails to resolve the website)

Anonymous
Thu 16 Mar 2017 10:51:06 AM UTC, comment #1:

We recently moved to IDNA 2008 + TR46 non-transitional.

Regarding that standard, your domain label '╯°□°╯┻━┻' contains disallowed characters. If you think that is wrong, you should get in contact with the Unicode consortium or the IETF.

You could still use an older version of wget that uses IDNA 2003 or do the punycode translation yourself with
$ idn '╯°□°╯┻━┻.tk'

The IDNA2008 tool 'idn2' gives:
string contains a disallowed character
no matter if you are using TR46 preprocessing or not.

Tim Ruehsen <rockdaboot>
Project AdministratorIn charge of this item.
Thu 16 Mar 2017 06:58:14 AM UTC, original submission:

When using international TLD, instead of encoding domain part using puny code, wget encodes it as precent encoding.

When trying to use command "wget 'http://╯°□°╯┻━┻.tk'"
wget tries to request http://%E2%95%AF%C2%B0%E2%96%A1%C2%B0%E2%95%AF%E2%94%BB%E2%94%81%E2%94%BB.tk/
while the correct domain is xn--nbaa500zvgab12ac21b.tk

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by rockdaboot (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 4 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu 16 Mar 2017 10:51:06 AM UTCrockdabootStatusNone=>Wont Fix
      Assigned toNone=>rockdaboot
      Open/ClosedOpen=>Closed
      Operating SystemMac OS=>None

    Back to the top


    Powered by Savane 3.1-cleanup1