bugGNU Wget - Bugs: bug #40656, wget crashes with unicode...

 
 

bug #40656: wget crashes with unicode characters while downloading a whole website

Submitter:  None
Submitted:  Thu 21 Nov 2013 11:31:24 AM UTC
   
 
Category:  Crash/Freeze/Infloop Severity:  3 - Normal
Priority:  5 - Normal Status:  None
Privacy:  Public Assigned to:  None
Originator Name:  Jo Originator Email:  -email is unavailable-
Open/Closed:  Open Release:  trunk
Operating System:  GNU/Linux Reproducibility:  Every Time
Fixed Release:  None Planned Release:  None
Regression:  None Work Required:  None
Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Thu 01 Jan 2015 07:16:30 PM UTC, comment #1: 

Does the problem still exists with Wget 1.16.1 ?
Can't reproduce it here.

Tim Ruehsen <rockdaboot>
Group administrator
Thu 21 Nov 2013 11:31:24 AM UTC, original submission:  

I was downloading a website, after a while wget crashed when it found an unicode character in an invalid url and the server responded 404.

The last file url was similar to:
http://www.example.com/aaa\303%9Faaa

I created an empty file named aaaßaaa.html and downloaded it from my local server.

<code>
[user@localhost ~]$ wget localhost/aaaßaaa.html
--2013-11-21 05:04:53--  http://localhost/aaa%C3%9Faaa.html
Resolving localhost (localhost)... ::1, ::1, 127.0.0.1, ...
Connecting to localhost (localhost)|::1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 0 [text/html]
Saving to: ‘aaa\303%9Faaa.html’
</code>

The Content-Type header is "text/html; charset=UTF-8"
The file was saved as "aaa�%9Faaa.html (invalid encoding)"
The test didn't reproduce the error, but probably is related.


Command to download website:
wget -U '' -kr http://www.example.com/ -D 'www.example.com' -nc --html-extension --convert-links --page-requisites -H



Message:
Error in `wget': double free or corruption (!prev): 0x0000000001d939b0



Version:
GNU Wget 1.14 built on linux-gnu.

+digest +https +ipv6 +iri +large-file +nls +ntlm +opie +ssl/openssl

Wgetrc:
    /etc/wgetrc (system)
Locale: /usr/share/locale
Compile: gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC="/etc/wgetrc"
    -DLOCALEDIR="/usr/share/locale" -I. -I../lib -I../lib
    -D_FORTIFY_SOURCE=2 -march=x86-64 -mtune=generic -O2 -pipe
    -fstack-protector --param=ssp-buffer-size=4
Link: gcc -march=x86-64 -mtune=generic -O2 -pipe -fstack-protector
    --param=ssp-buffer-size=4
    -Wl,-O1,--sort-common,--as-needed,-z,relro /usr/lib/libssl.so
    /usr/lib/libcrypto.so /usr/lib/libz.so -ldl -lz -lz -lidn -luuid
    -lpcre ftp-opie.o openssl.o http-ntlm.o ../lib/libgnu.a



uname -a
Linux localhost.localdomain 3.12.0-1-ARCH #1 SMP PREEMPT Wed Nov 6 09:06:27 CET 2013 x86_64 GNU/Linux

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #29683:  dump added by None (7KiB - application/octet-stream - Attached dump)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rockdaboot (Posted a comment)
  • -email is unavailable- added by None (Submitted the item)
  •  

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2013-11-21 None Attached File- Added dump, #29683

    Back to the top

    Powered by Savane 3.13-cf05.
    Corresponding source code