$ wget -np -r --local-encoding=utf-8 -d 'http://127.0.0.1/~foo/' DEBUG output created by Wget 1.19 on linux-gnu. Reading HSTS entries from /home/william/.wget-hsts URI encoding = ‘utf-8’ URI encoding = ‘utf-8’ Enqueuing http://127.0.0.1/~foo/ at depth 0 Queue count 1, maxcount 1. [IRI Enqueuing ‘http://127.0.0.1/~foo/’ with ‘utf-8’ Dequeuing http://127.0.0.1/~foo/ at depth 0 Queue count 0, maxcount 1. Converted file name '127.0.0.1/~foo/index.html' (UTF-8) -> '127.0.0.1/~foo/index.html' (utf-8) --2017-02-22 17:26:53-- http://127.0.0.1/~foo/ Connecting to 127.0.0.1:80... connected. Created socket 3. Releasing 0x0000000000773dd0 (new refcount 0). Deleting unused 0x0000000000773dd0. ---request begin--- GET /~foo/ HTTP/1.1 User-Agent: Wget/1.19 (linux-gnu) Accept: */* Accept-Encoding: identity Host: 127.0.0.1 Connection: Keep-Alive ---request end--- HTTP request sent, awaiting response... ---response begin--- HTTP/1.1 200 OK Date: Wed, 22 Feb 2017 22:26:53 GMT Server: Apache/2.4.18 (Ubuntu) Last-Modified: Wed, 22 Feb 2017 22:25:51 GMT ETag: "62-54925faab2645" Accept-Ranges: bytes Content-Length: 98 Vary: Accept-Encoding Keep-Alive: timeout=5, max=100 Connection: Keep-Alive Content-Type: text/html ---response end--- 200 OK Registered socket 3 for persistent reuse. Length: 98 [text/html] Saving to: ‘127.0.0.1/~foo/index.html’ 127.0.0.1/~foo/index.html 100%[=======================================================================================================>] 98 --.-KB/s in 0s 2017-02-22 17:26:53 (5.35 MB/s) - ‘127.0.0.1/~foo/index.html’ saved [98/98] Loaded 127.0.0.1/~foo/index.html (size 98). URI encoding = ‘utf-8’ 127.0.0.1/~foo/index.html: merge(‘http://127.0.0.1/~foo/’, ‘bar.html’) -> http://127.0.0.1/~foo/bar.html appending ‘http://127.0.0.1/~foo/bar.html’ to urlpos. URI content encoding = ‘Shift_JIS’ no-follow in 127.0.0.1/~foo/index.html: 0 Deciding whether to enqueue "http://127.0.0.1/~foo/bar.html". URI encoding = ‘utf-8’ Loading robots.txt; please ignore errors. Converted file name '127.0.0.1/robots.txt' (UTF-8) -> '127.0.0.1/robots.txt' (utf-8) --2017-02-22 17:26:53-- http://127.0.0.1/robots.txt Reusing existing connection to 127.0.0.1:80. Reusing fd 3. ---request begin--- GET /robots.txt HTTP/1.1 User-Agent: Wget/1.19 (linux-gnu) Accept: */* Accept-Encoding: identity Host: 127.0.0.1 Connection: Keep-Alive ---request end--- HTTP request sent, awaiting response... ---response begin--- HTTP/1.1 404 Not Found Date: Wed, 22 Feb 2017 22:26:53 GMT Server: Apache/2.4.18 (Ubuntu) Content-Length: 283 Keep-Alive: timeout=5, max=99 Connection: Keep-Alive Content-Type: text/html; charset=iso-8859-1 ---response end--- 404 Not Found URI content encoding = ‘iso-8859-1’ Skipping 283 bytes of body: [ 404 Not Found

Not Found

The requested URL /robots.txt was not found on this server.


Apache/2.4.18 (Ubuntu) Server at 127.0.0.1 Port 80
] done. 2017-02-22 17:26:53 ERROR 404: Not Found. Decided to load it. URI encoding = ‘Shift_JIS’ Enqueuing http://127.0.0.1/~foo/bar.html at depth 1 Queue count 1, maxcount 1. [IRI Enqueuing ‘http://127.0.0.1/~foo/bar.html’ with ‘Shift_JIS’ Dequeuing http://127.0.0.1/~foo/bar.html at depth 1 Queue count 0, maxcount 1. converted 'http://127.0.0.1/~foo/bar.html' (Shift_JIS) -> 'http://127.0.0.1/‾foo/bar.html' (UTF-8) Converted file name '127.0.0.1/‾foo/bar.html' (UTF-8) -> '127.0.0.1/‾foo/bar.html' (utf-8) --2017-02-22 17:26:53-- http://127.0.0.1/%E2%80%BEfoo/bar.html Reusing existing connection to 127.0.0.1:80. Reusing fd 3. ---request begin--- GET /%E2%80%BEfoo/bar.html HTTP/1.1 Referer: http://127.0.0.1/~foo/ User-Agent: Wget/1.19 (linux-gnu) Accept: */* Accept-Encoding: identity Host: 127.0.0.1 Connection: Keep-Alive ---request end--- HTTP request sent, awaiting response... ---response begin--- HTTP/1.1 404 Not Found Date: Wed, 22 Feb 2017 22:26:53 GMT Server: Apache/2.4.18 (Ubuntu) Content-Length: 288 Keep-Alive: timeout=5, max=98 Connection: Keep-Alive Content-Type: text/html; charset=iso-8859-1 ---response end--- 404 Not Found URI content encoding = ‘iso-8859-1’ Skipping 288 bytes of body: [ 404 Not Found

Not Found

The requested URL /‾foo/bar.html was not found on this server.


Apache/2.4.18 (Ubuntu) Server at 127.0.0.1 Port 80
] done. 2017-02-22 17:26:53 ERROR 404: Not Found. [IRI fallbacking to non-utf8 for ‘http://127.0.0.1/~foo/bar.html’ Converted file name '127.0.0.1/‾foo/bar.html' (UTF-8) -> '127.0.0.1/‾foo/bar.html' (utf-8) --2017-02-22 17:26:53-- http://127.0.0.1/~foo/bar.html Reusing existing connection to 127.0.0.1:80. Reusing fd 3. ---request begin--- GET /~foo/bar.html HTTP/1.1 Referer: http://127.0.0.1/~foo/ User-Agent: Wget/1.19 (linux-gnu) Accept: */* Accept-Encoding: identity Host: 127.0.0.1 Connection: Keep-Alive ---request end--- HTTP request sent, awaiting response... ---response begin--- HTTP/1.1 200 OK Date: Wed, 22 Feb 2017 22:26:53 GMT Server: Apache/2.4.18 (Ubuntu) Last-Modified: Wed, 22 Feb 2017 22:26:01 GMT ETag: "62-54925fb3e9bdd" Accept-Ranges: bytes Content-Length: 98 Vary: Accept-Encoding Keep-Alive: timeout=5, max=97 Connection: Keep-Alive Content-Type: text/html ---response end--- 200 OK Length: 98 [text/html] Saving to: ‘127.0.0.1/‾foo/bar.html’ 127.0.0.1/‾foo/bar.html 100%[=======================================================================================================>] 98 --.-KB/s in 0s 2017-02-22 17:26:53 (8.36 MB/s) - ‘127.0.0.1/‾foo/bar.html’ saved [98/98] Deciding whether to enqueue "http://127.0.0.1/~foo/bar.html". Already on the black list. Decided NOT to load it. Redirection "http://127.0.0.1/~foo/bar.html" failed the test. FINISHED --2017-02-22 17:26:53-- Total wall clock time: 0.005s Downloaded: 2 files, 196 in 0s (6.53 MB/s)