$ ~/Source/wget/src/wget --version GNU Wget 1.12-2507 built on linux-gnu. +digest +https +ipv6 +iri +large-file +nls -ntlm +opie +ssl/gnutls Wgetrc: /usr/local/stow/wget/etc/wgetrc (system) Locale: /usr/local/stow/wget/share/locale Compile: gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC="/usr/local/stow/wget/etc/wgetrc" -DLOCALEDIR="/usr/local/stow/wget/share/locale" -I. -I../lib -I../lib -O2 -Wall Link: gcc -O2 -Wall -lgnutls -lgcrypt -lgpg-error -lz -lrt -lidn ftp-opie.o gnutls.o ../lib/libgnu.a Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later . This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Originally written by Hrvoje Niksic . Please send bug reports and questions to . $ ~/Source/wget/src/wget -d --spider http://сайт.рф/ Setting --spider (spider) to 1 DEBUG output created by Wget 1.12-2507 on linux-gnu. URI encoding = `UTF-8' Spider mode enabled. Check if remote file exists. --2011-06-26 19:42:04-- http://%D1%81%D0%B0%D0%B9%D1%82.%D1%80%D1%84/ Resolving сайт.рф (сайт.рф)... failed: Name or service not known. wget: unable to resolve host address `сайт.рф' $ LANG="ru_RU.KOI8-R" ~/Source/wget/src/wget --spider `echo http://сайт.рф/ | iconv -t koi8-r` |& iconv -f koi8-r Spider mode enabled. Check if remote file exists. --2011-06-26 19:43:36-- http://xn--80aswg.xn--p1ai/ Resolving сайт.рф (xn--80aswg.xn--p1ai)... 213.219.241.57 Connecting to сайт.рф (xn--80aswg.xn--p1ai)|213.219.241.57|:80... connected. HTTP request sent, awaiting response... 200 Length: unspecified [text/html] Remote file exists and could contain further links, but recursion is disabled -- not retrieving. $ ~/Source/wget/src/wget --spider http://xn--80aswg.xn--p1ai/ -O /dev/null Spider mode enabled. Check if remote file exists. --2011-06-26 19:39:57-- http://xn--80aswg.xn--p1ai/ Resolving сайт.рф (xn--80aswg.xn--p1ai)... 213.219.241.57 Connecting to сайт.рф (xn--80aswg.xn--p1ai)|213.219.241.57|:80... connected. HTTP request sent, awaiting response... 200 Length: unspecified [text/html] Remote file exists and could contain further links, but recursion is disabled -- not retrieving. $