This continues to be an issue in v1.18 using the following options:

 wget \
      --mirror \
      --page-requisites \
      --adjust-extension \
      --convert-links \
      --no-parent \
      --no-host-directories \
      -o wget.log \
      --domains charlotteworks.com \
      www.charlotteworks.com

When running this command twice, the background images work on the first attempt then end up getting appended with .html. This is esp noticeably on the PNG and CSS files in the index.html file.

Simplifying this command and removing the --mirror option does not create the problem:

   wget --page-requisites --adjust-extension --convert-links --no-parent --no-host-directories -o wget.log --domains charlotteworks.com www.charlotteworks.com

FYI, the website above will be replaced by a new site after Feb 2017. I'm not sure if this behavior is dependent on the web hosting environment.

Well, that's obviously exactly what I'd expect -nc to do...

As to the behavior on -N, there's little we can do about that, since it can be difficult to know if and where a previous run had stored files locally that correspond to URLs. There are heuristics available, but...

We won't be fixing this until we have something like the Session Info Database implemented.

From http://lists.gnu.org/archive/html/bug-wget/2008-12/msg00050.html :

I'm trying to mirror a site (http://www.gamingcommission.fgov.be) and
update the mirror at regular intervals.

This is primarily meant to detect new and changed pages and files.  While
at it, I set it up as a local mirror so I get the added benefit of that
(the site has a tendency of going down a LOT).

I'm using wget 1.10.2 on Ubuntu Server 7.10, apparently they don't have
1.11.x in the repository yet (just scanned for and installed updates today
to make sure).
Should I have asked somewhere else in this case?



The initial local copy works perfectly, it is fully browsable, etc.

Then when I run wget again with the exact same command line arguments, this
is what happens:

1) It checks only the top page (index.html) and direct descendants.  If
there are no changes there, it just stops.  In other words, it only detects
a change in a page if the parent of that page (in the link tree) has also
changed.

2) It messes up links in the pages it re-checks.  Any link to a page that
isn't downloaded again (because it hasn't changed) is replaced by an
absolute link to the original server, but using the filename of the local
copy.

An example of an URL mutilated by (2):

Original:
   jsp/main.jsp?lang=NL
Mirror, initial copy:
   jsp/main.jsp%3Flang=NL.html
Mirror, after one update:
   http://www.gamingcommission.fgov.be/jsp/main.jsp%3Flang=NL.html


I am using these command line parameters:
   --mirror
   --html-extension
   --convert-links
   --backup-converted
   --w 2
   --random-wait
   -p
   --no-check-certificate
   --read-timeout=60
   -e robots=off

Is there anything wrong with my parameters?
Is it something in the site?
Is it a bug?  Fixed in 1.11.4?


BTW, in case someone wants to test it out locally: total size of the mirror
is 116MB.  You can significantly reduce that by skipping the .pdf and .doc
files.