Wed 18 Jul 2007 07:46:37 PM UTC, original submission:
Forwarded from http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=162283
Hi,
Wget always downloads retrieved symlinks, even when the retrieved
file has already been successfully downloaded.
I invoked wget like this,
the files in question have this ftp directory listing,
I ran wget and these two files, {man,misc}.tgz, were downloaded
successfully, ie, the symlinks were followed, and the
linked-to-files were downloaded, in addition, during this run many
other regular, ie, not symlinked files, were also downloaded.
The first indication of a problem is that the downloaded symlinked
files were given the mtime of the symlink, rather than the mtime
of the linked-to-file,
Then, I ran wget again, and here is where the problem occurred.
What happened is that the previously downloaded regular files were
not downloaded again, as expected, however, the two symlinked
files were downloaded again, in their entirety.
This is a tremendous waste of resources, and it negates the whole
purpose for using timestamping in the first place.
Thanks,
--
Jeff Sheinberg
|