bugGNU Wget - Bugs: bug #31915, the -k and -K options do not...

 
 

bug #31915: the -k and -K options do not prevent clobbering (contrary to whats in the man page)

Submitted by:  None
Submitted on:  Sat 18 Dec 2010 02:24:07 PM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: Fixed
Privacy: PublicAssigned to: Giuseppe Scrivano <gscrivano>
Originator Name: pikeOriginator Email: -unavailable-
Open/Closed: ClosedRelease: 1.11.4
Operating System: GNU/LinuxReproducibility: Every Time
Fixed Release: NonePlanned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Tue 28 Dec 2010 12:52:14 AM UTC, comment #2:

How about including an option to simply treat "X.html" as the same as "X" for the purposes of no-clobber? It's a workaround that doesn't always work well, bt I have run into this problem as well and this would be good enough for me.

Anonymous
Wed 22 Dec 2010 12:52:38 PM UTC, comment #1:

I don't see how this can be accomplishied. I am going to fix the manual, removing (at least until a working solution is found):

To prevent this re-downloading, you must use ‘-k’ and ‘-K’ so that the original version of the file will be saved as X.orig (see Recursive Retrieval Options)."

Giuseppe Scrivano <gscrivano>
Project AdministratorIn charge of this item.
Sat 18 Dec 2010 02:24:07 PM UTC, original submission:

The man page at http://www.gnu.org/software/wget/manual/wget.html
reads, about the -E (adjust extension) option

"Note that filenames changed in this way will be re-downloaded every time you re-mirror a site, because Wget can't tell that the local X.html file corresponds to remote URL ‘X’ (...) To prevent this re-downloading, you must use ‘-k’ and ‘-K’ so that the original version of the file will be saved as X.orig (see Recursive Retrieval Options)."

This is not true in wget 1.10 and wget 1.11, and I've been told on IRC this is not so in 1.12. In effect, you can not rewrite links on an archive already wgetted without wgetting it again. Someone on irc mentioned "perhaps the manual expresses an intention that was never manifested."

When this command
wget -d -r -k -K -E --restrict-file-names=windows --no-clobber -l inf -Q 1m -H -D http://www.gnu.org http://www.gnu.org

is run twice, all the html files that are to be renamed are retrieved again the second time (but not the page requisites). --no-clobber only has effects on page requisites and pages with extension html, not on html without the correct extension (probably because of the rewriting -E switch), which is in contrast with the manual.

I've logged this, but couldnt attach it here because of the upload size limit :-(

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by gscrivano (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 3 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Wed 22 Dec 2010 12:52:38 PM UTCgscrivanoStatusNone=>Fixed
      Assigned toNone=>gscrivano
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1