bugGNU Wget - Bugs: bug #49439, Incorrect message in log file

 
 

bug #49439: Incorrect message in log file

Submitted by:  Dale Worley <worley>
Submitted on:  Tue 25 Oct 2016 03:13:16 PM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: None
Privacy: PublicAssigned to: None
Originator Name: worleyOpen/Closed: Open
Release: 1.18Operating System: GNU/Linux
Reproducibility: Every TimeFixed Release: None
Planned Release: NoneRegression: None
Work Required: NonePatch Included: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Wed 23 Nov 2016 03:36:56 PM UTC, comment #1:

There might be files with the same name as the directory.

E.g. somewhere in HTML there is
http://www.iana.org/assignments/perm-mcast-groupids/index.html
and
http://www.iana.org/assignments/perm-mcast-groupids

After downloading the first URL, you have a directory
http://www.iana.org/assignments/perm-mcast-groupids

Then downloading the second URL results in such an error.
But wget should handle this situation, AFAIR there is a test provoking this situation (just can't find it).

The background is that a web server's file names not necessarily represent a file system (e.g. maybe the server looks up the files in a database), while wget uses the filesystem as storage. Sometimes there is no 1:1 mapping.

Tim Ruehsen <rockdaboot>
Project Administrator
Tue 25 Oct 2016 03:13:16 PM UTC, original submission:

If I execute this command:

wget --no-verbose -o -log -r --mirror --convert-links --page-requisites --include-directories=/assignments --limit-rate=20k http://www.iana.org/assignments/index.html

in an empty directory, the final lines of the file -log are:

FINISHED --2016-10-25 10:27:40--
Total wall clock time: 1h 16m 59s
Downloaded: 7404 files, 71M in 54m 54s (22.0 KB/s)
http://www.iana.org/assignments/perm-mcast-groupids: Is a directory
http://www.iana.org/assignments/power-state-sets: Is a directory

The final two lines seem to be incorrect, and likely indicate a logic error. (The message should also say what wget was trying to do at the time the error was found.) Indeed, the two items mentioned are directories, but they are directories that wget created, it shouldn't be surprised by them.

Dale Worley <worley>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by rockdaboot (Posted a comment)
  • -unavailable- added by worley (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    No Changes Have Been Made to This Item

    Back to the top


    Powered by Savane 3.1-cleanup1