bugGNU Wget - Bugs: bug #49439, Incorrect message in log file

 
 

bug #49439: Incorrect message in log file

Submitter:  Dale Worley <worley>
Submitted:  Tue 25 Oct 2016 03:13:16 PM UTC
   
 
Category:  Program Logic Severity:  3 - Normal
Priority:  5 - Normal Status:  None
Privacy:  Public Assigned to:  None
Originator Name:  worley Open/Closed:  Open
Release:  1.18 Operating System:  GNU/Linux
Reproducibility:  Every Time Fixed Release:  None
Planned Release:  None Regression:  None
Work Required:  None Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Wed 23 Nov 2016 03:36:56 PM UTC, comment #1: 

There might be files with the same name as the directory.

E.g. somewhere in HTML there is
  http://www.iana.org/assignments/perm-mcast-groupids/index.html
and
  http://www.iana.org/assignments/perm-mcast-groupids

After downloading the first URL, you have a directory 
  www.iana.org/assignments/perm-mcast-groupids

Then downloading the second URL results in such an error.
But wget should handle this situation, AFAIR there is a test provoking this situation (just can't find it).

The background is that a web server's file names not necessarily represent a file system (e.g. maybe the server looks up the files in a database), while wget uses the filesystem as storage. Sometimes there is no 1:1 mapping.

Tim Ruehsen <rockdaboot>
Group administrator
Tue 25 Oct 2016 03:13:16 PM UTC, original submission:  

If I execute this command:

wget --no-verbose -o -log -r --mirror --convert-links --page-requisites --include-directories=/assignments --limit-rate=20k http://www.iana.org/assignments/index.html

in an empty directory, the final lines of the file -log are:

FINISHED --2016-10-25 10:27:40--
Total wall clock time: 1h 16m 59s
Downloaded: 7404 files, 71M in 54m 54s (22.0 KB/s)
www.iana.org/assignments/perm-mcast-groupids: Is a directory
www.iana.org/assignments/power-state-sets: Is a directory

The final two lines seem to be incorrect, and likely indicate a logic error.  (The message should also say what wget was trying to do at the time the error was found.)  Indeed, the two items mentioned are directories, but they are directories that wget created, it shouldn't be surprised by them.


Dale Worley <worley>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rockdaboot (Posted a comment)
  • -email is unavailable- added by worley (Submitted the item)
  •  

    No changes have been made to this item

    Back to the top

    Powered by Savane 3.13-4448.
    Corresponding source code