bugGNU Wget - Bugs: bug #49439, Incorrect message in log file

 
 

bug #49439: Incorrect message in log file

Submitter:  Dale Worley <worley>
Submitted:  Tue 25 Oct 2016 03:13:16 PM UTC
   
 
Category:  Program Logic Severity:  3 - Normal
Priority:  5 - Normal Status:  None
Privacy:  Public Assigned to:  None
Originator Name:  worley Open/Closed:  Open
Release:  1.18 Operating System:  GNU/Linux
Reproducibility:  Every Time Fixed Release:  None
Planned Release:  None Regression:  None
Work Required:  None Patch Included:  None
* Mandatory Fields

Post a Comment

Add a New Comment Rich Markup
   

Discussion

Wed 23 Nov 2016 03:36:56 PM UTC, comment #1: 

There might be files with the same name as the directory.

E.g. somewhere in HTML there is
  http://www.iana.o ... oupids/index.html
and
  http://www.iana.o ... rm-mcast-groupids

After downloading the first URL, you have a directory 
  www.iana.org/assi ... rm-mcast-groupids

Then downloading the second URL results in such an error.
But wget should handle this situation, AFAIR there is a test provoking this situation (just can't find it).

The background is that a web server's file names not necessarily represent a file system (e.g. maybe the server looks up the files in a database), while wget uses the filesystem as storage. Sometimes there is no 1:1 mapping.

Tim Ruehsen <rockdaboot>
Group administrator
Tue 25 Oct 2016 03:13:16 PM UTC, original submission:  

If I execute this command:

wget --no-verbose -o -log -r --mirror --convert-links --page-requisites --include-directories=/assignments --limit-rate=20k http://www.iana.o ... nments/index.html

in an empty directory, the final lines of the file -log are:

FINISHED --2016-10-25 10:27:40--
Total wall clock time: 1h 16m 59s
Downloaded: 7404 files, 71M in 54m 54s (22.0 KB/s)
www.iana.org/assi ... rm-mcast-groupids: Is a directory
www.iana.org/assi ... /power-state-sets: Is a directory

The final two lines seem to be incorrect, and likely indicate a logic error.  (The message should also say what wget was trying to do at the time the error was found.)  Indeed, the two items mentioned are directories, but they are directories that wget created, it shouldn't be surprised by them.


Dale Worley <worley>

 

Attached Files

This item currently has no attached files.

(Note: upload size limit is set to 16MiB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

 

Dependencies

This item does not depend on any other items.

No items depend on this one.

 

Mail Notification Carbon-Copy List

Carbon-Copy List
  • -email is unavailable- added by rockdaboot (Posted a comment)
  • -email is unavailable- added by worley (Submitted the item)
  •  

    History

    No changes have been made to this item

    Back to the top

    Powered by Savane 3.16.
    Corresponding source code