bugGNU Wget - Bugs: bug #36797, add post-download command hook

 
 

bug #36797: add post-download command hook

Submitter:  Noël Köthe <nok>
Submitted:  Thu 05 Jul 2012 10:52:21 PM UTC
   
 
Category:  Feature Request Severity:  3 - Normal
Priority:  5 - Normal Status:  None
Privacy:  Public Assigned to:  None
Originator Name:  Open/Closed:  Open
Release:  None Operating System:  GNU/Linux
Reproducibility:  None Fixed Release:  None
Planned Release:  None Regression:  None
Work Required:  None Patch Included:  No
* Mandatory Fields

Add a New Comment Rich Markup
   

Thu 05 Jul 2012 10:52:21 PM UTC, original submission:  

Hello,

this is a forwarded feature request from http://bugs.debian.org/670615

--8<--
Hello,

It would be really great to have a post-download command hook which would be
executed after each file is downloaded successfully by wget.

Currently, when running from scripts it is not easy to do something with
actually downloaded file if it is downloaded using recursion or if file is
generated dynamically, or filename is unknown or redirection took place.

for example
   wget --post-download=md5sum  http://ftp.gnu.org/gnu/bash/bash-4.2.tar.gz

md5sum will be then executed by wget, for example using system() command:
    system("wget bash-4.2.tar.gz")

preferably with some additional environment variables set, like time of
download, wheter it was first download or already downloaded file previously
(but was running with -c flag), what was size, speed, original url, url after
last redirection, wheter redirection took place, what was dns and IP address
used and protocol (http/ftp, ipv4/ipv6, etc), average speed, number of retries,
wheter html links was already changed to local or absolute ones from relative
ones, received cookies/headers, etc.

Actual system command will depend also on -O flag, -c, and whatever we are
using -nc, -nd, -x, nH, --cut-dirs, (and so also -r) and -P.

This command will be very useful in recursive processing as well when using
glob patterns, as well in case of redirects.

Instead of system() command, one can use fork/execve, which will not clobber
environment variables, as well make files with spaces (both downloaded one as
well used script) not a danger.

Thanks,
Witek
--8<--

Thank you.

Noël Köthe <nok>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by nok (Submitted the item)
  • -email is unavailable- added by nok
  •  

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2012-07-05 nok Carbon-Copy- Added -email is unavailable-

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code