bugGNU Wget - Bugs: bug #28776, Using recursive download, -X does...

 
 

bug #28776: Using recursive download, -X does not exclude directories

Submitted by:  David Morris <morrisde>
Submitted on:  Sat 30 Jan 2010 04:46:23 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Priority: 5 - NormalStatus: None
Privacy: PublicAssigned to: None
Originator Name: David MorrisOpen/Closed: Open
Release: 1.12Operating System: GNU/Linux
Reproducibility: Every TimeFixed Release: None
Planned Release: NoneRegression: None
Work Required: NonePatch Included: No

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Fri 14 Jan 2011 02:41:09 PM UTC, comment #3:

FYI I attached a file to bug #20517 that elaborates on the wildcard problem starting with the example below.
file #22410: jimwrightcomment.txt
(I gave up trying to post it as a comment.)

Jim Wright <jimwrightbe>
Tue 12 Oct 2010 02:59:53 AM UTC, comment #2:

Thought I'd take a stab at a defect. I've attached a possible patch but really the way the code was originally, I think it would be more appropriate to refactor the code or convert this to an enhancement that would add regular expression handling for include/exclude.

Either way, if anyone wants to check the patch, apply it with patch -p0 < bug28766.patch.

The basic problem as I saw it was that when determining when to include/exclude, if the include match hit first then the exclude match would never get executed. I modified it so it would always do both and the exclude match would override the include match if both hit.

(file #21662)

Jason Unrein <diabelek>
Sat 30 Jan 2010 05:06:03 PM UTC, comment #1:

Note, the second command line has a '*' character before and after "/lang/". The web site automatically replaced those characters with making the string bold.

David Morris <morrisde>
Sat 30 Jan 2010 04:46:23 PM UTC, original submission:

OS: Debian testing

When using a recursive download, -X does not exclude directories.

The following is the first of many files under the "lang" directory which should not be downloaded:

comhaltas.ie/music/detail/garrett_barrys_jig/lang/ga/index.html

According to WGET documentation, I should be able to use "-X" to exclude directories using wild cards. However, this does not appear to work.

WGET command-lines tested:

wget -A html,mp3 -r -l3 -k -nc -I '/music/detail,/audio' -X '/music/detail/*/lang' http://comhaltas.ie/shop/detail/foinn_seisiun_cd_volume_2/index.html

wget -A html,mp3 -r -l3 -k -nc -I '/music/detail,/audio' -X '/music/detail//lang/' http://comhaltas.ie/shop/detail/foinn_seisiun_cd_volume_2/index.html

In all cases the noted file which should be excluded is in fact downloaded.

David Morris <morrisde>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files
file #21662:  bug28776.patch added by diabelek (787B - text/x-patch - possible patch)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by jimwrightbe (Posted a comment)
  • -unavailable- added by diabelek (Updated the item)
  • -unavailable- added by morrisde (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follows 1 latest change.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue 12 Oct 2010 02:59:53 AM UTCdiabelekAttached File-=>Added bug28776.patch, #21662

    Back to the top


    Powered by Savane 3.1-cleanup1