bugGNU Wget - Bugs: bug #20364, Regex support for -A -R (-I -X -D)


bug #20364: Regex support for -A -R (-I -X -D)

Submitted by:  Micah Cowan <micahcowan>
Submitted on:  Fri 06 Jul 2007 10:01:45 PM UTC  
Category:  Feature Request Severity:  3 - Normal
Priority:  8 Status:  Fixed
Privacy:  Public Assigned to:  Giuseppe Scrivano <gscrivano>
Originator Name:  Open/Closed:  Closed
Release:  None Operating System:  None
Reproducibility:  None Fixed Release:  None
Planned Release:  1.14 Regression:  None
Work Required:  1 - Days Patch Included:  No

Add a New Comment (Rich Markup)

You are not logged in

Please log in, so followups can be emailed to you.


( Jump to the original submission)

Fri 09 Aug 2013 09:40:05 AM UTC, comment #8: 

> Not sure how much use Savannah is getting from Wget developers these days.

I don't think I saw any other tracker on GNU or here:

> (1.14, at least) actually do include regex-based accept/reject.
> The relevant new options are:
> --accept-regex --reject-regex
> --regex-type

Tried this version from source and reject seems ok so far, thanks.

Would be nice to permit multiple instances:
egrep -v RE1 | egrep -v RE2
--reject-regex RE1 --reject-regex RE2
so that you can stack up the RE's modularly
in scripts as needed.
That doesn't appear to be implemented so I use one big (or).

grarpamp <grarpamp>
Thu 08 Aug 2013 05:29:55 PM UTC, comment #7: 

Not sure how much use Savannah is getting from Wget developers these days.

My understanding is that current releases of Wget (1.14, at least) actually do include regex-based accept/reject.

The relevant new options are:

Micah Cowan <micahcowan>
Thu 08 Aug 2013 08:41:59 AM UTC, comment #6: 

Would like to see POSIX extended regular expressions added
to wget as well. PCRE compatible would also be an option.
See pcre.org and

Need is to match particular url's (full paths, dirs,
filenames, extensions, whatever... a real regexp) for
inclusion or exclusion of the fetch.

Also, the documentation for whatever is implemented
needs improved to remove ambiguity. Example...

What spec exactly is 'shell-**like**' and 'like' supposed to be?
Without stating the spec we cannot tell if this is
the complete set, or even know the usage of them.

"Globbing refers to the use of shell-like
special characters (wildcards), like *, ?, [ and ]"


grarpamp <grarpamp>
Fri 25 Sep 2009 06:14:52 PM UTC, comment #5: 

Much more discussion on this at: http://article.gmane.org/gmane.comp.web.wget.general/8977

Setting "Patch Included" to "No", now, because it looks like the current plan is diverging a good deal from the proposed patch.

Retargetting at 1.13. As much as I really, really want to fix this ASAP, this really isn't a patch-level fix.

Micah Cowan <micahcowan>
Mon 31 Aug 2009 09:08:37 PM UTC, comment #4: 

Post never materialized, perhaps it was auto-detected as spam.

Micah Cowan <micahcowan>
Fri 17 Apr 2009 08:02:35 PM UTC, comment #3: 

Patch supplied on-list (unfortunately hasn't shown up yet either on list or in archives; I received a Cc copy; look on the archive for around the time this comment was posted)

Micah Cowan <micahcowan>
Wed 06 Aug 2008 10:34:04 PM UTC, comment #2: 

Tentatively schedule for 1.12; this really shouldn't be a ton of work. But, we need to guard against the same locale-dependent issues as fnmatch can suffer.

Micah Cowan <micahcowan>
Sat 29 Sep 2007 12:15:39 AM UTC, comment #1: 

Rather use the regex module from gnulib.

Micah Cowan <micahcowan>
Fri 06 Jul 2007 10:01:45 PM UTC, original submission:  

I like the idea of using regex.c from Emacs, which gives portable, slightly-extended BREs and EREs. PCRE seems like overkill to me, and adding the extra dependency doesn't seem worth it.

I'm not entirely convinced that this is nearly as practically useful as it may be sexy; therefore this is relatively low pri for me.

Micah Cowan <micahcowan>


(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:

No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by gscrivano (Updated the item)
  • -email is unavailable- added by grarpamp (Posted a comment)
  • -email is unavailable- added by micahcowan (Patch submittor)
  • -email is unavailable- added by micahcowan (Submitted the item)



    Follow 21 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2013-08-09 gscrivano StatusConfirmed => Fixed
        Assigned toNone => gscrivano
        Open/ClosedOpen => Closed
        Planned Release1.13 => 1.14
    2009-10-02 micahcowan Planned Release1.14 => 1.13
    2009-09-25 micahcowan Planned Release1.12.x => 1.14
        StatusAwaiting Approval => Confirmed
        Priority4 => 8
        Patch IncludedYes => No
        Severity2 - Minor => 3 - Normal
    2009-09-08 micahcowan Planned Release1.14 => 1.12.x
    2009-08-31 micahcowan Carbon-Copy- => Added wherethebandsr@gmail.com
    2009-04-17 micahcowan StatusNone => Awaiting Approval
        Patch IncludedNone => Yes
    2008-08-21 micahcowan Planned Release1.12 => 1.14
    2008-08-06 micahcowan Work RequiredNone => 1 - Days
    2008-08-06 micahcowan Priority5 - Normal => 4
        Planned Release2.0 => 1.12
    2008-01-27 micahcowan Planned Release1.15 => 2.0
    2007-10-11 micahcowan Planned Release2.0 => 1.15
    2007-07-20 micahcowan Planned ReleaseNone => 2.0

    Back to the top

    Powered by Savane 3.5