bugGNU Wget - Bugs: bug #26922, Allow addition of arbitrary...

 
 

bug #26922: Allow addition of arbitrary tags/attributes to be processed.

Submitted by:  Micah Cowan <micahcowan>
Submitted on:  Tue 30 Jun 2009 06:57:13 PM UTC  
 
Category: Feature RequestSeverity: 3 - Normal
Priority: 5 - NormalStatus: Confirmed
Privacy: PublicAssigned to: None
Originator Name: Open/Closed: Open
Release: NoneOperating System: None
Reproducibility: NoneFixed Release: None
Planned Release: 1.15Regression: None
Work Required: 1 - DaysPatch Included: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 06 Jul 2009 04:13:25 AM UTC, comment #1:

XPath-style specifications would also provide fine-grained control, such that links could be parsed from <link/> tags based on the value of the "rel" attribute, etc.

Micah Cowan <micahcowan>
Project Administrator
Tue 30 Jun 2009 06:57:13 PM UTC, original submission:

HTML 5 is approaching, for better or worse, which means a new slew of tags/attributes to parse for URIs.

OTOH, this also highlights a bit of future-proofing that Wget lacks. Users of existing Wget releases will need to upgrade just to get support for new tags. Also, if a page uses "custom" tags that a user might want to parse, there's no real way to specify that, currently.

Would be nice to extend the --folow-tags/--ignore-tags feature to accept lists of arbitrary tag/attr-list specifications, and not just tags that Wget already knows about. For instance, if a new "foo" element takes src uref attributes, both of which may contain URIs, then we could specify --follow-tags="<default>,foo:src|uref", where "<default>" means the ones Wget already knows about.

There might be some value in using an XPath-compatible syntax to specify tags/attributes. This feature would also potentially open Wget up to parse links from non-HTML XML files as well (RSS and the like?), if combined with a feature that told Wget to parse non-html content-types.

Micah Cowan <micahcowan>
Project Administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by micahcowan (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    No Changes Have Been Made to This Item

    Back to the top


    Powered by Savane 3.1-cleanup