bugGNU Wget - Bugs: bug #26628, Pages that are connected via...

 
 

bug #26628: Pages that are connected via <link rel> tags should count as a single "page" for recursive gets

Submitter:  None
Submitted:  Wed 20 May 2009 11:42:26 AM UTC
   
 
Category:  Feature Request Severity:  1 - Wish
Priority:  1 - Later Status:  Needs Discussion
Privacy:  Public Assigned to:  None
Originator Name:  Ken Originator Email:  -email is unavailable-
Open/Closed:  Open Release:  None
Operating System:  None Reproducibility:  Every Time
Fixed Release:  None Planned Release:  1.15
Regression:  None Work Required:  0 - Hours
Patch Included:  No
* Mandatory Fields

Add a New Comment Rich Markup
   

Wed 20 May 2009 11:42:26 AM UTC, original submission:  

Many websites now break their articles into many pages. These pages are usually linked by the <link rel="next"> or <link rel="prev"> tags, as well as traditional <a href> tags.

If the plucker spider hits one of these pages, it should optionally follow the <link rels> to get the rest of the article. Probably this should be limited to "prev" and "next" relations.  It should do this regardless of any depth settings - in other words the collection of linked pages should count as a single page as far as the spider is concerned.

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by micahcowan (Updated the item)
  • -email is unavailable- added by None (Submitted the item)
  •  

    Follow 5 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2009-05-20 micahcowan Severity3 - Normal 1 - Wish
        Priority5 - Normal 1 - Later
        StatusNone Needs Discussion
        Planned ReleaseNone 1.15
        Work RequiredNone 0 - Hours

    Back to the top

    Powered by Savane 3.13-4448.
    Corresponding source code