bugGNU Wget - Bugs: bug #27473, Wget doesn't recurse for...


bug #27473: Wget doesn't recurse for redirect-looped pages

Submitted by:  Micah Cowan <micahcowan>
Submitted on:  Thu 17 Sep 2009 09:13:11 PM UTC  
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: Confirmed
Privacy: PublicAssigned to: None
Originator Name: Open/Closed: Open
Release: trunkOperating System: None
Reproducibility: NoneFixed Release: None
Planned Release: 1.14Regression: None
Work Required: 0 - HoursPatch Included: None

Add a New Comment(Rich Markup)

You are not logged in

Please log in, so followups can be emailed to you.


Thu 17 Sep 2009 09:13:11 PM UTC, original submission:

This request results in the following series of redirects:

Note that it loops back around to the originally-requested page. By this point, Wget has already blacklisted the original URL, though at that point it was only a redirect. When Wget encounters it the second time (in the same redirect sequence), descend_redirect_p returns false, because it had been blacklisted, setting "descend = false" within retr.c:retrieve_tree, and silently fails to recurse the page.

The workaround is to add --save-cookies=cookies.txt --load-cookies=cookies.txt --keep-session-cookies, and try again, so that on the second try, the server sees the cookies right off the bat, and doesn't redirect again in the first place.

Reproduced in 1.11.4-2ubuntu1 and in the latest dev sources (as of e4153d501c59).

Micah Cowan <micahcowan>


(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):

No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by micahcowan (Submitted the item)

    Please enter the title of George Orwell's famous dystopian book (it's a date):



    No Changes Have Been Made to This Item

    Back to the top

    Powered by Savane 3.1-cleanup1