bugGNU Wget - Bugs: bug #21778, Users may not always wish to...

 
 

bug #21778: Users may not always wish to follow redirects across hosts

Submitted by:  Micah Cowan <micahcowan>
Submitted on:  Wed 12 Dec 2007 06:45:57 PM UTC  
 
Category: Program LogicSeverity: 2 - Minor
Priority: 5 - NormalStatus: Needs Discussion
Privacy: PublicAssigned to: None
Originator Name: Open/Closed: Open
Release: NoneOperating System: None
Reproducibility: NoneFixed Release: None
Planned Release: 1.15Regression: None
Work Required: 0 - HoursPatch Included: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 24 Nov 2008 12:24:40 PM UTC, comment #5:

sorry for more:

All these issues seem "semi-random": seems like it's dependent on at which point wget reached the redirect and what URLs it sees after that and if those URLs have already been fetched or not.

Anonymous
Mon 24 Nov 2008 12:22:46 PM UTC, comment #4:

"Weird issues":

We have http://www.example.com which we are dumping and redirected.example.com to where there is a redirect somewhere under http://www.example.com.

1. Stylesheets and other links are sometimes converted to point to non-existent files.
2. Links in content pointing to http://redirected.example.com/ get rewritten as local links, usually pointing to nonexistent files.
3. This I have not verified properly: links pointing to "wrong" files, for example we have redirected.example.com/bar.html and on http://www.example.com/foo/bar.html some pages that should link to /foo/bar.html end up linking to /bar.html.

Anonymous
Thu 20 Nov 2008 05:08:47 AM UTC, comment #3:

It would really help to be specific about what "wierd issues" is.

Micah Cowan <micahcowan>
Wed 19 Nov 2008 10:05:30 PM UTC, comment #2:

> Might be good to add a flag to make redirects follow all the -D/-I/-X/-A/-R rules.
>


Also (or at least) when in recursive mode it should respect -H (or lack of).

This bug when combined with -nH and -k can cause really weird issues (I'm inclined to do a really dirty patch to simply prevent host spanning on redirect to work around the issue locally where this hits me, but that would not acceptable as general policy).

Anonymous
Sat 08 Nov 2008 08:02:12 AM UTC, comment #1:

Might be good to add a flag to make redirects follow all the -D/-I/-X/-A/-R rules.

Micah Cowan <micahcowan>
Wed 12 Dec 2007 06:45:57 PM UTC, original submission:

One user on IRC was annoyed by the fact that Wget would follow redirects to a different host. I can see how this would be undesirable in some cases.

Micah Cowan <micahcowan>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by micahcowan (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follows 1 latest change.

    Date Changed By Updated Field Previous Value => Replaced By
    Sun 27 Jan 2008 04:17:06 AM UTCmicahcowanPlanned Release1.12=>1.15

    Back to the top


    Powered by Savane 3.1-cleanup1