bugGNU Wget - Bugs: bug #27694, Convert-links misbehaves with...

 
 

bug #27694: Convert-links misbehaves with redirections.

Submitter:  Micah Cowan <micahcowan>
Submitted:  Tue 13 Oct 2009 07:01:40 PM UTC
   
 
Category:  Program Logic Severity:  3 - Normal
Priority:  5 - Normal Status:  Needs Investigation
Privacy:  Public Assigned to:  None
Originator Name:  Open/Closed:  Open
Release:  1.12 Operating System:  None
Reproducibility:  None Fixed Release:  None
Planned Release:  1.12.x Regression:  None
Work Required:  0 - Hours Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Mon 07 Dec 2009 08:36:25 AM UTC, comment #2: 

Hi all,

well I test the line you write. for me it done :

http://pastebin.com/f4ac31366

It create a folder (host.com) with two other inside
 - adservices10.enhance.com (empty)
 - www.host.com (106 items)

Have a happy hacking day !

-- aurele

P.S. : :~$ wget -V
GNU Wget 1.12.1-devel (38a0105c05ea) built on linux-gnu.

On gNewSense metad http://www.gnewsense.org
IRC Freenode #gnewsense | #gnewsense-dev
:/proc$ cat version
Linux version 2.6.26-libre2-2-686-bigmem (Debian 2.6.26-libre2-19lenny1)
(rmh.debian@aybabtu.com) (gcc version 4.1.3 20080704 (prerelease)
(Debian 4.1.2-25)) #1 SMP Sun Oct 25 15:02:08 UTC 2009

Aurélien DESBRIÈRES <aurele>
Tue 13 Oct 2009 07:04:13 PM UTC, comment #1: 

May have been introduced with tweaks I had to make to the "redirected" argument in http_loop (or was it retrieve_url?).

If it's a regression over 1.11.4, we should fix it in 1.12.x. Targeting there for now, until there's more information.

Micah Cowan <micahcowan>
Tue 13 Oct 2009 07:01:40 PM UTC, original submission:  

http://article.gmane.org/gmane.comp.web.wget.general/9044


Using the latest version of wget, it appears that --convert-links doesn't work
when the URL being fetched is a redirect to another URL.  For example:

Server: www.host.com:

<base href="http://foo.host.com">
<a href="/foo">Foo</a>

If http://foo.host.com/foo redirects to http://bar.host.com/foo, then the data
for http://bar.host.com/foo gets downloaded and followed properly, but the URL
/foo gets rewritten improperly to http://foo.host.com/foo (should be
../bar.host.com/foo), which breaks the mirror.  Other, non-redirected links get
rewritten just fine.

Can anyone else confirm this behavior?

The command I'm running is:

wget --timeout=30 -E -H -p --convert-links -r -p --domains=host.com -e
robots=off -P host.com http://www.host.com/

Thanks in advance.


Micah Cowan <micahcowan>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by aurele (Posted a comment)
  • -email is unavailable- added by micahcowan (Submitted the item)
  •  

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2009-10-13 micahcowan Planned Release1.14 1.12.x

    Back to the top

    Powered by Savane 3.14-f13d.
    Corresponding source code