bugGNU Wget - Bugs: bug #22960, --convert-links doesn't properly...

 
 

bug #22960: --convert-links doesn't properly convert anchors with GET parameters

Submitted by:  None
Submitted on:  Wed 16 Apr 2008 09:07:27 PM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 5 - NormalStatus: Wont Fix
Privacy: PublicAssigned to: None
Originator Name: William McVeyOriginator Email: -unavailable-
Open/Closed: ClosedRelease: 1.11.1
Operating System: GNU/LinuxReproducibility: Every Time
Fixed Release: NonePlanned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu 17 Apr 2008 07:43:43 PM UTC, comment #1:

See http://article.gmane.org/gmane.comp.web.wget.general/6720/ for an explanation.

I recommend you use -E, as that will cause Wget to generate links that are recognizable to browsers as HTML (including the %3F). Without the ".html" suffix, browsers wouldn't be able to recognize it as html, even if the ? is encoded.

Micah Cowan <micahcowan>
Wed 16 Apr 2008 09:07:27 PM UTC, original submission:

I am trying to mirror a site for offline use that generates urls in the form:

results.html?page=1
results.html?page=2
results.html?page=3

Within each of these files are navigation links that link to the prior and next pages. When wget mirrors these urls the retrieved output file file is named 'results.html?page=2'. The URL in the file points to <a href="results.html?page=3">

However, when this file is viewed within a browser, with a file:// protocol method, the ? mark is considered the start of data parameters and results in the link just accessing 'results.html'. In order to get to the actual file, you have to access specify the URL as results.html%3Fpage=3 Ideally, I think wget's --convert-links should do this conversion of the HTML page. Alternativly, I'd be just as happy if the file that got written to disk was named something other than ?page=3 and the html page was converted to that.

In my case, I ran the mirroring with the options of:
-nH --convert-links -r -N -l 5 --page-requisites --no-parent

I tried this using wget 1.10.2 under Ubuntu Gutsy, as well as 1.11.1 pulled from the wget-latest.tbz from the gnu software download site.

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by micahcowan (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu 17 Apr 2008 07:43:43 PM UTCmicahcowanStatusNone=>Wont Fix
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1