bugGNU Wget - Bugs: bug #21504, --spider does not work with ftp

 
 

bug #21504: --spider does not work with ftp

Submitted by:  Lee Trager <ltrager>
Submitted on:  Fri 02 Nov 2007 04:22:53 PM UTC  
 
Category: Program LogicSeverity: 3 - Normal
Priority: 6Status: Fixed
Privacy: PublicAssigned to: Micah Cowan <micahcowan>
Originator Name: Open/Closed: Closed
Release: NoneOperating System: None
Reproducibility: NoneFixed Release: 1.12
Planned Release: 1.12Regression: None
Work Required: 0 - HoursPatch Included: Yes

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

(Jump to the original submission Jump to the original submission)

Fri 16 May 2008 06:31:49 AM UTC, comment #7:

Resolved for mainline in 994627b7bb4f.

Micah Cowan <micahcowan>In charge of this item.
Thu 24 Apr 2008 05:21:09 PM UTC, comment #6:

New patch from Schubiger at http://article.gmane.org/gmane.comp.web.wget.patches/2342

At this point I should wait until I get word of the copyright assignment. The patch could possibly use further refinements, such as ensuring the .listing file is deleted afterwards and such. I haven't actually played with it: I figure anything that works, is better than current code that doesn't.

Still need to ensure we do the right thing with recursion: we should not be doing recursion for FTP spidering. We should verify directory locations that are explicitly specified; but recursive checking has no meaning for FTP, AFAICT.

Micah Cowan <micahcowan>In charge of this item.
Tue 22 Apr 2008 10:47:19 PM UTC, comment #5:

I'd somehow missed the fact that the OP also submitted a patch, which does more-or-less the same thing.

Waiting for a better solution, that avoids actually retrieving the file. Steven Schubiger is currently playing with one; but if there isn't one before 1.12 is ready to release, I'll use one of these (so it at least works).

Micah Cowan <micahcowan>In charge of this item.
Tue 22 Apr 2008 07:04:50 PM UTC, comment #4:

Note that this results in retrieving the file, which fixes the problem but may not be what we want.

Micah Cowan <micahcowan>In charge of this item.
Tue 22 Apr 2008 07:02:51 PM UTC, comment #3:

Patch submitted by Steven Schubiger:

Micah Cowan <micahcowan>In charge of this item.
Mon 14 Apr 2008 03:48:26 AM UTC, comment #2:

Confirming, per Rodrigo.

Micah Cowan <micahcowan>In charge of this item.
Sun 13 Apr 2008 03:51:07 AM UTC, comment #1:

Agreed. If the path (directory) is wrong wget reports the failure, but if the directory exists and only the file is missing wget reports no failure. Tested with 1.11.

Rodrigo S. Wanderley <rwanderley>
Fri 02 Nov 2007 04:22:53 PM UTC, original submission:

When using wget --spider on an ftp server wget always responds that the file is there even when it is not.

Lee Trager <ltrager>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files
file #14281:  ftp-spider.patch added by ltrager (663B - text/x-patch - Patch to fix --spider with ftp)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by schubiger (Updated the item)
  • -unavailable- added by rwanderley (Posted a comment)
  • -unavailable- added by micahcowan (Updated the item)
  • -unavailable- added by ltrager (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 20 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Fri 16 May 2008 06:31:49 AM UTCmicahcowanStatusReady for Merge=>Fixed
      Open/ClosedOpen=>Closed
      Fixed ReleaseNone=>1.12
    Thu 24 Apr 2008 05:21:09 PM UTCmicahcowanStatusIn Progress=>Ready for Merge
      Assigned toschubiger=>micahcowan
      Patch IncludedNo=>Yes
    Tue 22 Apr 2008 10:47:19 PM UTCmicahcowanPriority8=>6
      StatusReady for Merge=>In Progress
      Assigned tomicahcowan=>schubiger
      Patch IncludedYes=>No
    Tue 22 Apr 2008 07:02:51 PM UTCmicahcowanStatusConfirmed=>Ready for Merge
      Assigned toschubiger=>micahcowan
      Patch IncludedNone=>Yes
    Tue 22 Apr 2008 02:48:48 PM UTCschubigerAssigned toNone=>schubiger
    Mon 14 Apr 2008 03:48:26 AM UTCmicahcowanStatusNeeds Discussion=>Confirmed
    Fri 02 Nov 2007 04:34:39 PM UTCmicahcowanPriority5 - Normal=>8
    Fri 02 Nov 2007 04:34:05 PM UTCmicahcowanStatusNone=>Needs Discussion
      Planned ReleaseNone=>1.12
      Work RequiredNone=>0 - Hours
    Fri 02 Nov 2007 04:22:53 PM UTCltragerAttached File-=>Added ftp-spider.patch, #14281

    Back to the top


    Powered by Savane 3.1-cleanup1