bugGNU Wget - Bugs: bug #20645, Wget should possibly not slurp...

 
 

bug #20645: Wget should possibly not slurp HTML files into mem just to process them

Submitter:  Micah Cowan <micahcowan>
Submitted:  Tue 31 Jul 2007 11:01:11 PM UTC
   
 
Category:  Code Architecture Severity:  2 - Minor
Priority:  5 - Normal Status:  Needs Discussion
Privacy:  Public Assigned to:  None
Originator Name:  Open/Closed:  Open
Release:  None Operating System:  None
Reproducibility:  None Fixed Release:  None
Planned Release:  1.15 Regression:  None
Work Required:  2 - Weeks Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Tue 07 Aug 2007 10:36:03 PM UTC, comment #1: 

Moving the HTML parser to a stream-based model, rather than dealing with the whole file as a chunk of memory, would also enable such things as spidering without touching disk I/O.

See bug 20714, regarding spidering without touching disk.

Micah Cowan <micahcowan>
Tue 31 Jul 2007 11:01:11 PM UTC, original submission:  

This is one of the issues encountered in bug 20496.

Micah Cowan <micahcowan>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by micahcowan (Submitted the item)
  •  

    No changes have been made to this item

    Back to the top

    Powered by Savane 3.13-758e.
    Corresponding source code