bugGNU Wget - Bugs: bug #20645, Wget should possibly not slurp...


bug #20645: Wget should possibly not slurp HTML files into mem just to process them

Submitted by:  Micah Cowan <micahcowan>
Submitted on:  Tue 31 Jul 2007 11:01:11 PM UTC  
Category: Code ArchitectureSeverity: 2 - Minor
Priority: 5 - NormalStatus: Needs Discussion
Privacy: PublicAssigned to: None
Originator Name: Open/Closed: Open
Release: NoneOperating System: None
Reproducibility: NoneFixed Release: None
Planned Release: 1.15Regression: None
Work Required: 2 - WeeksPatch Included: None

Add a New Comment(Rich Markup)

You are not logged in

Please log in, so followups can be emailed to you.


Tue 07 Aug 2007 10:36:03 PM UTC, comment #1:

Moving the HTML parser to a stream-based model, rather than dealing with the whole file as a chunk of memory, would also enable such things as spidering without touching disk I/O.

See bug 20714, regarding spidering without touching disk.

Micah Cowan <micahcowan>
Tue 31 Jul 2007 11:01:11 PM UTC, original submission:

This is one of the issues encountered in bug 20496.

Micah Cowan <micahcowan>


(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):

No files currently attached


Depends on the following items: None found

Items that depend on this one: None found


Carbon-Copy List
  • -email is unavailable- added by micahcowan (Submitted the item)

    Please enter the title of George Orwell's famous dystopian book (it's a date):



    No Changes Have Been Made to This Item

    Back to the top

    Powered by Savane 3.1-cleanup1