bugGNU Wget - Bugs: bug #20647, Need maximum filesize for HTML...

 
 

bug #20647: Need maximum filesize for HTML parsing

Submitter:  Micah Cowan <micahcowan>
Submitted:  Tue 31 Jul 2007 11:13:55 PM UTC
   
 
Category:  Code Architecture Severity:  3 - Normal
Priority:  4 Status:  Wont Fix
Privacy:  Public Assigned to:  micahcowan
Originator Name:  Open/Closed:  Closed
Release:  None Operating System:  None
Reproducibility:  None Fixed Release:  None
Planned Release:  1.12 Regression:  None
Work Required:  0 - Hours Patch Included:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Wed 01 Aug 2007 06:33:59 PM UTC, comment #1: 

It's looking like a hardcoded size limit, at any rate, could be a bad idea. Perhaps it would be well to implement a configurable file size limit, and we may want to only apply it in cases when mmap() failed.

Micah Cowan <micahcowan>
Tue 31 Jul 2007 11:13:55 PM UTC, original submission:  

A bug has been filed suggesting that we should perhaps not be slurping HTML files entirely into memory in order to process them (bug 20645). However, until this is addressed, we need to ensure that the HTML files we slurp in don't exceed reasonable sizes, in the meantime. This is especially true when you consider the potential for non-HTML files to be misrecognized as potential HTML files (bug 20496).

Perhaps something in the 15MB range?

Micah Cowan <micahcowan>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by micahcowan (Submitted the item)
  •  

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2008-01-27 micahcowan StatusConfirmed Wont Fix
        Open/ClosedOpen Closed
    2007-08-01 micahcowan Priority5 - Normal 4
        Planned Release1.11 1.12

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code