buggrep - Bugs: bug #9886, 'memory exhausted' error on very...

 
 

You are not allowed to post comments on this tracker with your current authentication level.

bug #9886: 'memory exhausted' error on very long lines

Submitter:  None
Submitted:  Wed 04 Aug 2004 06:10:43 PM UTC
Votes: 150
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Wont Fix
Privacy:  Public Assigned to:  None
Open/Closed:  Closed

Fri 04 Dec 2009 07:46:35 PM UTC, comment #5: 

grep is really a line-based tool, cannot fix this.

Paolo Bonzini <bonzini>
  Spam posted by dimon1
  Spam posted by scuko
  Spam posted by dayatakoy
Fri 23 May 2008 09:35:57 AM UTC, comment #1: 

I've just tested this example. I've not got any error, but the memory usage was about 84% during execution. It seems to me that bug was fixed.
____________________
mp3 download store

-Deleted Account- <scuko>
Wed 04 Aug 2004 06:10:43 PM UTC, original submission:  

I've seen discussions and various patches on the web for this problem, but I'm wondering why it hasn't been fixed within the main source tree.  I'm trying search the output of strings run on a hard drive image (dd).  The output from strings includes several very long lines.  It seems that when grep hits these lines, it is unable to load the entire line into memory and dies.

This can be tested as follows:
dd bs=1 seek=1000000000 of=bigFile < /dev/null
cat bigFile | grep "test"

It seems to me that grep needs to be smarter with it's memory allocation instead of assuming that it can always simply read up to a newline into memory.

Is any work being done on this or is there an alternative to grep that I should use instead?

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by bonzini (Posted a comment)
  • -email is unavailable- added by dimon1 (Posted a comment)
  • -email is unavailable- added by dayatakoy (Posted a comment)
  • -email is unavailable- added by scuko (Posted a comment)
  •  

    There are 150 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

     

    Follow 5 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2009-12-04 bonzini StatusNone Wont Fix
        Open/ClosedOpen Closed
    2007-05-18 loisch Carbon-Copy- Added loisch
    2006-11-22 twaugh Carbon-Copy- Added twaugh
    2005-04-11 julianfoad Summary'memory exhasted' error on very long lines 'memory exhausted' error on very long lines

    Back to the top

    Powered by Savane 3.13-cf05.
    Corresponding source code