bugfindutils - Bugs: bug #35254, Compress sort's temporary files

 
 

bug #35254: Compress sort's temporary files

Submitted by:  Andreas Metzler <ametzler>
Submitted on:  Fri 06 Jan 2012 06:37:07 PM UTC  
 
Category: updatedbSeverity: 1 - Wish
Item Group: NoneStatus: None
Privacy: PublicAssigned to: None
Originator Name: Attila KinaliOpen/Closed: Open
Release: NoneFixed Release: None

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Wed 25 Sep 2013 09:06:47 PM UTC, comment #1:

This isn't a good use for a configure check, since the result is not compiled into the program. That is, a change to the system sort command could make the choice made by "configure" incorrect after the findutils binaries have all been built. Having said this, there's probably no easily available alternative approach other than trying to use the --compress-program option to find out if it works.

James Youngman <jay>
Project Administrator
Fri 06 Jan 2012 06:37:07 PM UTC, original submission:

Hello,

this is http://bugs.debian.org/654860 submitted by Attila Kinali:

------------------
Hi,

I am running locate/updatedb on my fileserver which contains a large amount of files (several milion). When running updatedb in such an enviroment, its subprocess sort will create a large amount (1.5GB in my case) of temporary data in /var/tmp. If /var/tmp is on a rather small partition, this will cause the partition to be completely filled up.

The solution is to tell sort to use gzip on its temporary data, which results in a decrease of temp data size by a factor of 10. The performance impact on updatedb is negligible (less than 1%).

Attila Kinali
------------------

Attila suggests to simply use "sort --compress-program=gzip ...", I guess a clean patch would need to doublecheck at ./configure whether sort actually supports this option.

Andreas Metzler <ametzler>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by jay (Posted a comment)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Wed 25 Sep 2013 09:06:47 PM UTCjaySeverity3 - Normal=>1 - Wish
    Fri 06 Jan 2012 06:37:19 PM UTCametzlerCarbon-CopyRemoved 20807=>-

    Back to the top


    Powered by Savane 3.1-cleanup