bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #35814, --load

 
 

bug #35814: --load

Submitted by:  None
Submitted on:  Mon 12 Mar 2012 04:14:31 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Invalid
Privacy: PublicAssigned to: None
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 12 Mar 2012 04:34:50 PM UTC, comment #1:

This is not a bug report.

This is a question for the mailing list (parallel@gnu.org). Ask
there.

Ole Tange <tange>
Project Administrator
Mon 12 Mar 2012 04:14:31 PM UTC, original submission:

"Only difference is 0 which actually means 0."

So "--load 0" waits until the system is completely idle (0.00) or just below one (0.x)?

"The load average is only sampled every 10 seconds to avoid stressing small computers.

How is it sampled? top/uptime/etc. know load1/load5/load15. Do you look at one of them every 10s? Which one?

The idea behind "--load" is great, but it's not working that good. I think there should be a mechanism of delayed starting of jobs when "--load" is in use:

I tried running lrzip in parallel. It's a multithreaded compressor written by Con Kolivas, optimized for large files. I used "--load" to make sure it will not overload my system. But it still did.

I used a machine with 32 cores and it started 32 jobs, and the load went up to >90 for the first round of files to be compressed. No new jobs were started until load dropped below 32, but it's still not what a user might have expected.

(I know this is tricky as a job might start its helper threads at any time, but maybe you could start less jobs at the beginning and have a look at the resulting load for a while.)

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Posted a comment)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Mon 12 Mar 2012 04:34:50 PM UTCtangeStatusNone=>Invalid
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1