bugGNU Parallel - Bugs: bug #64992, --limit with 5 values

 
 

bug #64992: --limit with 5 values

Submitter:  None
Submitted:  Thu 07 Dec 2023 04:04:41 PM UTC
   
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  None
Privacy:  Public Assigned to:  None
Open/Closed:  Open
* Mandatory Fields

Add a New Comment Rich Markup
   

Thu 07 Dec 2023 04:26:23 PM UTC, comment #3: 

Naming: Should the options be called --limit-X instead:

--limit-cpu (alias --limit-load)
--limit-net
--limit-mem (alias --limit-ram)
--limit-net

All with alias: --l-X

This way the will be close in the man page.

Anonymous
Thu 07 Dec 2023 04:22:48 PM UTC, comment #2: 

Computations are allowed:

5/2k = 2500

100/3% = 33%

If using % it must be the last char.

Anonymous
Thu 07 Dec 2023 04:21:04 PM UTC, comment #1: 

Negative values:

-5 means: Compute what 100% means. Subtract 5 from that.

E.g. --memlimit -5G means keep 5GBytes free.

Default values: You can leave out values for a,b,c,d,e.

No a = disable stop spawning jobs
No b = disable suspending jobs
No c = ?
No d = disable killing jobs
No e = ?

So this is valid: --memlimit :-10G:-5G::

meaning: Start suspending at 10GB free RAM. All but one suspended at 5GB free RAM. Which is the same as --memsuspend 5G.

So this is valid: --memlimit -10G:::-10G:-5G

meaning: Don't start new processes at 10GB free RAM. Start killing at 10GB free RAM. All but one killed at 5GB free RAM. Which is the same as --memfree 10G.



Anonymous
Thu 07 Dec 2023 04:04:41 PM UTC, original submission:  

--loadlimit a:b:c:d:e
--memlimit a:b:c:d:e
--netlimit a:b:c:d:e
--iolimit a:b:c:d:e

a = stop spawning new jobs
b = start suspending jobs
c = all but one job suspended
d = start killing jobs
e = all but one job killed

Numbers can be given as actual numbers or percent.

Load is calculated similar to –jobs: 100% means a load average of one per CPU thread. 10 means a load average of 10.
Mem is calculated as bytes or as percentage of physical ram: 5G means 5GBytes, 70% means 70% of memory used.
IO is calculated as bytes/sec or as percentage business: 90% means busy 90% of the time, 10M means 10Mbytes I/O per second
Net is calculated as bytes/sec or as percentage of bandwidth: 90% means 90% of the bandwidth, 10M means 10Mbits/s per second

Net needs to know the total bandwidth. It can be done by --netlimit config=10M to set the total bandwidth to 10Mbits/s. --netlimit config=auto will try to autodetect the bandwidth using speedtest, fast, wget.

https://phoenixnap.com/kb/linux-network-speed-test

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

CC list is empty

 

There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

Only logged-in users can vote.

 

No changes have been made to this item

Back to the top

Powered by Savane 3.13-5884.
Corresponding source code