bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #41409, -N + -S fails

 
 

bug #41409: -N + -S fails

Submitted by:  Ole Tange <tange>
Submitted on:  Thu 30 Jan 2014 11:23:33 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: Ole Tange <tange>
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Tue 04 Feb 2014 07:10:20 PM UTC, comment #1:

Fixed in [213e49c07354321eb5f03cbac54505c8faab3585].

Ole Tange <tange>
Project AdministratorIn charge of this item.
Thu 30 Jan 2014 11:23:33 PM UTC, original submission:

$ seq 1000000000000000 1000000001000000 > lots_o_number.txt

$ parallel -S lo -N 10000 echo {} <
lots_o_number.txt > lots_o.log

Fails because -N fills the 128KB leaving nothing for the ssh wrapping.

GNU Parallel generates the command without knowing which server to run it on. So the command should never be longer than the smallest command being able to run on any server.

So compute min(max_command_len(servers)) - max(sshwrap(servers)) and use this as the max command length.

Ole Tange <tange>
Project AdministratorIn charge of this item.

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue 04 Feb 2014 07:10:20 PM UTCtangeStatusConfirmed=>Fixed
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1