bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #34074, Distribute --pipe in round robin...

 
 

bug #34074: Distribute --pipe in round robin fashion

Submitted by:  Ole Tange <tange>
Submitted on:  Fri 19 Aug 2011 01:25:45 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: Ole Tange <tange>
Open/Closed: Closed

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sat 28 Sep 2013 07:27:31 PM UTC, comment #4:

--round-robin implemented.

Ole Tange <tange>
Project AdministratorIn charge of this item.
Fri 07 Dec 2012 12:21:22 AM UTC, comment #3:

awk '{ print NR > "i/tmpfile."NR%3000 }'

Ole Tange <tange>
Project AdministratorIn charge of this item.
Wed 05 Dec 2012 10:26:55 PM UTC, comment #2:

cat stdin | split -n r/$NPROC --filter 'grep -a ole > '$TMP'.$FILE;echo '$TMP'.$FILE' | parallel cat

seq 1000 | split -n r/8 --filter 'grep -a . > $FILE;echo $FILE' | parallel cat

It does not work for records not one line long.

Ole Tange <tange>
Project AdministratorIn charge of this item.
Wed 05 Dec 2012 09:31:26 PM UTC, comment #1:

Use

split -n r/8 --filter='grep -a ole'

somehow.

Ole Tange <tange>
Project AdministratorIn charge of this item.
Fri 19 Aug 2011 01:25:45 PM UTC, original submission:

So when one pipe is empty fill in more records.

Useful for parallelizing pipe-sort.

Ole Tange <tange>
Project AdministratorIn charge of this item.

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 3 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Sat 28 Sep 2013 07:27:31 PM UTCtangeStatusNone=>Fixed
      Assigned toNone=>tange
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup