bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #45769, --round-robin --pipepart gives...

 
 

bug #45769: --round-robin --pipepart gives wrong results

Submitted by:  Ole Tange <tange>
Submitted on:  Sun 16 Aug 2015 10:15:15 AM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: None
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Thu 27 Aug 2015 08:36:53 PM UTC, comment #1:

Fixed in [18ab03c].

Ole Tange <tange>
Project Administrator
Sun 16 Aug 2015 10:15:15 AM UTC, original submission:

seq 10000 >/tmp/10000

OK:

parallel -j2 --pipe < /tmp/10000 --block 14 --round-robin wc |wc

This should give 2:

parallel -j2 --pipepart -a /tmp/10000 --block 14 --round-robin wc |wc

Simple solution:

Ignore --block and chop -a into one part per jobs (e.g. 2). Or set --block to size of -a / #of jobs.

Complex solution:

Have a queue that 'partial-dd' can request a new block from.

Ole Tange <tange>
Project Administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Thu 27 Aug 2015 08:36:53 PM UTCtangeStatusConfirmed=>Fixed
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1