bugGNU Parallel - Bugs: bug #61780, --pipe ::: should do combinations...

 
 

bug #61780: --pipe ::: should do combinations and not xapply

Submitter:  Ole Tange <tange>
Submitted:  Sun 09 Jan 2022 12:08:33 PM UTC
   
 
Category:  None Severity:  1 - Wish
Item Group:  None Status:  None
Privacy:  Public Assigned to:  tange
Open/Closed:  Open
* Mandatory Fields

Add a New Comment Rich Markup
   

Sun 09 Jan 2022 02:27:46 PM UTC, comment #1: 

It would mean that --cat/--fifo must be changed into something like:

    seq 300000 | parallel --pipe --cat 'echo {} {1}-{2}; md5sum {cat}' ::: 1 2 ::: A B

--roundrobin will have to be much like --tee: all jobs must be started at the same time. Should -j be ignored then?

    seq 300000 | parallel --pipe --roundrobin --cat 'echo {} {1}-{2}; md5sum {cat}' ::: 1 2 ::: A B
    seq 300000 | parallel --pipe --tee --cat 'echo {} {1}-{2}; md5sum {cat}' ::: 1 2 ::: A B


Ole Tange <tange>
Group administrator
Sun 09 Jan 2022 12:08:33 PM UTC, original submission:  

This:

    seq 300000 | parallel --pipe 'echo {1}-{2}; md5sum' ::: 1 2 ::: A B

gives:

    1-A
    1490f57cc8cedc0f3c9c6b26d29ac58a  -
    1-B
    20fbf3f07d8e81789f78b3906d951f09  -

But I think it would be better if it gave:

    1-A
    1490f57cc8cedc0f3c9c6b26d29ac58a  -
    1-B
    1490f57cc8cedc0f3c9c6b26d29ac58a  -
    2-A
    1490f57cc8cedc0f3c9c6b26d29ac58a  -
    2-B
    1490f57cc8cedc0f3c9c6b26d29ac58a  -
    1-A
    20fbf3f07d8e81789f78b3906d951f09  -
    1-B
    20fbf3f07d8e81789f78b3906d951f09  -
    2-A
    20fbf3f07d8e81789f78b3906d951f09  -
    2-B
    20fbf3f07d8e81789f78b3906d951f09  -

So the input chunk is given to all combinations of the command.

The code for retrying --pipe chunks already exist in --retries.

Ole Tange <tange>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    No changes have been made to this item

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code