bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #45479, --pipe/--pipepart --tee

 
 

bug #45479: --pipe/--pipepart --tee

Submitted by:  Ole Tange <tange>
Submitted on:  Mon 06 Jul 2015 06:17:58 AM UTC  
 
Category: NoneSeverity: 1 - Wish
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: Ole Tange <tange>
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sun 05 Feb 2017 01:48:14 AM UTC, comment #4:

Implemented for --pipe, not --pipepart.

Fixed in [c028fa0].

Ole Tange <tange>
Project AdministratorIn charge of this item.
Sat 04 Feb 2017 10:04:27 AM UTC, comment #3:

Must support --tag, so spawning tee is not enough.

Instead use --round-robin code but send to all running jobs.

Problem: What if number of jobs < args?

Cache on disk?

Ole Tange <tange>
Project AdministratorIn charge of this item.
Thu 02 Jun 2016 09:54:46 PM UTC, comment #2:

seq 11000000 | parallel --pipe --onall 'wc > {}' ::: {1..10}

could be interpreted as:

seq 11000000 | parallel --pipe -j1 --round-robin --tty tee ">/dev/null" $(parallel --dry-run '>(wc > {})' ::: {1..10} )

Ole Tange <tange>
Project AdministratorIn charge of this item.
Thu 02 Jun 2016 06:35:01 AM UTC, comment #1:

seq 11000000 | parallel --pipe -j1 --round-robin --tty pee $(seq 10 | parallel --dry-run 'wc\ \>\ {}' )

Ole Tange <tange>
Project AdministratorIn charge of this item.
Mon 06 Jul 2015 06:17:58 AM UTC, original submission:

GNU Parallel cannot pipe the stdin to several commands.

The command that needs to be executed is:

cat | tee >(cmd A > tmp 2> tmperr) >(cmd B > tmp 2> tmperr) >/dev/null

Maybe that should be run with --pipe --onall?

Ole Tange <tange>
Project AdministratorIn charge of this item.

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 3 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Sun 05 Feb 2017 01:48:14 AM UTCtangeStatusNone=>Fixed
      Open/ClosedOpen=>Closed
    Sat 04 Feb 2017 10:04:27 AM UTCtangeSummary--pipe --onall/--nonall frontend for tee >(... > tmp)=>--pipe/--pipepart --tee

    Back to the top


    Powered by Savane 3.1-cleanup1