bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #41623, Idea: --line-buffer with no...

 
 

bug #41623: Idea: --line-buffer with no tmpfiles

Submitted by:  Ole Tange <tange>
Submitted on:  Mon 17 Feb 2014 01:04:23 PM UTC  
 
Category: NoneSeverity: 1 - Wish
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: Ole Tange <tange>
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Tue 22 Aug 2017 12:35:31 AM UTC, comment #2:

Fixed in [3eef90da3].

Ole Tange <tange>
Project AdministratorIn charge of this item.
Thu 10 Aug 2017 06:34:54 AM UTC, comment #1:

@fifonames = tmpfifo1..tmpfifo{%}
# Open so we have filehandles before they are removed
open >> tmpfifo1..tmpfifo{%}
push @fifohandles, tmpfifohandles
internal_parcat(@fifonames)

Internal_parcat:
fork
code from parcat on
--rm -1 tmpfifostdout1..tmpfifostdout{%} -2 tmpfifostderr1..tmpfifostderr{%}

openoutputfile:
pop @fifohandle

exit_job:
do not close filehandle

exit_parallel:
close @fifohandles

Ole Tange <tange>
Project AdministratorIn charge of this item.
Mon 17 Feb 2014 01:04:23 PM UTC, original submission:

while(select(pipes)) {
read pipe.
Print full lines
}

This could possibly include a buffer (mbuffer -t) with compression (lzop before, lzop -dc after).

parallel --pipe --line-buffer prg | lzop | mbuffer -t | lzop -dc |

Should this be default for --line-buffer?

Ole Tange <tange>
Project AdministratorIn charge of this item.

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue 22 Aug 2017 12:35:31 AM UTCtangeStatusNone=>Fixed
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1