bugGNU Parallel - Bugs: bug #41623, Idea: --line-buffer with no...

 
 

bug #41623: Idea: --line-buffer with no tmpfiles

Submitter:  Ole Tange <tange>
Submitted:  Mon 17 Feb 2014 01:04:23 PM UTC
   
 
Category:  None Severity:  1 - Wish
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  tange
Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Tue 22 Aug 2017 12:35:31 AM UTC, comment #2: 

Fixed in [3eef90da3].


Ole Tange <tange>
Group administrator
Thu 10 Aug 2017 06:34:54 AM UTC, comment #1: 

@fifonames = tmpfifo1..tmpfifo{%}
# Open so we have filehandles before they are removed
open >> tmpfifo1..tmpfifo{%}
push @fifohandles, tmpfifohandles
internal_parcat(@fifonames)

Internal_parcat:
  fork
  code from parcat on
  --rm -1 tmpfifostdout1..tmpfifostdout{%} -2 tmpfifostderr1..tmpfifostderr{%}

openoutputfile:
  pop @fifohandle

exit_job:
  do not close filehandle

exit_parallel:
  close @fifohandles

Ole Tange <tange>
Group administrator
Mon 17 Feb 2014 01:04:23 PM UTC, original submission:  

while(select(pipes)) {
  read pipe.
  Print full lines
}

This could possibly include a buffer (mbuffer -t) with compression (lzop before, lzop -dc after).

parallel --pipe --line-buffer prg | lzop | mbuffer -t | lzop -dc |

Should this be default for --line-buffer?

Ole Tange <tange>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 2 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2017-08-22 tange StatusNone Fixed
        Open/ClosedOpen Closed

    Back to the top

    Powered by Savane 3.13-4448.
    Corresponding source code