bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #41613, --compress --line-buffer

 
 

bug #41613: --compress --line-buffer

Submitted by:  Ole Tange <tange>
Submitted on:  Sun 16 Feb 2014 07:55:59 PM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Fixed
Privacy: PublicAssigned to: Ole Tange <tange>
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sun 02 Mar 2014 01:38:50 PM UTC, comment #3:

Missing \n fixed in: [faff0eb].

Ole Tange <tange>
Project AdministratorIn charge of this item.
Sun 02 Mar 2014 01:11:23 PM UTC, comment #2:

This shows that --line-buffer actually works. The jobids are mixed:

perl -e 'for("x011".."x110"){print "$_\t", (map { rand } (1..100000)),"\n"}'| src/parallel -N10 -L1 --pipe -j6 --block 20M --compress --line-buffer --tagstring {#} pv -qL 1000000 | perl -pe 's/(.......).*/$1/'

Without the jobids:

perl -e 'for("x011".."x110"){print "$_\t", (map { rand } (1..100000)),"\n"}'| src/parallel -N10 -L1 --pipe -j6 --block 20M --compress --line-buffer pv -qL 1000000 | perl -pe 's/(....).*/$1/'

Compare to without --line-buffer:

perl -e 'for("x011".."x110"){print "$_\t", (map { rand } (1..100000)),"\n"}'| src/parallel -N10 -L1 --pipe -j6 --block 20M --compress --tagstring {#} pv -qL 1000000 | perl -pe 's/(.......).*/$1/'

Without the jobids:

perl -e 'for("x011".."x110"){print "$_\t", (map { rand } (1..100000)),"\n"}'| src/parallel -N10 -L1 --pipe -j6 --block 20M --compress pv -qL 1000000 | perl -pe 's/(....).*/$1/'

Ole Tange <tange>
Project AdministratorIn charge of this item.
Sun 02 Mar 2014 12:55:12 PM UTC, comment #1:

Does not deal correctly with input without \n:

perl -e 'print "a"'| src/parallel --pipe --compress --line-buffer cat

Ole Tange <tange>
Project AdministratorIn charge of this item.
Sun 16 Feb 2014 07:55:59 PM UTC, original submission:

seq 1000| src/parallel -N10 -L1 --pipe -j2 --compress --line-buffer pv -qL 10

Ole Tange <tange>
Project AdministratorIn charge of this item.

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Sun 02 Mar 2014 01:38:50 PM UTCtangeStatusConfirmed=>Fixed
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1