bugGNU Parallel - build and execute command lines from standard input in parallel - Bugs: bug #34983, -m flag not handling limits...

 
 

bug #34983: -m flag not handling limits correctly

Submitted by:  None
Submitted on:  Sun 04 Dec 2011 07:49:45 AM UTC  
 
Category: NoneSeverity: 3 - Normal
Item Group: NoneStatus: Works For Me
Privacy: PublicAssigned to: None
Open/Closed: Closed

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Fri 16 Dec 2011 01:21:51 PM UTC, comment #2:

I cannot reproduce your error.

Your bug report should always include:

The output of parallel --version. If you are not running the latest released version you should specify why you believe the problem is not fixed in that version.

A complete example that others can run that shows the problem. A combination of seq, cat, echo, and sleep can reproduce most errors. If you example requires large files, see if you can use make them by something like seq 1000000>file.

If you suspect the error is dependent on your distribution, please see if you can reproduce the error on one of these distibutions: http://sourceforge.net/projects/virtualboximage/files/

Ole Tange <tange>
Project Administrator
Thu 15 Dec 2011 10:45:22 PM UTC, comment #1:

I have the same bug in the same circumstances, but you can work around it (for anyone who finds this via Google) by manually specifying the maximum number of files to put on the command line, using -L. (xargs' default corresponds to -L 5000, and this worked just fine in my instance.)

Anonymous
Sun 04 Dec 2011 07:49:45 AM UTC, original submission:

If the text size output of command is too large, this happens:

$ seq 50000 | parallel -X 'echo {}' > /dev/null

{cropped}
44975 44976 44977 failed at /usr/local/bin/parallel line 3440

System details:

Mac OS X Snow Leopard
Perl 5.10.0

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by tange (Posted a comment)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Fri 16 Dec 2011 01:21:51 PM UTCtangeStatusNone=>Works For Me
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1