bugGNU Parallel - Bugs: bug #38439, "open files" with...

 
 

bug #38439: "open files" with --files --pipe blocks after a while

Submitter:  Ole Tange <tange>
Submitted:  Thu 28 Feb 2013 11:49:39 AM UTC
   
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  tange
Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Mon 04 Mar 2013 08:52:47 PM UTC, comment #1: 

Fixed in [93dd376].

Ole Tange <tange>
Group administrator
Thu 28 Feb 2013 11:49:39 AM UTC, original submission:  

Hi there ...

I tried to use the --pipe and --files options and found
that parallel sometimes stops working. It seems as if
this is somehow related to ulimit's "open files". I
can reproduce it with the following commands:

$ ulimit -n 500; yes | parallel --files --pipe true | nl | tail -n3
   488  /tmp/7T9kEbESkM.par
   489  /tmp/7uqQGUS8r9.par
   490  /tmp/69W44vvzOv.par

$ ulimit -n 400; yes | parallel --files --pipe true | nl | tail -n3
   390  /tmp/5d_P8viQaW.par
   391  /tmp/_NNQspv5Yp.par
   392  /tmp/e54eVHuqNt.par

$ ulimit -n 300; yes | parallel --files --pipe true | nl | tail -n3
   289  /tmp/IUfa7Gzukd.par
   290  /tmp/lu9tP4M0nG.par
   291  /tmp/dA4yMsrkGV.par

The strange thing is, setting the limit to 200 makes
parallel run fine, but pause for a few seconds every
~185 files.

Ole Tange <tange>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Submitted the item)
  • -email is unavailable- added by tange
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 5 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2013-03-04 tange StatusConfirmed Fixed
        Open/ClosedOpen Closed
    2013-02-28 tange StatusNone Confirmed
        Assigned toNone tange
    2013-02-28 tange Carbon-Copy- Added -email is unavailable-

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code