bugGNU Octave - Bugs: bug #43231, parallel package: error in...

 
 

bug #43231: parallel package: error in parcellfun - empty file-id

Submitted by:  Moritz <moritzk>
Submitted on:  Tue 16 Sep 2014 07:46:53 AM UTC  
 
Category:  Octave Forge Package Severity:  3 - Normal
Priority:  5 - Normal Item Group:  Segfault, Bus Error, etc.
Status:  Fixed Assigned to:  None
Originator Name:  moritzk Open/Closed:  Closed
Release:  other Operating System:  GNU/Linux

Add a New Comment (Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Tue 16 Sep 2014 01:41:22 PM UTC, comment #2: 

Anyway, I assumed your 'handler' gives an error. (And your error handler also gives an error, using deal() with more inputs than outputs.) I found some issues in parcellfun in handling this and another thing. Pushed the fixes to the repository and regard this issue to be fixed, as long as not reported otherwise. Changesets:

41d4abdd1ac9
7d9b59f0813b

Olaf

Olaf Till <i7tiol>
Project Member
Tue 16 Sep 2014 09:44:43 AM UTC, comment #1: 

I'd like to see if your 'handler' throws an error, so please:

1. Repeat the call to 'pararrayfun' without setting an "ErrorHandler" and post the whole output of messages between the Octave prompts.

2. Try the respective call to 'arrayfun' instead of 'pararrayfun' (just leaving out the first argument), again without setting an "ErrorHandler", and post any messages.

Olaf

Olaf Till <i7tiol>
Project Member
Tue 16 Sep 2014 07:46:53 AM UTC, original submission:  

Hello,

I am using the octave package parallel and have had increasingly
problems. Quite a lot of my last test runs aborted with the following error:

parcellfun: 9/13 jobs doneerror: invalid conversion from real matrix to real scalar
error: file id must be a file object, std::string, or integer value
warning: broken pipe
warning: broken pipe
warning: broken pipe
warning: broken pipe
error: called from:
error: /home/hpc/t1313/di34koy/octave/parallel-2.2.0/parcellfun.m at line 334, column 11

The error is not replicable (running the same program again won't
necessarily produce the error at the same iteration) and has appeared in different pipes.

I use octave 3.8.1 and parallel 2.2.0. The problem might be, that I am running several octave processes each of which generates subprocesses using parallel. As a concrete example I am starting 3 octave processes, each of which forks into 13 subprocesses on a 32 core engine. Ok stupid of me, that's not very efficient somehow I had in mind that I have more cores available. Anyway it should not lead to a crash.

The function pararrayfun is called like this:

p.ArmijoBeta = 0.5;
p.nArmijoProc = 13;
...
     parTs = deltaT * p.ArmijoBeta.^(0 : p.nArmijoProc - 1);
     errorHandler = @(s, curT) deal (NA, s);
     handler = @(curT) getCostForStep (curT, input);

     [output] = pararrayfun (p.nArmijoProc, handler, parTs, ...
                                   "UniformOutput", false, ...
                                   "ErrorHandler", errorHandler);

Thanks in advance for any help!

Moritz <moritzk>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by i7tiol (Posted a comment)
  • -email is unavailable- added by moritzk (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only project members can vote.

     

     

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2014-10-05 carandraug StatusNone => Fixed
        Open/ClosedOpen => Closed
        Release3.8.1 => other
        Summaryerror in parcellfun: empty file-id => parallel package: error in parcellfun - empty file-id

    Back to the top


    Powered by Savane 3.5