bugGNU Octave - Bugs: bug #43231, parallel package: error in...

 
 

bug #43231: parallel package: error in parcellfun - empty file-id

Submitter:  Moritz <moritzk>
Submitted:  Tue 16 Sep 2014 07:46:53 AM UTC
   
 
Category:  Octave Package Severity:  3 - Normal
Priority:  5 - Normal Item Group:  Segfault, Bus Error, etc.
Status:  Fixed Assigned to:  None
Originator Name:  moritzk Open/Closed:  * Closed
Release:  * other Operating System:  * GNU/Linux
Fixed Release:  None Planned Release:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Tue 16 Sep 2014 01:41:22 PM UTC, comment #2: 

Anyway, I assumed your 'handler' gives an error. (And your error handler also gives an error, using deal() with more inputs than outputs.) I found some issues in parcellfun in handling this and another thing. Pushed the fixes to the repository and regard this issue to be fixed, as long as not reported otherwise. Changesets:

41d4abdd1ac9
7d9b59f0813b

Olaf

Olaf Till <i7tiol>
Group Member
Tue 16 Sep 2014 09:44:43 AM UTC, comment #1: 

I'd like to see if your 'handler' throws an error, so please:

1. Repeat the call to 'pararrayfun' without setting an "ErrorHandler" and post the whole output of messages between the Octave prompts.

2. Try the respective call to 'arrayfun' instead of 'pararrayfun' (just leaving out the first argument), again without setting an "ErrorHandler", and post any messages.

Olaf

Olaf Till <i7tiol>
Group Member
Tue 16 Sep 2014 07:46:53 AM UTC, original submission:  

Hello,

I am using the octave package parallel and have had increasingly
problems. Quite a lot of my last test runs aborted with the following error:

parcellfun: 9/13 jobs doneerror: invalid conversion from real matrix to real scalar
error: file id must be a file object, std::string, or integer value
warning: broken pipe
warning: broken pipe
warning: broken pipe
warning: broken pipe
error: called from:
error: /home/hpc/t1313/di34koy/octave/parallel-2.2.0/parcellfun.m at line 334, column 11

The error is not replicable (running the same program again won't
necessarily produce the error at the same iteration) and has appeared in different pipes.

I use octave 3.8.1 and parallel 2.2.0. The problem might be, that I am running several octave processes each of which generates subprocesses using parallel. As a concrete example I am starting 3 octave processes, each of which forks into 13 subprocesses on a 32 core engine. Ok stupid of me, that's not very efficient somehow I had in mind that I have more cores available. Anyway it should not lead to a crash.

The function pararrayfun is called like this:

p.ArmijoBeta = 0.5;
p.nArmijoProc = 13;
...
     parTs = deltaT * p.ArmijoBeta.^(0 : p.nArmijoProc - 1);
     errorHandler = @(s, curT) deal (NA, s);
     handler = @(curT) getCostForStep (curT, input);

     [output] = pararrayfun (p.nArmijoProc, handler, parTs, ...
                                   "UniformOutput", false, ...
                                   "ErrorHandler", errorHandler);


Thanks in advance for any help!

Moritz <moritzk>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by i7tiol (Posted a comment)
  • -email is unavailable- added by moritzk (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only group members can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2014-10-05 carandraug StatusNone Fixed
        Open/ClosedOpen Closed
        Release3.8.1 other
        Summaryerror in parcellfun: empty file-id parallel package: error in parcellfun - empty file-id

    Back to the top

    Powered by Savane 3.13-3230.
    Corresponding source code