bugGNU Octave - Bugs: bug #60552, BIST for lscov.m tolerance failure...

 
 

bug #60552: BIST for lscov.m tolerance failure with OpenBLAS (v0.3.13–v0.3.15)

Submitted by:  Mike Miller <mtmiller>
Submitted on:  Fri 07 May 2021 07:17:28 PM UTC  
 
Category:  Test Suite Severity:  3 - Normal
Priority:  5 - Normal Item Group:  Inaccurate Result
Status:  Fixed Assigned to:  None
Originator Name:  Open/Closed:  Closed
Release:  dev Operating System:  GNU/Linux

Add a New Comment (Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

( Jump to the original submission)

Sun 16 May 2021 10:14:04 PM UTC, comment #6: 

Done.  Grafted to stable.

--Rik

Rik <rik5>
Project Administrator
Sun 16 May 2021 06:58:46 PM UTC, comment #5: 

Could we do it on stable as well ?

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Sat 08 May 2021 06:54:43 PM UTC, comment #4: 
Mike Miller <mtmiller>
Project Administrator
Fri 07 May 2021 08:07:13 PM UTC, comment #3: 

Result is exceeding current threshold by 8e-17/eps = 0.27.  Seems fine to relax the tolerance by one whole eps.

Rik <rik5>
Project Administrator
Fri 07 May 2021 07:56:08 PM UTC, comment #2: 

I meant to say fedora's buildbots still using 3.12.
Also -- I think all buildbots are on non-AVX2 hardware,
I have noticed that if I enable high optimization on modern CPUs
(-O3 -mavx2) a number of other numerical tests fails due to precision.

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 07 May 2021 07:29:34 PM UTC, comment #1: 

I can confirm that (on Fedora and Centos 8) (using pre-released openblas rpms). Buildbots are still on 0.3.12.

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 07 May 2021 07:17:28 PM UTC, original submission:  

In Octave version 6.2.0 or version 7.0.0 development branch, with OpenBLAS 0.3.13 (on Debian native system):

>> test lscov.m
***** test
## Adapted from example in Matlab documentation
x1 = [.2 .5 .6 .8 1.0 1.1]';
x2 = [.1 .3 .4 .9 1.1 1.4]';
X = [ones(size(x1)) x1 x2];
y = [.17 .26 .28 .23 .27 .34]';
[b, se_b, mse, S] = lscov(X, y);
assert (b, [0.1203 0.3284 -0.1312]', 1E-4);
assert (se_b, [0.0643 0.2267 0.1488]', 1E-4);
assert (mse, 0.0015, 1E-4);
assert (S, [0.0041 -0.0130 0.0075; -0.0130 0.0514 -0.0328; 0.0075 -0.0328 0.0221], 1E-4);
w = [1 1 1 1 1 .1]';
[bw, sew_b, msew] = lscov (X, y, w);
assert (bw, [0.1046 0.4614 -0.2621]', 1E-4);
assert (sew_b, [0.0309 0.1152 0.0814]', 1E-4);
assert (msew, 3.4741e-004, -1E-4);
V = .2*ones (length (x1)) + .8*diag (ones (size (x1)));
[bg, sew_b, mseg] = lscov (X, y, V);
assert (bg, [0.1203 0.3284 -0.1312]', 1E-4);
assert (sew_b, [0.0672 0.2267 0.1488]', 1E-4);
assert (mseg, 0.0019, 1E-4);
y2 = [y 2*y];
[b2, se_b2, mse2, S2] = lscov (X, y2);
assert (b2, [b 2*b], 2*eps);
assert (se_b2, [se_b 2*se_b], 2*eps);
assert (mse2, [mse 4*mse], eps);
assert (S2(:, :, 1), S, eps);
assert (S2(:, :, 2), 4*S, eps);
!!!!! test failed
ASSERT errors for:  assert (S2 (:, :, 2),4 * S,eps)

  Location  |  Observed  |  Expected  |  Reason
   (2,2)       0.20555      0.20555      Abs err 2.7756e-16 exceeds tol 2.2204e-16 by 6e-17

In Octave version 6.2.0 or version 7.0.0 development branch, with OpenBLAS 0.3.15, running in Flatpak container, same test, slightly different result:

!!!!! test failed
ASSERT errors for:  assert (S2 (:, :, 2),4 * S,eps)

  Location  |  Observed  |  Expected  |  Reason
   (2,2)       0.20555      0.20555      Abs err 3.0531e-16 exceeds tol 2.2204e-16 by 8e-17

Mike Miller <mtmiller>
Project Administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rik5 (Posted a comment)
  • -email is unavailable- added by dasergatskov (Posted a comment)
  •  

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only project members can vote.

     

     

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2021-05-08 mtmiller StatusConfirmed => Fixed
        Open/ClosedOpen => Closed
    2021-05-07 mtmiller Carbon-CopyRemoved 80942 => -
    2021-05-07 rik5 StatusNone => Confirmed

    Back to the top


    Powered by Savane 3.7