bugGNU Octave - Bugs: bug #60552, BIST for lscov.m tolerance failure...

 
 

bug #60552: BIST for lscov.m tolerance failure with OpenBLAS (v0.3.13–v0.3.15)

Submitter:  Mike Miller <mtmiller>
Submitted:  Fri 07 May 2021 07:17:28 PM UTC
   
 
Category:  Test Suite Severity:  3 - Normal
Priority:  5 - Normal Item Group:  Inaccurate Result
Status:  Fixed Assigned to:  None
Originator Name:  Open/Closed:  * Closed
Release:  * dev Operating System:  * GNU/Linux
Fixed Release:  None Planned Release:  None
* Mandatory Fields

Add a New Comment Rich Markup
   

Jump to the original submission

Sun 16 May 2021 10:14:04 PM UTC, comment #6: 

Done.  Grafted to stable.

--Rik

Rik <rik5>
Group administrator
Sun 16 May 2021 06:58:46 PM UTC, comment #5: 

Could we do it on stable as well ?

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Sat 08 May 2021 06:54:43 PM UTC, comment #4: 
Mike Miller <mtmiller>
Group Member
Fri 07 May 2021 08:07:13 PM UTC, comment #3: 

Result is exceeding current threshold by 8e-17/eps = 0.27.  Seems fine to relax the tolerance by one whole eps.

Rik <rik5>
Group administrator
Fri 07 May 2021 07:56:08 PM UTC, comment #2: 

I meant to say fedora's buildbots still using 3.12.
Also -- I think all buildbots are on non-AVX2 hardware,
I have noticed that if I enable high optimization on modern CPUs
(-O3 -mavx2) a number of other numerical tests fails due to precision.

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 07 May 2021 07:29:34 PM UTC, comment #1: 

I can confirm that (on Fedora and Centos 8) (using pre-released openblas rpms). Buildbots are still on 0.3.12.

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 07 May 2021 07:17:28 PM UTC, original submission:  

In Octave version 6.2.0 or version 7.0.0 development branch, with OpenBLAS 0.3.13 (on Debian native system):


>> test lscov.m
***** test
 ## Adapted from example in Matlab documentation
 x1 = [.2 .5 .6 .8 1.0 1.1]';
 x2 = [.1 .3 .4 .9 1.1 1.4]';
 X = [ones(size(x1)) x1 x2];
 y = [.17 .26 .28 .23 .27 .34]';
 [b, se_b, mse, S] = lscov(X, y);
 assert (b, [0.1203 0.3284 -0.1312]', 1E-4);
 assert (se_b, [0.0643 0.2267 0.1488]', 1E-4);
 assert (mse, 0.0015, 1E-4);
 assert (S, [0.0041 -0.0130 0.0075; -0.0130 0.0514 -0.0328; 0.0075 -0.0328 0.0221], 1E-4);
 w = [1 1 1 1 1 .1]';
 [bw, sew_b, msew] = lscov (X, y, w);
 assert (bw, [0.1046 0.4614 -0.2621]', 1E-4);
 assert (sew_b, [0.0309 0.1152 0.0814]', 1E-4);
 assert (msew, 3.4741e-004, -1E-4);
 V = .2*ones (length (x1)) + .8*diag (ones (size (x1)));
 [bg, sew_b, mseg] = lscov (X, y, V);
 assert (bg, [0.1203 0.3284 -0.1312]', 1E-4);
 assert (sew_b, [0.0672 0.2267 0.1488]', 1E-4);
 assert (mseg, 0.0019, 1E-4);
 y2 = [y 2*y];
 [b2, se_b2, mse2, S2] = lscov (X, y2);
 assert (b2, [b 2*b], 2*eps);
 assert (se_b2, [se_b 2*se_b], 2*eps);
 assert (mse2, [mse 4*mse], eps);
 assert (S2(:, :, 1), S, eps);
 assert (S2(:, :, 2), 4*S, eps);
!!!!! test failed
ASSERT errors for:  assert (S2 (:, :, 2),4 * S,eps)

  Location  |  Observed  |  Expected  |  Reason
   (2,2)       0.20555      0.20555      Abs err 2.7756e-16 exceeds tol 2.2204e-16 by 6e-17


In Octave version 6.2.0 or version 7.0.0 development branch, with OpenBLAS 0.3.15, running in Flatpak container, same test, slightly different result:


!!!!! test failed
ASSERT errors for:  assert (S2 (:, :, 2),4 * S,eps)

  Location  |  Observed  |  Expected  |  Reason
   (2,2)       0.20555      0.20555      Abs err 3.0531e-16 exceeds tol 2.2204e-16 by 8e-17


Mike Miller <mtmiller>
Group Member

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rik5 (Posted a comment)
  • -email is unavailable- added by dasergatskov (Posted a comment)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only group members can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2021-05-08 mtmiller StatusConfirmed Fixed
        Open/ClosedOpen Closed
    2021-05-07 mtmiller Carbon-CopyRemoved 80942 -
    2021-05-07 rik5 StatusNone Confirmed

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code