bugGNU Octave - Bugs: bug #60552, BIST for lscov.m tolerance failure...

 
 

bug #60552: BIST for lscov.m tolerance failure with OpenBLAS (v0.3.13–v0.3.15)

Submitter:  Mike Miller <mtmiller>
Submitted:  Fri 07 May 2021 07:17:28 PM UTC
   
 
Category:  Test Suite Severity:  3 - Normal
Priority:  5 - Normal Item Group:  Inaccurate Result
Status:  Fixed Assigned to:  None
Originator Name:  Open/Closed:  * Closed
Release:  * dev Operating System:  * GNU/Linux
Fixed Release:  None Planned Release:  None
* Mandatory Fields

Post a Comment

Add a New Comment Rich Markup
   

Discussion

Jump to the original submission

Sun 16 May 2021 10:14:04 PM UTC, comment #6: 

Done.  Grafted to stable.

--Rik

Rik <rik5>
Group administrator
Sun 16 May 2021 06:58:46 PM UTC, comment #5: 

Could we do it on stable as well ?

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Sat 08 May 2021 06:54:43 PM UTC, comment #4: 

Fixed on the default branch

https://hg.savann ... /rev/c0a028c5d7ac

Mike Miller <mtmiller>
Group Member
Fri 07 May 2021 08:07:13 PM UTC, comment #3: 

Result is exceeding current threshold by 8e-17/eps = 0.27.  Seems fine to relax the tolerance by one whole eps.

Rik <rik5>
Group administrator
Fri 07 May 2021 07:56:08 PM UTC, comment #2: 

I meant to say fedora's buildbots still using 3.12.
Also -- I think all buildbots are on non-AVX2 hardware,
I have noticed that if I enable high optimization on modern CPUs
(-O3 -mavx2) a number of other numerical tests fails due to precision.

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 07 May 2021 07:29:34 PM UTC, comment #1: 

I can confirm that (on Fedora and Centos 8) (using pre-released openblas rpms). Buildbots are still on 0.3.12.

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 07 May 2021 07:17:28 PM UTC, original submission:  

In Octave version 6.2.0 or version 7.0.0 development branch, with OpenBLAS 0.3.13 (on Debian native system):


>> test lscov.m
***** test
 ## Adapted from example in Matlab documentation
 x1 = [.2 .5 .6 .8 1.0 1.1]';
 x2 = [.1 .3 .4 .9 1.1 1.4]';
 X = [ones(size(x1)) x1 x2];
 y = [.17 .26 .28 .23 .27 .34]';
 [b, se_b, mse, S] = lscov(X, y);
 assert (b, [0.1203 0.3284 -0.1312]', 1E-4);
 assert (se_b, [0.0643 0.2267 0.1488]', 1E-4);
 assert (mse, 0.0015, 1E-4);
 assert (S, [0.0041 -0.0130 0.0075; -0.0130 0.0514 -0.0328; 0.0075 -0.0328 0.0221], 1E-4);
 w = [1 1 1 1 1 .1]';
 [bw, sew_b, msew] = lscov (X, y, w);
 assert (bw, [0.1046 0.4614 -0.2621]', 1E-4);
 assert (sew_b, [0.0309 0.1152 0.0814]', 1E-4);
 assert (msew, 3.4741e-004, -1E-4);
 V = .2*ones (length (x1)) + .8*diag (ones (size (x1)));
 [bg, sew_b, mseg] = lscov (X, y, V);
 assert (bg, [0.1203 0.3284 -0.1312]', 1E-4);
 assert (sew_b, [0.0672 0.2267 0.1488]', 1E-4);
 assert (mseg, 0.0019, 1E-4);
 y2 = [y 2*y];
 [b2, se_b2, mse2, S2] = lscov (X, y2);
 assert (b2, [b 2*b], 2*eps);
 assert (se_b2, [se_b 2*se_b], 2*eps);
 assert (mse2, [mse 4*mse], eps);
 assert (S2(:, :, 1), S, eps);
 assert (S2(:, :, 2), 4*S, eps);
!!!!! test failed
ASSERT errors for:  assert (S2 (:, :, 2),4 * S,eps)

  Location  |  Observed  |  Expected  |  Reason
   (2,2)       0.20555      0.20555      Abs err 2.7756e-16 exceeds tol 2.2204e-16 by 6e-17


In Octave version 6.2.0 or version 7.0.0 development branch, with OpenBLAS 0.3.15, running in Flatpak container, same test, slightly different result:


!!!!! test failed
ASSERT errors for:  assert (S2 (:, :, 2),4 * S,eps)

  Location  |  Observed  |  Expected  |  Reason
   (2,2)       0.20555      0.20555      Abs err 3.0531e-16 exceeds tol 2.2204e-16 by 8e-17


Mike Miller <mtmiller>
Group Member

 

Attached Files

This item currently has no attached files.

(Note: upload size limit is set to 4.0MiB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

 

Dependencies

This item does not depend on any other items.

No items depend on this one.

 

Mail Notification Carbon-Copy List

Carbon-Copy List
  • -email is unavailable- added by rik5 (Posted a comment)
  • -email is unavailable- added by dasergatskov (Posted a comment)
  •  

    Votes

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only group members can vote.

     

    History

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2021-05-08 mtmiller StatusConfirmed Fixed
        Open/ClosedOpen Closed
    2021-05-07 mtmiller Carbon-CopyRemoved 80942 -
    2021-05-07 rik5 StatusNone Confirmed

    Back to the top

    Powered by Savane 3.16-ed84.
    Corresponding source code