bugGNU Octave - Bugs: bug #49040, lscov test failure

 
 

bug #49040: lscov test failure

Submitted by:  Orion Poplawski <opoplawski>
Submitted on:  Fri 09 Sep 2016 06:18:59 PM UTC  
 
Category: Test SuiteSeverity: 3 - Normal
Priority: 5 - NormalItem Group: Inaccurate Result
Status: Wont FixAssigned to: None
Originator Name: Open/Closed: Closed
Release: 4.2.0-rc1Operating System: GNU/Linux

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

(Jump to the original submission Jump to the original submission)

Sat 12 Nov 2016 01:16:29 PM UTC, comment #6:

I think I've just had some remainders of old mxe-builts in my dist directory with MXE-Octave-4.2.0-rc3 (see comment #5). When building a (definitly clean) MXE-Octave-4.2.0-rc4, then all tests pass on WinXP. There is no failure on lscov.m now.

Hartmut <hardy>
Fri 04 Nov 2016 04:50:12 PM UTC, comment #5:

I have just compiled

  • octave-4.2.0-rc3
  • via an up-to-date mxe-octave
  • and compilation done on an Ubuntu 14.04. system.

Letting this Octave run the test suite on WindowsXP gives me a failure of "test lscov.m" to my very surprise.

Running the official Windows installer of Octave 4.2.0-rc3 on the very same WinXP machine passes this test. (But this official Windows installer was obviously compiled on a different computer.)

Here is the relevant part of the fntest.log :

Hartmut <hardy>
Mon 12 Sep 2016 04:36:01 AM UTC, comment #4:

So it looks like this test failure is due to using ATLAS vs OpenBLAS. Assuming there is nothing that Octave can do about this, it's a tolerance problem from within ATLAS.

I've added this bug number to the test case so when it fails it will be reported as a known bug and refer to this bug number.

Closing as won't fix.

Mike Miller <mtmiller>
Project Administrator
Fri 09 Sep 2016 08:38:02 PM UTC, comment #3:

Yes. I can reproduce it with atlas.
Should Fedora switch to openblas?

Dmitri.

Dmitri A. Sergatskov <dasergatskov>
Fri 09 Sep 2016 08:34:40 PM UTC, comment #2:

It's likely due to the default Fedora compile flags (-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -m64 -mtune=generic). Or perhaps my use of --enable-float-truncate (which I can't recall exactly why it was added). Or perhaps the use of atlas.

Orion Poplawski <opoplawski>
Fri 09 Sep 2016 08:24:03 PM UTC, comment #1:

Orion,

I built dev/-rc1 on few different computers (Xeon/AMD/i7) and
never saw this problem (running Fedora 24/25).

Dmitri.
--

Dmitri A. Sergatskov <dasergatskov>
Fri 09 Sep 2016 06:18:59 PM UTC, original submission:

>>>>> processing /builddir/build/BUILD/octave-4.2.0-rc1/scripts/statistics/base/lscov.m

          • test

## Longley data from the NIST Statistical Reference Dataset
Z = [ 60323 83.0 234289 2356 1590 107608 1947
61122 88.5 259426 2325 1456 108632 1948
60171 88.2 258054 3682 1616 109773 1949
61187 89.5 284599 3351 1650 110929 1950
63221 96.2 328975 2099 3099 112075 1951
63639 98.1 346999 1932 3594 113270 1952
64989 99.0 365385 1870 3547 115094 1953
63761 100.0 363112 3578 3350 116219 1954
66019 101.2 397469 2904 3048 117388 1955
67857 104.6 419180 2822 2857 118734 1956
68169 108.4 442769 2936 2798 120445 1957
66513 110.8 444546 4681 2637 121950 1958
68655 112.6 482704 3813 2552 123366 1959
69564 114.2 502601 3931 2514 125368 1960
69331 115.7 518173 4806 2572 127852 1961
70551 116.9 554894 4007 2827 130081 1962 ];
## Results certified by NIST using 500 digit arithmetic
## b and standard error in b
V = [ -3482258.63459582 890420.383607373
15.0618722713733 84.9149257747669
-0.358191792925910E-01 0.334910077722432E-01
-2.02022980381683 0.488399681651699
-1.03322686717359 0.214274163161675
-0.511041056535807E-01 0.226073200069370
1829.15146461355 455.478499142212 ];
rsd = 304.854073561965;
y = Z(:,1); X = [ones(rows(Z),1), Z(:,2:end)];
alpha = 0.05;
[b, stdb, mse] = lscov (X, y);
assert(b, V(:,1), 3e-6);
assert(stdb, V(:,2), -1.e-5);
assert(sqrt (mse), rsd, -1E-6);
!!!!! test failed
ASSERT errors for: assert (b,V (:, 1),3e-6)

Location | Observed | Expected | Reason
(1) -3482258.6346 -3482258.6346 Abs err 3.3514e-06 exceeds tol 3e-06

This has been present in Fedora rpm builds for a long time.

Orion Poplawski <opoplawski>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by hardy (Posted a comment)
  • -unavailable- added by mtmiller (Posted a comment)
  • -unavailable- added by dasergatskov (Posted a comment)
  • -unavailable- added by opoplawski (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only project members can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Mon 12 Sep 2016 04:36:01 AM UTCmtmillerStatusNone=>Wont Fix
      Open/ClosedOpen=>Closed

    Back to the top


    Powered by Savane 3.1-cleanup1