This bug still affects Octave 5.0.1.

In a future version of Octave, I would rather see a non-internal function that can process tests in a directory. Essentially '__run_test_suite__' is a private function for Octave's own internal use, I would like to see 'runtests' or a new function that users can rely on for similar functionality.

So I would like to close this as won't fix, but maybe a discussion can be had first on what behavior is needed in a replacement.

Leaving as "regression", but in a function that is not meant to be used outside of Octave.

With the following directory structure:

testfolder (dir)
  a1.m
  test1 (dir)
    a2.m

a1.m and a2.m can be empty


Then running

 __run_test_suite__ ({"testfolder"},{})

Running in 4.2.2:

Integrated test scripts:

Fixed test scripts:


Summary:

  PASS         0
  FAIL         0

Running 5.0.0:

Integrated test scripts:

__run_test_suite__: fopen failed: testfolder/test1/a2.m

same thing accurs with package +folders.

Looking at the code for _run_test_suite_, it does a cd into the test folder and then tries to open the file using the full path name.