On Thu, May 21, 2020 at 11:56 AM Aleksandra Fedorova <alpha@bookwar.info> wrote:
On Thu, May 21, 2020 at 6:30 PM Richard Shaw <hobbes1069@gmail.com> wrote:
>
> On Thu, May 21, 2020 at 10:37 AM Przemo Firszt <przemo@firszt.eu> wrote:
>>
>> "FreeCAD -t 0" performs approx 470 tests. No GUI required. Example
>> output starts here:
>> https://travis-ci.org/github/FreeCAD/FreeCAD/jobs/689681966#L9103
>
>
> May need some work to get working from inside mock:
>
> # ./FreeCAD -t 0
> FreeCAD 0.18, Libs: 0.18RUnknown
> © Juergen Riegel, Werner Mayer, Yorik van Havre 2001-2019
>   #####                 ####  ###   ####
>   #                    #      # #   #   #
>   #     ##  #### ####  #     #   #  #   #
>   ####  # # #  # #  #  #     #####  #   #
>   #     #   #### ####  #    #     # #   #
>   #     #   #    #     #    #     # #   #  ##  ##  ##
>   #     #   #### ####   ### #     # ####   ##  ##  ##
>
> Aborted (core dumped)

Please don't run it inside mock.

RPM %check tests are good for unit testing, but they should тще be
used for extensive integration test suites.
The build environment is very different from the target user system.
It has build requirements installed it may have side effects on the
test you run.
Also you would be testing the binary in you working directory, where
you have just executed `make` command.

To run tests in the environment which resembles the actual user
environment we have the STR framework and gating infrastructure [1].

To run the command above as the integration test you need to put
tests/tests.yml file in dist-git repo with the following content:

- hosts: localhost
  roles:
  - role: standard-test-basic
    tags:
    - classic
    tests:
    - simple:
        dir: .
        run: "FreeCAD -t 0"

Note how here you will be using the install FreeCAD binary, not the local one.

Is this only run on "real" builds, or is it possible to run locally or for scratch builds?

Thanks,
Richard