Test Runner

FoBiS includes a lightweight test runner that discovers, compiles, and runs Fortran test programs — no external test harness required.

Quick start

# Discover, build, and run all tests
fobis test

# Run only tests tagged with a specific suite name
fobis test --suite physics

# Run only tests whose names match a glob pattern
fobis test --name "test_*_rk8"

# Build tests without running them
fobis test --no-run

How discovery works

fobis test scans the source tree for files that contain a program statement (i.e. Fortran main programs). Every such file is treated as a test program and compiled independently.

To assign a test to a named suite, add a special comment in the source file:

! fobis: suite=physics
program test_gravity
  implicit none
  ! ...
end program

Tests without a ! fobis: suite= tag belong to the implicit default suite and are always included unless --suite filters them out.

Options

Option	Default	Description
--suite NAME	(all)	Run only tests belonging to this suite
--name GLOB	(all)	Run only tests whose program name matches this glob
--no-run	False	Compile tests but do not execute them
--timeout N	60	Seconds before a single test is considered failed
--jobs N	1	Number of parallel compile jobs

[test] fobos section

Set defaults in the fobos file so you never have to type them:

[test]
suite   = unit
timeout = 120
jobs    = 4

Output format

Running 5 test(s)...
  PASS  test_vector_norm       (0.12 s)
  PASS  test_matrix_mult       (0.34 s)
  FAIL  test_solver_converge   (exit 1)
  PASS  test_io_roundtrip      (0.08 s)
  SKIP  test_mpi_reduce        (binary not found)

Results: 3 passed, 1 failed, 1 skipped

The runner exits with code 0 if all executed tests passed, 1 otherwise.

Exit codes

Code	Meaning
0	All tests passed
1	One or more tests failed or timed out

Typical CI workflow

- name: Build and test
  run: |
    fobis build --build-profile debug
    fobis test --timeout 120

Or with coverage:

- run: fobis build --build-profile coverage
- run: fobis test
- run: fobis coverage --format xml --fail-under 75

See Coverage for the full coverage reporting workflow.