bench command
Measure the run time of declared cases, with a confidence interval, against their history or a revision.
bash
fobis bench [CASE...] [options]How to use it, with examples: Verifying results.
All options
Arguments: NAMES...
| Option | Value | Default | Description |
|---|---|---|---|
--fobos, -f | TEXT | Specify a "fobos" file named differently from "fobos" | |
--fci | Assume fobos inputs as case insensitive | ||
--mode | TEXT | Select a mode defined into a fobos file | |
--compare | TEXT | Measure a revision too (scratch copies, runs interleaved) and compare. | |
--feedback | With --compare: diff the compiler's vectorisation and data-movement reports. | ||
--record | Append the measurement to the case's history (verification/bench/). | ||
--runs | INTEGER | Maximum runs per side (overrides max_runs). | |
--keep | Keep the scratch copies of --compare (path printed). | ||
--runner | TEXT | local | Where the programs run: local, or slurm (jobs submitted with sbatch; [scheduler] settings). |
--json | Emit structured JSON to stdout instead of human-readable output (useful for scripting / agents) |