Benchmark builder

Easily compare execution time of tasks with this very simple online benchmark builder.

About Benchmark builder

Compares sets of measurements you have taken yourself, for example execution times of two implementations: enter the values for each suite and get the mean and variance, ranked, with a Markdown table ready to paste into an issue or a pull request.

When you would use it

How to use it

  1. Name each suite and type its measurements, one number per field; add suites with the plus button.
  2. Set the unit (ms, s, MB) so the table is labelled.
  3. Read the mean and variance, then copy the result as a Markdown table or as plain text.

Things worth knowing

Frequently asked questions

Why does my faster variant sometimes measure slower?
Background activity, CPU frequency scaling and garbage collection all add noise. More repetitions and reporting the mean with its variance (or better, the median) make the comparison robust.
Can I paste a list of numbers at once?
Not currently; values are entered one per field. For long series, aggregate them in your benchmarking tool and enter the summary values here.

All the tools