__str__ ( self )

Returns the class signature

add ( self,  benchmark )

Adds a benchmark or list of benchmarks to the list in this suite.

debug ( self )

Run the benchmarks without collecting errors in a result instance

remote_tidy_up ( self,  dir )

This function removes the remote benchmark directory of the first benchmark in the suite if this benchmark was run remotely.

run (
        self,
        results,
        copied_files=[],
        remote_benchmark_dir="",
        )

This function runs either a list of suites or a list of benchmarks. In the case of remote runs it assumes that all benchmarks are run on the same host in the sense that only the host on which the first benchmark is run gets cleaned up.