Prof. Dr. Cesare Pautasso

Integrating Faban with Docker for Performance Benchmarking

Vincenzo Ferme, Cesare Pautasso

7th ACM/SPEC International Conference on Performance Engineering (ICPE 2016), Delft, The Netherlands, pp. 129-130

March 2016

Abstract

Reliability and repeatability are key requirements in performance benchmarking ensuring the trustworthiness of the obtained performance results. To apply a benchmark to multiple systems, the reusability of the load driver is essential. While Faban has been designed to ensure the reliability of the performance data obtained from a benchmark experiment, it lacks support for ensuring that the system under test is deployed in a known configuration. This is what Docker, a recently emerging containerization technology, excels at. In this demo paper we present how we integrated Faban with Docker as part of the BenchFlow framework to offer a complete and automated performance benchmarking framework that provides a reliable and reusable environment, ensuring the repeatability of the experiments.

Download

DOI: 10.1145/2851553.2858676

PDF: ▼benchflow-icpe2016demo.pdf (630KB)

Citation

Bibtex

@demo{benchflow:2016:icpe,
	author = {Vincenzo Ferme and Cesare Pautasso},
	title = {Integrating Faban with Docker for Performance Benchmarking},
	booktitle = {7th ACM/SPEC International Conference on Performance Engineering (ICPE 2016)},
	year = {2016},
	month = {March},
	pages = {129-130},
	publisher = {ACM},
	address = {Delft, The Netherlands},
	abstract = {Reliability and repeatability are key requirements in performance benchmarking ensuring the trustworthiness of the obtained performance results. To apply a benchmark to multiple systems, the reusability of the load driver is essential. While Faban has been designed to ensure the reliability of the performance data obtained from a benchmark experiment, it lacks support for ensuring that the system under test is deployed in a known configuration. This is what Docker, a recently emerging containerization technology, excels at. In this demo paper we present how we integrated Faban with Docker as part of the BenchFlow framework to offer a complete and automated performance benchmarking framework that provides a reliable and reusable environment, ensuring the repeatability of the experiments. },
	keywords = {BenchFlow, benchmarking, Docker, Faban},
	doi = {10.1145/2851553.2858676}
}