DocLite: a Docker-based Lightweight Cloud benchmarking tool

Blesson Varghese, Lawan Thamsuhang Subba, Long Thanh Thai, Adam David Barker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)


Existing benchmarking methods are time consuming processes as they typically benchmark the entire Virtual Machine (VM) in order to generate accurate performance data, making them less suitable for real-time analytics. The research in this paper is aimed to surmount the above challenge by presenting DocLite - Docker Container-based Lightweight benchmarking tool. DocLite explores lightweight cloud benchmarking methods for rapidly executing benchmarks in near real-time. DocLite is built on the Docker container technology, which allows a user-defined memory size and number of CPU cores of the VM to be benchmarked. The tool incorporates two benchmarking methods - the first referred to as the native method employs containers to benchmark a small portion of the VM and generate performance ranks, and the second uses historic benchmark data along with the native method as a hybrid to generate VM ranks.The proposed methods are evaluated on three use-cases and are observed to be up to 91 times faster than benchmarking the entire VM. In both methods, small containers provide the same quality of rankings as a large container. The native method generates ranks with over 90% and 86% accuracy for sequential and parallel execution of an application compared against benchmarking the whole VM. The hybrid method did not improve the quality of the rankings significantly.
Original languageEnglish
Title of host publication2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid)
PublisherIEEE Computer Society
Number of pages10
ISBN (Electronic)9781509024537
ISBN (Print)9781509024544
Publication statusPublished - 21 Jul 2016
Event16th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid 2016) - Cartegena, Colombia
Duration: 16 May 201619 May 2016
Conference number: 16


Conference16th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid 2016)
Abbreviated titleCCGrid 2016


  • Lightweight benchmark
  • Docker
  • Cloud benchmarking
  • Containers
  • Hybrid benchmark


Dive into the research topics of 'DocLite: a Docker-based Lightweight Cloud benchmarking tool'. Together they form a unique fingerprint.

Cite this