Self managing monitoring for highly elastic large scale Cloud deployments

Jonathan Stuart Ward, Adam David Barker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)
2 Downloads (Pure)


Infrastructure as a Service computing exhibits a number of properties, which are not found in conventional server deployments. Elasticity is among the most significant of these properties which has wide reaching implications for applications deployed in cloud hosted VMs. Among the applications affected by elasticity is monitoring.

In this paper we investigate the challenges of monitoring large cloud deployments and how these challenges differ from previous monitoring problems. In order to meet these unique challenges we propose Varanus, a highly scalable monitoring tool resistant to the effects of rapid elasticity. This tool breaks with many of the conventions of previous monitoring systems and leverages a multi-tier P2P architecture in order to achieve in situ monitoring without the need for dedicated monitoring infrastructure.

We then evaluate Varanus against current monitoring architectures. We find that conventional monitoring tools perform acceptably for small, non changing cloud deployments. However in the case of large or highly elastic deployments current tools perform unacceptably incurring increased latencies, high load and slowed operation necessitating that a new, alternative tool be used. Further, we demonstrate that Varanus maintains low latency and low resource monitoring state propagation at scale and during during periods of high elasticity.
Original languageEnglish
Title of host publicationDIDC '14 Proceedings of the Sixth International Workshop on Data Intensive Distributed Computing
Number of pages8
ISBN (Print)9781450329132
Publication statusPublished - 23 Jun 2014
EventThe 6th International Workshop on Data-intensive Distributed Computing (DIDC'14) - Marriott Pinnacle Downtown Hotel, Vancouver, Canada
Duration: 23 Jun 201427 Jun 2014


WorkshopThe 6th International Workshop on Data-intensive Distributed Computing (DIDC'14)


Dive into the research topics of 'Self managing monitoring for highly elastic large scale Cloud deployments'. Together they form a unique fingerprint.

Cite this