Exploiting data compression in collective I/O techniques

Rosa Filgueira*, David E. Singh, Juan C. Pichel, Jesus Carretero

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper presents Two-Phase Compressed I/O (TPC I/O,) an optimization of the Two-Phase collective I/O technique from ROMIO, the most popular MPI-IO implementation. In order to reduce network traffic, TPC I/O employs LZO algorithm to compress and decompress exchanged data in the inter-node communication operations. The compression algorithm has been fully implemented in the MPI collective technique, allowing to dynamically use (or not) compression. Compared with Two-Phase I/O, Two-Phase Compressed I/O obtains important improvements in the overall execution time for many of the considered scenarios.

Original languageEnglish
Title of host publicationProceedings of the 2008 IEEE International Conference on Cluster Computing, CCGRID 2008
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages479-485
Number of pages7
ISBN (Print)9781424426409
DOIs
Publication statusPublished - 2008
Event2008 IEEE International Conference on Cluster Computing, ICCC 2008 - Tsukuba, Japan
Duration: 29 Sept 20081 Oct 2008

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
VolumeProceedings of the 2008 IEEE International Conference on Clus...
ISSN (Print)1552-5244

Conference

Conference2008 IEEE International Conference on Cluster Computing, ICCC 2008
Country/TerritoryJapan
CityTsukuba
Period29/09/081/10/08

Fingerprint

Dive into the research topics of 'Exploiting data compression in collective I/O techniques'. Together they form a unique fingerprint.

Cite this