TY - GEN
T1 - An adaptive, scalable, and portable technique for speeding up MPI-based applications
AU - Filgueira, Rosa
AU - Atkinson, Malcolm
AU - Nuñez, Alberto
AU - Fernández, Javier
PY - 2012
Y1 - 2012
N2 - This paper presents a portable optimization for MPI communications, called PRAcTICaL-MPI (Portable Adaptive Compression Library- MPI). PRAcTICaL-MPI reduces the data volume exchanged among processes by using lossless compression and offers two main advantages. Firstly, it is independent of the MPI implementation and the application used. Secondly, it allows for turning the compression on and off and selecting the most appropriate compression algorithm at run-time, depending on the characteristics of each message and on network performance. We have validated PRAcTICaL-MPI in different MPI implementations and HPC clusters. The evaluation shows that compressing MPI messages with the best algorithm and only when it is worthwhile, we obtain a great reduction in the overall execution time for many of the scenarios considered.
AB - This paper presents a portable optimization for MPI communications, called PRAcTICaL-MPI (Portable Adaptive Compression Library- MPI). PRAcTICaL-MPI reduces the data volume exchanged among processes by using lossless compression and offers two main advantages. Firstly, it is independent of the MPI implementation and the application used. Secondly, it allows for turning the compression on and off and selecting the most appropriate compression algorithm at run-time, depending on the characteristics of each message and on network performance. We have validated PRAcTICaL-MPI in different MPI implementations and HPC clusters. The evaluation shows that compressing MPI messages with the best algorithm and only when it is worthwhile, we obtain a great reduction in the overall execution time for many of the scenarios considered.
KW - Adaptive systems
KW - Compression algorithms
KW - High-Performance Computing
KW - MPI Library
KW - Parallel techniques
KW - Portable optimizations
UR - http://www.scopus.com/inward/record.url?scp=84867638295&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-32820-6_72
DO - 10.1007/978-3-642-32820-6_72
M3 - Conference contribution
AN - SCOPUS:84867638295
SN - 9783642328190
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 729
EP - 740
BT - Parallel Processing - 18th International Conference, Euro-Par 2012, Proceedings
T2 - 18th International Conference on Parallel Processing, Euro-Par 2012
Y2 - 27 August 2012 through 31 August 2012
ER -