Towards semi-automatic data-type translation for parallelism in Erlang

Adam David Barwell, Christopher Mark Brown, David Castro, Kevin Hammond

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

As part of our ongoing research programme into programmer-in-the-loop parallelisation, we are studying the problem of introducing alternative data structures to support parallelism. Automated support for data structure transformations makes it easier to produce the best parallelisation for some given program, or even to make parallelisation feasible. We use a refactoring approach to choose and introduce these transformations for specific algorithmic skeletons, structured forms of parallelism that capture common patterns of parallelism. Our approach integrates with the Wrangler refactoring tool for Erlang, and uses the advanced Skel [4] skeleton library for Erlang. This library has previously been shown to give good parallelisations for a number of applications, including a multi-agent system [1] where we have achieved speedups of up to 142.44 on a 61-core machine with 244 threads. We have investigated three widely-used Erlang data structures: lists, binary structures and ETS (Erlang Term Storage) tables. In general, we have found that ETS tables deliver the best parallel performance for the examples that we have considered. However, our results show that simple lists may deliver similar performance to the use of ETS tables, and better performance than using binary structures. This means that we cannot blindly choose to implement a single optimisation as part of the compilation process. Our approach also allows the use of new (possibly user-defined) data structures and other transformations in future, giving a high level of flexibility and generality.
Original languageEnglish
Title of host publicationProceedings of the 15th International Workshop on Erlang
Place of PublicationNew York
PublisherACM
Pages60-61
ISBN (Print)9781450344319
DOIs
Publication statusPublished - 23 Sept 2016
Event15th ACM SIGPLAN Workshop on Erlang - Nara, Japan
Duration: 23 Sept 201623 Sept 2016
http://conf.researchr.org/home/icfp-2016/

Workshop

Workshop15th ACM SIGPLAN Workshop on Erlang
Abbreviated titleICFP
Country/TerritoryJapan
CityNara
Period23/09/1623/09/16
Internet address

Fingerprint

Dive into the research topics of 'Towards semi-automatic data-type translation for parallelism in Erlang'. Together they form a unique fingerprint.

Cite this