Transparent fault tolerance for scalable functional computation

STEWART, Robert, MAIER, Patrick and TRINDER, Phil (2016). Transparent fault tolerance for scalable functional computation. Journal of Functional Programming, 26, e5.

[img]
Preview
PDF
JFP-accepted_version-107448.pdf - Accepted Version
All rights reserved.

Download (459kB) | Preview
Official URL: https://www.cambridge.org/core/journals/journal-of...
Link to published version:: https://doi.org/10.1017/S095679681600006X

Abstract

Reliability is set to become a major concern on emergent large-scale architectures. While there are many parallel languages, and indeed many parallel functional languages, very few address reliability. The notable exception is the widely emulated Erlang distributed actor model that provides explicit supervision and recovery of actors with isolated state. We investigate scalable transparent fault tolerant functional computation with automatic supervision and recovery of tasks. We do so by developing HdpH-RS, a variant of the Haskell distributed parallel Haskell (HdpH) DSL with Reliable Scheduling. Extending the distributed work stealing protocol of HdpH for task supervision and recovery is challenging. To eliminate elusive concurrency bugs, we validate the HdpH-RS work stealing protocol using the SPIN model checker. HdpH-RS differs from the actor model in that its principal entities are tasks, i.e. independent stateless computations, rather than isolated stateful actors. Thanks to statelessness, fault recovery can be performed automatically and entirely hidden in the HdpH-RS runtime system. Statelessness is also key for proving a crucial property of the semantics of HdpH-RS: fault recovery does not change the result of the program, akin to deterministic parallelism. HdpH-RS provides a simple distributed fork/join-style programming model, with minimal exposure of fault tolerance at the language level, and a library of higher level abstractions such as algorithmic skeletons. In fact, the HdpH-RS DSL is exactly the same as the HdpH DSL, hence users can opt in or out of fault tolerant execution without any refactoring. Computations in HdpH-RS are always as reliable as the root node, no matter how many nodes and cores are actually used. We benchmark HdpH-RS on conventional clusters and an HPC platform: all benchmarks survive Chaos Monkey random fault injection; the system scales well e.g. up to 1,400 cores on the HPC; reliability and recovery overheads are consistently low even at scale.

Item Type: Article
Departments - Does NOT include content added after October 2018: Faculty of Science, Technology and Arts > Department of Computing
Identification Number: https://doi.org/10.1017/S095679681600006X
Page Range: e5
Depositing User: Patrick Maier
Date Deposited: 16 Feb 2018 12:35
Last Modified: 18 Mar 2021 15:31
URI: https://shura.shu.ac.uk/id/eprint/18620

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics