Chiminey: Reliable Computing and Data Management Platform in the Cloud
This addresses the challenge for researchers in managing virtual environments for data-intensive and parallel experiments, though it appears incremental as it builds on existing cloud computing concepts.
The paper tackles the problem of enabling complex scientific experiments on cloud-based environments by presenting Chiminey, a software platform that allows researchers to run applications on HPC and cloud infrastructures, handle failures, curate outputs, share data, and search public data.
The enabling of scientific experiments that are embarrassingly parallel, long running and data-intensive into a cloud-based execution environment is a desirable, though complex undertaking for many researchers. The management of such virtual environments is cumbersome and not necessarily within the core skill set for scientists and engineers. We present here Chiminey, a software platform that enables researchers to (i) run applications on both traditional high-performance computing and cloud-based computing infrastructures, (ii) handle failure during execution, (iii) curate and visualise execution outputs, (iv) share such data with collaborators or the public, and (v) search for publicly available data.