AGOCS -- Accurate Google Cloud Simulator Framework
This provides researchers with a convenient desktop tool for cloud workload simulation using real-world data, though it is incremental as it builds on existing trace-based simulation approaches.
The paper introduces AGOCS, a high-fidelity cloud workload simulator that parses real workload traces from a Google Cluster with 12.5K nodes over a month to provide precise job, task, and node parameters with resource usage statistics, implemented in Scala for parallel execution and extensibility.
This paper presents the Accurate Google Cloud Simulator (AGOCS) - a novel high-fidelity Cloud workload simulator based on parsing real workload traces, which can be conveniently used on a desktop machine for day-to-day research. Our simulation is based on real-world workload traces from a Google Cluster with 12.5K nodes, over a period of a calendar month. The framework is able to reveal very precise and detailed parameters of the executed jobs, tasks and nodes as well as to provide actual resource usage statistics. The system has been implemented in Scala language with focus on parallel execution and an easy-to-extend design concept. The paper presents the detailed structural framework for AGOCS and discusses our main design decisions, whilst also suggesting alternative and possibly performance enhancing future approaches. The framework is available via the Open Source GitHub repository.