Structural Analysis and Optimal Design of Distributed System Throttlers
For system designers, this work provides a framework to analyze and optimize throttler performance under uncertainty, though it is an incremental extension of known control/queueing methods.
This paper analyzes performance deterioration of distributed system throttlers under demand uncertainty and proposes network synthesis methods to improve performance via communication link and server update cycle modifications.
In this paper, we investigate the performance analysis and synthesis of distributed system throttlers (DST). A throttler is a mechanism that limits the flow rate of incoming metrics, e.g., byte per second, network bandwidth usage, capacity, traffic, etc. This can be used to protect a service's backend/clients from getting overloaded, or to reduce the effects of uncertainties in demand for shared services. We study performance deterioration of DSTs subject to demand uncertainty. We then consider network synthesis problems that aim to improve the performance of noisy DSTs via communication link modifications as well as server update cycle modifications.