Narwhal and Tusk: A DAG-based Mempool and Efficient BFT Consensus
This work addresses the need for scalable and fault-tolerant consensus protocols in distributed systems, offering significant performance improvements over existing methods like HotStuff.
The authors tackled the problem of achieving high-performance Byzantine fault-tolerant consensus by separating transaction dissemination from ordering, resulting in Narwhal-HotStuff achieving over 130,000 tx/sec at less than 2-sec latency and Tusk achieving 160,000 tx/sec with about 3 seconds latency, with throughput scaling linearly to 600,000 tx/sec using additional workers.
We propose separating the task of reliable transaction dissemination from transaction ordering, to enable high-performance Byzantine fault-tolerant quorum-based consensus. We design and evaluate a mempool protocol, Narwhal, specializing in high-throughput reliable dissemination and storage of causal histories of transactions. Narwhal tolerates an asynchronous network and maintains high performance despite failures. Narwhal is designed to easily scale-out using multiple workers at each validator, and we demonstrate that there is no foreseeable limit to the throughput we can achieve. Composing Narwhal with a partially synchronous consensus protocol (Narwhal-HotStuff) yields significantly better throughput even in the presence of faults or intermittent loss of liveness due to asynchrony. However, loss of liveness can result in higher latency. To achieve overall good performance when faults occur we design Tusk, a zero-message overhead asynchronous consensus protocol, to work with Narwhal. We demonstrate its high performance under a variety of configurations and faults. As a summary of results, on a WAN, Narwhal-Hotstuff achieves over 130,000 tx/sec at less than 2-sec latency compared with 1,800 tx/sec at 1-sec latency for Hotstuff. Additional workers increase throughput linearly to 600,000 tx/sec without any latency increase. Tusk achieves 160,000 tx/sec with about 3 seconds latency. Under faults, both protocols maintain high throughput, but Narwhal-HotStuff suffers from increased latency.