All videos
All videos
Reaching Zen in Your Cluster Coordination
October 9, 2019
Distributed systems are hard and unfortunately often less perfect than we would hope. This talk shows a concrete example: Elasticsearch's cluster coordination system, called Zen Discovery, got a rewrite in version 7.0. Starting from a formal model, the coordination layer was rebuilt to address multiple issues discovered over the years. We discuss the main improvements of the new implementation: Master elections are much faster, the infamous minimum_master_nodes setting has been removed, growing and shrinking clusters becomes safer and easier, and leaves less room to misconfigure the system. Let us join the new, more Zen way of cluster coordination.
Tags
Other videos that you might like

Netflix 2.0 – How to build your own VOD global web application without using single server
Tomasz Stachlewski

Nine Ways To Fail at Cloud Native
Holly Cummins

Migrating legacy workloads to Kubernetes
Piotr Kliczewski

Machine Learning at any scale with Amazon SageMaker
Antonio Duma