Building a Distributed Message Log from Scratch

Tyler Treat·2018·GOTO·45 min

What you learn when you implement a Kafka-style log yourself: replication, leader election, fsync semantics, and the limits of 'just use a queue.'

distributed-systemsdatabasesarchitecture

Treat reframes consistency, latency, and partial failure as user-facing concerns — and shows what good distributed-system UX looks like.

Young walks through the idea that mutating state is a lossy compression of history — and what you get back when you stop throwing the events away.

Newman and Fowler talk through the cases where microservices earn their keep — and the much larger set where they don't.

Kingsbury takes a flamethrower to databases that promise more than they deliver, and shows how Jepsen catches them lying about consistency.

A tour of the algorithms that let independent replicas converge without a coordinator — and why CRDTs are the cleanest answer we have.

Cockcroft on how Netflix actually moved off the datacenter — and why microservices are a tool for shipping faster, not for being fashionable.

Search the vault