Twitter Made Searching Scalable Before Elon Musk

Doing Everything on One Cluster Doesn't Work

TLDR;

Twitter struggled using Elasticsearch and letting that cluster handle everything. This was a problem handling tons of traffic and doing large backfill operations.

The simple way they fixed this …