Intermediate Topic 27 of 51 Distributed Systems & Cloud
Consistent Hashing
Key distribution minimizing movement when nodes change.
How it works
Consistent hashing maps both keys and nodes onto a circular hash space, the ring, and assigns each key to the first node clockwise from its position. When a node joins or leaves, only the keys in its adjacent range move, about 1/n of all keys, instead of nearly everything as with modulo hashing. Virtual nodes give each physical server many positions on the ring for even distribution and heterogeneous capacity, and replication places copies on the next several nodes.
Where it is used
Distributed caches such as Memcached clients, key-value stores such as DynamoDB and Cassandra, load balancers and content delivery networks use consistent hashing to spread data and minimize remapping.
Common pitfall
Without virtual nodes, the distribution is uneven and hot spots appear. Hash function quality matters. Popular keys still overload a single node regardless of the hash. Membership changes must be propagated consistently or clients disagree on placement. Rebalancing data transfer takes time. Choose enough virtual nodes and monitor per-node load.
Where it fits in the course
Consistent Hashing is topic 27 of 51 in Distributed Systems & Cloud, rated Intermediate. It follows Saga Pattern. The next topic is Distributed Hash Tables.
Practice and explore
- Open the interactive lesson, with a mini quiz.
- Take the Distributed Systems & Cloud quiz.
- Explore the Hash Table visualizer: Hash function, buckets and chaining collisions.
How to study this topic
- Read the explanation above and restate the definition in your own words.
- Open the interactive lesson and answer its mini quiz.
- Read the common pitfall, then write a short example that avoids it.
- Check your understanding in the Distributed Systems & Cloud quiz, and revisit the topic if you miss a question.
Frequently asked questions
What is Consistent Hashing?
Where do people use Consistent Hashing?
What is the most common mistake with Consistent Hashing?
What should I learn before this topic?
How can I practice it?
Is Consistent Hashing hard to learn?
How long does it take to learn Consistent Hashing?
Which topics are related to Consistent Hashing?
What should I study after Consistent Hashing?
Related topics
- Saga Pattern (Distributed Systems & Cloud)
- Distributed Hash Tables (Distributed Systems & Cloud)
- Two-Phase Commit (Distributed Systems & Cloud)
- Gossip Protocols (Distributed Systems & Cloud)
- Passwords and Hashing (Security & Cryptography)
- Cuckoo Hashing (Data Structures)