Optimal Load Balancing and Easy Scaling with Redis Streams and Redis Cluster

In real life applications, keys are produced at very different and non uniform access rates. This impacts the efficiency and effectiveness of the application. In this talk, MachineZone will describe a technique they developed to distribute keys evenly in a cluster of machines, so that each machine handles a fair amount of traffic and computation. We’ll look at a variety of use cases including scaling down a cluster to save resources and cost.

Key points covered:

• Use Cobra for real time analytics with instant filterable results coming from a Redis stream.
• Understand how to measure Redis keys frequency access and distribution
• Reshard a Redis cluster to achieve optimal load balancing using flexible hash slot design