“It is a waste of an impression if we display ads on devices where the probability of conversion is low. The Cuckoo filter allows us to achieve this functionality with low latency on a 1.5 TB database.”
Streamline data deduplication
The fastest apps start with the world’s only feature-rich modern cache
Benefits
Easily check if a given value already exists in a data stream with Redis Sets and probabilistic Bloom and Cuckoo filters.
Avoid redundant processing by making sure no data is handled more than once—or avoid processing altogether.
Redis sets store any given value only once and are optimized to deterministically answer extremely fast the question, such as “Is this value in this set?”
Bloom filter is a probabalistic algorithm that only stores hashes for each value, not the values themselves. That means it takes up less memory and is faster than sets, with some slight accuracy tradeoffs.
Key features
State-of-the-art and academically proven probabilistic data structures and algorithms optimized for Redis.
Get fast and efficient dedupe and filtering with very large datasets at high performance and linear scalability.
Data structures can be managed in a fully reliable and durable manner across geo-distributed locations with active-active replication.
We work on any major cloud provider as a managed service or software. Automate operations and integrate seamlessly with modern platforms.
What our customers say
- Billionsof ad requests served at low latency
Get started with Redis today
Speak to a Redis expert and learn more about enterprise-grade Redis today.