So, you’ve come across Bloom filters and understand that, despite their probabilistic nature, they are a great fit for your use case. You’ve decided to integrate them into your system design, but you’re unsure about the optimal size and the number of hash functions needed for your…
Durability requirements influence the choice of data protection mechanisms, such as replication, erasure coding, and RAID parity configurations. Achieving higher durability involves trade-offs between redundancy, storage usage ratio, and computational complexity. Replication achieves durability by creating multiple copies of data, which increases redundancy but reduces the storage usage ratio. In…
Shapeless is a type class and dependent type based generic programming library for Scala that helps us in tackling heterogeneity in a collection of objects so as to cut boilerplate in our libraries. In this blog post we will see how can we leverage Shapeless to tackle heterogeneity in Apache…
In any distributed system, services need to discover each other to be able to communicate. This requires a broker of sorts in place to which services could register themselves and be discovered by other services. This mechanism is what is known as Service Discovery and the most famous choice of…
What's Redpanda? Redpanda, a Kafka® replacement for mission critical systems: * 10X Faster * Kafka® API Compatible - no code changes * Easy to use - No Zookeeper®, No JVM - built in C++. One binary. Redpanda is a modern streaming data platform. It essentially is a drop-in replacement of Apache…