Netflix AI Team Cuts Wide-Partition Read Latency from Seconds to Milliseconds by Splitting Cassandra Partitions Per ID

1Key Takeaways

• Netflix engineers detailed how they handle wide partitions in Apache Cassandra for the TimeSeries Abstraction.
• Two approaches work together: Time Slice re-partitioning tunes future partitions at the table level, while dynamic partitioning detects and splits oversized partitions per TimeSeries ID on the read path.
• Detection runs via byte counting and Kafka, splits are checksum-validated, and Bloom filters route reads to parallel child partitions.
• Average read latency dropped from seconds to low….