At 250 billion DNS cache entries, one wasted byte costs 250 GB of RAM. Five Rust optimizations later: 100 TB freed, inserts 43% faster, lookups 19% faster. We didn't trade speed for space. https://cfl.re/4wOegyp
How we saved 100 terabytes of memory by optimizing 1.1.1.1’s DNS cache
Five Rust-level memory optimizations to the DNS cache layout of Big Pineapple cut per-entry memory by 56%, freeing approximately 100 TB of memory across Cloudflare's fleet.
blog.cloudflare.com