Cloudflare's Gen 13 Servers - Doubling Edge Compute Performance
Basically, Cloudflare upgraded their servers to be faster by using new technology.
Cloudflare has launched its Gen 13 servers, doubling compute performance by utilizing AMD's EPYC processors. This upgrade enhances edge computing capabilities, crucial for businesses relying on fast internet services. The new architecture promises improved performance and efficiency, allowing Cloudflare to meet growing demands.
What Happened
Cloudflare has launched its Gen 13 servers, marking a significant upgrade in their computing capabilities. By switching to AMD EPYC™ 5th Gen Turin processors, Cloudflare has doubled its compute throughput. This transition involved a strategic trade-off: sacrificing large cache sizes for increased core counts. The new architecture is designed to enhance performance while maintaining service level agreements (SLAs).
The previous generation, Gen 12, utilized AMD's Genoa-X processors, which featured a cache-heavy design ideal for Cloudflare's earlier software stack. However, as they sought to improve performance, they faced a dilemma. The new CPUs offered better throughput but came with reduced cache, which could potentially increase latency. This blog explores how Cloudflare's new FL2 stack, a Rust-based rewrite of their core request handling layer, mitigated these latency issues and unlocked the full potential of Gen 13.
Who's Affected
The upgrade to Gen 13 servers affects Cloudflare's customers who rely on fast and efficient edge computing. With the new architecture, Cloudflare can handle more requests simultaneously, improving the overall user experience. This is particularly important for businesses that depend on real-time data processing and low-latency responses, such as e-commerce platforms and streaming services.
By doubling the compute performance, Cloudflare aims to support a growing demand for faster and more reliable internet services. The transition to the FL2 stack also ensures that customers benefit from enhanced security and performance, as the new architecture is built to handle modern workloads more efficiently.
What Data Was Exposed
While the article does not discuss data exposure in the traditional sense, it highlights the performance metrics that were affected by the transition to Gen 13. The analysis showed that the latency increased significantly when using the previous FL1 stack, particularly under high CPU utilization. For instance, latency penalties exceeded 50% at high usage levels, which would have negatively impacted customer experiences.
The new FL2 stack demonstrated impressive results, reducing latency by 70% compared to the previous generation. This improvement means that Cloudflare can now process requests faster, even as they scale operations. The performance gains are crucial for maintaining competitive service levels in a rapidly evolving digital landscape.
What You Should Do
For businesses using Cloudflare's services, it’s essential to stay informed about these upgrades. Understanding the capabilities of Gen 13 can help companies optimize their applications to take full advantage of the increased throughput.
- Monitor Performance: Keep an eye on how the new servers impact your application’s performance. This can help identify any areas for optimization.
- Engage with Cloudflare: If you're experiencing latency issues or have specific performance needs, reach out to Cloudflare's support. They can provide insights into how to best utilize the new architecture.
- Stay Updated: Follow Cloudflare's updates and documentation to understand the full capabilities of the Gen 13 servers and the FL2 stack. This knowledge can help businesses leverage these advancements for improved service delivery.
Cloudflare Blog