Engineering at Meta
https://engineering.fb.com/Why it matters: This article details how Meta is re-architecting its core network infrastructure to handle the massive data demands of AI, offering insights into large-scale network design for future-proof, high-capacity connectivity.
- •Meta is scaling its Express Backbone (EBB) network by 10x to support the increasing demands of AI workloads and extend AI clusters across data centers.
- •The Backbone comprises Classic Backbone (CBB) for global DC-to-POP connectivity and EBB for scalable DC-to-DC interconnection, with EBB facing the most significant scaling challenges.
- •EBB employs a customized software stack, including the Open/R routing protocol and an in-house traffic engineering system with onbox agents and a centralized controller.
- •A key scaling technique for 10X Backbone is the DC Metro Architecture, which pre-builds fiber rings and POPs to simplify and standardize new data center connectivity.
- •This architecture separates metro and long-haul networks, enabling faster, more reliable high-capacity connections for rapidly expanding data centers.
Why it matters: This article offers engineers actionable design principles to reduce IT hardware's environmental impact, fostering sustainability and cost savings through circularity and emissions reduction in data center infrastructure.
- •Meta introduces "Design for Sustainability" principles for IT hardware to cut emissions and costs via reuse, extended life, and optimized design.
- •Key strategies include modularity, retrofitting, dematerialization, greener materials, and extending hardware lifecycles in data centers.
- •The focus is on reducing Scope 3 emissions from manufacturing, delivery, and end-of-life of IT hardware components.
- •Methods involve optimizing material selection, using lower carbon alternatives, extending rack life, and harvesting components for reuse.
- •These principles apply across various rack types (AI, Compute, Storage, Network) and target components like compute, storage, and cooling.
- •Collaboration with suppliers to electrify processes and transition to renewable energy is crucial for achieving net-zero goals.
- •The initiative also significantly reduces electronic waste (e-waste) generated from data centers.