New Strategies in Design to Meet the Demands of AI Data Centers

Posted: 19th Jul 2024

In the data center industry, rack densities have been predicted to trend upward for over a decade, but until the advent of artificial intelligence (AI), these predictions have been unrealized. AI data centers present unique challenges in terms of rack densities and in terms of scale. It is not uncommon to see data centers of 1 GW with liquid-cooled racks with densities over 100 kW. In the future, we will see even larger data centers with higher rack densities.

One projection is for rack densities over 500 kW per rack. To accommodate the larger scale and higher densities, there must be a significant shift in the design of efficient, sustainable, high-capacity data centers. One thing is clear: To manage this scale, we will need to change our concept of design beyond GPUs and cooling innovations.

View Full Article

Related Articles

Popular Articles

Artificial intelligence tools can now write, code, draw, summarise, and brainstorm. The proliferatio...
Microsoft has designed two additional infrastructure chips for its data centers that will help spe...
Cloud infrastructure delivered large language models to the enterprise, and hyperscaler platforms ...
The cybersecurity landscape is constantly changing as new technologies and threat trends emerge. M...