Traditionally, data center operators recommend an ambient temperature of 18 to 27 degrees Celsius (about 64 to 80 degrees Fahrenheit) for data center equipment. But in an unexpected surprise, Nvidia’s new 100% liquid-cooled AI data centers operate at a feverish 45 degrees Celsius (113 degrees Fahrenheit). It may seem counterintuitive, but Nvidia claims that this cooling method represents one of the greatest efficiency advancements in data center history.
In Nvidia’s blog post by Josh Parker, Head of Sustainability at Nvidia, it was announced that Nvidia DSX AI factories host Nvidia’s Rubin AI infrastructure, without fans or cold aisles. The idea that a data center should look like a walk-in freezer is considered a misconception. All that remained was to find a way to move from hybrid liquid and air cooling to a pure liquid cooling solution.
So how does the Nvidia DSX design work? The coolant enters the chip at 45 degrees Celsius, absorbs heat from the chip surface, and exits at 55 degrees. It has been observed that processors can continue to operate at full power at this temperature and the process does not cause them to degrade. This is a huge boon for data centers, given that every one degree Fahrenheit increase in operating temperature translates into up to 5% savings in energy costs. And as the United States pushes for data centers to pay for network access, the timing couldn’t be better for Nvidia.
What NVIDIA’s High-Temperature Cooling Means for Consumers
The mention of a fully liquid-cooled data center may ring alarm bells for ordinary people who fear that AI data centers will do more harm than just increasing prices. These data centers already consume 5 million gallons of water per day, to the potential detriment of neighboring communities. However, Nvidia claims its DSX AI factories have “zero water consumption” thanks to a dry-cooler-based design with a closed-loop system without evaporative water cooling.
That being said, this energy-efficient method of high-temperature cooling could one day find its way into your home computer. For your personal computer’s CPU and GPU, manufacturers explain that you should aim for a temperature as low as 30 degrees Celsius (86 degrees Fahrenheit) when the system is idle or under light use. That figure could rise to the new standard of 45 degrees if Nvidia’s partner companies, such as cooling system maker Motivair, start implementing similar engineering in consumer products.
If Nvidia makes significant savings on data center energy costs, does that mean the price of Nvidia’s AI-based products will drop? Not necessarily. As Parker stated in the original blog post, “AI workloads are not getting lighter. The demand for computing that is driving data center construction is growing faster than almost any other category of infrastructure investment. » This is another time when you shouldn’t wait to buy a new graphics card for your PC.
