At the recent 2024 SIEPR Economic Summit, NVIDIA CEO Huang Renxun revealed that the next generation of DGX GPU servers will feature water-cooling for heat dissipation, presenting a truly magnificent and beautiful system.
Huang Renxun also mentioned that the new generation of DGX servers is coming soon, hinting at the imminent release of the Blacwell B100 GPU accelerator card — while the official statement only mentions within 2024, rumors suggest it could arrive as early as the second quarter.
During a previous Dell conference, it was confirmed that NVIDIA will also introduce an upgraded version of the B200 GPU next year, with a maximum power consumption reaching 1000W, and there are even suggestions of a staggering 1400W!
NVIDIA's flagship AI GPUs, the H100 and the upgraded H200, currently have a maximum power consumption of 700W and a core area of 814 square millimeters, both requiring only air cooling.
On the other hand, the AMD MI300X demands 750W with a larger area of 1017 square millimeters.
Today, the use of immersion liquid cooling in servers and data centers has become commonplace, but there are also many experts who oppose this development path.
Patrick Moorhead, the founder, CEO, and chief analyst of Moor Insights & Strategy, has explicitly stated that we have exhausted means to improve performance while controlling reasonable power consumption and heat dissipation. What's next? Liquid nitrogen? It's time to rethink our approach.
