NVIDIA Boosts Production: GB200 NVL72 AI Monster Set to Dominate Despite Its $3 Million Price Tag

LaptopMedia.com News NVIDIA Boosts Production: GB200 NVL72 AI Monster Set to Dominate Despite Its $3 Million Price Tag

From: Simeon Nikolov 18 July 2024 / 19:56 0

Last month, HSBC analysis revealed that the price of NVIDIA’s 72 GPU flagship NVL72 will be about $3 million, while the *cheaper* NVL36 server rack system will be around $1.8 million. NVIDIA originally planned an order for 40,000 units from TSMC for these systems.

Now it turns out that despite the high prices, NVIDIA has increased its order by 50%, aiming for 60,000 units, according to UDN. Out of these, 50,000 will be for the GB200 NVL36 variant.

The B200 chip, at the heart of these systems, features 208 billion transistors made with advanced 4NP technology from TSMC. The GB200 model pairs two B200 accelerators with a 72-core Grace ARM processor. The high-end GB200 NVL72 system, which fits into a single rack and uses 18 1U nodes, consumes about 120 kW of power and requires a liquid cooling system.

The GB200 NVL36 is expected to be the bestseller. This system also takes up a full rack but is more efficient, using 2U nodes and consuming only 66 kW.

Industry insiders report that major tech giants like Amazon, Google, Microsoft, and Meta are eagerly awaiting these GPU systems to further improve their AI servers.