Zuckerberg’s company is spending billions to buy 350,000 Nvidia H100 graphics processing units
Mark Zuckerberg is planning to acquire 350,000 Nvidia H100 GPUs to help Meta build the next generation of AI that has human-like intelligence.
Zuckerberg mentioned that number today when he announced his company’s long-term effort to develop artificial general intelligence (AGI), or artificial intelligence that can learn and use it to perform a variety of tasks.
Meta’s CEO envisions artificial general intelligence powering a wave of cutting-edge services and devices, such as more powerful digital assistants and augmented reality glasses. “Building the best AI assistants, AI for creators, AI for businesses, and more, requires progress in every area of AI,” he said in an Instagram video.
But to get to that point, the Meta will need Nvidia’s H100, an enterprise GPU adept at training large language models. “We’re building a tremendous amount of infrastructure to support this,” Zuckerberg said. “By the end of this year, we will have about 350,000 Nvidia H100 units. Or about 600,000 H100 compute equivalents if you include other GPUs.
The number 350,000 is staggering, and it would also cost Meta a small fortune to obtain. Each H100 can cost around $30,000, meaning Zuckerberg’s company would need to pay an estimated $10.5 billion just to buy the computing power, let alone pay for all the electricity costs.
The statement also provides a glimpse into how far leading technology companies will go to develop new models of artificial intelligence. Other tech giants, including Microsoft, Google and Amazon, also likely bought between 50,000 and 150,000 Nvidia H100s last year, according to research firm Omdia.
Recommended by our editors
In his Instagram post, Zuckerberg noted that Meta is already using GPUs to train Llama 3, the company’s answer to OpenAI’s ChatGPT technology. But Meta’s AI models won’t remain isolated in the company’s servers. Instead, the company plans to make it open source, as it did with Llama 2.
“This technology is so important and the opportunities are so great that we must open source and make it as widely available as possible,” he added.
Get our best stories!
Subscribe to What’s new now Get our top stories in your inbox every morning.