Zuckerberg’s company is spending billions to buy 350,000 Nvidia H100 graphics processing units

Zuckerberg’s company is spending billions to buy 350,000 Nvidia H100 graphics processing units

Mark Zuckerberg is planning to acquire 350,000 Nvidia H100 GPUs to help Meta build the next generation of AI that has human-like intelligence.

Zuckerberg mentioned that number today when he announced his company’s long-term effort to develop artificial general intelligence (AGI), or artificial intelligence that can learn and use it to perform a variety of tasks.

Meta’s CEO envisions artificial general intelligence powering a wave of cutting-edge services and devices, such as more powerful digital assistants and augmented reality glasses. “Building the best AI assistants, AI for creators, AI for businesses, and more, requires progress in every area of ​​AI,” he said in an Instagram video.

But to get to that point, the Meta will need Nvidia’s H100, an enterprise GPU adept at training large language models. “We’re building a tremendous amount of infrastructure to support this,” Zuckerberg said. “By the end of this year, we will have about 350,000 Nvidia H100 units. Or about 600,000 H100 compute equivalents if you include other GPUs.

The number 350,000 is staggering, and it would also cost Meta a small fortune to obtain. Each H100 can cost around $30,000, meaning Zuckerberg’s company would need to pay an estimated $10.5 billion just to buy the computing power, let alone pay for all the electricity costs.

The statement also provides a glimpse into how far leading technology companies will go to develop new models of artificial intelligence. Other tech giants, including Microsoft, Google and Amazon, also likely bought between 50,000 and 150,000 Nvidia H100s last year, according to research firm Omdia.

Recommended by our editors

In his Instagram post, Zuckerberg noted that Meta is already using GPUs to train Llama 3, the company’s answer to OpenAI’s ChatGPT technology. But Meta’s AI models won’t remain isolated in the company’s servers. Instead, the company plans to make it open source, as it did with Llama 2.

“This technology is so important and the opportunities are so great that we must open source and make it as widely available as possible,” he added.

Get our best stories!

Subscribe to What’s new now Get our top stories in your inbox every morning.

This newsletter may contain advertisements, deals or affiliate links. Subscribing to the newsletter indicates your acceptance of our Terms of Use and Privacy Policy. You can unsubscribe from newsletters at any time.

You may also like...

Leave a Reply

Your email address will not be published. Required fields are marked *