Meta debuts new generation of AI chip

In this article

• META

Meta Platforms unveiled details on Wednesday about the next generation of the company's in-house artificial intelligence accelerator chip.

Reuters reported earlier this year that Meta planned to deploy a new version of a custom data center chip to address the swelling amount of computing power necessary to run AI products in Facebook, Instagram and WhatsApp. The chip, referred to internally as "Artemis," will help Meta reduce its reliance on Nvida's AI chips and reduce its energy costs overall.

"This chip's architecture is fundamentally focused on providing the right balance of compute, memory bandwidth, and memory capacity for serving ranking and recommendation models," the company wrote in a blog post.

The new Meta Training and Inference Accelerator (MTIA) chip is part of a broad custom silicon effort at the company that includes looking at other hardware systems too. Beyond building the chips and hardware, Meta has made significant investments in developing the software necessary to harness the power of its infrastructure in the most efficient way.

Read more Our reporting on AI

• How to drive bias out of AI without making mistakes of Google Gemini
• Apple announces its big annual conference, where it could reveal its AI strategy
• Pro: This 'hidden AI gem' can surge 80%, Baird says

The company is also spending billions on buying Nvidia and other AI chips: This year CEO Mark Zuckerberg said the company planned to acquire roughly 350,000 flagship H100 chips from Nvidia. Combined with other suppliers, Meta plans to accumulate the equivalent of 600,000 H100 chips this year, he said.

Taiwan Semiconductor Manufacturing Co will produce the new chip on its "5nm" process. Meta said it is capable of three times the performance of its first generation processor.

The chip has been deployed in the data center and is engaged in serving AI applications. The company said it has several programs underway "aimed at expanding the scope of MTIA, including support of (generative AI) workloads."

Don’t miss these stories from Our PRO:

• Five stocks to buy and hold for the long term, according to the pros
• These are Piper Sandler's favorite stocks for the second quarter 
• Energy might be the 'story of the summer,' one chief investment officer says. Here's how to play it
• Alphabet quietly hits new record in down market, forming bullish 'cup-and-handle' chart pattern
• S&P 500 chart analysis shows pullback is likely and investors should hedge
• Cathie Wood buys more Tesla, says now 'is not the time to run for the hills'

Disclaimer: The copyright of this article belongs to the original author. Reposting this article is solely for the purpose of information dissemination and does not constitute any investment advice. If there is any infringement, please contact us immediately. We will make corrections or deletions as necessary. Thank you.