Microsoft is building its own server tech — networking hardware will lessen reliance on Nvidia and possibly supercharge AI speeds

News
By Craig Hale
published

Could Microsoft's move spell disaster for Nvidia and others?

Inside Facebook data center
(Image credit: Facebook)

In a bold move to enhance the performance of its Maia AI server chip, Microsoft is reportedly developing its own network cards.

According to a report by The Information, the project is reportedly being headed up by Pradeep Sindhu, CVP Silicon at Microsoft and CEO of Fungible, a server chip startup that Microsoft acquired in 2023.

If true, Microsoft, one of the world’s biggest investors in artificial intelligence, could significantly reduce its reliance on Nvidia, which currently provides the industry with many crucial components.

Microsoft wants to use fewer Nvidia parts

The rumored network card, similar to Nvidia’s ConnectX-7 card, is envisioned to optimize the performance of Microsoft’s Maia AI server chip. If successful, it could reduce the time required for OpenAI – another company that has benefited from major Microsoft investments – to train models on Microsoft servers, helping to improve cost efficiency.

The report speculates that the development could take more than a year.

Besides the positive impacts on Microsoft and company-backed artificial intelligence, more in-house components will help the Redmond giant to reduce its reliance on other companies, like Nvidia.

Microsoft’s Maia chip, introduced in November, is designed to power large language models (LLMs) and support AI computing.

Moreover, the company’s significant investments in OpenAI, the startup behind the popular ChatGPT AI chatbot, have further solidified its position in the competitive market for artificial intelligence.

Though both companies now sit below the all-important threshold (at the time of writing), Microsoft became the second company in the world to hit a market valuation of $3 trillion, following in Apple’s footsteps.

Nvidia’s shares have also gone up a staggering amount since artificial intelligence hit the ground running, and its powerful position saw it reach an all-time high position as the third-most valuable company in the US.

Though Microsoft’s developments do not look imminent, such a drastic move could severely impact Nvidia’s profits and share prices.

More from TechRadar Pro

Craig Hale
Craig Hale

With several years’ experience freelancing in tech and automotive circles, Craig’s specific interests lie in technology that is designed to better our lives, including AI and ML, productivity aids, and smart fitness. He is also passionate about cars and the decarbonisation of personal transportation. As an avid bargain-hunter, you can be sure that any deal Craig finds is top value!