Elon Musk’s new Memphis data center hits an AI milestone with Nvidia chips

Elon Musk’s new xAI knowledge middle in Memphis reached a significant milestone this week, bringing on-line all 100,000 superior Nvidia chips on the identical time, in accordance with individuals who have information of the matter.

The feat makes the info middle, nicknamed “Colossus,” probably the most highly effective recognized laptop ever constructed and represents a major technical achievement for xAI, a comparatively younger firm that made the large facility operational in lower than six months.

Whereas Musk has tweeted in regards to the facility, calling it the most important on the planet, trade consultants have questioned whether or not xAI has the required power or the technical means to run so many GPUs — on this case, Nvidia’s H100 chips — all of sudden.

“Musk could also be overstating how lots of the GPUs are literally working in a single cluster,” The Info reported earlier this month. “No different firm has been capable of efficiently string collectively 100,000 GPUs, because of the limitations of networking know-how that connects chips to one another to allow them to act like a single laptop.”

The achievement got here earlier this week, permitting the corporate to coach an AI mannequin with extra compute energy than every other recognized one in historical past. xAI is utilizing the info middle to coach the AI mannequin behind Grok, the corporate’s chatbot that payments itself as an uncensored model of ChatGPT.

Musk didn’t instantly reply to a request for remark.