Musk confirms that xAI will build its own supercomputer to train Grok's large language model

Musk confirmed that his artificial intelligence start-up xAI had concluded talks with Oracle to expand an existing agreement to lease Nvidia chips. He said xAI was building a supercomputer with 100,000 Nvidia H100 GPUs and expected to deliver and start training later this month.
"This is going to be the most powerful training cluster in the world, with a huge lead," he said. "Our core competency is to be faster than any other artificial intelligence company, and that's the only way to close the gap."