Elon Musk's xAI plans to build a supercomputer by Fall 2025 for its next-gen AI chatbot, Grok.
Elon Musk's AI startup, xAI, plans to build a supercomputer by Fall 2025 to power its next-gen AI chatbot, Grok. The supercomputer will be at least four times the size of the largest GPU clusters currently in existence and may partner with Oracle for development. Training the Grok 2 model required approximately 20,000 Nvidia H100 GPUs, while future versions will require 100,000 such chips.
May 25, 2024
7 Articles