In December 2024, xAI doubled the capacity of Colossus to 200,000 Nvidia H100 GPUs, which consumes 250 MW of power–enough to energize 250,000 homes. In March 2025, the AI company bought a 1-million-square-foot site in Whitehaven, Memphis, for $80 million. xAI’s Whitehaven site could host up to 350,000 GPUs with the potential to deploy the largest number of Tesla Megapacks for backup power.
xAI plans to scale Colossus up to 1 million GPUs to create the world’s largest AI supercomputer. A 1-million-GPU setup would require over 1 gigawatt, about one-third of Memphis’s peak summer demand.