Cloud providers sometimes inform customers that some GPUs will be moved into maintenance mode and become unavailable within minutes. Baseten helps its clients handle those instances without interruptions, Srivastava said.
After the January breakthrough of Chinese AI lab DeepSeek, which claimed its models were trained for a fraction of the costs as its U.S. counterparts, efficiency in AI has become more important than ever.
Baseten was quick to add support for DeepSeek's R1 reasoning model that compares to OpenAI's o1. Baseten's website promises top-tier performance at a fraction of OpenAI's cost. There has been a lot of inbound from organizations looking at switching to DeepSeek, and Baseten has been busy trying to keep up, Srivastava said.